I don't doubt it one bit
My only caveat is this, I work in a part of the hospital that deal a lot with emergencies, and I can't tell you how many times I've heard the phrase "my husband has always been healthy, nothing ever wrong with him, in fact he's never been to a doctor until now"....
And then we see the coronary arteries and he has severe triple vessel disease that has been building up most likely over decades. The reality is the guy hasn't been healthy, he just chose not to go to the doctor, which I respect. I stay away as much as I can as well. Then we send him over to surgery to have a quadruple bypass. So I don't know what the answer is, but my gut tells me stay away as much as you can, at most go see a GOOD PCP once a year just in case you're missing something.
Just last night I saw that Prince had opioids on him, as did Michael Jackson, as have so many others. With the DEA's war on prescription drugs right now, it's making it nearly impossible for normal people with severe chronic pain to obtain opioids for pain relief. I fall into this category. I told my wife just last night "it's probably time I figure out a way to get off the oxy, because eventually no Dr. is going to write me for it anymore."
So to your point, I have come to the same conclusion, albeit for a different reason, but the same conclusion nonetheless. Time to taper down