One true and horrifying story about bad science.
In investigating treatments for ME/CFS a trial (the 'PACE trial') reported that two particular treatments, known as cognitive behavioral therapy (CBT) and graded exercise therapy (GET), were effective. They cited 641 test subjects and claimed that 60 (yes sixty) percent showed improvement, if not cure. The result was that these approaches formed the basis of medical treatment and insurance companies response to ME/CFS.
However, their findings did not ring true to sufferers of the condition nor experts in the field.
After a very lengthy and combative process the underlying data was finally released for review, and "...analysis showed that... only 4.4 percent of the exercise patients and 6.8 percent of the cognitive behavior therapy patients would have qualified as having recovered, along with 3.1 percent of patients in a trial arm that received neither therapy." So not quite 60%.
It was also found that the definition of “recovery” used was so loose that patients could get worse over the course of the trial on both fatigue and physical function and still be considered “recovered.” and that the threshold for physical function was so low that an average 80-year-old would exceed it. Additionally "The study used such a broad definition of the disease that it likely included many patients who didn’t truly have ME/CFS at all."
In my conversation with a very senior ME/CFS specialist, he was blunter, saying that of the 641 test subjects, 0 showed any significant improvement.
But along the way, how many people had been harmed and made to feel that they were wrong about their own bodies? I find it obscene that this now thoroughly discredited study has never been retracted.
Sorry to vary the tone. Cat meme coming shortly.