Questions to Consider
When you hear about a new medical development, the first question to ask yourself is whether the news is based on a scientific study. Knowing there's a study behind the news is only the first step, though. How the study was done (and who did it) matters too.
For example:
Was the Study Done in People?
A lot of medical research is done in the laboratory or in lab animals, not in people — at least, not at first. Lab studies help scientists figure out whether a drug looks promising, how it works, and whether there might be side effects. But what happens in a laboratory does not necessarily work the same in people. These studies are often a beginning — but they're usually not the end of the story.
When watching or reading a news report about a new drug or treatment, see if it tells you whether the findings involved animals or people. It might not — so you'll have to do some sleuthing on your own to get the information.
Who Was in the Study?
Even if a study was done in people, it may not apply to you. For instance, findings from studies involving only adults may not be true for teens. Results of all-male studies may not apply to women. Research studies usually list who took part — their sex, age, and other characteristics. Are these people like you?
In addition to who is in a study, you'll also need to keep in mind how many people took part in it. The more people in the study, the more likely it is that the study's findings will hold true for the whole population. Sometimes a study's results are announced with a big splash and then it turns out that the study only involved a few people. When researchers do the same study using the hundreds or thousands of people necessary to get really accurate (or "significant") results, those results might be different.
It's also important for the study to follow patients long enough to be sure that a treatment really works, and that additional or more serious side effects don't develop over time.
How Was the Study Designed?
There are lots of ways researchers look into new treatments and information that can help people stay healthier. Sometimes they look back at people's medical records or ask them questions to find out what might have put them at more (or less) risk for a health condition. Those studies, called retrospective studies, can provide useful clues, but they're only as reliable as a person's memory or the accuracy of medical records.
Prospective studies are usually better. They look forward, not backward. The best of these studies follow thousands of people long enough to see whether the things they do — like diet and exercise — have a good or bad effect on their health.
For new drugs or treatments, randomized, controlled clinical trials are the best way for deciding whether a treatment works. In this kind of research, some of the participants get the drug, vitamin, or other therapy being tested. Others get what is called a placebo (a fake treatment or sugar pill that contains no medicine at all). In this type of study, the patients are "blinded" — they don't know who is getting the treatment and who is getting the placebo until the trial is over. That way, their response to the drug or placebo can't be influenced by whether they think they have been taking the real drug or not. In a double-blind study, neither the patients nor the researchers know which patients have taken the drug or the placebo until the study is over.
It's rare for one study to be the final word. Medical knowledge comes from many studies done over time — and frequently there are contradictions along the way. Often, different studies of a particular treatment or condition, all done properly, can still have different (or even completely opposite) results.
Also, the news media (and even researchers themselves!) are more likely to report the findings of a study if that study shows results that are different from what is thought to be true. For example, the media are much more likely to do a story about a study that shows that eating a particular type of food may help prevent cancer. But other studies may show that eating that food doesn't really make much difference.
The scientific community can take into account all the different studies and decide that eating the food might not really help a person avoid cancer. But to the regular person who just hears about one study through the news, that food suddenly becomes a cancer-fighting miracle.