Unscientific words in scientific papers

It’s common for researchers to compare an “autism group” with a “control group,” on some dimension. Perhaps some part of the brain differs in size or in activation, or the neural network graph has a different shape, or kids with autism have more allergies, or they are less prone to certain cognitive biases, or whatever, the list is a mile long. Then we get a “such-and-such correlates with autism” discovery.

In writing up their research, scientists get out their mental thesaurus and try to avoid saying “more-connected neural network” and “less-connected neural network” over and over. They might start to say things like “connectivity deficit” or “excess connectivity” or “abnormal neural network” or “pathological neural network” or “defective gene.” If the autism group has more then it’s “excess” and if it has less it’s “deficit.”

This is bad science.

Think about what you’d have to prove to justify the words “excess” and “deficiency.” You would need to determine the “best” genotype or phenotype. Then you would need to know thresholds (how far someone can be from “best” before it’s a practical problem). When was the last time an autism study showed either of these?

Just because we demonstrate that something is correlated with autism, we haven’t demonstrated that it is “bad.” We haven’t shown that it results in the negative aspects of autism. We haven’t demonstrated that it’s unequivocally bad; perhaps it’s a mixed blessing. Or perhaps it’s something innocuous and irrelevant (it could share a cause with some forms of autism, but have no functional effect). Or perhaps it’s an effect of autism, rather than a cause.

In most correlation studies, there’s no evidence whatsoever about how or why the thing in question relates to autism, there’s just an unexplained correlation.

Many biology textbooks discuss sickle-cell disease, a genetic trait which can be an advantage: in heterozygous form, it confers resistance to malaria. In tropical regions, evolution tends to select for this gene, even though it has major downsides.

The various conditions which involve autistic traits are undoubtedly more genetically complex. If we are humble and scientific, we might assume that many traits which correlate with autism exist in our genetic heritage for a reason. Since we don’t know what the conditions are, what the endophenotypes are, or how it all relates to observed autistic traits, we need to reserve judgment on whether anything we observe constitutes a “deficit” or “excess.” Stick to saying it’s a difference.

Even when a trait is plainly a deficit in one context, it may be a strength in another. Is sickle-cell disease a net negative? β€” well, do you live in a malaria-infested region or not?

In my speculative theory about how autism works in our family, it’s easy to see how causes which contribute to “intellect” and causes which contribute to “instinct” would need to be in balance. A person too lopsided in either direction will have trouble. None of the genes or other causes which push the balance one way or the other would be “abnormal” or “deficits” in themselves; only an imbalance or preponderance β€” potentially in either direction β€” would cause a problem.

I’m not saying this is how our particular autism condition works, or how any condition works. It’s pure speculation. But the point isn’t that I’m right about this, it’s simply that in many possible scenarios, we don’t know whether the phenomena we’re observing are net positive, net negative, context-dependent, irrelevant, or what.

Outside of autism, think about intelligence. Why are human IQs distributed as they are? Well, some people say that IQ at the very upper limits of the distribution can be a liability. Anecdotally, people with IQs of 150 or 160 may be barely functional. So perhaps intelligence, also, requires a balance. Perhaps we need some genes to make us smart enough, and some other genes that keep us from being too smart. In this balance, there may be many genes which are neither categorically “good” nor categorically “bad.”

Scientific papers should strive to use neutral language, reserving judgment on the merits of the observed phenomena, unless there’s actual evidence about those merits. This goes double for poorly-understood genetic and neurological features.

No “deficits” and “abnormalities” and “dysfunctions,” just the facts.

This should be done to promote sharper, clearer, more precise, more accurate research.

There are ethical implications as well (we should be concerned about stigma and eugenics). But even if one doesn’t care about ethical considerations, factual considerations ought to rule out language based on unproven assumptions about the “best” genotype or phenotype.

(To be clear, I’m not talking about an observable problem described as such; “difficulty conducting a conversation” can be described as a “pragmatic deficit” and that’s fine. The problem comes when we have some proposed underlying genetic or neurological feature, but no proof of that feature’s specific effect on observable behaviors or quality of life.)

11 thoughts on “Unscientific words in scientific papers

  1. Sanjiv Bhamre

    Excellent comment and suggestion. In any research, we see a correlation ( not a causation) that is true in a specific situation. But, unknowingly, we forget the condition, and then generalise it. In other areas, this may be acceptable. But in research on intelligence, autism and other scenarios, this can be very misleading.

    Reply
  2. mosaicofminds

    Yes! What a great explanation of why every brain difference in autism isn’t necessarily bad, or a cause of disability.

    I think you would like Morton Ann Gernsbacher’s APS columns that talk about this problem (this one on seeing every difference as bad http://www.psychologicalscience.org/index.php/publications/observer/2007/january-07/presidential-column-the-eye-of-the-beholder.html and this one on bias in research http://www.psychologicalscience.org/index.php/publications/observer/2006/november-06/presidential-column-how-to-spot-bias-in-research.html).

    There are better synonyms out there; we need to use them!

    I love your blog. You ask good questions!

    Reply
    1. intellectualizing Post author

      Those links are the best – what an excellent evidence-rich argument from Dr. Gernsbacher!

      Thanks for sharing these.

      Reply
  3. Alexander Cheezem

    There’s also the second-to-last chapter of a 2008 book called “Memory in Autism” ( http://www.amazon.com/Memory-In-Autism-Theory-Evidence/dp/0521184010/ref=sr_1_4?ie=UTF8&qid=1385273369&sr=8-4&keywords=memory+in+autism )… which, frankly, is the best discussion of this issue (which it terms “normocentric bias”) I’ve seen.

    Personally, my own favorite example of this is a paper by Hudenko et al., 2009: http://www.ncbi.nlm.nih.gov/pubmed/19449097 . While the abstract is perfectly fine, the paper… well, isn’t. See http://autismcrisis.blogspot.com/2009/05/autistic-way-of-laughing.html for a nice discussion.

    (It is not a coincidence that Michelle, the author of that blog entry, is also an author of that book chapter. She’s written a lot about this matter.)

    Reply
    1. intellectualizing Post author

      Thanks for this pointer, Memory in Autism looks like an interesting book in general (in addition to the normocentric bias essay). I don’t know why researchers persist in making this “differences are automatically deficits” error, when it’s so easy to avoid and so clearly an error.

      Reply
      1. Alexander Cheezem

        It is in some ways, but I give that particular chapter in it the distinct honor of being the single most spectacular academic “well, screw you” that I have ever seen. It manages this, mind, while maintaining perfectly polite and respectful academic language.

        As for the error… gyah. This is a field where _Simon Baron-Cohen_ is taken seriously as a scientist.

        Reply
  4. Pingback: Book: “Rethinking Autism: Variation and Complexity” | Intellectualizing

  5. Pingback: On normalization and social skills: my reaction to “The Kids Who Beat Autism” | Intellectualizing

  6. Pingback: The Parents Who Beat Up “The Kids Who Beat Autism”

  7. Pingback: Autism and prediction | Intellectualizing

  8. Pingback: Not explaining autism | Intellectualizing

Leave a comment