Wednesday, September 26, 2018

Dangers of DNA Testing: Outstanding New York Times 'opinion' piece by Dr. Greg Hampikian. (If I used 'must reads' on this Blog this would certainly be one of them! Kudos to the New York Times for publishing it. (HL)..."In a new study, 74 out of 108 crime laboratories implicated an innocent person in a hypothetical bank robbery."..."The good news is that there are methods to reanalyze old DNA mixture data using computer programs that can help analysts correct errors, without any new lab testing. In fact, one lesson from the study is that while only seven of the 108 labs in the study properly excluded the innocent profile, one of them used such a program (TrueAllele by Cybergenetics). Many crime labs now have access to these programs and use them on current cases. But they could and should easily go back and re-examine old DNA mixtures to correct tragic mistakes. In fact, we have shown that this is possible."


PASSAGE OF THE DAY: "The test results are troubling, especially since errors also occur in actual casework. Just ask Dwayne Jackson of Las Vegas. When he was 18, he was told that his DNA matched DNA from a home invasion and kidnapping of a woman and her two daughters. He was advised that a jury would most likely believe the DNA, not him. Facing a life sentence at trial, he pleaded guilty to reduced charges in 2003. Mr. Jackson spent nearly four years in a Nevada prison, until the crime lab realized it had accidentally switched his sample with another suspect’s tube. The lab apologized, and he was released from prison.  Tube swaps are easy to understand. But some laboratory errors are far more difficult to detect. For example, it’s hard to interpret DNA mixtures from three or more people. As DNA testing has become more sensitive, most laboratories are now able to produce profiles from anyone who may have lightly touched an object. The result is that DNA mixtures have become more common, making up about 15 percent of all evidence samples. To assess how labs are doing with these mixtures, the institute’s researchers have conducted several national studies over the past two decades. Basically, they gave crime labs DNA from several people, as well as DNA from fake crime scenes. They asked the labs if any suspects matched the evidence. If the labs found a match, they were required to report a match statistic. This statistic indicates the odds that the match is a coincidental or innocent match. One shocking result from the new N.I.S.T. study is that labs analyzing the same evidence calculated vastly different statistics."

------------------------------------------------------------

COMMENTARY: "The Dangers of DNA Testing," by Dr. Greg Hampikian, published by The New York Times on September 21, 2018. (Dr. Hampikian is a professor of biology at Boise State University.)

SUB-HEADING: "In a new study, 74 out of 108 crime laboratories implicated an innocent person in a hypothetical bank robbery."

PHOTO CAPTION: "Linda Krueger, executive director of the Las Vegas Metropolitan Police Criminalistics Bureau, at a news conference in 2011 where police officials apologized for a DNA error that wrongly sent Dwayne Jackson to prison for four years."

GIST: Before you give the police a DNA sample, read an alarming new study of crime laboratories published this summer, the largest study of its kind. Researchers from the National Institute of Standards and Technology gave the same DNA mixture to about 105 American crime laboratories and three Canadian labs and asked them to compare it with DNA from three suspects from a mock bank robbery. The first two suspects’ DNA was part of the mixture, and most labs correctly matched their DNA to the evidence. However, 74 labs wrongly said the sample included DNA evidence from the third suspect, an “innocent person” who should have been cleared of the hypothetical felony. The test results are troubling, especially since errors also occur in actual casework. Just ask Dwayne Jackson of Las Vegas. When he was 18, he was told that his DNA matched DNA from a home invasion and kidnapping of a woman and her two daughters. He was advised that a jury would most likely believe the DNA, not him. Facing a life sentence at trial, he pleaded guilty to reduced charges in 2003. Mr. Jackson spent nearly four years in a Nevada prison, until the crime lab realized it had accidentally switched his sample with another suspect’s tube. The lab apologized, and he was released from prison.  Tube swaps are easy to understand. But some laboratory errors are far more difficult to detect. For example, it’s hard to interpret DNA mixtures from three or more people. As DNA testing has become more sensitive, most laboratories are now able to produce profiles from anyone who may have lightly touched an object. The result is that DNA mixtures have become more common, making up about 15 percent of all evidence samples. To assess how labs are doing with these mixtures, the institute’s researchers have conducted several national studies over the past two decades. Basically, they gave crime labs DNA from several people, as well as DNA from fake crime scenes. They asked the labs if any suspects matched the evidence. If the labs found a match, they were required to report a match statistic. This statistic indicates the odds that the match is a coincidental or innocent match. One shocking result from the new N.I.S.T. study is that labs analyzing the same evidence calculated vastly different statistics. Among the 108 crime labs in the study, the match statistics varied over 100 trillion-fold. That’s like the difference between soda change and the United States’ gross domestic product. These statistics are important because they are used by juries to consider whether a DNA match is just coincidence. I first learned about the results of this study in 2014, at a talk by one of its authors. It was clear that crime labs were making mistakes, and I expected the results to be published quickly. Peer-reviewed publication is important, because most judges won’t let you cite someone’s PowerPoint slide in your testimony. But years went by before the study was published, preventing lawyers from using the findings in court, and academics from citing the results in journal articles. If some of us had not complained publicly, it may not ever have been published. While this lapse in publication is troubling, more disturbing is that the authors try to mute the impact of their own excellent work. Neither the paper’s title nor the abstract mention the shocking findings. And the paper contains an amazing number of disclaimers. In fact, the conclusion begins with a stark disclaimer apparently intended to block courtroom use:
The results described in this article provide only a brief snapshot of DNA mixture interpretation as practiced by participating laboratories in 2005 and 2013. Any overall performance assessment is limited to participating laboratories addressing specific questions with provided data based on their knowledge at the time. Given the adversarial nature of the legal system, and the possibility that some might attempt to misuse this article in legal arguments, we wish to emphasize that variation observed in DNA mixture interpretation cannot support any broad claims about “poor performance” across all laboratories involving all DNA mixtures examined in the past.
People serving time behind bars based on shoddy DNA methods may disagree. It is uncomfortable to read the study’s authors praising labs for their careful work when they get things right, but offering sophomoric excuses for them when they get things wrong. Scientists in crime labs need clear feedback to change entrenched, error-prone methods, and they should be strongly encouraged to re-examine old cases where such methods were used. The good news is that there are methods to reanalyze old DNA mixture data using computer programs that can help analysts correct errors, without any new lab testing. In fact, one lesson from the study is that while only seven of the 108 labs in the study properly excluded the innocent profile, one of them used such a program (TrueAllele by Cybergenetics). Many crime labs now have access to these programs and use them on current cases. But they could and should easily go back and re-examine old DNA mixtures to correct tragic mistakes. In fact, we have shown that this is possible. Working with Cybergenetics analysts and Innocence Network organizations in four states, our Boise State University laboratory has re-examined a few select cases and already persuaded courts to overturn a conviction in New Mexico, two in Indiana and two in Montana. We have also helped identify a new suspect in a 23-year-old murder. While we have to go to court to get access to case data (a very time-consuming process), the crime labs don’t. They could easily review their own cases. With tens of thousands of DNA mixtures analyzed each year, there are many innocent people who hope the crime labs and courts take the national institute’s study seriously, and act quickly."

The entire commentary can be read at:
https://www.nytimes.com/2018/09/21/opinion/the-dangers-of-dna-testing.html

PUBLISHER'S NOTE: I am monitoring this case/issue. Keep your eye on the Charles Smith Blog for reports on developments. The Toronto Star, my previous employer for more than twenty incredible years, has put considerable effort into exposing the harm caused by Dr. Charles Smith and his protectors - and into pushing for reform of Ontario's forensic pediatric pathology system. The Star has a "topic" section which focuses on recent stories related to Dr. Charles Smith. It can be found at: http://www.thestar.com/topic/charlessmith. Information on "The Charles Smith Blog Award"- and its nomination process - can be found at: http://smithforensic.blogspot.com/2011/05/charles-smith-blog-award-nominations.html Please send any comments or information on other cases and issues of interest to the readers of this blog to: hlevy15@gmail.com.  Harold Levy: Publisher; The Charles Smith Blog;
---------------------------------------------------------------------