skip to main | skip to sidebar

the charles smith blog

Saturday, December 9, 2017

'Likelihood Ratio'. Ten points if you know about this statistical tool: If you don't know what it is, read this post and beware...Publisher's note: "This release was an eye-opener to me. I had no idea, until reading it, that there was a method of presenting evidence in courtrooms - a statistical tool called the 'Likelihood Ratio' - LR - which gives experts a shorthand way to communicate their assessment of how strongly forensic evidence, such as a fingerprint or DNA sample, can be tied to a suspect. "In essence, LR allows a forensics expert to boil down a potentially complicated set of circumstances into a number—providing a pathway for experts to concisely express their conclusions based on a logical and coherent framework." The NIST does an important public service by drawing attention to an academic paper which urges caution because of dangers inherent in its use. HL."


PUBLISHER'S NOTE: This release was an eye-opener to me. I had no idea, until reading it, that there  was a method of presenting evidence in courtrooms -  a statistical tool called the 'Likelihood Ratio - LR -  which  gives experts a shorthand way to communicate their assessment of how strongly forensic evidence, such as a fingerprint or DNA sample, can be tied to a suspect.  "In essence, LR allows a forensics expert to boil down a potentially complicated set of circumstances into a number—providing a pathway for experts to concisely express their conclusions based on a logical and coherent framework."  The NIST  does an important public service by drawing  attention to an academic paper which  urges caution because of dangers inherent in its use.

Harold Levy: Publisher: The Charles Smith Blog;

-----------------------------------------------------------

RELEASE: National Institute of Standards and Technology (NIST): Experts Urge Caution in Use of Courtroom Evidence Presentation Method," published by NIST on October 12,  2017.

SUB-HEADING:  "Use of 'Likelihood Ratio' not consistently supported by scientific reasoning approach, authors state."


GIST: "Two experts at the National Institute of Standards and Technology (NIST) are calling into question a method of presenting evidence in courtrooms, arguing that it risks allowing personal preference to creep into expert testimony and potentially distorts evidence for a jury. The method involves the use of Likelihood Ratio (LR), a statistical tool that gives experts a shorthand way to communicate their assessment of how strongly forensic evidence, such as a fingerprint or DNA sample, can be tied to a suspect. In essence, LR allows a forensics expert to boil down a potentially complicated set of circumstances into a number—providing a pathway for experts to concisely express their conclusions based on a logical and coherent framework. LR’s proponents say it is appropriate for courtroom use; some even argue that it is the only appropriate method by which an expert should explain evidence to jurors or attorneys. However, in a new paper published in the Journal of Research of the National Institute of Standards and Technology (link is external), statisticians Steve Lund and Hari Iyer caution that the justification for using LR in courtrooms is flawed. The justification is founded on a reasoning approach called Bayesian decision theory (link is external), which has long been used by the scientific community to create logic-based statements of probability. But Lund and Iyer argue that while Bayesian reasoning works well in personal decision making, it breaks down in situations where information must be conveyed from one person to another such as in courtroom testimony. These findings could contribute to the discussion among forensic scientists regarding LR, which is increasingly used in criminal courts in the U.S. and Europe. While the NIST authors stop short of stating that LR ought not to be employed whatsoever, they caution that using it as a one-size-fits-all method for describing the weight of evidence risks conclusions being driven more by unsubstantiated assumptions than by actual data. They recommend using LR only in cases where a probability-based model is warranted. Last year’s report (link is external) from the President’s Council of Advisors on Science and Technology (PCAST) mentions some of these situations, such as the evaluation of high-quality samples of DNA from a single source. “We are not suggesting that LR should never be used in court, but its envisioned role as the default or exclusive way to transfer information is unjustified,” Lund said. “Bayesian theory does not support using an expert’s opinion, even when expressed numerically, as a universal weight of evidence. Among different ways of presenting information, it has not been shown that LR is most appropriate.” Bayesian reasoning is a structured way of evaluating and re-evaluating a situation as new evidence comes up. If a child who rarely eats sweets says he did not eat the last piece of blueberry pie, his older sister might initially think it unlikely that he did, but if she spies a bit of blue stain on his shirt, she might adjust that likelihood upward. Applying a rigorous version of this approach to complex forensic evidence allows an expert to come up with a logic-based numerical LR that makes sense to the expert as an individual. The trouble arises when other people—such as jurors—are instructed to incorporate the expert’s LR into their own decision-making. An expert’s judgment often involves complicated statistical techniques that can give different LRs depending on which expert is making the judgment. As a result, one expert’s specific LR number can differ substantially from another’s.
“Two people can employ Bayesian reasoning correctly and come up with two substantially different answers,” Lund said. “Which answer should you believe, if you’re a juror?” In the blueberry pie example, imagine a jury had to rely on expert testimony to determine the probability that the stain came from a specific pie. Two different experts could be completely consistent with Bayesian theory, but one could testify to, say, an LR of 50 and another to an LR of 500—the difference stemming from their own statistical approaches and knowledge bases. But if jurors were to hear 50 rather than 500, it could lead them to make a different ultimate decision. Viewpoints differ on the appropriateness of using LR in court. Some of these differences stem from the view that jurors primarily need a tool to help them to determine reasonable doubt, not particular degrees of certainty. To Christophe Champod, a professor of forensic science at the University of Lausanne, Switzerland, an argument over LR’s statistical purity overlooks what is most important to a jury. “We’re a bit presumptuous as expert witnesses that our testimony matters that much,” Champod said. “LR could perhaps be more statistically pure in the grand scheme, but it’s not the most significant factor. Transparency is. What matters is telling the jury what the basis of our testimony is, where our data comes from, and why we judge it the way we do.” The NIST authors, however, maintain that for a technique to be broadly applicable, it needs to be based on measurements that can be replicated. In this regard, LR often falls short, according to the authors. “Our success in forensic science depends on our ability to measure well. The anticipated use of LR in the courtroom treats it like it’s a universally observable quantity, no matter who measures it,” Lund said. “But it’s not a standardized measurement. By its own definition, there is no true LR that can be shared, and the differences between any two individual LRs may be substantial.” The NIST authors do not state that LR is always problematic; it may be suitable in situations where LR assessments from any two people would differ inconsequentially. Their paper offers a framework for making such assessments, including examples for applying them. Ultimately, the authors contend it is important for experts to be open to other, more suitable science-based approaches rather than using LR indiscriminately. Because these other methods are still under development, the danger is that the criminal justice system could treat the matter as settled. “Just because we have a tool, we should not assume it’s good enough,” Lund said. “We should continue looking for the most effective way to communicate the weight of evidence to a nonexpert audience.”"

The entire release can be found at:



https://www.nist.gov/news-events/news/2017/10/nist-experts-urge-caution-use-courtroom-evidence-presentation-method

PUBLISHER'S NOTE: I am monitoring this case/issue. Keep your eye on the Charles Smith Blog for reports on developments. The Toronto Star, my previous employer for more than twenty incredible years, has put considerable effort into exposing the harm caused by Dr. Charles Smith and his protectors - and into pushing for reform of Ontario's forensic pediatric pathology system. The Star has a "topic" section which focuses on recent stories related to Dr. Charles Smith. It can be found at: http://www.thestar.com/topic/charlessmith. Information on "The Charles Smith Blog Award"- and its nomination process - can be found at: http://smithforensic.blogspot.com/2011/05/charles-smith-blog-award-nominations.html Please send any comments or information on other cases and issues of interest to the readers of this blog to: hlevy15@gmail.com. Harold Levy; Publisher; The Charles Smith Blog.


Posted by Harold Levy at Saturday, December 09, 2017
Email ThisBlogThis!Share to XShare to FacebookShare to Pinterest
Newer Post Older Post Home

Blog Nation Badge

Crime Blogs

Followers

The Charles smith blog

Blog Directory - Blogged

Blog Archive

  • ►  2025 (385)
    • ►  June (44)
    • ►  May (89)
    • ►  April (59)
    • ►  March (64)
    • ►  February (64)
    • ►  January (65)
  • ►  2024 (743)
    • ►  December (60)
    • ►  November (61)
    • ►  October (73)
    • ►  September (63)
    • ►  August (55)
    • ►  July (62)
    • ►  June (78)
    • ►  May (57)
    • ►  April (62)
    • ►  March (66)
    • ►  February (46)
    • ►  January (60)
  • ►  2023 (732)
    • ►  December (68)
    • ►  November (59)
    • ►  October (58)
    • ►  September (67)
    • ►  August (72)
    • ►  July (62)
    • ►  June (70)
    • ►  May (66)
    • ►  April (54)
    • ►  March (58)
    • ►  February (52)
    • ►  January (46)
  • ►  2022 (679)
    • ►  December (73)
    • ►  November (44)
    • ►  October (33)
    • ►  September (38)
    • ►  August (53)
    • ►  July (70)
    • ►  June (51)
    • ►  May (66)
    • ►  April (83)
    • ►  March (60)
    • ►  February (47)
    • ►  January (61)
  • ►  2021 (825)
    • ►  December (77)
    • ►  November (83)
    • ►  October (81)
    • ►  September (77)
    • ►  August (70)
    • ►  July (84)
    • ►  June (69)
    • ►  May (71)
    • ►  April (61)
    • ►  March (63)
    • ►  February (43)
    • ►  January (46)
  • ►  2020 (612)
    • ►  December (31)
    • ►  November (32)
    • ►  October (36)
    • ►  September (34)
    • ►  August (41)
    • ►  July (52)
    • ►  June (55)
    • ►  May (50)
    • ►  April (59)
    • ►  March (69)
    • ►  February (83)
    • ►  January (70)
  • ►  2019 (520)
    • ►  December (53)
    • ►  November (56)
    • ►  October (43)
    • ►  September (47)
    • ►  August (39)
    • ►  July (25)
    • ►  June (46)
    • ►  May (49)
    • ►  April (40)
    • ►  March (45)
    • ►  February (37)
    • ►  January (40)
  • ►  2018 (561)
    • ►  December (39)
    • ►  November (44)
    • ►  October (7)
    • ►  September (32)
    • ►  August (55)
    • ►  July (53)
    • ►  June (69)
    • ►  May (60)
    • ►  April (42)
    • ►  March (44)
    • ►  February (54)
    • ►  January (62)
  • ▼  2017 (621)
    • ▼  December (42)
      • (Year end Part Four): Kevin Cooper; Death Row. Cal...
      • Bulletin: Momentous Development; Kirstin Lobato: ...
      • Derrie Nelson: D.C. Flawed FBI hair matching analy...
      • (Year end Part Three): 'Mother Jones' has certainl...
      • (Year end Part Two); False confessions: Professor...
      • (Year end Part One): Radley Balko: (Washington Pos...
      • Daniel Holtzclaw: 'Pyongyang on the Prairie. Part ...
      • Angela Garcia: Ohio: An extraordinary account of ...
      • Mark Denny: Brooklyn, New York: Exonerated after s...
      • Isaac Itiary: UK: 'Times' story shows that th...
      • Forensic Experiential Trauma Interview: (FETI): T...
      • John Huffington; Maryland. (Flawed FBI hair testi...
      • Alan Beaman: Illinois; Bulletin; In reversal, sta...
      • Clyde Ray Spencer: Vancouver, Washington: Bullet...
      • Kirstin Lobato: Nevada: Failure of defence counsel...
      • Bulletin: Kirstin Lobato; Nevada; Major Developme...
      • Liam Allan. UK: Sexual assault investigations: 'Th...
      • Greg Kelley: Texas: Bulletin: Judge recommends his...
      • Death Investigations series. (Part three); New Jer...
      • Death investigations series : (Part two): Radley B...
      • Death investigations series (Part One): Radley Bal...
      • Crime lab corruption UK, USA and Australia; (Start...
      • U.S. Coast Guardsman Jimmy Barlow Found Not Guilty...
      • False confessions: (Part three): Brendan Dassey.Wi...
      • Jimmy Barlow: California: On-going trial; Coast g...
      • False confessions (Part 2): Reid technique: Hamilt...
      • False confessions: (Part 1): The Englewood Four; ...
      • Shaken baby syndrome: Part 2: Zavion Johnson: Cal...
      • Shaken Baby Syndrome: (Part 1): An in-depth analy...
      • Forensic Experiential Trauma Interview: (FETI): (P...
      • Forensic Experiential Trauma Interview: (FETI); P...
      • Forensic Experiential Trauma Interview: (FETI): (...
      • 'Likelihood Ratio'. Ten points if you know about t...
      • Daniel Holtzclaw: Oklahoma; Flawed forensic scienc...
      • Julie Baumer: Michigan; Shaken baby syndrome: 'A...
      • Disgraced Hospital for Sick Children now-defunct M...
      • Rodricus Crawford: Louisiana; Civil lawsuit launch...
      • Question of the day: Journalist Ted Gest asks: "Do...
      • False Confessions: Illinois: The Crime report pre...
      • Shawn Henning; Ralph "Rocky" Birch: Connecticut: ...
      • Annie Dookhan: Sonja Farak: Massachusetts lab sc...
      • Chanel Lewis: Queens; New York: Daily Beast's mast...
    • ►  November (39)
    • ►  October (79)
    • ►  September (48)
    • ►  August (56)
    • ►  July (39)
    • ►  June (63)
    • ►  May (47)
    • ►  April (76)
    • ►  March (65)
    • ►  February (5)
    • ►  January (62)
  • ►  2016 (1013)
    • ►  December (82)
    • ►  November (106)
    • ►  October (105)
    • ►  September (99)
    • ►  August (90)
    • ►  July (83)
    • ►  June (42)
    • ►  May (93)
    • ►  April (91)
    • ►  March (80)
    • ►  February (72)
    • ►  January (70)
  • ►  2015 (939)
    • ►  December (70)
    • ►  November (76)
    • ►  October (92)
    • ►  September (92)
    • ►  August (57)
    • ►  July (90)
    • ►  June (87)
    • ►  May (76)
    • ►  April (114)
    • ►  March (54)
    • ►  February (84)
    • ►  January (47)
  • ►  2014 (597)
    • ►  December (40)
    • ►  October (49)
    • ►  September (47)
    • ►  August (50)
    • ►  July (3)
    • ►  June (61)
    • ►  May (70)
    • ►  April (64)
    • ►  March (76)
    • ►  February (73)
    • ►  January (64)
  • ►  2013 (661)
    • ►  December (42)
    • ►  November (61)
    • ►  October (99)
    • ►  September (83)
    • ►  August (15)
    • ►  July (33)
    • ►  June (43)
    • ►  May (61)
    • ►  April (52)
    • ►  March (46)
    • ►  February (56)
    • ►  January (70)
  • ►  2012 (619)
    • ►  December (55)
    • ►  November (23)
    • ►  October (19)
    • ►  September (58)
    • ►  August (71)
    • ►  July (73)
    • ►  June (69)
    • ►  May (34)
    • ►  April (68)
    • ►  March (51)
    • ►  February (48)
    • ►  January (50)
  • ►  2011 (830)
    • ►  December (59)
    • ►  November (58)
    • ►  October (65)
    • ►  September (86)
    • ►  August (54)
    • ►  July (78)
    • ►  June (79)
    • ►  May (68)
    • ►  April (84)
    • ►  March (86)
    • ►  February (47)
    • ►  January (66)
  • ►  2010 (764)
    • ►  December (62)
    • ►  November (8)
    • ►  October (105)
    • ►  September (63)
    • ►  August (83)
    • ►  July (83)
    • ►  June (71)
    • ►  May (65)
    • ►  April (57)
    • ►  March (87)
    • ►  February (49)
    • ►  January (31)
  • ►  2009 (465)
    • ►  December (55)
    • ►  November (28)
    • ►  September (53)
    • ►  August (49)
    • ►  July (32)
    • ►  June (34)
    • ►  May (56)
    • ►  April (34)
    • ►  March (42)
    • ►  February (43)
    • ►  January (39)
  • ►  2008 (370)
    • ►  December (47)
    • ►  November (21)
    • ►  October (49)
    • ►  September (36)
    • ►  August (1)
    • ►  June (15)
    • ►  May (41)
    • ►  April (54)
    • ►  March (35)
    • ►  February (33)
    • ►  January (38)
  • ►  2007 (103)
    • ►  December (20)
    • ►  November (48)
    • ►  October (31)
    • ►  September (4)

About Me

My photo
Harold Levy
Two Blogs Now: The Charles Smith Blog; The Selfless Warriors Blog: I created the Charles Smith Blog in 2007 after I retired from The Toronto Star to permit me to keep digging into the story of the flawed pathologist and the harm he had done to so many innocent parents and caregivers, and to Ontario’s criminal justice system. Since then it has taken new directions, including examinations of other flawed pathologists, flawed pathology, and flawed science and technology which has marred the quality of justice in courtrooms around the world. On International Wrongful Conviction Day in 2024, I was thrilled to have the Blog recognized by Innocence Canada, when I was presented with the, "Rubin Hurricane Carter Champion of Justice Award." The heart of the Blog is my approach to following cases which raise issues in all of these areas - especially those involving the death penalty. I have dedicated 'The Selfless Warrior Blog’ (soon to appear) to those exceptional individuals who have been ripped out of their ordinary lives by their inability to stand by in the face of a glaring miscarriage of justice. They are my ’Selfless Warriors.’ Enjoy!
View my complete profile
 

Search This Blog

https://forensicresources.org/

  • CSI DDS | Forensic Science Testimony. CSI bad science issues and their contribution to wrongful convictions.
    Forensics: appeals court finds gun forensic method is not ‘scientifically valid’
    21 hours ago
  • The Marshall Project
    He Spent Years in Federal Prisons. Now He’s Helping to Lead Them.
    1 day ago
  • Gamso - For the Defense
    Today in History
    1 day ago
  • Pursue Democracy
    Dan Andrews car & cycle crash: damning expert report
    3 days ago
  • Comments on: In a Louisiana Parish, Hundreds of Cases May Be Tainted By Sheriff’s Office Misconduct
    A 68-year-old Grandfather Died in ICE’s Custody. His Family Seeks Answers.
    1 week ago
  • Wrongful Convictions Report
    Australia’s legal system not in top10 – surveys
    1 week ago
  • Forensic Resources
    Managing Digital Discovery Webinar
    2 weeks ago
  • In the news by Karen Franklin PhD
    Adolescence, interrogated
    2 months ago
  • Crime & Justice Research Alliance
    Program That Aims to Reduce Cyclical, Retaliatory Gun Violence Saw Shootings Decline After Prevention Program in Lansing, MI
    2 months ago
  • Grits for Breakfast
    Grits publishes "Tulia" zine for 25th anniversary: Preorder now!
    8 months ago
  • Wrongful Conviction News
    Life after a wrongful conviction: Meet Charles Jackson
    2 years ago
  • MIP
    2022 Annual Report
    2 years ago
  • Stop Wrongful Convictions
    Truth About The Innoculations – Dr. Chetty
    3 years ago
  • Wrongly Convicted Group Website
    Could Conner Have Washed Ashore?
    4 years ago
  • Wrongful Convictions Blog
    Ohio Chief Justice Convenes Wrongful Conviction Task Force
    5 years ago
  • Forensic Science in North Carolina
    Forensic Toxicology Online Symposium
    6 years ago
  • Little Rascals Day Care Case
    Death noted: Former publisher of Edenton paper
    6 years ago
  • Forensic Pathology Forum
    My Father Killed Himself — Advice from a Physician and Suicide Survivor.
    6 years ago
  • Innocence Project of Florida
    Exoneration Anniversary: Wilton Dedge
    6 years ago
  • The Watch
    Afternoon links: Conservatives and criminal-justice reform
    6 years ago
  • Comments for Fault Lines
    Comment on Thank You, and Farewell by Brian Cowles
    7 years ago
  • View-from-Wilmington
    A new book on forensic science and the law
    8 years ago
  • Megrahi: You are my Jury
    Sunday Times letter highlights errors in Kenny MacAskill’s book
    8 years ago
  • Justiceforaarushitalwar.com
    CBI USES ‘TYPOGRAPHICAL ERROR’ TO SAVE FACE !!
    9 years ago
  • Innocence Matters: The Innocent should not be in prison
    John Klene's Innocence Matters
    12 years ago
  • Todd Willingham was Executed, but His Story Gets a New Life | The Arson Research Project
    March 25 2013
    12 years ago
  • On SBS
    New Research Questions Classic Model of Shaken Baby Syndrome
    13 years ago
  • Welcome to the Justice 4 Simon website
  • The Crime Report – Criminal Justice News, Statistics & Resources
  • The Wrongful Conviction of Jason Payne / Home
  • Susan Neill-Fraser is Innocent | Facebook
  • The Innocence Project - Home
  • Home
  • The Exoneration Initiative
  • Simple Justice
  • Comments on: MAIN
  • Petition | Free Pam Jacobazzi | Change.org
  • Envista Forensic Engineering Services and Forensic Consultants
  • innocent.org.uk
  • The Crime Report – Criminal Justice News, Statistics & Resources
  • The Innocence Project
  • The Marshall Project
  • Inquiry into Pediatric Forensic Pathology in Ontario - Home Page
  • Jeffrey Havard
  • Medill Innocence Project
  • Home
  • AIDWYC: The Association In Defence of the Wrongly Convicted
  • The case of Hank Skinner
  • Free Rodney Lincoln - Free an innocent man from a wrongful conviction in St. Louis, Missouri
  • McElroy Law
  • NZPIP - The Home of the New Zealand Public Interest Project. Working in the interests of justice and the public good.

http://www.personal.psu.edu/dhk3/blogs/DoubleHelixLaw/

  • The Marshall Project
    He Spent Years in Federal Prisons. Now He’s Helping to Lead Them.
    1 day ago
  • Pursue Democracy
    Dan Andrews car & cycle crash: damning expert report
    3 days ago
  • Comments on: In a Louisiana Parish, Hundreds of Cases May Be Tainted By Sheriff’s Office Misconduct
    A 68-year-old Grandfather Died in ICE’s Custody. His Family Seeks Answers.
    1 week ago
  • Forensic Resources
    Managing Digital Discovery Webinar
    2 weeks ago
  • Innocence Project
    Perry Lott is Exonerated After 35 Years of Wrongful Conviction in Ada, Oklahoma
    1 year ago
  • Wrongly Convicted Group Website
    Could Conner Have Washed Ashore?
    4 years ago
  • On SBS
    New Research Questions Classic Model of Shaken Baby Syndrome
    13 years ago
  • BEtter Consulting – Legal Services
  • Free Clayton Allison