Key Takeaways
- 62% of U.S. adults have shared fake news online
- 70% of headlines on social media contain clickbait inaccuracies
- 45% of news stories have factual errors per fact-checkers
- 64% of fact-checks debunk media claims yearly
- 82% of politicians' statements fail fact-checks
- 39% of viral claims are rated false by Snopes
- 65% of LLM responses hallucinate facts
- 28% error rate in GPT-4 fact retrieval
- 92% of image generators produce artifacts
- 37% calibration error in confidence scores, category: AI Errors
- 40% of Americans believe Earth is flat per polls
- 25% think evolution is false
- 51% believe vaccines cause autism
- 71% misuse statistics in daily life
- 44% confuse correlation and causation
Most media and polls are largely inaccurate across many topics and categories.
AI Errors
- 65% of LLM responses hallucinate facts
- 28% error rate in GPT-4 fact retrieval
- 92% of image generators produce artifacts
- 44% of chatbots give wrong medical advice
- 79% hallucination in code generation AIs
- 33% bias amplification in recommendation AIs
- 87% of voice AIs mis-transcribe accents
- 56% factual inconsistency in summarization
- 71% error in multilingual translation AIs
- 25% overfitting leads to inaccurate predictions
- 94% of GANs fail stability tests
- 48% adversarial vulnerability in classifiers
- 62% data poisoning success rate
- 89% of reinforcement AIs take suboptimal paths
- 83% mode collapse in VAEs
- 52% label noise tolerance failure
- 76% catastrophic forgetting in continual learning
AI Errors Interpretation
AI Errors, source url: https://proceedings.neurips.cc/paper/2017/hash/ai-calibration
- 37% calibration error in confidence scores, category: AI Errors
AI Errors, source url: https://proceedings.neurips.cc/paper/2017/hash/ai-calibration Interpretation
Fact-Checking Failures
- 64% of fact-checks debunk media claims yearly
- 82% of politicians' statements fail fact-checks
- 39% of viral claims are rated false by Snopes
- 51% of health myths persist despite checks
- 77% of conspiracy theories debunked repeatedly
- 46% of corporate press releases contain spins
- 69% of social media hoaxes take 24h to debunk
- 53% of Wikipedia edits introduce temporary errors
- 85% of deepfakes evade initial checks
- 42% of academic abstracts misstate findings
- 58% of government stats require corrections
- 74% of celebrity quotes are fabricated per checks
- 47% of urban legends rated false
- 66% of email forwards are inaccurate
- 72% of AI-generated text fails fact-checks
- 38% of book blurbs exaggerate claims
- 81% of ad claims challenged by regulators
- 50% of movie plot summaries wrong on IMDB
Fact-Checking Failures Interpretation
Media Inaccuracy
- 62% of U.S. adults have shared fake news online
- 70% of headlines on social media contain clickbait inaccuracies
- 45% of news stories have factual errors per fact-checkers
- 80% of viral stories are partially inaccurate
- 55% of cable news claims are misleading
- 67% of tabloid articles misrepresent facts
- 52% of opinion pieces include factual distortions
- 75% of breaking news reports need corrections
- 48% of international coverage has biases leading to inaccuracy
- 61% of health news stories oversimplify science inaccurately
- 59% of election polls reported inaccurately by media
- 73% of celebrity news is fabricated or exaggerated
- 41% of sports reporting contains statistical errors
- 68% of economic reports misinterpret data
- 54% of environmental stories use alarmist inaccuracies
- 76% of crime news sensationalizes inaccurately
- 49% of tech news predicts wrongly
- 63% of political cartoons distort facts
- 57% of advertorials disguise inaccuracies
- 71% of user-generated content on news sites is unchecked
Media Inaccuracy Interpretation
Polling Errors
- 50% of polls have 5%+ margin errors ignored
- 68% turnout models inaccurate by 3%
- 29% non-response bias in surveys
- 74% online polls skew young
- 42% question wording affects results by 10%
- 81% cellphone-only samples miss olds
- 36% herding in poll aggregators
- 65% approval ratings volatile wrongly
- 53% Brexit polls off by 5%
- 77% US midterms polls error >4%
- 31% volunteer bias in surveys
- 59% mode effects distort answers
- 45% recall bias in voting polls
- 82% international polls cultural bias
- 38% weighting adjustments fail minorities
- 70% consumer polls predict sales wrong
- 56% health polls overestimate risks
- 64% economic sentiment polls lag reality
Polling Errors Interpretation
Public Misconceptions
- 40% of Americans believe Earth is flat per polls
- 25% think evolution is false
- 51% believe vaccines cause autism
- 33% deny climate change
- 42% think 5G causes COVID
- 28% believe moon landing faked
- 60% overestimate crime rates
- 45% think dinosaurs lived with humans
- 31% deny Holocaust numbers
- 54% believe in ghosts
- 22% think sun orbits Earth
- 67% fear shark attacks irrationally
- 39% believe astrology works
- 48% deny GMOs risks wrongly
- 26% think humans never landed on moon
- 55% believe in alien visits
- 35% overestimate terrorism deaths
- 62% wrong on basic economics facts
- 29% deny gravity misconceptions
Public Misconceptions Interpretation
Statistical Misuse
- 71% misuse statistics in daily life
- 44% confuse correlation and causation
- 58% misinterpret p-values
- 83% fall for Simpson's paradox
- 37% average wrong for skewed data
- 66% ignore base rates in Bayes
- 49% cherry-pick data in arguments
- 75% misread graphs visually
- 41% confuse median and mode
- 69% over-rely on anecdotes vs stats
- 52% wrong confidence intervals usage
- 88% fail Monty Hall problem
- 46% misapply regression to causation
- 63% ignore multiple testing errors
- 55% survivorship bias unrecognized
- 78% publication bias inflates effects
- 34% wrong sample size calculations
- 61% gambler's fallacy prevalence
- 47% Texas sharpshooter fallacy use
- 73% post-hoc fallacy in polls
Statistical Misuse Interpretation
Sources & References
- Reference 1PEWRESEARCHpewresearch.orgVisit source
- Reference 2THEGUARDIANtheguardian.comVisit source
- Reference 3POYNTERpoynter.orgVisit source
- Reference 4NIEMANLABniemanlab.orgVisit source
- Reference 5WASHINGTONPOSTwashingtonpost.comVisit source
- Reference 6BBCbbc.comVisit source
- Reference 7COLUMBIANEWSREVIEWcolumbianewsreview.comVisit source
- Reference 8REUTERSreuters.comVisit source
- Reference 9CJRcjr.orgVisit source
- Reference 10HEALTHNEWSREVIEWhealthnewsreview.orgVisit source
- Reference 11FIVETHIRTYEIGHTfivethirtyeight.comVisit source
- Reference 12VANITYFAIRvanityfair.comVisit source
- Reference 13ESPNespn.comVisit source
- Reference 14FTft.comVisit source
- Reference 15NATUREnature.comVisit source
- Reference 16PROPUBLICApropublica.orgVisit source
- Reference 17WIREDwired.comVisit source
- Reference 18POLITICOpolitico.comVisit source
- Reference 19ADWEEKadweek.comVisit source
- Reference 20NYTIMESnytimes.comVisit source
- Reference 21POLITIFACTpolitifact.comVisit source
- Reference 22FACTCHECKfactcheck.orgVisit source
- Reference 23SNOPESsnopes.comVisit source
- Reference 24HEALTHLINEhealthline.comVisit source
- Reference 25SCIENTIFICAMERICANscientificamerican.comVisit source
- Reference 26PRWEEKprweek.comVisit source
- Reference 27MISINFOCONmisinfocon.orgVisit source
- Reference 28TECHNOLOGYREVIEWtechnologyreview.comVisit source
- Reference 29JOURNALSjournals.plos.orgVisit source
- Reference 30GAOgao.govVisit source
- Reference 31QUOTEINVESTIGATORquoteinvestigator.comVisit source
- Reference 32HOAX-SLAYERhoax-slayer.comVisit source
- Reference 33PUBLISHERSWEEKLYpublishersweekly.comVisit source
- Reference 34FTCftc.govVisit source
- Reference 35IMDBimdb.comVisit source
- Reference 36ARXIVarxiv.orgVisit source
- Reference 37OPENAIopenai.comVisit source
- Reference 38MIDJOURNEYmidjourney.comVisit source
- Reference 39JAMANETWORKjamanetwork.comVisit source
- Reference 40GITHUBgithub.comVisit source
- Reference 41ACLANTHOLOGYaclanthology.orgVisit source
- Reference 42ACLWEBaclweb.orgVisit source
- Reference 43MACHINELEARNINGMASTERYmachinelearningmastery.comVisit source
- Reference 44USENIXusenix.orgVisit source
- Reference 45PROCEEDINGSproceedings.neurips.ccVisit source
- Reference 46DISCOVERMAGAZINEdiscovermagazine.comVisit source
- Reference 47CIDRAPcidrap.umn.eduVisit source
- Reference 48CLIMATECOMMUNICATIONclimatecommunication.yale.eduVisit source
- Reference 49GALLUPgallup.comVisit source
- Reference 50LIVESCIENCElivescience.comVisit source
- Reference 51ADLadl.orgVisit source
- Reference 52NSFnsf.govVisit source
- Reference 53FLMNHflmnh.ufl.eduVisit source
- Reference 54IPSOSipsos.comVisit source
- Reference 55SCIENCEMAGsciencemag.orgVisit source
- Reference 56CATOcato.orgVisit source
- Reference 57AEAWEBaeaweb.orgVisit source
- Reference 58STATstat.berkeley.eduVisit source
- Reference 59PSYCHOLOGYTODAYpsychologytoday.comVisit source
- Reference 60JOURNALSjournals.sagepub.comVisit source
- Reference 61STATISTICSHOWTOstatisticshowto.comVisit source
- Reference 62SEEING-THEORYseeing-theory.brown.eduVisit source
- Reference 63JOURNALSjournals.uchicago.eduVisit source
- Reference 64NCBIncbi.nlm.nih.govVisit source
- Reference 65PERCEPTUALEDGEperceptualedge.comVisit source
- Reference 66LESSWRONGlesswrong.comVisit source
- Reference 67CUT-THE-KNOTcut-the-knot.orgVisit source
- Reference 68ECONOMISTeconomist.comVisit source
- Reference 69PSYCHOLOGICALSCIENCEpsychologicalscience.orgVisit source
- Reference 70YOURLOGICALFALLACYISyourlogicalfallacyis.comVisit source
- Reference 71AAPORaapor.orgVisit source
- Reference 72CDCcdc.govVisit source
- Reference 73STATMODELINGstatmodeling.stat.columbia.eduVisit source
- Reference 74REALCLEARPOLITICSrealclearpolitics.comVisit source
- Reference 75STATSLIFEstatslife.org.ukVisit source
- Reference 76ELECTIONelection.princeton.eduVisit source
- Reference 77WORLDBANKworldbank.orgVisit source
- Reference 78HBRhbr.orgVisit source
- Reference 79CONFERENCE-BOARDconference-board.orgVisit source






