Analgesics
Antiandrogens
Azvudine
Bromhexine
Budesonide
Colchicine
Conv. Plasma
Curcumin
Famotidine
Favipiravir
Fluvoxamine
Hydroxychlor..
Ivermectin
Lifestyle
Melatonin
Metformin
Minerals
Molnupiravir
Monoclonals
Naso/orophar..
Nigella Sativa
Nitazoxanide
Paxlovid
Quercetin
Remdesivir
Thermotherapy
Vitamins
More

Other
Feedback
Home
Top
Abstract
All ivermectin studies
Meta analysis
 
Feedback
Home
next
study
previous
study
c19ivm.org COVID-19 treatment researchIvermectinIvermectin (more..)
Melatonin Meta
Metformin Meta
Azvudine Meta
Bromhexine Meta Molnupiravir Meta
Budesonide Meta
Colchicine Meta
Conv. Plasma Meta Nigella Sativa Meta
Curcumin Meta Nitazoxanide Meta
Famotidine Meta Paxlovid Meta
Favipiravir Meta Quercetin Meta
Fluvoxamine Meta Remdesivir Meta
Hydroxychlor.. Meta Thermotherapy Meta
Ivermectin Meta

All Studies   Meta Analysis    Recent:   

Published benefits of ivermectin use in Itajaí, Brazil for COVID-19 infection, hospitalisation, and mortality are entirely explained by statistical artefacts

Mills et al., medRxiv, doi:10.1101/2023.08.10.23293924
Aug 2023  
  Post
  Facebook
Share
  Source   PDF   All Studies   Meta AnalysisMeta
Ivermectin for COVID-19
4th treatment shown to reduce risk in August 2020
 
*, now known with p < 0.00000000001 from 102 studies, recognized in 22 countries.
No treatment is 100% effective. Protocols combine complementary and synergistic treatments. * >10% efficacy in meta analysis with ≥3 clinical studies.
4,100+ studies for 60+ treatments. c19ivm.org
Highly flawed analysis with multiple basic errors, invalid assumptions, highly biased discussion, failure to correct any of the issues for over two months, major changes without explanation, and repeating known major errors.
There are major changes to all tables and figures, without explanation of why these changes were made. Code changes can be seen at github.com, github.com (B).
For example, authors claim that there were ""499 reported deaths - a citywide post-hospitalisation COVID death rate of 30.1% during the study period"", which is not possible based on official data twitter.com, twitter.com (B). Authors appear to have used a mismatched dataset, incorrectly including data from neighboring municipalities twitter.com (C), twitter.com (D). Author's R code appears to incorrectly select patients twitter.com (E). Authors also do not appear to have read the original paper in full, missing details of the population analyzed twitter.com (F). They also appear to have missed the distinction between an individual's residential city and the location of their medical care twitter.com (C), twitter.com (G). Authors assumptions are also invalid - participation for patients with symptoms may depend on multiple factors. For example, patients with more severe symptoms may be more likely to perceive serious risk and more likely to seek known effective treatment. Authors also only discuss potential biases in one direction - for example ignoring bias due to dropping out of the program. The assumption of no effect for treatment is contradicted by 17 out of 17 prophylaxis studies.
While the errors may be accidental, two factors increase the severity.
The extreme mismatch in deaths with the original paper should have been a sign to check. The cause of the mismatch should have been relatively easy to determine, and in case authors were still stuck, they could have asked the original authors. Such an extreme and easily identifiable error in mortality numbers undermines author's credibility.
Further, authors were notified of the mortality error within 12 hours of announcing the preprint on Twitter and acknowledged the error, initially claiming a rapid correction would be forthcoming. However, the paper had still not been withdrawn over two months after publication, and was still available without any warning, note, or even partial correction. Leaving known highly incorrect information for so long raises ethical concerns.
Discussion in this paper is highly biased, supporting concern over bias from the team. Authors claim that ""rigorous randomised clinical trials have largely not found clinical benefit for ivermectin use in COVID-19"", but in reality all 17 of 17 prophylaxis studies at the time showed statistically significant benefits of ivermectin, including all 4 of 4 RCTs.
Authors reference none of the other prophylaxis studies, and cherry pick a few non-prophylaxis studies, and even then they ignore the signs of efficacy in those studies. While it's common for authors to misrepresent research, excluding all 16 other studies and cherry picking a few non-prophylaxis studies stands out as one of the most extreme cases.
Authors cite only 4 of the 102 studies, all with major issues, and none reporting prophylaxis results. Further, the 4 studies cited all show signs of efficacy - Lim shows 69% lower mortality, close to statistical significance; Bramante showed 61% lower hospitalization for ivermectin vs. placebo (not reported by authors, without statistical significance); the co-principal investigator of Reis has stated ""there is a clear signal that IVM works in COVID patients""; and in Naggie the posterior probability ivermectin was effective was 99%, 98%, 97% for mean time unwell and clinical progression @14 and 7 days, all exceeding the pre-specified threshold for superiority (clinical progression results were changed without explanation between the preprint and journal version, the primary outcome was not reported, with a new post-hoc highly biased outcome created).
All 4 of the cited studies are low quality studies with major issues. For example, one trial reports impossible data, refuses to release data despite pledging to, broke blinding and shared interim results externally, had randomization failure, blinding failure, and numerous protocol violations Marinos, Reis.
Further, author's discussion of preclinical data is highly cherry-picked and highly misleading, with inaccurate interpretation of the concentration required based on Caly (see discussion) and other studies, and no mention of the majority of proposed mechanisms and supporting data.
2.5 months later authors released an updated preprint which has very different data, but does not detail or mention the authors' errors. Note that an author pre-announced that there would be no change in the results on Twitter before it was possible to have made corrections. The analysis is unreliable because the conclusion came before the analysis, and the analysis includes assumptions that can be easily tweaked for any desired result. Moreover, many errors have clearly not been fixed. As before, the authors reference none of the other prophylaxis studies, and cherry pick a few low quality non-prophylaxis studies with many critical issues, and even then they ignore the signs of efficacy in those studies. While it's common for authors to misrepresent research, excluding all 16 other studies and cherry picking a few non-prophylaxis studies stands out as one of the most extreme cases. All 17 of 17 prophylaxis studies at the time showed statistically significant benefits of ivermectin, including all 4 of 4 RCTs, contradictory to the author's claims. Further, it is known that author's were aware of these errors.
Author's extreme bias, silent major changes without explanation, and failure to correct known errors suggests their goal is not to accurately evaluate the clinical evidence.
Ivermectin, better known for antiparasitic activity, is a broad spectrum antiviral with activity against many viruses including H7N7 Götz, Dengue Jitobaom, Tay, Wagstaff, HIV-1 Wagstaff, Simian virus 40 Wagstaff (B), Zika Barrows, Jitobaom, Yang, West Nile Yang, Yellow Fever Mastrangelo, Varghese, Japanese encephalitis Mastrangelo, Chikungunya Varghese, Semliki Forest virus Varghese, Human papillomavirus Li, Epstein-Barr Li, BK Polyomavirus Bennett, and Sindbis virus Varghese.
Ivermectin inhibits importin-α/β-dependent nuclear import of viral proteins Götz, Kosyna, Wagstaff, Wagstaff (B), shows spike-ACE2 disruption at 1nM with microfluidic diffusional sizing Fauquet, binds to glycan sites on the SARS-CoV-2 spike protein preventing interaction with blood and epithelial cells and inhibiting hemagglutination Boschi, Scheim, shows dose-dependent inhibition of wildtype and omicron variants Shahin, exhibits dose-dependent inhibition of lung injury Abd-Elmawla, Ma, may inhibit SARS-CoV-2 via IMPase inhibition Jitobaom, may inhibit SARS-CoV-2 induced formation of fibrin clots resistant to degradation Vottero, inhibits SARS-CoV-2 3CLpro Mody, may inhibit SARS-CoV-2 RdRp activity Parvez (B), may minimize viral myocarditis by inhibiting NF-κB/p65-mediated inflammation in macrophages Gao, may be beneficial for COVID-19 ARDS by blocking GSDMD and NET formation Liu (C), shows protection against inflammation, cytokine storm, and mortality in an LPS mouse model sharing key pathological features of severe COVID-19 DiNicolantonio, Zhang, may be beneficial in severe COVID-19 by binding IGF1 to inhibit the promotion of inflammation, fibrosis, and cell proliferation that leads to lung damage Zhao, may minimize SARS-CoV-2 induced cardiac damage Liu, Liu (B), increases Bifidobacteria which play a key role in the immune system Hazan, has immunomodulatory Munson and anti-inflammatory DiNicolantonio (B), Yan properties, and has an extensive and very positive safety profile Descotes.
Mills et al., 15 Aug 2023, retrospective, Brazil, preprint, 3 authors, study period 7 July, 2020 - 2 December, 2020. Contact: dbsgtk@nus.edu.sg.
This PaperIvermectinAll
Published benefits of ivermectin use in Itajaí, Brazil for COVID-19 infection, hospitalisation, and mortality are entirely explained by statistical artefacts
Robin Mills, Ana Carolina Peçanha Antonio, Greg Tucker-Kellogg
doi:10.1101/2023.08.10.23293924
Background Two recent publications by Kerr et al. (Cureus 14(1):e21272; Cureus 14(8): e28624) reported dramatic effects of prophylactic ivermectin use for both prevention of COVID-19 and reduction of COVID-19-related hospitalisation and mortality, including a dose-dependent effect of ivermectin prophylaxis. These papers have gained an unusually large public influence: they were incorporated into debates around COVID-19 policies and may have contributed to decreased trust in vaccine efficacy and public health authorities more broadly. Both studies were based on retrospective observational analysis of city-wide registry data from the city of Itajaí, Brazil from July-December 2020. Methods Starting with initially identified sources of error, we conducted a revised statistical analysis of available data, including data made available with the original papers and public data from the Brazil Ministry of Health. We identified additional uncorrected sources of bias and errors from the original analysis, including incorrect subject exclusion and missing subjects, an enrolment time bias, and multiple sources of immortal time bias. In models assuming no actual effect from ivermectin use, we conducted Monte Carlo simulations to estimate the contribution of these biases to any observed effect. Results Untreated statistical artefacts and methodological errors alone lead to dramatic apparent risk reduction associated with Ivermectin use in both studies. The magnitude of apparent risk reduction from these artefacts is comparable to the results reported by the studies themselves, including apparent protection from infection, hospitalisation, and death, and including the reported apparent dose-response relationship. Conclusions The inference of ivermectin efficacy reported in both papers is unsupported, as the observed effects are entirely explained by untreated statistical artefacts and methodological errors. Our re-analysis calls for caution in interpreting highly publicised observational studies and highlights the importance of common sources of bias in clinical research.
Author contributions RM conducted the research required to uncover all fallacies mentioned in the manuscript (delayed registrations, missing data, incorrect inclusion of prior infections, all biases). GTK independently uncovered the immortal time bias, enrolment bias, and attrition bias. RM and GTK wrote the simulation and analysis code. GTK in particular, RM, and ACPA contributed to writing and reviewing the manuscript. ACPA acquired the data from the Brazilian Health Ministry. ACPA has been in frequent contact with Itajaí City Hall in an attempt to get access to missing raw data. RM has been in frequent contact with the KC22 and KB22 authors in an attempt to discuss the issues in their work before publishing this manuscript.
References
Adam, Journal says ivermectin study met standard for 'credible science'. Retraction Watch
Alein, Haro-Ramos, Frontline work and racial disparities in social and economic pandemic stressors during the first COVID-19 surge, Health Services Research
Aragon, epitools: Epidemiology tools. manual
Atif, Effects of glutamate and ivermectin on single glutamate-gated chloride channels of the parasitic nematode H. contortus, PLoS Pathogens
Bandt, Boen, A prevalent misconception about sample size, statistical significance, and clinical importance, Journal of Periodontology
Bordalo, Gennaioli, Shleifer, Salience Theory of Choice Under Risk, The Quarterly Journal of Economics
Bordalo, Gennaioli, Shleifer, Salience and consumer choice, Journal of Political Economy
Bramante, Randomized Trial of Metformin, Ivermectin, and Fluvoxamine for Covid-19, The New England Journal of Medicine
Buffet, Mendoza-Sassi, Fysekidis, Inaccurate Real-World Data Does Not Provide Real-World Answers, American Journal of Therapeutics
Caly, The FDA-approved drug ivermectin inhibits the replication of SARS-CoV-2 in vitro, Antiviral Research
Chee, Lim, Efficacy of Ivermectin Treatment on Disease Progression Among Adults With Mild to Moderate COVID-19 and Comorbidities: The I-TECH Randomized Clinical Trial, JAMA Internal Medicine
Da Silva, Factors Contributing to Exacerbating Vulnerabilities in Global Clinical Trials, Frontiers in Pharmacology
Daniel, Lackland, Impact of COVID-19 on Clinical Research and Inclusion of Diverse Populations, Ethnicity & Disease
Dornels Freire De Souza, Feliciano Do Carmo, Machado, The burden of COVID-19 in Brazil is greater in areas with high social deprivation, Journal of Travel Medicine
Drummond, Da, Influência da desigualdade socioeconômica na distribuição das internações e dos óbitos por covid-19 em municípios brasileiros, 2020: um estudo ecológico Influência da desigualdade socioeconômica na distribuição das internações e dos óbitos por covid-19 em municípios brasileiros, 2020: um estudo ecológico, Epidemiologia e servicos de saude : revista do Sistema Unico de Saude do Brasil
Flaxman, Estimating the effects of non-pharmaceutical interventions on COVID-19 in Europe, Nature
Furlan, Caramelli, The regrettable story of the "Covid Kit" and the "Early Treatment of Covid-19" in Brazil
Gelman, Loken, The statistical crisis in science, American Scientist
González, The Pharmacokinetics and Interactions of Ivermectin in Humans-A Mini-review, The AAPS Journal
Grasselli, Hospital-Acquired Infections in Critically Ill Patients With COVID-19, Chest
Greenland, Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations, European Journal of Epidemiology
Hill, Retraction to: Meta-analysis of Randomized Trials of Ivermectin to Treat SARS-CoV-2 Infection, Open Forum Infectious Diseases
Janmohamed, Interventions to Mitigate COVID-19 Misinformation: A Systematic Review and Meta-Analysis, doi:10.1080/10810730.2021.2021460
Jaramillo, Clinical Trials Show Ivermectin Does Not Benefit COVID-19 Patients, Contrary to Social Media Claims
Keegan, Crown, Joseph, Diversity, Equity, and Inclusion in Clinical Trials, Surgical Oncology Clinics of North America
Kerr, Ivermectin Prophylaxis Used for COVID-19: A Citywide, Prospective, Observational Study of 223,128 Subjects Using Propensity Score Matching, Cureus
Kerr, Regular Use of Ivermectin as Prophylaxis for COVID-19 Led Up to a 92% Reduction in COVID-19 Mortality Rate in a Dose-Response Manner: Results of a Prospective Observational Study of a Strictly Controlled Population of 88,012 Subjects, Cureus
Kory, Review of the Emerging Evidence Demonstrating the Efficacy of Ivermectin in the Prophylaxis and Treatment of COVID-19, American Journal of Therapeutics
Laplante, Enrollment, retention, and strategies for including disadvantaged populations in randomized controlled trials: a systematic review protocol, Systematic Reviews
Lawrence, The lesson of ivermectin: meta-analyses based on summary data alone are inherently unreliable, Nature Medicine
Lee, Nunan, Immortal time bias
Leppink, Winston, Sullivan, Statistical significance does not imply a real effect, Perspectives on Medical Education
Long, Bui, Estimation of the incubation period of COVID-19 in Vietnam, PloS one
Martins-Filho, COVID-19 fatality rates related to social inequality in Northeast Brazil: a neighbourhood-level analysis, Journal of Travel Medicine
Men, Estimate the incubation period of coronavirus 2019 (COVID-19), Computers in biology and medicine
Meyerowitz-Katz, Unethical studies of ivermectin for covid-19, British Medical Journal Publishing Group Section: Editorial
Mueser, Granberg, The Monty Hall Dilemma Revisited: Understanding the Interaction of Problem Definition and Decision Making. Experimental
Naggie, Effect of Ivermectin vs Placebo on Time to Sustained Recovery in Outpatients With Mild to Moderate COVID-19: A Randomized Clinical Trial, JAMA
Nilima, Kumar, Moxidectin and Ivermectin Inhibit SARS-CoV-2 Replication in Vero E6 Cells but Not in Human Primary Bronchial Epithelial Cells, Antimicrobial Agents and Chemotherapy
Patrick, Walker, The impact of COVID-19 and strategies for mitigation and suppression in low-and middle-income countries, Science
Pennycook, Shifting attention to accuracy can reduce misinformation online, Nature
Peña-Silva, Pharmacokinetic considerations on the repurposing of ivermectin for treatment of COVID-19, British Journal of Clinical Pharmacology, doi:10.1111/bcp.14476
Popp, Ivermectin for preventing and treating COVID-19, Cochrane Database of Systematic Reviews
Reardon, Flawed ivermectin preprint highlights challenges of COVID drug studies
Reis, Effect of Early Treatment with Ivermectin among Patients with Covid-19, Publisher: Massachusetts Medical Society, doi:10.1056/NEJMoa2115869,null
Sackett, Bias in analytic research, Journal of Chronic Diseases
Saenen, Why Humans Fail in Solving the Monty Hall Dilemma: A Systematic Review
Sander Van Der Linden, Misinformation: susceptibility, spread, and interventions to immunize the public, Nature Medicine
Sheldrick, Meyerowitz-Katz, Tucker-Kellogg, Plausibility of Claimed Covid-19 Vaccine Efficacies by Age: A Simulation Study, American Journal of Therapeutics
Spencer, Heneghan, Chronological bias
Stacy, Uybico, Pavel, Gross, Recruiting Vulnerable Populations into Research: A Systematic Review of Recruitment Interventions, Journal of General Internal Medicine
Sundy, Yang, The broad spectrum antiviral ivermectin targets the host nuclear transport importin α/β1 heterodimer, Antiviral Research
Turner, Schaeffer ; William, Campbell, Mode of Action of Ivermectin
Tversky, Kahneman, Judgment under uncertainty: Heuristics and biases, Science
Wagstaff, Ivermectin is a specific inhibitor of importin α/β-mediated nuclear import able to inhibit replication of HIV-1 and dengue virus, Biochemical Journal
Loading..
Please send us corrections, updates, or comments. c19early involves the extraction of 100,000+ datapoints from thousands of papers. Community updates help ensure high accuracy. Treatments and other interventions are complementary. All practical, effective, and safe means should be used based on risk/benefit analysis. No treatment or intervention is 100% available and effective for all current and future variants. We do not provide medical advice. Before taking any medication, consult a qualified physician who can provide personalized advice and details of risks and benefits based on your medical history and situation. FLCCC and WCH provide treatment protocols.
  or use drag and drop   
Submit