Everything Hertz

James and Dan discuss James' newly funded 'Medical Evidence Project', whose goal is to find questionable medical evidence that is contaminating treatment guidelines. Links * James' blog post [https://jamesclaims.substack.com/p/how-should-we-fund-scientific-error] from last year * The carthorse child blog post [https://medium.com/hackernoon/introducing-sprite-and-the-case-of-the-carthorse-child-58683c2bfeb] * The blog post [https://jamesclaims.substack.com/p/introducing-the-medical-evidence] announcing the project * A write up in Nature [https://www.nature.com/articles/d41586-025-01739-z?utm_source=bluesky&utm_medium=social&utm_campaign=nature&linkId=14776408] about the project Other links * Dan on Bluesky [https://bsky.app/profile/dsquintana.bsky.social] * James on Bluesky [https://bsky.app/profile/jamesheathers.bsky.social] * Everything Hertz on Bluesky [https://bsky.app/profile/hertzpodcast.bsky.social] Citation Quintana, D. S., & Heathers, J. (2025, June 4). 191: Cleaning up contaminated medical treatment guidelines Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/537BN Support Everything Hertz [https://www.patreon.com/hertzpodcast]

We chat about two new studies that took different approaches for evaluating the impact of paying reviewers on peer review speed and quality. Links * James' 450 movement proposal [https://jamesheathers.medium.com/the-450-movement-1f86132a29bd] * The paper [https://journals.lww.com/ccmjournal/fulltext/9900/effect_of_monetary_incentives_on_peer_review.488.aspx] from Critical Care Medicine * The preprint [https://www.biorxiv.org/content/10.1101/2025.03.18.644032v1] from Biology Open Other links * Dan on Bluesky [https://bsky.app/profile/dsquintana.bsky.social] * James on Bluesky [https://bsky.app/profile/jamesheathers.bsky.social] * Everything Hertz on Bluesky [https://bsky.app/profile/hertzpodcast.bsky.social] Citation Quintana, D. S., & Heathers, J. (2025, April 2). 190: What happens when you pay reviewers?, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/PHQ2K Support Everything Hertz [https://www.patreon.com/hertzpodcast]

Dan and James discuss a recent piece that proposes a post-publication review process, which is triggered by citation counts. They also cover how an almetrics trigger could be alternatively used for a more immediate post-publication critique. Links * The Chonicle piece [https://www.chronicle.com/article/social-science-is-broken-heres-how-to-fix-it?sra=true] by Andrew Gelman and Andrew King [Free to read with email registration] * The paper [https://psycnet.apa.org/fulltext/2022-14587-001.html] by Peder Isager and collegues on how to decide what papers we should replicate. Here is the preprint [https://files.de-1.osf.io/v1/resources/2gurz/providers/osfstorage/5f4f4314a392b9002f1d9576?action=download&direct&version=2]. * The ERROR project [https://error.reviews/about/] Other links Everything Hertz on Bluesky * Dan on Bluesky [https://bsky.app/profile/dsquintana.bsky.social] * James on Bluesky [https://bsky.app/profile/jamesheathers.bsky.social] * Everything Hertz on Bluesky [https://bsky.app/profile/hertzpodcast.bsky.social] Citation Quintana, D. S., & Heathers, J. (2025, Mar 2). 189: Crit me baby, one more time, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/3X5UR Support Everything Hertz [https://www.patreon.com/hertzpodcast]

Dan and James discuss a recent editorial which argues that double-blind peer review is detrimental to scientific integrity. Links * The editorial from Christopher Mebane: https://doi.org/10.1093/etojnl/vgae046 [https://doi.org/10.1093/etojnl/vgae046] Other links Everything Hertz on Bluesky * Dan on Bluesky [https://bsky.app/profile/dsquintana.bsky.social] * James on Bluesky [https://bsky.app/profile/jamesheathers.bsky.social] * Everything Hertz on Bluesky [https://bsky.app/profile/hertzpodcast.bsky.social] Support us on Patreon [https://www.patreon.com/hertzpodcast] and get bonus stuff! * $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show * $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D. S., & Heathers, J. (2025, Jan 30). Double-blind peer review vs. scientific integrity, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/6XS29 Support Everything Hertz [https://www.patreon.com/hertzpodcast]

We chat about the events that started the replication crisis in psychology and Dorothy Bishop's recent resignation from the Royal Society Links * The resignation blogpost [http://deevybee.blogspot.com/2024/11/why-i-have-resigned-from-royal-society.html] from Dorothy Bishop * The bluesky post [https://bsky.app/profile/sarahwieten.bsky.social/post/3lbtsqc6jcs2z] from Sarah Weiten that asked the question, "If you had to cite an event that opened the "replication crisis" era, what would you point to?" * The "Year of Horrors" paper [https://www.ejwagenmakers.com/2012/Wagenmakers2012Horrors.pdf] from Eric-Jan Wagenmakers Other links Everything Hertz on Bluesky * Dan on Bluesky [https://bsky.app/profile/dsquintana.bsky.social] * James on Bluesky [https://bsky.app/profile/jamesheathers.bsky.social] * Everything Hertz on Bluesky [https://bsky.app/profile/hertzpodcast.bsky.social] Support us on Patreon [https://www.patreon.com/hertzpodcast] and get bonus stuff! * $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show * $5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month Citation Quintana, D. S., & Heathers, J. (2024, Dec 3). 187: What started the replication crisis era?, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/EC7QH Support Everything Hertz [https://www.patreon.com/hertzpodcast]