In a previous episode, we discussed whether and when you should draw inferences about a person based on their scientific work. Today we turn the question around: When should you judge a piece of scientific work based on what you know about the person who did it? We talk about the implications of masking authors’ identities from reviewers and editors, about judging the “pedigree” of what lab someone was trained in, and the tricky but sometimes important distinctions between fairness, validity, and bias. Also: This week’s letter is about what to do when your findings fail to replicate.
Discussed in this episode:
- Simine’s paper Quality Uncertainty Erodes Trust in Science
- And the Akerlof paper that inspired it
- Principles for the Validation and Use of Personnel Selection Procedures by the Society for Industrial and Organizational Psychology
- Graduate Admission Variables and Future Success by Robyn Dawes
The Black Goat is hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire. Find us on the web at www.theblackgoatpodcast.com, on Twitter at @blackgoatpod, or on Facebook at facebook.com/blackgoatpod/. You can email us at firstname.lastname@example.org. You can subscribe to us on iTunes.
Our theme music is Peak Beak by Doctor Turtle, available on freemusicarchive.org under a Creative Commons noncommercial attribution license.
This is episode 23. It was recorded December 2, 2017.