This chapter highlights the prevalence of Questionable Research Practices for some disciplines of Biology and Psychology, explains how they lead to non-reproducible research, and discusses solutions to begin to deal with them. The preceding chapters introduced fundamental concepts to design experiments. You also learned important statistical tests (e.g. randomisation test and t-tests) and how to interpret their results appropriately (e.g. interpret p-values along a continuum, and focus on effect sizes to understand the results’ practical importance). Implementing these skills contribute to producing reproducible (reliable) research.This Chapter shows that, even if we design an experiment well and analyse the data with an appropriate test (and interpret it correctly), the decisions we make throughout the research process can still dangerously compromise research reproducibility. Such decisions are often called “Questionable Research Practices”.This chapter highlights the prevalence of Questionable Research Practices for some disciplines of Biology and Psychology, explains how they lead to non-reproducible research, and discusses solutions to begin to deal with them.We note that the topic of Questionable Research Practices is not typically covered in courses of “Experimental Design and / or Analysis”. However, we expect that the videos in this chapter will convince you that it should be, and that reproducible (reliable) research demands that we follow wise practices.Questionable Research Practices: General IntroductionThis video explains why we are taking time to learn about Questionable Research Practices. Document QRP General introduction (951.94 KB / PPTX) Document Transcript - Questionable research practices General introduction (13.79 KB / TXT) Questionable Research Practices: Cherry PickingCherry picking... not as pleasant as it sounds Document Questionable research practices - Cherry picking (575.04 KB / PPTX) Document Transcript - questionable research practices cherry picking (18.79 KB / TXT) Questionable Research Practices: P-hackingP-hacking: practices that alter p-values. Document Questionable research practices p-hacking (353.16 KB / PPTX) Document Transcript - questionable research practices p-hacking (22.33 KB / TXT) Questionable Research Practices: Collecting Additional DataWhy is it problematic to collect more data after analysing your dataset? We discuss. Document Transcript - questionable research practices collecting additional data (26.93 KB / TXT) Questionable Research Practices: HARKingHARKing = Hypothesizing After Results are Known. Why is HARKing a problem? How common is it? How can we avoid it? Document Questionable research practices HARKing (422.7 KB / PPTX) Document Transcript - Questionable research practices HARKing (23.14 KB / TXT) Challenge yourselfYou will hear different advice from different people on how to do good science. The following paper published in eLife, endeavours to provide advice on how to think about your results and report research findings: Document Article in E-Life 'Tell me a story' (108.51 KB / PDF) Challenge yourself to critically assess the advice in this paper, given what you have learned about Questionable Research Practices. As an interesting twist, note that eLife allows you to examine comments on the paper left by previous readers (see “Add a comment” at the end of the paper’s text). Reading these comments provides a window on what scientists think about a paper: does your opinion agree with theirs?Another challenge: Read this comic. Which questionable research practice does this correspond to? Michael Whitlock Discusses the Science of DoubtThis video presents a fascinating discussion of the role for ‘doubt’ in the scientific process. Simultaneously, it confronts some of the Questionable Research Practices introduced in the videos above. This video presents a ‘Presidential Address’ by Prof Michael Whitlock for the American Society of Naturalists. Please note that the first 10 minutes involve award announcements which you can skip without losing any important content; the talk starts immediately after the award announcements.View youtube video ‘Presidential Address’ by Prof Michael WhitlockRecommended readingThis article provides further references that explore questionable research practices in Psychology:Nguyen, V., Sharp, M.K., Superchi, C. et al. Biomedical doctoral students’ research practices when facing dilemmas: two vignette-based randomized control trials. Sci Rep 13, 16371 (2023) Document Article in PLoS One questionable research practices (2.78 MB / PDF) This article was published on 2024-08-05