Crowdsourcing multiverse analyses to explore the impact of different data-processing and analysis decisions: A tutorial.

Tom Heyman; Ekaterina Pronizius; Savannah C. Lewis; Oguz A. Acar; Matúš Adamkovič; Ettore Ambrosini; Jan Antfolk; Krystian Barzykowski; Ernest Baskin; Carlota Batres; Leanne Boucher; Jordane Boudesseul; Eduard Brandstätter; W. Matthew Collins; Dušica Filipović Ðurđević; Ciara Egan; Vanessa Era; Paulo Ferreira; Chiara Fini; Patricia Garrido-Vásquez; Hendrik Godbersen; Pablo Gomez; Aurelien Graton; Necdet Gurkan; Zhiran He; Dave C. Johnson; Pavol Kačmár; Chris Koch; Marta Kowal; Tomas Kratochvil; Marco Marelli; Fernando Marmolejo-Ramos; Martín Martínez; Alan Mattiassi; Nicholas P. Maxwell; Maria Montefinese; Coby Morvinski; Maital Neta; Yngwie A. Nielsen; Sebastian Ocklenburg; Jaš Onič; Marietta Papadatou-Pastou; Adam J. Parker; Mariola Paruzel-Czachura; Yuri G. Pavlov; Manuel Perea; Gerit Pfuhl; Tanja C. Roembke; Jan P. Röer; Timo B. Roettger; Susana Ruiz-Fernandez

doi:10.1037/met0000770

Crowdsourcing multiverse analyses to explore the impact of different data-processing and analysis decisions: A tutorial.

Tom Heyman
, Ekaterina Pronizius
, Savannah C. Lewis
, Oguz A. Acar
, Matúš Adamkovič
, Ettore Ambrosini
, Jan Antfolk
, Krystian Barzykowski
, Ernest Baskin
, Carlota Batres
, Leanne Boucher
, Jordane Boudesseul
, Eduard Brandstätter
, W. Matthew Collins
, Dušica Filipović Ðurđević
, Ciara Egan
, Vanessa Era
, Paulo Ferreira
, Chiara Fini
, Patricia Garrido-Vásquez

Hendrik Godbersen, Pablo Gomez, Aurelien Graton, Necdet Gurkan, Zhiran He, Dave C. Johnson, Pavol Kačmár, Chris Koch, Marta Kowal, Tomas Kratochvil, Marco Marelli, Fernando Marmolejo-Ramos, Martín Martínez, Alan Mattiassi, Nicholas P. Maxwell, Maria Montefinese, Coby Morvinski, Maital Neta, Yngwie A. Nielsen, Sebastian Ocklenburg, Jaš Onič, Marietta Papadatou-Pastou, Adam J. Parker, Mariola Paruzel-Czachura, Yuri G. Pavlov, Manuel Perea, Gerit Pfuhl, Tanja C. Roembke, Jan P. Röer, Timo B. Roettger, Susana Ruiz-Fernandez

Psychology

Research output: Contribution to a Journal (Peer & Non Peer) › Article › peer-review

Original language	English
Journal	Psychological Methods
DOIs	https://doi.org/10.1037/met0000770
Publication status	Published - 18 Sep 2025

Access to Document

10.1037/met0000770

Cite this

Heyman, T., Pronizius, E., Lewis, S. C., Acar, O. A., Adamkovič, M., Ambrosini, E., Antfolk, J., Barzykowski, K., Baskin, E., Batres, C., Boucher, L., Boudesseul, J., Brandstätter, E., Collins, W. M., Ðurđević, D. F., Egan, C., Era, V., Ferreira, P., Fini, C., ... Ruiz-Fernandez, S. (2025). Crowdsourcing multiverse analyses to explore the impact of different data-processing and analysis decisions: A tutorial. Psychological Methods. https://doi.org/10.1037/met0000770

@article{c6ae504ebeb746d5a94db697d81b460f,

title = "Crowdsourcing multiverse analyses to explore the impact of different data-processing and analysis decisions: A tutorial.",

author = "Tom Heyman and Ekaterina Pronizius and Lewis, \{Savannah C.\} and Acar, \{Oguz A.\} and Mat{\'u}{\v s} Adamkovi{\v c} and Ettore Ambrosini and Jan Antfolk and Krystian Barzykowski and Ernest Baskin and Carlota Batres and Leanne Boucher and Jordane Boudesseul and Eduard Brandst{\"a}tter and Collins, \{W. Matthew\} and {\DH}ur{\d}evi{\'c}, \{Du{\v s}ica Filipovi{\'c}\} and Ciara Egan and Vanessa Era and Paulo Ferreira and Chiara Fini and Patricia Garrido-V{\'a}squez and Hendrik Godbersen and Pablo Gomez and Aurelien Graton and Necdet Gurkan and Zhiran He and Johnson, \{Dave C.\} and Pavol Ka{\v c}m{\'a}r and Chris Koch and Marta Kowal and Tomas Kratochvil and Marco Marelli and Fernando Marmolejo-Ramos and Mart{\'i}n Mart{\'i}nez and Alan Mattiassi and Maxwell, \{Nicholas P.\} and Maria Montefinese and Coby Morvinski and Maital Neta and Nielsen, \{Yngwie A.\} and Sebastian Ocklenburg and Ja{\v s} Oni{\v c} and Marietta Papadatou-Pastou and Parker, \{Adam J.\} and Mariola Paruzel-Czachura and Pavlov, \{Yuri G.\} and Manuel Perea and Gerit Pfuhl and Roembke, \{Tanja C.\} and R{\"o}er, \{Jan P.\} and Roettger, \{Timo B.\} and Susana Ruiz-Fernandez",

year = "2025",

month = sep,

day = "18",

doi = "10.1037/met0000770",

language = "English",

journal = "Psychological Methods",

issn = "1939-1463",

publisher = "American Psychological Association",

}

Heyman, T, Pronizius, E, Lewis, SC, Acar, OA, Adamkovič, M, Ambrosini, E, Antfolk, J, Barzykowski, K, Baskin, E, Batres, C, Boucher, L, Boudesseul, J, Brandstätter, E, Collins, WM, Ðurđević, DF, Egan, C, Era, V, Ferreira, P, Fini, C, Garrido-Vásquez, P, Godbersen, H, Gomez, P, Graton, A, Gurkan, N, He, Z, Johnson, DC, Kačmár, P, Koch, C, Kowal, M, Kratochvil, T, Marelli, M, Marmolejo-Ramos, F, Martínez, M, Mattiassi, A, Maxwell, NP, Montefinese, M, Morvinski, C, Neta, M, Nielsen, YA, Ocklenburg, S, Onič, J, Papadatou-Pastou, M, Parker, AJ, Paruzel-Czachura, M, Pavlov, YG, Perea, M, Pfuhl, G, Roembke, TC, Röer, JP, Roettger, TB & Ruiz-Fernandez, S 2025, 'Crowdsourcing multiverse analyses to explore the impact of different data-processing and analysis decisions: A tutorial.', Psychological Methods. https://doi.org/10.1037/met0000770

TY - JOUR

T1 - Crowdsourcing multiverse analyses to explore the impact of different data-processing and analysis decisions: A tutorial.

AU - Heyman, Tom

AU - Pronizius, Ekaterina

AU - Lewis, Savannah C.

AU - Acar, Oguz A.

AU - Adamkovič, Matúš

AU - Ambrosini, Ettore

AU - Antfolk, Jan

AU - Barzykowski, Krystian

AU - Baskin, Ernest

AU - Batres, Carlota

AU - Boucher, Leanne

AU - Boudesseul, Jordane

AU - Brandstätter, Eduard

AU - Collins, W. Matthew

AU - Ðurđević, Dušica Filipović

AU - Egan, Ciara

AU - Era, Vanessa

AU - Ferreira, Paulo

AU - Fini, Chiara

AU - Garrido-Vásquez, Patricia

AU - Godbersen, Hendrik

AU - Gomez, Pablo

AU - Graton, Aurelien

AU - Gurkan, Necdet

AU - He, Zhiran

AU - Johnson, Dave C.

AU - Kačmár, Pavol

AU - Koch, Chris

AU - Kowal, Marta

AU - Kratochvil, Tomas

AU - Marelli, Marco

AU - Marmolejo-Ramos, Fernando

AU - Martínez, Martín

AU - Mattiassi, Alan

AU - Maxwell, Nicholas P.

AU - Montefinese, Maria

AU - Morvinski, Coby

AU - Neta, Maital

AU - Nielsen, Yngwie A.

AU - Ocklenburg, Sebastian

AU - Onič, Jaš

AU - Papadatou-Pastou, Marietta

AU - Parker, Adam J.

AU - Paruzel-Czachura, Mariola

AU - Pavlov, Yuri G.

AU - Perea, Manuel

AU - Pfuhl, Gerit

AU - Roembke, Tanja C.

AU - Röer, Jan P.

AU - Roettger, Timo B.

AU - Ruiz-Fernandez, Susana

PY - 2025/9/18

Y1 - 2025/9/18

UR - http://dx.doi.org/10.1037/met0000770

U2 - 10.1037/met0000770

DO - 10.1037/met0000770

M3 - Article

SN - 1939-1463

JO - Psychological Methods

JF - Psychological Methods

ER -

Crowdsourcing multiverse analyses to explore the impact of different data-processing and analysis decisions: A tutorial.

Access to Document

Other files and links

Cite this