Veganism Social

0 posts0 participants0 posts today

Jesus Castagnetto 🇵🇪"Estimating the <a href="https://mastodon.social/tags/replicability" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#replicability</a> of Brazilian <a href="https://mastodon.social/tags/biomedical" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#biomedical</a> <a href="https://mastodon.social/tags/science" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#science</a>"... Replication rates for these experiments varied between 15 and 45% according to five predefined criteria ...<a href="https://mastodon.social/tags/Brazil" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Brazil</a><a href="https://www.biorxiv.org/content/10.1101/2025.04.02.645026v2" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.biorxiv.org/content/10.1101/2025.04.02.645026v2</a>

Dr Mircea Zloteanu 🌼🐝<a href="https://mastodon.social/tags/statstab" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#statstab</a> #315 What fraction of repeat experiments will have an effect size within the 95% confidence interval of the first experiment?Thoughts: CV is a great place to learn. We see the same answer as Cumming: 83%<a href="https://mastodon.social/tags/replicability" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#replicability</a> <a href="https://mastodon.social/tags/confidenceintervals" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#confidenceintervals</a> <a href="https://mastodon.social/tags/replication" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#replication</a> <a href="https://mastodon.social/tags/metascience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#metascience</a> <a href="https://mastodon.social/tags/estimation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#estimation</a> <a href="https://mastodon.social/tags/research" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#research</a> <a href="https://mastodon.social/tags/science" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#science</a><a href="https://stats.stackexchange.com/questions/218602/what-fraction-of-repeat-experiments-will-have-an-effect-size-within-the-95-conf" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://stats.stackexchange.com/questions/218602/what-fraction-of-repeat-experiments-will-have-an-effect-size-within-the-95-conf</a>

Dutch Reproducibility NetworkThe University for <a href="https://mastodon.social/tags/HumanisticStudies" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#HumanisticStudies</a>/ UvH joins the NLRN as an institutional member! At the NLRN, we want to make a range of epistemic voices heard in the discussion around <a href="https://mastodon.social/tags/reproducibility" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#reproducibility</a> and <a href="https://mastodon.social/tags/replicability" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#replicability</a> of <a href="https://mastodon.social/tags/science" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#science</a> and <a href="https://mastodon.social/tags/scholarship" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scholarship</a>. With their research portofolio focusing on <a href="https://mastodon.social/tags/worldviews" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#worldviews</a> and humane societies, the UvH complements the voices of the other, more technical and generalistic institutions TU Delft, TU/e, RUG and escience Center. Foto: Gaelle Marcel for Unsplash

petersuberComparing the predicted <a href="https://fediscience.org/tags/replicability" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#replicability</a> of a study with its actual replicability. <a href="https://www.nature.com/articles/s41562-024-01961-1" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.nature.com/articles/s41562-024-01961-1</a>"Both beginners and more-experienced participants…have some ability to make better-than-chance predictions about the reliability of ‘fast science’ under conditions of high uncertainty." For more along these lines, esp <a href="https://fediscience.org/tags/PredictionMarkets" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PredictionMarkets</a> for <a href="https://fediscience.org/tags/replication" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#replication</a>, see the Twitter thread I started in 2020, which I plan to continue here in Mastodon. Watch this space. <a href="https://x.com/petersuber/status/1259521012196167681" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://x.com/petersuber/status/1259521012196167681</a><a href="https://fediscience.org/tags/Predictions" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Predictions</a> <a href="https://fediscience.org/tags/Preprints" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Preprints</a> <a href="https://fediscience.org/tags/Reproducibility" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Reproducibility</a>

Elen Le Foll 🇫🇷 🇬🇧 🇩🇪"ReprodubiliTea in the HumaniTeas" starts again next Monday! Check out the full winter 24/25 programme here: <a href="https://ub.uni-koeln.de/kurse-beratung/reproducibilitea-in-the-humaniteas" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://ub.uni-koeln.de/kurse-beratung/reproducibilitea-in-the-humaniteas</a>.Our <a href="https://fediscience.org/tags/ReprodubiliTea" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ReprodubiliTea</a> in the HumaniTeas sessions are informal meetings for <a href="https://fediscience.org/tags/humanities" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#humanities</a> scholars of all career stages to learn about and discuss <a href="https://fediscience.org/tags/OpenScience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OpenScience</a> practices, the (lack of) <a href="https://fediscience.org/tags/replicability" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#replicability</a> and <a href="https://fediscience.org/tags/reproducibility" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#reproducibility</a> of published studies, research ethics, and generally how to improve research practices. Join our mailing list: <a href="https://lists.uni-koeln.de/mailman/listinfo/reproducibilitea-humaniteas" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://lists.uni-koeln.de/mailman/listinfo/reproducibilitea-humaniteas</a><a href="https://fediscience.org/tags/Academia" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Academia</a>

Matt HodgkinsonResearch integrity irony:"A high-profile paper about ways to improve the rigor of research papers has been retracted after critics attacked its own rigor." 🤦<a href="https://www.science.org/content/article/we-are-embarrassed-scientific-rigor-proponents-retract-paper-benefits-scientific-rigor" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.science.org/content/article/we-are-embarrassed-scientific-rigor-proponents-retract-paper-benefits-scientific-rigor</a><a href="https://scicomm.xyz/tags/PreRegistration" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PreRegistration</a> <a href="https://scicomm.xyz/tags/ResearchIntegrity" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ResearchIntegrity</a> <a href="https://scicomm.xyz/tags/PublicationEthics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PublicationEthics</a> <a href="https://scicomm.xyz/tags/Retractions" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Retractions</a> <a href="https://scicomm.xyz/tags/Reproducibility" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Reproducibility</a> <a href="https://scicomm.xyz/tags/Replicability" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Replicability</a> <a href="https://scicomm.xyz/tags/RIirony" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#RIirony</a>

Nick Byrd, Ph.D.Will a religious <a href="https://nerdculture.de/tags/mindfulness" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#mindfulness</a> practice improve <a href="https://nerdculture.de/tags/wellbeing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#wellbeing</a>?Among more than 700 self-identifying <a href="https://nerdculture.de/tags/Christians" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Christians</a>, "we found no differences on well-being between a religiously framed <a href="https://nerdculture.de/tags/meditation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#meditation</a> practice (experimental condition), a nonreligious framed meditation practice (active control), or a condition that asked participants to notice their daily life (passive control)."<a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11218060/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11218060/</a><a href="https://nerdculture.de/tags/religion" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#religion</a> <a href="https://nerdculture.de/tags/cogSci" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#cogSci</a> <a href="https://nerdculture.de/tags/psychology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#psychology</a> <a href="https://nerdculture.de/tags/psychiatry" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#psychiatry</a> <a href="https://nerdculture.de/tags/replicability" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#replicability</a> <a href="https://nerdculture.de/tags/philosophyOfReligion" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#philosophyOfReligion</a> <a href="https://nerdculture.de/tags/xPhi" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#xPhi</a>

Joel SnyderI’m part of the <a href="https://neuromatch.social/tags/EEGManyLabs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#EEGManyLabs</a> project testing the <a href="https://neuromatch.social/tags/replicability" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#replicability</a> of influential <a href="https://neuromatch.social/tags/EEG" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#EEG</a> studies. We are using <a href="https://neuromatch.social/tags/PredictionMarkets" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PredictionMarkets</a> as a tool in this effort and you are invited to take part, especially if you have some expertise in EEG research, no matter how little. See below for details.You may well know about the success of “prediction markets” in forecasting the likelihood of replication (e.g., Dreber et al., PNAS 2015). We are delighted to announce that we have partnered with economists who led these seminal studies to test the wisdom of the EEG community.From today (as we near the end of recruitment for this project - please see last calls below), we are opening a survey to ask you to vote on the likelihood of some hypotheses studied in the <a href="https://neuromatch.social/tags/EEGManyLabs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#EEGManyLabs</a> project. Subsequently, you will be invited to bet on the likelihood of success through a stock market platform, where you will earn real money for you or a selected charity. The success of this effort will become clear when we complete the full project in a few years time. But the results will immediately tell us about the degree of optimism/pessimism amongst our community. So, please share this widely and place your bets now...How can I sign up for the prediction markets? Registrations to participate in the prediction markets are administered via the sign-up form linked below. You must have experience of working with EEG (for example, through collecting and/or analysing EEG data, which may be evidenced by having published peer-reviewed articles or preprints with EEG or equivalent experience e.g. designing, collecting and analysing data from EEG experiments). <a href="https://neuromatch.social/tags/neuroscience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#neuroscience</a> <a href="https://neuromatch.social/tags/psychology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#psychology</a> <a href="https://neuromatch.social/tags/replication" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#replication</a> <a href="https://neuromatch.social/tags/replicationcrisis" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#replicationcrisis</a> <a href="https://neuromatch.social/tags/reproducibility" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#reproducibility</a> <a href="https://neuromatch.social/tags/metascience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#metascience</a><a href="https://pavlovug-dot-yamm-track.appspot.com/2fDq4NW3JydtlOhg09G1yGVAVSU8W-Whs6kPML9_ZfizxufZcjwEmQPWP5AnyD8NUrSZsBDvk7fYcappAg1Sgo3_tXQFMEu2Cc91Q_7ZoUrnvmZiS20DZiHsSFcGXN3Cpu_h990jl35DhtizskaAYiFIXKDiVMD0arROUO4-wXStjr4hF_n39GH14z3uQM6NK9ioOU86MruRx" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://pavlovug-dot-yamm-track.appspot.com/2fDq4NW3JydtlOhg09G1yGVAVSU8W-Whs6kPML9_ZfizxufZcjwEmQPWP5AnyD8NUrSZsBDvk7fYcappAg1Sgo3_tXQFMEu2Cc91Q_7ZoUrnvmZiS20DZiHsSFcGXN3Cpu_h990jl35DhtizskaAYiFIXKDiVMD0arROUO4-wXStjr4hF_n39GH14z3uQM6NK9ioOU86MruRx</a>

Felix Schönbrodt*CALL FOR SUBMISSIONS* Interested in <a href="https://scicomm.xyz/tags/metaScience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#metaScience</a>, <a href="https://scicomm.xyz/tags/replicability" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#replicability</a>, robustness issues, ... in the beh/soc/cog sciences? Then attend/present your work at META-REP 2024 in Munich (Oct 28-31): <a href="https://www.conference2024.meta-rep.uni-muenchen.de/index.html" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.conference2024.meta-rep.uni-muenchen.de/index.html</a>Submission deadline April 30.<a href="https://scicomm.xyz/tags/metaRep" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#metaRep</a> <a href="https://scicomm.xyz/tags/MetaResearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MetaResearch</a>

AnthonyThis may be an unpopular or outmoded opinion, but I am frequently against sharing source code in empirical computer science research. I believe we should communicate our work largely in natural language and mathematics, and I believe anyone interested in replicating our observations should implement the ideas we've expressed on their own. I think we severely degrade what replication tells us otherwise; I also think we narrow the scope of what we're able to discover. Why? Because I view source code as analogous to a chemist's lab equipment. I put my computational gear together in a certain way, run my experiments with it, record my results, and report it all in natural language, math, and possibly pseudocode if it's warranted. By analogy, a chemist sets up their gear, lab, reagents and whatnot in their particular way, runs their experiments with all that, and reports their results. If another chemist wants to try replicating these results, they do not ask the 1st chemist to ship over their lab gear and reagents (at least, I hope they don't). Rather, they set up their own lab in their own way, make or obtain their own reagents, and then replicate the procedure the 1st chemist shared. If they observe something similar it's evidence that the 1st chemist's ideas are sound; if they observe something different, that might be an interesting discovery! I think we should strive for this in computer science as well. If I give you my source code and you run it, then all you're really testing is whether or not I baked an assumption about my execution environment into my experiment. That's boring! At this point we can minimize the risk of that with technologies like <code>nix</code>, virtual machines or containers and CI/CD pipelines. If instead you implement what I wrote in my report yourself and run it, then you're testing the ideas I'm expressing. That's exciting! If just from an idea you can implement code that does something that I did with code I separately implemented from the same idea, we've discovered something! I think sharing source code tends to optimize for reproducible execution environments and much less for solid concepts. I also think sharing source code makes imitation far too easy, which limits the possibility of genuine discovery. Don't even get me started on what using <a href="https://buc.ci?t=gpt" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#GPT</a> or <a href="https://buc.ci?t=copilot" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Copilot</a> does. I'm interested in hearing others' thoughts on this, though. I'm clearly oversimplifying, but also there's plenty of room for other ways of looking at it and I'm curious how others think about it. <a href="https://buc.ci?t=science" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#science</a> <a href="https://buc.ci?t=replicability" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#replicability</a> <a href="https://buc.ci?t=computerscience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#computerscience</a>

Recent searches

Search options

Administered by:

Server stats:

#replicability