#statstab #315 What fraction of repeat experiments will have an effect size within the 95% confidence interval of the first experiment?
Thoughts: CV is a great place to learn. We see the same answer as Cumming: 83%
#replicability #confidenceintervals #replication #metascience #estimation #research #science
#statstab #313 Analyzing Replication Studies
Thoughts: Replications and RR are on the rise, but not all are conducted appropriately, and become meaningless.
#stats #replication #metascience #openscience #metaresearch #metaanalysis
https://lakens.github.io/statistical_inferences/17-replication.html#analyzing-replication-studies.
"From Hypothesis to Publication: A Comprehensive Survey of AI-Driven
Research Support Systems"
The table shown below from this paper
that shows AI tools for research paper assistance is the most informative one of this type that I have seen in looking at many, many AI and ML research papers.
https://arxiv.org/abs/2503.01424
The authors of this paper have a wonderful bibliography on this topic at the Github repo:
https://github.com/zkzhou126/AI-for-Research
New in our #digital #collection:
Science of science : understanding the foundations and limits of science from an interdisciplinary perspective
https://doi.org/10.1093/9780198937401.001.0001
'Science of Science' provides an integrated framework for the #science of science as an emerging field, and a comprehensive understanding of the foundations and limits of science.
List of grant winners from first UKRI Metascience call
(published 13 feb, but I missed it)
Congratulations all
MEETING
2025 Science of Science Funding https://www.nber.org/conferences/si-2025-science-science-funding
Cambridge, MA. 17-18 July 2025; paper deadline March 20th
#TIL about The Unjournal and it checks sooo many boxes! https://unjournal.pubpub.org/
If you're interested in #metascience and understanding the implications of #AI for the #science and #research ecosystem, this looks like a great postdoctoral opportunity: https://sloan.org/programs/digital-technology/aipostdoc-rfp
UKRI Metascience AI early career fellowships
https://www.ukri.org/opportunity/ukri-metascience-ai-early-career-fellowships/
Call Open today, closes 10 April 2025 4:00pm UK time
If you have the AI/ML skills and want to bolster the scale and impact of your research by plugging into the most exciting metascience team in the world, please get in touch with @RoRInstitute about us supporting your fellowship application
@renebekkers I'd only recently heard of the Resque framework by @nicebread (thanks to @alexh for introducing me to it!). Thanks for sharing about this conference and the very relevant resources for #metascience!
#statstab #276 Experiment Design Checklist
by @tomstafford
Thoughts: Useful list for PhD students and ECRs to check they have most things covered.
#metascience #integrity #guide #research #resources #experiments
What could #metascience learn from #criminology for the prevention of #researchmisconduct and #researchintegrity violations? In a seminar at the Netherlands Institute for the Study of Crime and Law Enforcement (NSCR), I discussed with researchers in criminology how theories and findings from the field may be applied in the field of meta research.
Blog: https://renebekkers.wordpress.com/2025/01/24/how-can-criminology-help-reduce-research-integrity-violations/
Slides: https://renebekkers.wordpress.com/wp-content/uploads/2025/01/how-can-criminology-help-reduce-research-integrity-violations.pptx
#peerreview
Lots of new sign-ups to the METASERV email list recently. Don't know where everyone came from, but welcome. Stay tuned for #metascience announcements and discussion
I'm hiring multiple PhDs and postdocs to join our lab for a project titled CHEETAH: CHallenges of Evaluating Teams and Algorithms. https://candidate.hr-manager.net/ApplicationInit.aspx?cid=119&ProjectId=181763&DepartmentId=3439&MediaId=5
· Multimodal health data
· Data quality, evaluation metrics
· ML competitions
· Diversity and inclusion in ML education
Please reach out (via email) if you have questions + forward to others!
#MedicalImaging #MetaScience #AcademicChatter #phdPosition
More about our lab here: https://purrlab.github.io/
Pre-announcement: UKRI Metascience AI early career fellowships
https://www.ukri.org/opportunity/ukri-metascience-ai-early-career-fellowships/
"The UK Metascience Unit will fund a cohort of early career fellows to build our understanding of:
- how the growing adoption of AI is changing the research landscape, including what metascientific, ethical, epistemic, and socioeconomic questions this raises
- how governments, industry, and funding organisations should respond"
Closes 10 April,
How much of researchers' grant-funded research time is spent on bureaucracy rather than the research?
In 2018, it was 44.3% (in the U.S.).
Source: https://thefdp.org/demonstrations-resources/faculty-workload-survey/
- reports & slide decks
- data from 2005, 2012, 2018
#Psychology publication "transparency increased moderately from 2017 to 2022 [but] continues to be widely neglected" (N = 400 peer-reviewed articles).
#OpenAccess paper: https://doi.org/10.1177/25152459241283477
Researchers planning to do #SystematicReviews must now plan to filter out the #JunkScience. That's difficult, time-consuming, error-prone, and demoralizing. It causes some researchers to drop their plans and forces others to move more slowly.
https://www.science.org/content/article/systematic-reviews-aim-extract-broad-conclusions-many-studies-are-peril
(#paywalled)
#Academia #LiteratureReviews #MetaResearch #MetaScience #ScholComm
@academicchatter
looking at https://metascience.info/call-for-proposals I doubt I'd go for the in-person event but considering a proposal for the virtual symposium. Looking at their theme on alliances. hmu if you're interested in collaborating