arXiv / 2019

Reproducibility in Machine Learning for Health

Unknown authors

Computer VisionOptimizationPopular and Landmark PapersProbabilistic MLReinforcement Learning

Machine learning algorithms designed to characterize, monitor, and intervene on human health (ML4H) are expected to perform safely and reliably when operating at scale, potentially outside strict human supervision. This requirement warrants a stricter attention to issues of reproducibility than other fields of machine learning. In this work, we conduct a systematic evaluation of over 100 recently published ML4H research papers along several dimensions related to reproducibility. We find that the field of ML4H compares poorly to more established machine learning fields, particularly concerning data and code accessibility. Finally, drawing from success in other fields of science, we propose recommendations to data providers, academic publishers, and the ML4H research community in order to promote reproducible research moving forward.

0 citations0 influential

Full paper

Read the original paper

Open PDF Source page

Learning resources

arXiv PDFPDF arXiv abstract pagearXiv Google Scholar referencesGoogle Scholar Papers with Code searchPapers with Code YouTube explanationsYouTube

Reading state

Discuss in ChatGPT

Uses your own ChatGPT account. The paper context is copied into a tutor prompt before ChatGPT opens.

Preview prompt

You are my AI/ML research paper instructor. I want to deeply understand the paper below.

First, teach it in layers:
1. One-paragraph intuition.
2. Problem statement and why it mattered.
3. Key method, architecture, or algorithm.
4. Important equations or mechanisms, explained intuitively.
5. Experiments and evidence.
6. Limitations, assumptions, and failure modes.
7. How this paper influenced later AI/ML/Deep Learning/GenAI work.
8. A 30-minute study plan with checkpoints.
9. Quiz me with 5 questions and wait for my answers.

When something is not available in the attached context, say what is missing and infer carefully.

### Paper attached as context
Title: Reproducibility in Machine Learning for Health
Authors: Unknown
Year: 2019
Venue: arXiv
Categories: Computer Vision, Optimization, Popular and Landmark Papers, Probabilistic ML, Reinforcement Learning
Citations: 0
Paper URL: https://arxiv.org/abs/1907.01463v1
Open PDF: https://arxiv.org/pdf/1907.01463v1

Abstract:
Machine learning algorithms designed to characterize, monitor, and intervene on human health (ML4H) are expected to perform safely and reliably when operating at scale, potentially outside strict human supervision. This requirement warrants a stricter attention to issues of reproducibility than other fields of machine learning. In this work, we conduct a systematic evaluation of over 100 recently published ML4H research papers along several dimensions related to reproducibility. We find that the field of ML4H compares poorly to more established machine learning fields, particularly concerning data and code accessibility. Finally, drawing from success in other fields of science, we propose recommendations to data providers, academic publishers, and the ML4H research community in order to promote reproducible research moving forward.

Learning resources:
- PDF: arXiv PDF (https://arxiv.org/pdf/1907.01463v1)
- arXiv: arXiv abstract page (https://arxiv.org/abs/1907.01463v1)
- Google Scholar: Google Scholar references (https://scholar.google.com/scholar?q=Reproducibility%20in%20Machine%20Learning%20for%20Health)
- Papers with Code: Papers with Code search (https://paperswithcode.com/search?q=Reproducibility%20in%20Machine%20Learning%20for%20Health)
- YouTube: YouTube explanations (https://www.youtube.com/results?search_query=Reproducibility%20in%20Machine%20Learning%20for%20Health+paper+explained)