arXiv / 2019

ReinBo: Machine Learning pipeline search and configuration with Bayesian Optimization embedded Reinforcement Learning

Xudong Sun, Jiali Lin, Bernd Bischl

Computer VisionPopular and Landmark PapersProbabilistic MLReinforcement Learning

Machine learning pipeline potentially consists of several stages of operations like data preprocessing, feature engineering and machine learning model training. Each operation has a set of hyper-parameters, which can become irrelevant for the pipeline when the operation is not selected. This gives rise to a hierarchical conditional hyper-parameter space. To optimize this mixed continuous and discrete conditional hierarchical hyper-parameter space, we propose an efficient pipeline search and configuration algorithm which combines the power of Reinforcement Learning and Bayesian Optimization. Empirical results show that our method performs favorably compared to state of the art methods like Auto-sklearn , TPOT, Tree Parzen Window, and Random Search.

0 citations0 influential

Full paper

Read the original paper

Open PDF Source page

Learning resources

arXiv PDFPDF arXiv abstract pagearXiv Google Scholar referencesGoogle Scholar Papers with Code searchPapers with Code YouTube explanationsYouTube

Reading state

Discuss in ChatGPT

Uses your own ChatGPT account. The paper context is copied into a tutor prompt before ChatGPT opens.

Preview prompt

You are my AI/ML research paper instructor. I want to deeply understand the paper below.

First, teach it in layers:
1. One-paragraph intuition.
2. Problem statement and why it mattered.
3. Key method, architecture, or algorithm.
4. Important equations or mechanisms, explained intuitively.
5. Experiments and evidence.
6. Limitations, assumptions, and failure modes.
7. How this paper influenced later AI/ML/Deep Learning/GenAI work.
8. A 30-minute study plan with checkpoints.
9. Quiz me with 5 questions and wait for my answers.

When something is not available in the attached context, say what is missing and infer carefully.

### Paper attached as context
Title: ReinBo: Machine Learning pipeline search and configuration with Bayesian Optimization embedded Reinforcement Learning
Authors: Xudong Sun, Jiali Lin, Bernd Bischl
Year: 2019
Venue: arXiv
Categories: Computer Vision, Popular and Landmark Papers, Probabilistic ML, Reinforcement Learning
Citations: 0
Paper URL: https://arxiv.org/abs/1904.05381v1
Open PDF: https://arxiv.org/pdf/1904.05381v1

Abstract:
Machine learning pipeline potentially consists of several stages of operations like data preprocessing, feature engineering and machine learning model training. Each operation has a set of hyper-parameters, which can become irrelevant for the pipeline when the operation is not selected. This gives rise to a hierarchical conditional hyper-parameter space. To optimize this mixed continuous and discrete conditional hierarchical hyper-parameter space, we propose an efficient pipeline search and configuration algorithm which combines the power of Reinforcement Learning and Bayesian Optimization. Empirical results show that our method performs favorably compared to state of the art methods like Auto-sklearn , TPOT, Tree Parzen Window, and Random Search.

Learning resources:
- PDF: arXiv PDF (https://arxiv.org/pdf/1904.05381v1)
- arXiv: arXiv abstract page (https://arxiv.org/abs/1904.05381v1)
- Google Scholar: Google Scholar references (https://scholar.google.com/scholar?q=ReinBo%3A%20Machine%20Learning%20pipeline%20search%20and%20configuration%20with%20Bayesian%20Optimization%20embedded%20Reinforcement%20Learning)
- Papers with Code: Papers with Code search (https://paperswithcode.com/search?q=ReinBo%3A%20Machine%20Learning%20pipeline%20search%20and%20configuration%20with%20Bayesian%20Optimization%20embedded%20Reinforcement%20Learning)
- YouTube: YouTube explanations (https://www.youtube.com/results?search_query=ReinBo%3A%20Machine%20Learning%20pipeline%20search%20and%20configuration%20with%20Bayesian%20Optimization%20embedded%20Reinforcement%20Learning+paper+explained)