IEEE Network / 2024

When In-Network Computing Meets Distributed Machine Learning

Haowen Zhu, Wenchao Jiang, Qi Hong, Zehua Guo

Computer VisionML SystemsPopular and Landmark PapersReinforcement Learning

Emerging In-Network Computing (INC) technique provides a new opportunity to improve application’s performance by using network programmability, computational capability, and storage capacity enabled by programmable switches. One typical application is Distributed Machine Learning (DML), which accelerates machine learning training by employing multiple works to train model parallelly. This paper introduces INC-based DML systems, analyzes performance improvement from using INC, and overviews current studies of INC-based DML systems. We also propose potential research directions for applying INC to DML systems.

15 citations0 influential

Full paper

Read the original paper

Source page

A direct open-access PDF is not available in the database yet. Use the source page or learning resources below to open the complete paper from the publisher or index.

Learning resources

Google Scholar referencesGoogle Scholar Papers with Code searchPapers with Code Semantic Scholar paper pageSemantic Scholar YouTube explanationsYouTube

Reading state

Discuss in ChatGPT

Uses your own ChatGPT account. The paper context is copied into a tutor prompt before ChatGPT opens.

Preview prompt

You are my AI/ML research paper instructor. I want to deeply understand the paper below.

First, teach it in layers:
1. One-paragraph intuition.
2. Problem statement and why it mattered.
3. Key method, architecture, or algorithm.
4. Important equations or mechanisms, explained intuitively.
5. Experiments and evidence.
6. Limitations, assumptions, and failure modes.
7. How this paper influenced later AI/ML/Deep Learning/GenAI work.
8. A 30-minute study plan with checkpoints.
9. Quiz me with 5 questions and wait for my answers.

When something is not available in the attached context, say what is missing and infer carefully.

### Paper attached as context
Title: When In-Network Computing Meets Distributed Machine Learning
Authors: Haowen Zhu, Wenchao Jiang, Qi Hong, Zehua Guo
Year: 2024
Venue: IEEE Network
Categories: Computer Vision, ML Systems, Popular and Landmark Papers, Reinforcement Learning
Citations: 15
Paper URL: https://www.semanticscholar.org/paper/38687b782053e029ce3773fabed85b9fdeea93ca
Open PDF: Not available

Abstract:
Emerging In-Network Computing (INC) technique provides a new opportunity to improve application’s performance by using network programmability, computational capability, and storage capacity enabled by programmable switches. One typical application is Distributed Machine Learning (DML), which accelerates machine learning training by employing multiple works to train model parallelly. This paper introduces INC-based DML systems, analyzes performance improvement from using INC, and overviews current studies of INC-based DML systems. We also propose potential research directions for applying INC to DML systems.

Learning resources:
- Google Scholar: Google Scholar references (https://scholar.google.com/scholar?q=When%20In-Network%20Computing%20Meets%20Distributed%20Machine%20Learning)
- Papers with Code: Papers with Code search (https://paperswithcode.com/search?q=When%20In-Network%20Computing%20Meets%20Distributed%20Machine%20Learning)
- Semantic Scholar: Semantic Scholar paper page (https://www.semanticscholar.org/paper/38687b782053e029ce3773fabed85b9fdeea93ca)
- YouTube: YouTube explanations (https://www.youtube.com/results?search_query=When%20In-Network%20Computing%20Meets%20Distributed%20Machine%20Learning+paper+explained)