arXiv / 2020

Evaluating Information Retrieval Systems for Kids

Ashlee Milton, Maria Soledad Pera

Information RetrievalLarge Language ModelsML Systems

Evaluation of information retrieval systems (IRS) is a prominent topic among information retrieval researchers--mainly directed at a general population. Children require unique IRS and by extension different ways to evaluate these systems, but as a large population that use IRS have largely been ignored on the evaluation front. In this position paper, we explore many perspectives that must be considered when evaluating IRS; we specially discuss problems faced by researchers who work with children IRS, including lack of evaluation frameworks, limitations of data, and lack of user judgment understanding.

0 citations0 influential

Full paper

Read the original paper

Open PDF Source page

Learning resources

arXiv PDFPDF arXiv abstract pagearXiv Google Scholar referencesGoogle Scholar Papers with Code searchPapers with Code YouTube explanationsYouTube

Reading state

Discuss in ChatGPT

Uses your own ChatGPT account. The paper context is copied into a tutor prompt before ChatGPT opens.

Preview prompt

You are my AI/ML research paper instructor. I want to deeply understand the paper below.

First, teach it in layers:
1. One-paragraph intuition.
2. Problem statement and why it mattered.
3. Key method, architecture, or algorithm.
4. Important equations or mechanisms, explained intuitively.
5. Experiments and evidence.
6. Limitations, assumptions, and failure modes.
7. How this paper influenced later AI/ML/Deep Learning/GenAI work.
8. A 30-minute study plan with checkpoints.
9. Quiz me with 5 questions and wait for my answers.

When something is not available in the attached context, say what is missing and infer carefully.

### Paper attached as context
Title: Evaluating Information Retrieval Systems for Kids
Authors: Ashlee Milton, Maria Soledad Pera
Year: 2020
Venue: arXiv
Categories: Information Retrieval, Large Language Models, ML Systems
Citations: 0
Paper URL: https://arxiv.org/abs/2005.12992v1
Open PDF: https://arxiv.org/pdf/2005.12992v1

Abstract:
Evaluation of information retrieval systems (IRS) is a prominent topic among information retrieval researchers--mainly directed at a general population. Children require unique IRS and by extension different ways to evaluate these systems, but as a large population that use IRS have largely been ignored on the evaluation front. In this position paper, we explore many perspectives that must be considered when evaluating IRS; we specially discuss problems faced by researchers who work with children IRS, including lack of evaluation frameworks, limitations of data, and lack of user judgment understanding.

Learning resources:
- PDF: arXiv PDF (https://arxiv.org/pdf/2005.12992v1)
- arXiv: arXiv abstract page (https://arxiv.org/abs/2005.12992v1)
- Google Scholar: Google Scholar references (https://scholar.google.com/scholar?q=Evaluating%20Information%20Retrieval%20Systems%20for%20Kids)
- Papers with Code: Papers with Code search (https://paperswithcode.com/search?q=Evaluating%20Information%20Retrieval%20Systems%20for%20Kids)
- YouTube: YouTube explanations (https://www.youtube.com/results?search_query=Evaluating%20Information%20Retrieval%20Systems%20for%20Kids+paper+explained)