Skip to content

Create lite-data dataset for JupyterLite #14041

Description

@natinew77-creator

Problem

The JupyterLite docs build currently downloads the full sample dataset (and a few others) just to serve a small handful of files to the browser notebooks. Those files then get bundled into the documentation build, which bloats it.

Streaming directly from OSF at runtime isn't possible: Pyodide runs in a web worker and OSF doesn't send CORS headers, so the fetch fails from the browser.

Proposal

Create a small curated dataset — lite-data — containing only the files the JupyterLite notebooks actually need (a slim subset of sample). Host it on OSF as its own dataset.

Since OSF supports downloading individual files, we could add something like mne.datasets.lite_data that fetches only the required files rather than pulling the whole sample dataset. Any mne.datasets.* calls in the notebooks could then be pointed at lite-data instead of the full dataset.

This would cut down both the download at build time and what gets bundled with the docs.

Relevant code: mne/datasets/_fetch.py (uses pooch) and mne/datasets/utils/.

Context: PR #13925.

cc @teonbrooks

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions