Problem
The JupyterLite docs build currently downloads the full sample dataset (and a few others) just to serve a small handful of files to the browser notebooks. Those files then get bundled into the documentation build, which bloats it.
Streaming directly from OSF at runtime isn't possible: Pyodide runs in a web worker and OSF doesn't send CORS headers, so the fetch fails from the browser.
Proposal
Create a small curated dataset — lite-data — containing only the files the JupyterLite notebooks actually need (a slim subset of sample). Host it on OSF as its own dataset.
Since OSF supports downloading individual files, we could add something like mne.datasets.lite_data that fetches only the required files rather than pulling the whole sample dataset. Any mne.datasets.* calls in the notebooks could then be pointed at lite-data instead of the full dataset.
This would cut down both the download at build time and what gets bundled with the docs.
Relevant code: mne/datasets/_fetch.py (uses pooch) and mne/datasets/utils/.
Context: PR #13925.
cc @teonbrooks
Problem
The JupyterLite docs build currently downloads the full
sampledataset (and a few others) just to serve a small handful of files to the browser notebooks. Those files then get bundled into the documentation build, which bloats it.Streaming directly from OSF at runtime isn't possible: Pyodide runs in a web worker and OSF doesn't send CORS headers, so the fetch fails from the browser.
Proposal
Create a small curated dataset —
lite-data— containing only the files the JupyterLite notebooks actually need (a slim subset ofsample). Host it on OSF as its own dataset.Since OSF supports downloading individual files, we could add something like
mne.datasets.lite_datathat fetches only the required files rather than pulling the wholesampledataset. Anymne.datasets.*calls in the notebooks could then be pointed atlite-datainstead of the full dataset.This would cut down both the download at build time and what gets bundled with the docs.
Relevant code:
mne/datasets/_fetch.py(usespooch) andmne/datasets/utils/.Context: PR #13925.
cc @teonbrooks