|
| 1 | +# Annotate Those Steps -- how to curate analysis-ready MoBI datasets |
| 2 | + |
| 3 | +A talk on the Mobile Brain/Body Imaging (MoBI) annotation gap and how the HEDit + Annotation Garden Initiative closes it. Case study: Peterson and Ferris (2018) perturbed beam-walking dataset (ds003739). |
| 4 | + |
| 5 | +## Interactive Slides |
| 6 | + |
| 7 | +<div class="embed-container"> |
| 8 | + <iframe |
| 9 | + src="./annotate-those-steps/presentation.html?presentation=./annotate-those-steps.json" |
| 10 | + title="Annotate Those Steps -- HEDit for MoBI" |
| 11 | + frameborder="0" |
| 12 | + allowfullscreen> |
| 13 | + </iframe> |
| 14 | +</div> |
| 15 | + |
| 16 | +<p class="slide-hint">Use arrow keys to navigate. Press <kbd>F</kbd> for fullscreen, <kbd>S</kbd> for presenter view, <kbd>?</kbd> for shortcuts.</p> |
| 17 | + |
| 18 | +<style> |
| 19 | +.embed-container { |
| 20 | + position: relative; |
| 21 | + padding-bottom: 56.25%; /* 16:9 */ |
| 22 | + height: 0; |
| 23 | + overflow: hidden; |
| 24 | + border: 1px solid var(--md-default-fg-color--lightest); |
| 25 | + border-radius: 8px; |
| 26 | + margin-bottom: 1.5rem; |
| 27 | +} |
| 28 | +.embed-container iframe { |
| 29 | + position: absolute; |
| 30 | + top: 0; |
| 31 | + left: 0; |
| 32 | + width: 100%; |
| 33 | + height: 100%; |
| 34 | + border-radius: 8px; |
| 35 | +} |
| 36 | +.slide-hint { |
| 37 | + margin: -0.5rem 0 1.5rem 0; |
| 38 | + font-size: 0.75rem; |
| 39 | + color: var(--md-default-fg-color--lighter); |
| 40 | +} |
| 41 | +.slide-hint kbd { |
| 42 | + font-size: 0.7rem; |
| 43 | + padding: 0.1rem 0.3rem; |
| 44 | + border: 1px solid var(--md-default-fg-color--lightest); |
| 45 | + border-radius: 3px; |
| 46 | + background: var(--md-code-bg-color); |
| 47 | +} |
| 48 | +</style> |
| 49 | + |
| 50 | +## Abstract |
| 51 | + |
| 52 | +Mobile Brain/Body Imaging (MoBI) experiments capture rich synchronized streams: high-density EEG, motion capture, electromyography, force, and virtual reality. The annotations that reach re-users are typically a handful of string labels. Peterson and Ferris (2018) shared one of the cleanest MoBI datasets on NEMAR (ds003739) and even there, the events.tsv carries no pull force, no rotation angle, no gait phase, and no balance-loss flag. That gap is a format and culture problem, not a data limitation; the motion-capture markers, load-cell traces, and condition metadata are already on the lab's disk. |
| 53 | + |
| 54 | +This talk frames that asymmetry as the central MoBI annotation problem. The Hierarchical Event Descriptors (HED) sidecar pattern carries column-level semantics in events.json without touching the timeseries, but hand-tagging stalls in practice. HEDit, a multi-agent LangGraph pipeline, converts plain-English event descriptions into validated HED tags. The Annotation Garden Initiative wraps that engine and a future GUI (hedify) into a community-curated commons. The case study walks through what ds003739 shares today, what is missing, and what a HEDit-enriched sidecar restores for downstream analysis. |
| 55 | + |
| 56 | +## Talk outline |
| 57 | + |
| 58 | +- **Why MoBI annotation is hard** -- rich raw data, thin shared annotations |
| 59 | +- **Case study: ds003739** -- beam walking with mediolateral pull and visual rotation perturbations |
| 60 | +- **Three gaps** -- gait phases and balance loss; pull force and rotation parameters; trial context |
| 61 | +- **The fix in principle** -- HED sidecars |
| 62 | +- **Why hand-tagging stalls** -- schema size, JSON complexity, cryptic validation |
| 63 | +- **HEDit today (v0.6)** -- natural-language to HED via Parser, Tagger, Validator agents |
| 64 | +- **Demo** -- before/after on the ds003739 sidecar |
| 65 | +- **Roadmap** -- hedify GUI (planned), Annotation Garden ecosystem |
| 66 | + |
| 67 | +## Links |
| 68 | + |
| 69 | +- **Project repository**: [github.com/Annotation-Garden/hedit](https://github.com/Annotation-Garden/hedit) |
| 70 | +- **API endpoint** (planned): `api.annotation.garden/hedit` |
| 71 | +- **Annotation Garden Initiative**: [annotation.garden](https://annotation.garden) |
| 72 | +- **HED schemas and validator**: [hedtags.org](https://hedtags.org) |
| 73 | +- **Dataset**: [ds003739 on NEMAR](https://nemar.org/dataexplorer/detail?dataset_id=ds003739) / [OpenNeuro](https://openneuro.org/datasets/ds003739) |
| 74 | +- **Reference paper**: Peterson SM and Ferris DP (2018). *Differentiation in theta and beta electrocortical activity between visual and physical perturbations to walking and standing balance.* eNeuro. [doi:10.1523/ENEURO.0207-18.2018](https://doi.org/10.1523/ENEURO.0207-18.2018) |
| 75 | + |
| 76 | +## Acknowledgements |
| 77 | + |
| 78 | +Steven Peterson and Daniel Ferris for the open dataset; the HED working group and EEGLAB team; the Swartz Center for Computational Neuroscience; and the Annotation Garden Initiative contributors. |
| 79 | + |
| 80 | +--- |
| 81 | + |
| 82 | +<small>Interactive slides built with [Agentic Presentation Builder](https://github.com/casual-vibers/agent-presentation), a JSON-to-Reveal.js presentation tool.</small> |
0 commit comments