Skip to content

Comments

Add SDO real-time data fetcher tool#45

Open
ep150de wants to merge 2 commits intoNASA-IMPACT:mainfrom
ep150de:add-sdo-data-fetcher
Open

Add SDO real-time data fetcher tool#45
ep150de wants to merge 2 commits intoNASA-IMPACT:mainfrom
ep150de:add-sdo-data-fetcher

Conversation

@ep150de
Copy link

@ep150de ep150de commented Feb 10, 2026

Adds a new tools/ directory with SDO data acquisition utility for fetching real-time Solar Dynamics Observatory observations.

Features:

  • Fetch latest SDO/AIA and HMI observations (updated every 12 seconds)
  • Support for all 8 AIA channels and HMI instruments used in Surya
  • Command-line interface and Python API
  • Advanced monitoring and batch download capabilities
  • Designed to complement Surya's preprocessed HuggingFace datasets

Use Cases:

  • Real-time solar activity monitoring with current observations
  • Custom inference on latest SDO data
  • Fine-tuning dataset creation from recent events
  • Quick data exploration without downloading full datasets
  • Educational purposes and research prototyping

This tool bridges the gap between Surya's historical training data (2011-2019) and current solar observations, enabling researchers to apply the model to real-time space weather monitoring and recent solar events.

Files added:

  • tools/sdo_data_fetcher/sdo_fetcher_v2.py (main fetcher)
  • tools/sdo_data_fetcher/sdo_advanced_examples.py (advanced features)
  • tools/sdo_data_fetcher/requirements.txt (dependencies: requests)
  • tools/sdo_data_fetcher/README.md (documentation)
  • tools/README.md (tools directory overview)

Adds a new tools/ directory with SDO data acquisition utility for fetching
real-time Solar Dynamics Observatory observations.

Features:
- Fetch latest SDO/AIA and HMI observations (updated every 12 seconds)
- Support for all 8 AIA channels and HMI instruments used in Surya
- Command-line interface and Python API
- Advanced monitoring and batch download capabilities
- Designed to complement Surya's preprocessed HuggingFace datasets

Use Cases:
- Real-time solar activity monitoring with current observations
- Custom inference on latest SDO data
- Fine-tuning dataset creation from recent events
- Quick data exploration without downloading full datasets
- Educational purposes and research prototyping

This tool bridges the gap between Surya's historical training data (2011-2019)
and current solar observations, enabling researchers to apply the model to
real-time space weather monitoring and recent solar events.

Files added:
- tools/sdo_data_fetcher/sdo_fetcher_v2.py (main fetcher)
- tools/sdo_data_fetcher/sdo_advanced_examples.py (advanced features)
- tools/sdo_data_fetcher/requirements.txt (dependencies: requests)
- tools/sdo_data_fetcher/README.md (documentation)
- tools/README.md (tools directory overview)
Fixed UnicodeEncodeError when creating monitoring_daemon.py on Windows.
The file now opens with UTF-8 encoding to properly handle Unicode characters.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant