Title
Add prediction-drift alerts on serving output
Context
AstroML is a research-driven Python framework for building dynamic graph machine learning models on the Stellar blockchain (ingestion -> graph -> train). This issue is a contributor-friendly task intended to be picked up by the community. Please ask for clarification in the discussion thread before starting, and reference this issue in your PR.
Task
Detect drift between training label distribution and serving predictions and alert when deviation exceeds thresholds.
Suggested files / areas
astroml/serving, astroml/observability
Acceptance Criteria
Difficulty: Hard
This issue is ideal for a first-time contributor. If you would like to work on it, comment to claim it and maintainers will assign it to you.
Title
Add prediction-drift alerts on serving outputContext
AstroML is a research-driven Python framework for building dynamic graph machine learning models on the Stellar blockchain (ingestion -> graph -> train). This issue is a contributor-friendly task intended to be picked up by the community. Please ask for clarification in the discussion thread before starting, and reference this issue in your PR.
Task
Detect drift between training label distribution and serving predictions and alert when deviation exceeds thresholds.
Suggested files / areas
astroml/serving, astroml/observability
Acceptance Criteria
Difficulty: Hard
This issue is ideal for a first-time contributor. If you would like to work on it, comment to claim it and maintainers will assign it to you.