Skip to content

Integrate with Hugging Face Hub API to index evaluation datasets and metrics #3

Description

@linny006

Currently, LLM Eval Tracker only indexes GitHub repositories. Integrating with the Hugging Face Hub would surface evaluation datasets and metrics that aren't on GitHub, significantly expanding coverage. This requires building a new data source adapter that queries the HF Hub API, maps results to our metadata schema, and deduplicates entries across sources.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requesthelp wantedExtra attention is needed

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions