Skip to content

Fix realistic answer parsing for text answers - #11

Open
Artemis-ignis wants to merge 1 commit into
Infini-AI-Lab:mainfrom
Artemis-ignis:fix-realistic-answer-parser
Open

Fix realistic answer parsing for text answers#11
Artemis-ignis wants to merge 1 commit into
Infini-AI-Lab:mainfrom
Artemis-ignis:fix-realistic-answer-parser

Conversation

@Artemis-ignis

Copy link
Copy Markdown

Summary

  • Fix criteriaoutput in the realistic evaluator so \text{answer: } parsing reads the current reply instead of always indexing generatedtext[0].
  • Add a bounds check while scanning answer digits so answers at the end of a reply do not raise IndexError.
  • Add focused regression coverage for multi-reply parsing and end-of-reply answers.

Verification

  • python -m unittest discover -s tests -v
  • python -m compileall -q gsm-infinite tests

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant