Skip to content

About

Reproducible Spark-X2.5-1.7B bilingual mathematics evaluation: 96 raw outputs, scoring scripts, and analysis

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

2 Commits

Folders and files

Repository files navigation

Spark-X2.5 bilingual mathematics evaluation

A locally executed, reproducible case study of XHToken/Spark-X2.5-1.7B at revision 448e61eb392c00f2c403185c5b56d5e0665bfaab.

The study has 24 seeded instances, two languages and two thinking modes. There are 22 distinct mathematical questions because some dice instances repeat; duplicates and output truncations are disclosed and retained. The original strict scorer and the explicitly post-hoc formatting analysis remain separate. See the report for limitations and reproduction instructions.

Codex created and ran the experiment and prepared the analysis for the account owner. The owner confirmed personal review of the completed report and authorized publication. No model weights are included.

Prepared for HER Hack-Astron #6. This repository hosts supporting artifacts; contest entry additionally requires a Discussion on the official model's Hugging Face page and a link from the event issue. No entry, award or payment is implied by publication of this repository.

About

Reproducible Spark-X2.5-1.7B bilingual mathematics evaluation: 96 raw outputs, scoring scripts, and analysis

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages