Repository navigation
bench: NG vs Fortran runtime harness (#59) - #62
Merged
neuromechanist merged 1 commit intoJul 7, 2026
Merged
Conversation
Times AMICATorchNG vs the amica15mac binary on real sample EEG with a matched config, over an iteration x thread-count grid. Derives total wall-clock and a fixed-overhead-free marginal per-iteration slope, prints an environment banner (flags Rosetta emulation of the x86_64 binary on arm64), and writes JSON + a markdown report. Results dir gitignored. Refs #59.
5 tasks
5 tasks
neuromechanist
deleted the
59-benchmark-amicatorchng-runtime-vs-fortran-binary
branch
July 7, 2026 15:47
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Part of #59. Adds
benchmarks/benchmark_runtime.py, a repeatable runtime benchmark forAMICATorchNGvs the Fortran binary on the real sample EEG.What it does
sample_params.json/input.param, so both backends do equivalent work (verified by near-identical final LL).amica15macis x86_64 and runs under Rosetta 2 on arm64, so local ratios flatter NG.Measured result (this host: M4 Pro, Fortran emulated)
NG misses the 2-3x criterion on the CPU float64 parity path: ~3.2x single-thread, ~7.3x at 8 threads because NG barely parallelizes on CPU (219->204 ms/it) while Fortran's OpenMP scales ~2.4x. Full numbers + profile posted to #59; hot-spot follow-up filed separately.
Docs-adjacent tooling; no library code touched.