Skip to content

Complete the external-tier Table 1 re-measurement after epic #324 #357

Description

@neuromechanist

Finish re-measuring the external-tier rows of the paper's Table 1 under the epic #324 code. These are the single-model log-likelihood gap and component correlation on ds002718 sub-002.

Status

The run started on the CUDA workstation at 09b8247 (the epic head after Phase 12, which has the final fitting code):

  • command: benchmarks/reproduce_table1.py --tier external --threads 16 --device cuda --native-version v0.3.3;
  • protocol: unchanged, 5 seeds at 2000 iterations, Newton off, block_size=512.

Interim per-seed results (pamica on CUDA float64 against the pinned v0.3.3 binary):

Seed Fortran LL pamica LL Mean matched corr Min corr Amari
201 -3.6993 -3.6993 0.9999 0.9996 0.0008
202 -3.6994 -3.6993 0.9987 0.9602 0.0024
203 -3.6993 -3.6993 0.9999 0.9985 0.0012
204 running
205 pending

Before the epic, Table 1 reported an LL within ~0.0005 of -3.6993 and a component correlation of 0.998.

Remaining

Follow-up to #351 (epic #324).

Activity

  1. neuromechanist commented on Sep 24, 2026

    @neuromechanist
    MemberAuthor

    The external tier finished within the epic, so its figures go into #356 directly. Run: 09b8247, CUDA float64 vs v0.3.3 at 16 threads, protocol unchanged; raw record in .context/issue-351/raw/table1_external/.

    • Log-likelihood: Fortran -3.699346 (sd 6.5e-5), pamica -3.699341 (sd 4.1e-5), gap of means 6e-6. Before the epic: within ~0.0005.
    • Component correlation: pamica vs Fortran 0.9996 (min 0.960); Fortran vs Fortran 0.9983 (min 0.917). Before the epic: 0.998.
    • Amari distance: pamica vs Fortran 0.0013; Fortran vs Fortran 0.0025.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentation

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions