Skip to content

Add benchmark tests for indexing pipeline#6

Open
KRRT7 wants to merge 2 commits intomainfrom
perf/benchmark-tests
Open

Add benchmark tests for indexing pipeline#6
KRRT7 wants to merge 2 commits intomainfrom
perf/benchmark-tests

Conversation

@KRRT7
Copy link
Copy Markdown
Owner

@KRRT7 KRRT7 commented Apr 10, 2026

Summary

  • Add pytest-async-benchmark as dev dependency (from fork with pedantic mode)
  • Add benchmark tests for add_messages_with_indexing using pedantic mode (setup/teardown excluded from timing)
  • Three benchmarks: VTT ingest (40 msgs), synthetic 50 msgs, synthetic 200 msgs

Context

These benchmarks were used to measure the improvements in #5 (batch SQLite INSERTs). They can also serve as a regression baseline for future indexing pipeline changes.

Test plan

  • Benchmark tests pass: python -m pytest tests/benchmarks/test_benchmark_indexing.py -v -s
  • Existing 69 offline tests unaffected

KRRT7 added 2 commits April 10, 2026 01:57
Install from fork with pedantic mode support for benchmark tests.
pytest-async-benchmark pedantic mode benchmarks for add_messages_with_indexing.
Setup (DB creation, storage init) and teardown (close, delete) are excluded
from timing via async_benchmark.pedantic().

Three benchmarks: VTT ingest (40 msgs), synthetic 50 msgs, synthetic 200 msgs.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant