PERF: Use SIMD for read_csv C tokenizer#64515

Open

jbrockmendel wants to merge 15 commits into

pandas-dev:mainfrom

jbrockmendel:perf-read_csv-simd

Commits on May 8, 2026

build: remove simd option
Alvaro-Kothe
committed

Commits on May 12, 2026

PERF: Use SIMD for read_csv C tokenizer

jbrockmendel
and
claude
committed
BLD: Fix MSVC build for SIMD tokenizer by replacing __builtin_ctz

jbrockmendel
and
claude
committed
CLN: Address review comments on SIMD tokenizer

jbrockmendel
and
claude
committed
BLD: Fix -Werror build failure from tautological char < 256 comparison

jbrockmendel
and
claude
committed
CLN: Address review comments on SIMD tokenizer

jbrockmendel
and
claude
committed
BLD: Fix MSVC build for SIMD tokenizer on Windows ARM64 by replacing __builtin_ctzll

jbrockmendel
and
claude
committed
REF: Use xsimd library for read_csv SIMD tokenizer

jbrockmendel
and
claude
committed
BLD: Link simd_scan into tslibs/parsing extension

jbrockmendel
and
claude
committed