Custom dataloader#162

Draft

voegtlel wants to merge 39 commits into

feature/custom_dataloader

Commits on Jul 4, 2025

WIP: Custom dataloader
voegtlel
committed

Commits on Jul 8, 2025

WIP: Custom dataloader
voegtlel
committed

Commits on Jul 9, 2025

Commits on Jul 10, 2025

Commits on Jul 21, 2025

Merge remote-tracking branch 'origin/develop' into feature/custom_dataloader
voegtlel
committed

Commits on Jul 24, 2025

Commits on Jul 30, 2025

WIP: Thread-local state
voegtlel
committed

Commits on Aug 12, 2025

WIP: Fix thread local state
voegtlel
committed

Commits on Aug 15, 2025

Fix several minor issues,
voegtlel
committed

Commits on Aug 19, 2025

Commits on Aug 20, 2025

Fix small issues with threaded worker and thread-local states
voegtlel
committed

Commits on Aug 22, 2025

Publish dataloader.start
voegtlel
committed

Commits on Aug 25, 2025

Clean up rng
voegtlel
committed

Commits on Aug 28, 2025

Fix rng assignment
philipp-fischer
committed

Commits on Aug 29, 2025

Remove THREAD_SAFE
philipp-fischer
committed

Commits on Sep 1, 2025

Commits on Sep 2, 2025

Commits on Sep 4, 2025

Change all tests to pytest. Cleanup a few unused functions. Implement multiple shutdown/close functionalities, especially worker_init/_close
voegtlel
committed

Commits on Dec 9, 2025