Skip to content

[WIP] Add DB compression #2578

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
tylerkaraszewski wants to merge 16 commits into
base: main
Choose a base branch
from
Draft

[WIP] Add DB compression #2578

Changes from 1 commit
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
35dac5f
Link zstd library for DB compression support
tylerkaraszewski Apr 14, 2026
8e59579
Install libzstd-dev in CI and Docker build environments
tylerkaraszewski Apr 14, 2026
2b2b004
Add basic plugin
tylerkaraszewski Apr 14, 2026
4a8efa7
Style
tylerkaraszewski Apr 14, 2026
c3dbd1e
Add Zstd plugin and fix style scripts to not mangle Zstd:: identifiers
tylerkaraszewski Apr 14, 2026
5aaf08d
Add compress/decompress SQLite UDFs and rename plugin to Compression
tylerkaraszewski Apr 14, 2026
f22faa1
Fix build
tylerkaraszewski Apr 14, 2026
2769fe0
Wrap journal reads with decompress() for transparent decompression
tylerkaraszewski Apr 14, 2026
7023fcf
Update getCommit to have optional columns to select
tylerkaraszewski Apr 15, 2026
164cf18
Load dictionaries at startup
tylerkaraszewski Apr 15, 2026
813c6ed
Add command line flag
tylerkaraszewski Apr 16, 2026
0daae40
Decompress journal entries on recvSynchronize
tylerkaraszewski Apr 16, 2026
5bcbd31
monir cleanup
tylerkaraszewski Apr 16, 2026
ecf04fd
First part of tests
tylerkaraszewski Apr 16, 2026
f017fb9
Add test verifying we actually compompress data
tylerkaraszewski Apr 16, 2026
c6ca106
Add check for DB content after decompression
tylerkaraszewski Apr 16, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion Makefile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ INTERMEDIATEDIR = .build

# We use the same library paths and required libraries for all binaries.
LIBPATHS =-L$(PROJECT) -Lmbedtls/library
LIBRARIES =-Wl,--start-group -lbedrock -lstuff -Wl,--end-group -ldl -lpcre2-8 -lpthread -lmbedtls -lmbedx509 -lmbedcrypto -lz -lm
LIBRARIES =-Wl,--start-group -lbedrock -lstuff -Wl,--end-group -ldl -lpcre2-8 -lpthread -lmbedtls -lmbedx509 -lmbedcrypto -lz -lzstd -lm
Comment thread
tylerkaraszewski marked this conversation as resolved.

# These targets aren't actual files.
.PHONY: all test clustertest clean testplugin
Expand Down
Loading