Add PyPI Package Manager Support - #49

Open

stevenlei wants to merge 16 commits into

teaxyz:mainfrom

stevenlei:impl-pypi

Commits on Jan 3, 2025

add pypi support - wip
stevenlei
committed
d8fd33d
process to database per batch (size: 10)
stevenlei
committed
2d45981
import to db - wip
stevenlei
committed
be08d73
batch downloading package data and cache
stevenlei
committed
58256f1
clean up
stevenlei
committed
6f0dba1
do not do anything (yet) when finished download
stevenlei
committed
6d83407
transformer wip
stevenlei
committed
a18b4c8

Commits on Jan 4, 2025

temp fix: import_id for versions
stevenlei
committed
7a16c94
better handling for processing dependencies
stevenlei
committed
61a7570
accept dependency_type_id as optional property
stevenlei
committed
a7b1940
working code for the transformer and the full flow
stevenlei
committed
3499997
fix: rename crate_id to import_id as we have changed db.py
stevenlei
committed
7d28769
maintain the semver range for dependencies
stevenlei
committed
ee01623
update the test case for the change of crate_id to import_id
stevenlei
committed
2c625db

Commits on Jan 6, 2025

Merge branch 'main' into impl-pypi
stevenlei
authored
63d8742

Commits on Jan 10, 2025

refactor: improve PyPI data ingestion and database operations
stevenlei
committed
0400725