Skip to content

refactor code for improved readability and consistency - #930

Merged
tchaton merged 7 commits into
Lightning-AI:mainfrom
deependujha:fix/default-storage-option
Sep 29, 2026
Merged

tchaton merged 7 commits into
Lightning-AI:mainfrom
deependujha:fix/default-storage-option

Conversation

@deependujha

Copy link
Copy Markdown
Collaborator
Before submitting
  • Was this discussed/agreed via a Github issue? (no need for typos and docs improvements)
  • Did you read the contributor guideline, Pull Request section?
  • Did you make sure to update the docs?
  • Did you write any new necessary tests?

What does this PR do?

Continues work from #837

PR review

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in GitHub issues there's a high chance it will not be merged.

Did you have fun?

Make sure you had fun coding 🙃

@codecov-commenter

codecov-commenter commented Sep 28, 2026 •

Copy link
Copy Markdown

⚠️ Please install the 'codecov app svg image' to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 82%. Comparing base (bb96b0e) to head (fe06811).
❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files
@@          Coverage Diff          @@
##            main    #930   +/-   ##
=====================================
  Coverage     82%     82%           
=====================================
  Files         70      70           
  Lines      16153   16154    +1     
=====================================
+ Hits       13258   13260    +2     
+ Misses      2895    2894    -1     
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot review overview

🟢 Approval recommended

Only a minor documentation nit remains, with no approval-blocking issues.

Review effort: Lite
Findings: 1 Low severity

Open (1)
What changed in this PR

Refactors optional API defaults for consistency and improves Parquet typing.

Changes:

  • Replaces mutable {} defaults with None.
  • Adds explicit Parquet file typing.
  • Ignores uv.lock.
File Summary
src/​litdata/​utilities/​parquet.py Updates Parquet option defaults.
src/​litdata/​utilities/​dataset_utilities.py Updates dataset utility defaults.
src/​litdata/​streaming/​writer.py Updates indexing API defaults.
src/​litdata/​streaming/​reader.py Updates reader defaults.
src/​litdata/​streaming/​item_loader.py Updates loader state initialization.
src/​litdata/​streaming/​downloader.py Updates downloader defaults; docstring default needs alignment.
src/​litdata/​streaming/​dataset.py Updates dataset defaults.
src/​litdata/​streaming/​config.py Updates configuration defaults.
src/​litdata/​streaming/​client.py Updates client defaults.
src/​litdata/​streaming/​cache.py Updates cache defaults.
src/​litdata/​processing/​readers.py Adds Parquet file typing.
.gitignore Ignores uv.lock.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread src/litdata/streaming/downloader.py
@tchaton
tchaton merged commit c791f51 into Lightning-AI:main Sep 29, 2026
36 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants