Skip to content

git transmat should parallelize more (and network less) #9

Description

@warpfork

The git transmat should do a lot more work in parallel.

There's probably some very low-hanging fruit here.

Particularly, for submodules to be fetched in parallel once the main repo checkout is available should be possible. (It should even be possible in parallel with the actual checkout -- the submodules can be read from the git data, then submodule fetches launched, before/in-parallel to the actual file content checkouts.)

Sidequest note: I have a sneaking suspicion there's also a bug that causes the git warehouse "open" functions to dial more than necessary (particularly, when the desired hash is already available in the repo)... and this may (or may not, idk) show up on the path and be easy to fix while handling the other parallelization.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions