docs(readme): document hybrid kernel variants and AWS EFA support - #7
Merged
Xuan-1998 merged 1 commit intoAug 27, 2026
Merged
Conversation
Xuan-1998
force-pushed
the
readme-hybrid-kernels-efa
branch
from
August 26, 2026 06:07
d9155d3 to
8a81f34
Compare
Xuan-1998
force-pushed
the
readme-hybrid-kernels-efa
branch
5 times, most recently
from
August 26, 2026 18:22
9d7296c to
b49b3af
Compare
Xuan-1998
force-pushed
the
readme-hybrid-kernels-efa
branch
2 times, most recently
from
August 27, 2026 00:40
6f84da2 to
33ccc5c
Compare
avivbenchorin
previously approved these changes
Aug 27, 2026
amitrad-aws
previously approved these changes
Aug 27, 2026
Xuan-1998
dismissed stale reviews from amitrad-aws and avivbenchorin
via
August 27, 2026 18:36
9d876d4
Xuan-1998
force-pushed
the
readme-hybrid-kernels-efa
branch
from
August 27, 2026 18:36
33ccc5c to
9d876d4
Compare
Add a section on the ordered and unordered hybrid kernel pair selected by EP_HYBRID_KERNEL: what each variant assumes about network delivery order, which GIN signal types each requests, and why unordered is the default and the only correct variant on backends that can deliver a signal before the data it trails, such as the EFA GPU-initiated one. Add a Running on AWS EFA section describing the two GIN backends (EFA-GDA and CPU proxy) and the requirements: EFA installer 1.50.0 or later, NCCL 2.31 or later for the GIN device API, GPUDirect RDMA (GDR) support on both backend paths, and the gdrcopy kernel module, with an explicit note that gdrdrv loading does not by itself confirm GDR support. Link the EFA public guide and the awsome-distributed-ai DeepEP V2 benchmark for the ready-to-run setup. Register EP_HYBRID_KERNEL in the environment variable list.
Xuan-1998
force-pushed
the
readme-hybrid-kernels-efa
branch
from
August 27, 2026 18:38
9d876d4 to
a0eaa08
Compare
Xuan-1998
requested review from
akkart-aws,
amitrad-aws,
anshumang and
avivbenchorin
August 27, 2026 18:39
avivbenchorin
approved these changes
Aug 27, 2026
amitrad-aws
approved these changes
Aug 27, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add a section on the ordered and unordered hybrid kernel pair selected by EP_HYBRID_KERNEL: what each variant assumes about network delivery order, which GIN signal types each requests, and why unordered is the default and the only correct variant on backends that can deliver a signal before the data it trails, such as the EFA GPU-initiated one.
Add a Running on AWS EFA section describing the two GIN backends (EFA-GDA and CPU proxy) and the requirements: EFA installer 1.50.0 or later, NCCL 2.31 or later for the GIN device API, GPUDirect RDMA (GDR) support on both backend paths, and the gdrcopy kernel module, with an explicit note that gdrdrv loading does not by itself confirm GDR support. Link the EFA public guide and the awsome-distributed-ai DeepEP V2 benchmark for the ready-to-run setup. Register EP_HYBRID_KERNEL in the environment variable list.