Skip to content
Open
Show file tree
Hide file tree
Changes from 2 commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
32 changes: 32 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -84,6 +84,16 @@ For the 40b model:
```
python -m evo2.test.test_evo2_generation --model_name evo2_40b
```
### Example conda environment

For users who prefer a reproducible setup, we provide an example conda environment file (`environment.yml`) that pins Python, CUDA, PyTorch, Transformer Engine, FlashAttention and Vortex.

You can create and activate the environment with:

```bash
conda env create -f environment.yml
conda activate evo2
python -m evo2.test.test_evo2_generation --model_name evo2_7b

### Docker

Expand All @@ -100,6 +110,28 @@ Once inside the container:
```bash
python -m evo2.test.test_evo2_generation --model_name evo2_7b
```
### Troubleshooting (installation)

Some common installation errors and suggested fixes:

- `ModuleNotFoundError: No module named 'transformer_engine'`
Make sure the PyTorch extension for Transformer Engine is installed, for example:
```bash
pip install "transformer_engine[pytorch]"
or follow the installation instructions from the Transformer Engine documentation.

- `ModuleNotFoundError: No module named 'vortex'`
Install the Vortex package (published as `vtx` on PyPI), for example:

```bash
pip install "vtx>=0.0.8"

- Errors mentioning `libnvrtc` or `Could not find shared object file for Transformer Engine torch lib`
These errors typically indicate a mismatch between CUDA, PyTorch, and Transformer Engine versions, or that CUDA libraries are not available in your `LD_LIBRARY_PATH`. We recommend:

- using the same CUDA and PyTorch versions as in `environment.yml`,
- checking that your NVIDIA drivers and CUDA toolkit satisfy the requirements listed in the README,
- consulting the Transformer Engine and Vortex documentation for environment-specific installation details.
Comment thread
aymaneVXx marked this conversation as resolved.
Outdated

## Usage

Expand Down
16 changes: 16 additions & 0 deletions environment.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
name: evo2
channels:
- nvidia
- conda-forge
- pytorch
- defaults
dependencies:
- python=3.12
- pip
- pytorch=2.5.1
- pytorch-cuda=12.1
- transformer-engine-torch=2.3.0
- flash-attn=2.8.0.post2
- pip:
- vtx>=0.0.8
- evo2
Comment thread
aymaneVXx marked this conversation as resolved.
Outdated