Skip to content

[WIP] Fix FT Service issue #344

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
artek0chumak wants to merge 1 commit into
base: next
Choose a base branch
from
Draft

[WIP] Fix FT Service issue #344

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions .stats.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
configured_endpoints: 74
openapi_spec_url: https://storage.googleapis.com/stainless-sdk-openapi-specs/togetherai%2Ftogetherai-04a478c28ccfda001301fb0066e8155fead5a9d42fa31fcd9f6ccbf49add8566.yml
openapi_spec_hash: f7276d5ac16bebb9e105fe4e065d1e96
config_hash: 52d213100a0ca1a4b2cdcd2718936b51
configured_endpoints: 75
openapi_spec_url: https://storage.googleapis.com/stainless-sdk-openapi-specs/togetherai%2Ftogetherai-19148ebeed55db4be0c1c60d31c81306386c4c71a2aee8d1eeac8ebfa15c1168.yml
openapi_spec_hash: 7bc7e54a7356083f1fb639734be306b1
config_hash: 279a64a8df3e6dba241bfa1e18a04f69
154 changes: 79 additions & 75 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -471,62 +471,64 @@ with Together() as client:

```bash
# Help
together files --help
tg files --help

# Check file
together files check example.jsonl
tg files check example.jsonl

# Upload file
together files upload example.jsonl
tg files upload example.jsonl

# List files
together files list
tg files list

# Retrieve file metadata
together files retrieve file-6f50f9d1-5b95-416c-9040-0799b2b4b894
tg files retrieve file-6f50f9d1-5b95-416c-9040-0799b2b4b894

# Retrieve file content
together files retrieve-content file-6f50f9d1-5b95-416c-9040-0799b2b4b894
tg files retrieve-content file-6f50f9d1-5b95-416c-9040-0799b2b4b894

# Delete remote file
together files delete file-6f50f9d1-5b95-416c-9040-0799b2b4b894
tg files delete file-6f50f9d1-5b95-416c-9040-0799b2b4b894
```

### Fine-tuning

```bash
# `tg ft` and `tg fine-tuning` are equivalent

# Help
together fine-tuning --help
tg ft --help

# Create fine-tune job
together fine-tuning create \
tg ft create \
--model togethercomputer/llama-2-7b-chat \
--training-file file-711d8724-b3e3-4ae2-b516-94841958117d

# List fine-tune jobs
together fine-tuning list
tg ft list

# Retrieve fine-tune job details
together fine-tuning retrieve ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b
tg ft retrieve ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b

# List fine-tune job events
together fine-tuning list-events ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b
tg ft list-events ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b

# Cancel running job
together fine-tuning cancel ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b
tg ft cancel ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b

# Download fine-tuned model weights
together fine-tuning download ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b
tg ft download ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b
```

### Models

```bash
# Help
together models --help
tg models --help

# List models
together models list
tg models list
```

## Versioning
Expand Down Expand Up @@ -562,201 +564,203 @@ Python 3.9 or higher.

```bash
# Help
together files --help
tg files --help

# Check file
together files check example.jsonl
tg files check example.jsonl

# Upload file
together files upload example.jsonl
tg files upload example.jsonl

# List files
together files list
tg files list

# Retrieve file metadata
together files retrieve file-6f50f9d1-5b95-416c-9040-0799b2b4b894
tg files retrieve file-6f50f9d1-5b95-416c-9040-0799b2b4b894

# Retrieve file content
together files retrieve-content file-6f50f9d1-5b95-416c-9040-0799b2b4b894
tg files retrieve-content file-6f50f9d1-5b95-416c-9040-0799b2b4b894

# Delete remote file
together files delete file-6f50f9d1-5b95-416c-9040-0799b2b4b894
tg files delete file-6f50f9d1-5b95-416c-9040-0799b2b4b894
```

### Fine-tuning

```bash
# `tg ft` and `tg fine-tuning` are equivalent

# Help
together fine-tuning --help
tg ft --help

# Create fine-tune job
together fine-tuning create \
tg ft create \
--model togethercomputer/llama-2-7b-chat \
--training-file file-711d8724-b3e3-4ae2-b516-94841958117d

# List fine-tune jobs
together fine-tuning list
tg ft list

# Retrieve fine-tune job details
together fine-tuning retrieve ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b
tg ft retrieve ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b

# List fine-tune job events
together fine-tuning list-events ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b
tg ft list-events ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b

# List fine-tune checkpoints
together fine-tuning list-checkpoints ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b
tg ft list-checkpoints ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b

# Cancel running job
together fine-tuning cancel ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b
tg ft cancel ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b

# Download fine-tuned model weights
together fine-tuning download ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b
tg ft download ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b

# Delete fine-tuned model weights
together fine-tuning delete ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b
tg ft delete ft-c66a5c18-1d6d-43c9-94bd-32d756425b4b
```

### Models

```bash
# Help
together models --help
tg models --help

# List models
together models list
tg models list

# Upload a model
together models upload --model-name my-org/my-model --model-source s3-or-hugging-face
tg models upload --model-name my-org/my-model --model-source s3-or-hugging-face
```

### Clusters

```bash
# Help
together beta clusters --help
tg beta clusters --help

# Create a cluster
together beta clusters create
tg beta clusters create

# List clusters
together beta clusters list
tg beta clusters list

# Retrieve cluster details
together beta clusters retrieve [cluster-id]
tg beta clusters retrieve [cluster-id]

# Update a cluster
together beta clusters update [cluster-id]
tg beta clusters update [cluster-id]

# Retrieve Together cluster configuration options such as regions, gpu types and drivers available
together beta clusters list-regions
tg beta clusters list-regions
```

##### Cluster Storage

```bash
# Help
together beta clusters storage --help
tg beta clusters storage --help

# Create cluster storage volume
together beta clusters storage create
tg beta clusters storage create

# List storage volumes
together beta clusters storage list
tg beta clusters storage list

# Retrieve storage volume
together beta clusters storage retrieve [storage-id]
tg beta clusters storage retrieve [storage-id]

# Delete storage volume
together beta clusters storage delete [storage-id]
tg beta clusters storage delete [storage-id]
```

### Jig (Container Deployments)

```bash
# Help
together beta jig --help
tg beta jig --help

# Initialize jig configuration (creates pyproject.toml)
together beta jig init
tg beta jig init

# Generate Dockerfile from config
together beta jig dockerfile
tg beta jig dockerfile

# Build container image
together beta jig build
together beta jig build --tag v1.0 --warmup
tg beta jig build
tg beta jig build --tag v1.0 --warmup

# Push image to registry
together beta jig push
together beta jig push --tag v1.0
tg beta jig push
tg beta jig push --tag v1.0

# Deploy model (builds, pushes, and deploys)
together beta jig deploy
together beta jig deploy --build-only
together beta jig deploy --image existing-image:tag
tg beta jig deploy
tg beta jig deploy --build-only
tg beta jig deploy --image existing-image:tag

# Get deployment status
together beta jig status
tg beta jig status

# Get deployment endpoint URL
together beta jig endpoint
tg beta jig endpoint

# View deployment logs
together beta jig logs
together beta jig logs --follow
tg beta jig logs
tg beta jig logs --follow

# Destroy deployment
together beta jig destroy
tg beta jig destroy

# Get queue metrics
together beta jig queue-status
tg beta jig queue-status

# List all deployments
together beta jig list
tg beta jig list
```

##### Jig Secrets

```bash
# Help
together beta jig secrets --help
tg beta jig secrets --help

# Set a secret (creates or updates)
together beta jig secrets set --name MY_SECRET --value "secret-value"
tg beta jig secrets set --name MY_SECRET --value "secret-value"

# Remove a secret from local state
together beta jig secrets unset --name MY_SECRET
tg beta jig secrets unset --name MY_SECRET

# List all secrets with sync status
together beta jig secrets list
tg beta jig secrets list
```

##### Jig Volumes

```bash
# Help
together beta jig volumes --help
tg beta jig volumes --help

# Create a volume and upload files from directory
together beta jig volumes create --name my-volume --source ./data
tg beta jig volumes create --name my-volume --source ./data

# Update a volume with new files
together beta jig volumes update --name my-volume --source ./data
tg beta jig volumes update --name my-volume --source ./data

# Set volume mount path for deployment
together beta jig volumes set --name my-volume --mount-path /app/data
tg beta jig volumes set --name my-volume --mount-path /app/data

# Remove volume from deployment config (does not delete remote volume)
together beta jig volumes unset --name my-volume
tg beta jig volumes unset --name my-volume

# Delete a volume
together beta jig volumes delete --name my-volume
tg beta jig volumes delete --name my-volume

# Describe a volume
together beta jig volumes describe --name my-volume
tg beta jig volumes describe --name my-volume

# List all volumes
together beta jig volumes list
tg beta jig volumes list
```

## Contributing
Expand Down
2 changes: 2 additions & 0 deletions api.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -184,6 +184,7 @@ from together.types import (
FineTuningEstimatePriceResponse,
FineTuningListCheckpointsResponse,
FineTuningListEventsResponse,
FineTuningListMetricsResponse,
)
```

Expand All @@ -197,6 +198,7 @@ Methods:
- <code title="post /fine-tunes/estimate-price">client.fine_tuning.<a href="./src/together/resources/fine_tuning.py">estimate_price</a>(\*\*<a href="src/together/types/fine_tuning_estimate_price_params.py">params</a>) -> <a href="./src/together/types/fine_tuning_estimate_price_response.py">FineTuningEstimatePriceResponse</a></code>
- <code title="get /fine-tunes/{id}/checkpoints">client.fine_tuning.<a href="./src/together/resources/fine_tuning.py">list_checkpoints</a>(id) -> <a href="./src/together/types/fine_tuning_list_checkpoints_response.py">FineTuningListCheckpointsResponse</a></code>
- <code title="get /fine-tunes/{id}/events">client.fine_tuning.<a href="./src/together/resources/fine_tuning.py">list_events</a>(id) -> <a href="./src/together/types/fine_tuning_list_events_response.py">FineTuningListEventsResponse</a></code>
- <code title="get /fine-tunes/{id}/metrics">client.fine_tuning.<a href="./src/together/resources/fine_tuning.py">list_metrics</a>(id) -> <a href="./src/together/types/fine_tuning_list_metrics_response.py">FineTuningListMetricsResponse</a></code>

# CodeInterpreter

Expand Down
1 change: 1 addition & 0 deletions pyproject.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,7 @@ dependencies = [
"types-pyyaml>=6.0.12.20250915",
"tomli>=2.0.0; python_version < '3.11'",
"detect-agent>=0.2.0",
"asciichartpy>=0.7.0",
]

requires-python = ">= 3.10"
Expand Down
8 changes: 2 additions & 6 deletions src/together/_qs.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,17 +2,13 @@

from typing import Any, List, Tuple, Union, Mapping, TypeVar
from urllib.parse import parse_qs, urlencode
from typing_extensions import Literal, get_args
from typing_extensions import get_args

from ._types import NotGiven, not_given
from ._types import NotGiven, ArrayFormat, NestedFormat, not_given
from ._utils import flatten

_T = TypeVar("_T")


ArrayFormat = Literal["comma", "repeat", "indices", "brackets"]
NestedFormat = Literal["dots", "brackets"]

PrimitiveData = Union[str, int, float, bool, None]
# this should be Data = Union[PrimitiveData, "List[Data]", "Tuple[Data]", "Mapping[str, Data]"]
# https://github.com/microsoft/pyright/issues/3555
Expand Down
Loading
Loading