Skip to content

fix(together-ai): use a valid Together embedding model as default#1717

Open
ankit25bcs10610 wants to merge 1 commit into
Portkey-AI:mainfrom
ankit25bcs10610:fix/together-ai-embed-default-model
Open

fix(together-ai): use a valid Together embedding model as default#1717
ankit25bcs10610 wants to merge 1 commit into
Portkey-AI:mainfrom
ankit25bcs10610:fix/together-ai-embed-default-model

Conversation

@ankit25bcs10610

Copy link
Copy Markdown

What

The Together AI embed config defaults the model to mistral-embed:

model: {
  param: 'model',
  required: true,
  default: 'mistral-embed',
},

This is copy-pasted from mistral-ai/embed.ts. Together AI does not serve mistral-embed, so an embeddings request that relies on the default (omits model) is sent an invalid model id and fails.

Fix

Default to BAAI/bge-large-en-v1.5 — the embedding model used in Together's own Create Embedding API docs example.

Note: Together's hosted model list shifts over time. I picked the model from their official docs example; maintainers may prefer a different supported default (e.g. togethercomputer/m2-bert-80M-8k-retrieval) — happy to change it.

npm run format:check passes.

The embed config defaulted to `mistral-embed`, copy-pasted from
`mistral-ai/embed.ts`. Together AI does not serve that model, so an embed
request that omits `model` fails with an invalid-model error.

Default to `BAAI/bge-large-en-v1.5`, the model used in Together's own
embeddings API documentation example.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant