Skip to content

【需求】路由规则支持Action #1361

Description

@MercuryLi

期望:未来AI网关对外公布服务时,只需要采用固定path。

  • 当收到请求时,通过路由规则根据请求体中的model类型判断转发目标集群。
  • 选中集群后执行集群对应的Action,将path改写成下游大模型服务需要的path
  • 备用模型同样需要支持Action

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions