Skip to content

Model blocks should be able to use the granite-io platform #532

@esnible

Description

@esnible

Is your feature request related to a problem? Please describe.
We might be able to get performance and functionality improvements more quickly by implementing a back end that calls granite-io directly, rather than through LiteLLM.

Describe the solution you'd like
A back end that calls granite-io directly, rather than through LiteLLM.

Describe alternatives you've considered
Waiting for LiteLLM to incorporate all of the improvements offered by granite-io in a provider-agnostic way, and making use of those improvements.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions