Skip to content

[Kernel] Add Exllama as a backend for compressed-tensors #9395

Merged
robertgshaw2-redhat merged 6 commits intovllm-project:mainfrom
neuralmagic:lwilkinson/exllama-backend
Oct 17, 2024
Merged

[Kernel] Add Exllama as a backend for compressed-tensors #9395
robertgshaw2-redhat merged 6 commits intovllm-project:mainfrom
neuralmagic:lwilkinson/exllama-backend

Commits

Commits on Oct 16, 2024