Skip to content

Commit 1cd6754

Browse files
committed
chore(model gallery): add granite embeddings models
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent ab50c13 commit 1cd6754

File tree

1 file changed

+34
-0
lines changed

1 file changed

+34
-0
lines changed

gallery/index.yaml

Lines changed: 34 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1169,6 +1169,40 @@
11691169
- filename: ibm-granite_granite-3.2-2b-instruct-Q4_K_M.gguf
11701170
sha256: e1b915b0849becf4fdda188dee7b09cbebbfabd71c6f3f2b75dd3eca0a8fded1
11711171
uri: huggingface://bartowski/ibm-granite_granite-3.2-2b-instruct-GGUF/ibm-granite_granite-3.2-2b-instruct-Q4_K_M.gguf
1172+
- name: "granite-embedding-107m-multilingual"
1173+
url: github:mudler/LocalAI/gallery/virtual.yaml@master
1174+
urls:
1175+
- https://huggingface.co/ibm-granite/granite-embedding-107m-multilingual
1176+
- https://huggingface.co/bartowski/granite-embedding-107m-multilingual-GGUF
1177+
description: |
1178+
Granite-Embedding-107M-Multilingual is a 107M parameter dense biencoder embedding model from the Granite Embeddings suite that can be used to generate high quality text embeddings. This model produces embedding vectors of size 384 and is trained using a combination of open source relevance-pair datasets with permissive, enterprise-friendly license, and IBM collected and generated datasets. This model is developed using contrastive finetuning, knowledge distillation and model merging for improved performance.
1179+
tags:
1180+
- embeddings
1181+
overrides:
1182+
embeddings: true
1183+
parameters:
1184+
model: granite-embedding-107m-multilingual-f16.gguf
1185+
files:
1186+
- filename: granite-embedding-107m-multilingual-f16.gguf
1187+
uri: huggingface://bartowski/granite-embedding-107m-multilingual-GGUF/granite-embedding-107m-multilingual-f16.gguf
1188+
sha256: 3fc99928632fcecad589c401ec33bbba86b51c457e9813e3a1cb801ff4106e21
1189+
- name: "granite-embedding-125m-english"
1190+
url: github:mudler/LocalAI/gallery/virtual.yaml@master
1191+
urls:
1192+
- https://huggingface.co/ibm-granite/granite-embedding-125m-english
1193+
- https://huggingface.co/bartowski/granite-embedding-125m-english-GGUF
1194+
description: |
1195+
Granite-Embedding-125m-English is a 125M parameter dense biencoder embedding model from the Granite Embeddings suite that can be used to generate high quality text embeddings. This model produces embedding vectors of size 768. Compared to most other open-source models, this model was only trained using open-source relevance-pair datasets with permissive, enterprise-friendly license, plus IBM collected and generated datasets. While maintaining competitive scores on academic benchmarks such as BEIR, this model also performs well on many enterprise use cases. This model is developed using retrieval oriented pretraining, contrastive finetuning and knowledge distillation.
1196+
tags:
1197+
- embeddings
1198+
overrides:
1199+
embeddings: true
1200+
parameters:
1201+
model: granite-embedding-125m-english-f16.gguf
1202+
files:
1203+
- filename: granite-embedding-125m-english-f16.gguf
1204+
uri: huggingface://bartowski/granite-embedding-125m-english-GGUF/granite-embedding-125m-english-f16.gguf
1205+
sha256: e2950cf0228514e0e81c6f0701a62a9e4763990ce660b4a3c0329cd6a4acd4b9
11721206
- name: "moe-girl-1ba-7bt-i1"
11731207
icon: https://cdn-uploads.huggingface.co/production/uploads/634262af8d8089ebaefd410e/kTXXSSSqpb21rfyOX7FUa.jpeg
11741208
# chatml

0 commit comments

Comments
 (0)