Skip to content

Conversation

createthis
Copy link
Contributor

Fixes:

llama_model_load: error loading model: error loading model vocabulary: unknown pre-tokenizer type: 'deepseek-v3.1'
llama_model_load_from_file_impl: failed to load model
common_init_from_params: failed to load model '/data2/DeepSeek-V3.1-GGUF/q4_k_m/DeepSeek-V3.1-Q4_K_M.gguf'
srv    load_model: failed to load model, '/data2/DeepSeek-V3.1-GGUF/q4_k_m/DeepSeek-V3.1-Q4_K_M.gguf'
srv    operator(): operator(): cleaning up before exit...   
main: exiting due to model loading error

@github-actions github-actions bot added the ggml changes relating to the ggml tensor library for machine learning label Aug 22, 2025
@CISC
Copy link
Collaborator

CISC commented Aug 22, 2025

Fixes:

llama_model_load: error loading model: error loading model vocabulary: unknown pre-tokenizer type: 'deepseek-v3.1'
llama_model_load_from_file_impl: failed to load model
common_init_from_params: failed to load model '/data2/DeepSeek-V3.1-GGUF/q4_k_m/DeepSeek-V3.1-Q4_K_M.gguf'
srv    load_model: failed to load model, '/data2/DeepSeek-V3.1-GGUF/q4_k_m/DeepSeek-V3.1-Q4_K_M.gguf'
srv    operator(): operator(): cleaning up before exit...   
main: exiting due to model loading error

Uhm, it only fixes a broken GGUF (wrong pre-tokenizer), where did that come from?

The chkhsh is identical to deepseek-v3, so no new pre-tokenizer required.

@CISC CISC closed this Aug 22, 2025
@createthis
Copy link
Contributor Author

Fixes:

llama_model_load: error loading model: error loading model vocabulary: unknown pre-tokenizer type: 'deepseek-v3.1'
llama_model_load_from_file_impl: failed to load model
common_init_from_params: failed to load model '/data2/DeepSeek-V3.1-GGUF/q4_k_m/DeepSeek-V3.1-Q4_K_M.gguf'
srv    load_model: failed to load model, '/data2/DeepSeek-V3.1-GGUF/q4_k_m/DeepSeek-V3.1-Q4_K_M.gguf'
srv    operator(): operator(): cleaning up before exit...   
main: exiting due to model loading error

Uhm, it only fixes a broken GGUF (wrong pre-tokenizer), where did that come from?

The chkhsh is identical to deepseek-v3, so no new pre-tokenizer required.

Something must be wrong with my GGUF workflow. Thanks for pointing that out.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ggml changes relating to the ggml tensor library for machine learning python python script changes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants