Skip to content

Commit b001783

Browse files
committed
fix(llama.cpp): adapt init function call
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent c9350da commit b001783

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

backend/cpp/llama/grpc-server.cpp

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -458,7 +458,9 @@ struct llama_server_context
458458
}
459459
}
460460

461-
std::tie(model, ctx) = llama_init_from_gpt_params(params);
461+
llama_init_result llama_init = llama_init_from_gpt_params(params);
462+
llama_model * model = llama_init.model;
463+
llama_context * ctx = llama_init.context;
462464
if (model == nullptr)
463465
{
464466
LOG_ERROR("unable to load model", {{"model", params.model}});

0 commit comments

Comments
 (0)