Skip to content

Commit 60117ec

Browse files
authored
fix(apple): disable BUILD_TYPE metal on fallback (#3199)
When compiling the single-binary on Apple, we enforce BUILD_TYPE=metal, however, we want still to have the fallback vanilla such as if llama.cpp fails to load metal (e.g. if Acceleration framework is missing, or MacOS version is too old) we can still run by offloading to the CPU. The default backend is still using metal as usual. Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent 1c708d2 commit 60117ec

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

Makefile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -387,7 +387,7 @@ ifeq ($(DETECT_LIBS),true)
387387
scripts/prepare-libs.sh backend-assets/grpc/llama-cpp-avx2
388388
endif
389389
ifeq ($(OS),Darwin)
390-
$(info ${GREEN}I Skip CUDA/hipblas build on MacOS${RESET})
390+
BUILD_TYPE=none $(MAKE) backend-assets/grpc/llama-cpp-fallback
391391
else
392392
$(MAKE) backend-assets/grpc/llama-cpp-cuda
393393
$(MAKE) backend-assets/grpc/llama-cpp-hipblas

0 commit comments

Comments
 (0)