llama : greatly reduce output buffer memory usage#6122

ggerganov merged 26 commits intomasterggml-org/llama.cpp:masterfrom

compilade/smaller-output-bufferggml-org/llama.cpp:compilade/smaller-output-bufferCopy head branch name to clipboard