The same responses are repeated over and over, why

[dforsbergsectra]

Using the https://huggingface.co/TheBloke/Luna-AI-Llama2-Uncensored-GGUF/resolve/main/luna-ai-llama2-uncensored.Q4_0.gguf model and the quay.io/go-skynet/local-ai:v2.11.0-cublas-cuda12 Docker image.

When repeatedly running the following http request:

curl http://localhost:8080/v1/completions -H "Content-Type: application/json" -d '{"model": "luna-ai-llama2", "prompt": "You are a helpful assistant. Explain gravity to someone in university", "temperature": 0.9 }'

I receive the same response over and over (same entries for created, id and text itself):

{
    "created": 1712122984,
    "object": "text_completion",
    "id": "7ef3c677-5049-4738-ad68-ec7dabf9b946",
    "model": "luna-ai-llama2",
    "choices": [
        {
            "index": 0,
            "finish_reason": "stop",
            "text": ".\nGravity is a fundamental force of nature that exists between any two objects in the universe that have mass. It is the force that pulls objects towards the center of the Earth, or any other massive object. This force is what keeps the planets in orbit around the sun, and what causes objects to fall towards the Earth when they are dropped. The strength of the gravitational force depends on the mass of the objects, and the distance between them. The greater the mass, the stronger the force, and the farther apart the objects, the weaker the force. Therefore, we can use gravity to understand many natural phenomena, such as the motion of planets, the behavior of black holes, and the formation of galaxies."
        }
    ],
    "usage": {
        "prompt_tokens": 0,
        "completion_tokens": 0,
        "total_tokens": 0
    }
}

The same holds for chats.

What am I missing?