Skip to content

Conversation

sredman
Copy link
Contributor

@sredman sredman commented Apr 27, 2025

Description

This PR adds documentation for work already done in #1647

Notes for Reviewers

I did not actually get cuda + Docker working, so the note in the doc is a best guess for how to pass the nvidia GPU to the container.

Signed commits

  • Yes, I signed my commits.

Copy link

netlify bot commented Apr 27, 2025

Deploy Preview for localai ready!

Name Link
🔨 Latest commit f923c29
🔍 Latest deploy log https://app.netlify.com/sites/localai/deploys/680d90531336d90008952bb5
😎 Deploy Preview https://deploy-preview-5255--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@mudler
Copy link
Owner

mudler commented Apr 27, 2025

Hi @sredman - thanks for the contributions! However CUDA should work. Happy to assist you there if you run into issues, another example on how to run with cuda and docker compose is also here: https://github.com/mudler/LocalAGI/blob/6516af6c34b034486c5016b0d1d9c6f2cdc15c6d/docker-compose.nvidia.yaml#L2

@mudler mudler merged commit a65e012 into mudler:master Apr 27, 2025
9 of 10 checks passed
@mudler mudler added the kind/documentation Improvements or additions to documentation label May 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kind/documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants