Skip to content

Conversation

mudler
Copy link
Owner

@mudler mudler commented Dec 31, 2023

Description

This PR allows to start local-ai with a list of model config files URLs or our short-handed format (e.g. huggingface://. github://). It works by passing the urls as arguments or environment variable, for example:

local-ai github://owner/repo/file.yaml@branch

# Env
MODELS="github://owner/repo/file.yaml@branch,github://owner/repo/file.yaml@branch" local-ai

# Args
local-ai --models github://owner/repo/file.yaml@branch --models github://owner/repo/file.yaml@branch

For example, to start localai with phi-2, now it's possible for instance (config file from gists):

./local-ai https://gist.githubusercontent.com/mudler/ad601a0488b497b69ec549150d9edd18/raw/a8a8869ef1bb7e3830bf5c0bae29a0cce991ff8d/phi-2.yaml

The file should be a valid YAML configuration file. Note this works well with the last feature #1452. Note this is different from model galleries as that supports up to now also downloading multiple assets. This is for now an attempt to ease out the ux (see also #1373)

Copy link

netlify bot commented Dec 31, 2023

Deploy Preview for localai canceled.

Name Link
🔨 Latest commit df1a461
🔍 Latest deploy log https://app.netlify.com/sites/localai/deploys/659279a343cd3300081e7f85

@mudler mudler added the enhancement New feature or request label Jan 1, 2024
@mudler mudler merged commit 66fa4f1 into master Jan 1, 2024
@mudler mudler deleted the share_models_by_url branch January 1, 2024 09:31
@mudler
Copy link
Owner Author

mudler commented Jan 2, 2024

to some extents this PR enhanced messages of model loading (see #1416)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant