All-In-One images
All-In-One images are images that come pre-configured with a set of models and backends to fully leverage almost all the LocalAI featureset. These images are available for both CPU and GPU environments. The AIO images are designed to be easy to use and requires no configuration. Models configuration can be found here separated by size.
What you can find configured out of the box:
- Image generation
- Text generation
- Text to audio
- Audio transcription
- Embeddings
- GPT Vision
| Description | Quay | Docker Hub |
|---|---|---|
| Latest images for CPU | quay.io/go-skynet/local-ai:latest-aio-cpu |
localai/localai:latest-aio-cpu |
| Versioned image (e.g. for CPU) | quay.io/go-skynet/local-ai:v2.11.0-aio-cpu |
localai/localai:v2.11.0-aio-cpu |
| Latest images for Nvidia GPU (CUDA11) | quay.io/go-skynet/local-ai:latest-aio-gpu-nvidia-cuda-11 |
localai/localai:latest-aio-gpu-nvidia-cuda-11 |
| Latest images for Nvidia GPU (CUDA12) | quay.io/go-skynet/local-ai:latest-aio-gpu-nvidia-cuda-12 |
localai/localai:latest-aio-gpu-nvidia-cuda-12 |
| Latest images for AMD GPU | quay.io/go-skynet/local-ai:latest-aio-gpu-hipblas |
localai/localai:latest-aio-gpu-hipblas |
| Latest images for Intel GPU (sycl f16) | quay.io/go-skynet/local-ai:latest-aio-gpu-intel-f16 |
localai/localai:latest-aio-gpu-intel-f16 |
| Latest images for Intel GPU (sycl f32) | quay.io/go-skynet/local-ai:latest-aio-gpu-intel-f32 |
localai/localai:latest-aio-gpu-intel-f32 |
Available environment variables
The AIO Images are inheriting the same environment variables as the base images and the environment of LocalAI (that you can inspect by calling --help). However, it supports additional environment variables available only from the container image
| Variable | Default | Description |
|---|---|---|
SIZE |
Auto-detected | The size of the model to use. Available: cpu, gpu-8g |
MODELS |
Auto-detected | A list of models YAML Configuration file URI/URL (see also running models) |
Example
Start the image with Docker:
docker run -p 8080:8080 --name local-ai -ti localai/localai:latest-aio-cpu
LocalAI will automatically download all the required models, and will be available at localhost:8080.
Last updated 26 Mar 2024, 18:45 +0100 .