# Deploy LocalAI with Easypanel

URL: /templates/localai

LocalAI is a drop-in replacement REST API that's compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-premises with consumer grade hardware, supporting multiple model families and not requiring GPU.

## Benefits

### OpenAI API Compatible

Drop-in replacement for OpenAI API that works with existing applications.

### Local Inference

Run AI models locally without sending data to external services.

### Multiple Model Support

Supports various model families including LLMs, image generation, and audio.

## Features

### Local LLM Hosting

Host and run large language models locally on your hardware.

### API Compatibility

Full compatibility with OpenAI API specifications for easy integration.

### Multi-Modal Support

Support for text generation, image creation, audio processing, and more.

### GPU Acceleration

Optional GPU support for faster inference with NVIDIA CUDA.

## Configuration

- `appServiceName` (App Service Name, required): localai

- `appServiceImage` (App Service Image, required): localai/localai:v2.29.0-aio-cpu

- `debugMode` (Debug Mode, required): false

## Services

- localai: app (localai/localai:v2.29.0-aio-cpu)

## Resources

- [Website](https://localai.io/)

- [Documentation](https://localai.io/docs/)

- [Github](https://github.com/mudler/LocalAI)

- [Template source](https://github.com/easypanel-io/templates/tree/main/templates/localai)