AI
Featured apps in AI
Qwen3.6-27B MTP (llama.cpp)
Qwen3.6-27B MTP UD-Q4_K_XL served with llama.cpp.
Gemma 4 26B (Ollama)
Gemma 4 26B served with Ollama.
EmbeddingGemma
EmbeddingGemma-300M text embeddings via IREmbeddingServer (OpenVINO / ONNX)
Speaches
OpenAI-compatible TTS/STT server
Latest apps in AI
See all
SGLang Engine Base
Generic SGLang engine base. Pick any HuggingFace Safetensors model at install via env.
llama.cpp Engine Base
Generic llama.cpp engine base. Pick any GGUF model at install via env.
Ollama Engine Base
Generic Ollama engine base. Pick any Ollama library model at install via env.
Qwen3.8-27B (llama.cpp)
Qwen3.8-27B (GGUF UD-Q4_K_XL) served with llama.cpp.
Gemma-4-12B (vLLM)
Gemma-4-12B (AWQ-INT4) served with vLLM.
vLLM Engine Base
Generic vLLM engine base. Pick any HuggingFace Safetensors model at install via env.
Install Olares