High-performance open source local large language model inference engine, supports Gemma-4, Qwen, GPT-OSS and other models, is compatible with OpenAI and Ollama interfaces, and supports Cuda/Apple Metal/Vulkan
Description translated from the developer's original Chinese by machine translation. 中文原页 ↗
高性能开源本地大语言模型推理引擎，支持 Gemma-4、Qwen、GPT-OSS 等模型，兼容 OpenAI 和 Ollama 接口，支持 Cuda/Apple Metal/Vulkan
This page is part of Indie Maker, a directory of works by Chinese indie developers. We sync daily from the open-source repository chinese-independent-developer; this product was added on 2026-07-15.
About pricingAny pricing, membership, plans or premium features mentioned in a product's description belong to that product itself, not to this directory. We don't build, host or resell any product — the directory is entirely free.