Skip to main content

Ctrl+K

Get Started

Installation — CUDA
Installation — Apple Silicon
Installation — Ascend NPU
Installation — Intel XPU
Installation — Intel CPU
Installation — MUSA
Troubleshooting

Cookbook

Qwen3 TTS
MOSS-TTS
Whisper ASR
Nemotron 3.5 ASR
MOSS-Transcribe-Diarize
Fish Audio S2-Pro
Fun-CosyVoice3
NemotronLabs VoiceChat
PersonaPlex
Cosmos3 Nano serving
Qwen3-Omni
Qwen3-ASR
MiniCPM-o
Fun-ASR-Nano
Higgs TTS
MOSS-TTS-Local
Nemotron 3 Diarization
Fish Audio Drama 3
MiniMax Music 3
Ming-Omni
AuK
ZONOS2
ARK-ASR-3B
Voxtral TTS
dots.tts
LLaDA2.0-Uni
Ming-Omni-TTS
Ming-3.0-asr-tiny
Ming-3.0-audio-flash
Ming-3.0-TTS

General Usage

Omni Model Usage
Native Chat Stage
Audio Translations
TTS Model Usage
Process Topology, Replicas, and GPU Sharing
TTS Process Topology
Process Topology Migration
SGLang-Omni Rust Router
Same-GPU Data Parallelism with CUDA MPS
Native Media Routes

MLX

MLX Path

Developer Reference

Architecture
API Server Design
Pipeline Overview
Full Duplex Interactive Model
Config
Adding a Parameter
Communication
Reference Encode Service
Request-level profiler
Qwen3-ASR High-Concurrency Benchmark and Bottleneck Profile
Full-Duplex-Bench runbook
Full-Duplex-Bench v1.0 unified metrics
TTS benchmark runbook
ASR benchmark runbook
MiniCPM-o offline benchmark runbook
RL Admin Control
CI Workflows and Labels
Bumping the SGLang Pin

Repository
Open issue

Search

Ctrl+K

By SGLang-Omni Team

© Copyright 2025-2026, SGLang-Omni.

Last updated on Oct 23, 2026.