Skip to main content

Ctrl+K

Getting Started

Install SGLang
Quick Start: Launch A Server and Send Requests

Backend Tutorial

OpenAI-Compatible APIs - Completions
OpenAI-Compatible APIs - Vision
Backend: SGLang Runtime (SRT)

Frontend Tutorial

Frontend: Structured Generation Language (SGLang)

References

Sampling Parameters in SGLang Runtime
Guide on Hyperparameter Tuning
How to Support a New Model
Contributor Guide
Choices Methods in SGLang
Benchmark and Profiling
Troubleshooting
Custom Chat Template in SGLang Runtime
Frequently Asked Questions
Learn more

Repository
Show source
Suggest edit
Open issue

.md

Learn more

Learn more#

You can find more blogs, slides, and videos about SGLang at sgl-project/sgl-learning-materials.

previous

Frequently Asked Questions

By SGLang Team

© Copyright 2023-2024, SGLang.

Last updated on Nov 02, 2024.