- Home
- Byok System
- SillyTavern
SillyTavern
What it is
SillyTavern is a locally installed interface for using text-generation LLMs, image-generation engines and text-to-speech voice models. Users can create, import and switch between character cards, then resume or review their chat histories. The interface includes group chats, lorebooks, user personas, prompt controls, chat commands, scripting and built-in retrieval-augmented generation. Extensions can add character sprites, chat summaries and translation, image generation, text-to-speech and web search. SillyTavern connects to local and cloud backends, including KoboldCpp, llama.cpp, Ollama, OpenAI, Claude, Mistral, OpenRouter and AI Horde. It is free and open-source under the AGPL-3.0 license, and the project says it does not offer hosted services or programmatically track user data. Cloud providers may log information sent to them. Local use requires a system supporting NodeJS 20 or higher; the documentation recommends an NVIDIA 3000-series GPU with at least 6GB of VRAM for local inference. Performance may decline with character libraries above 1,000 entries.
For and against
For
- Free and open-source under AGPL-3.0.
- Supports character cards and resumable chat histories.
- Works with local and cloud model backends.
- Extensions can add image generation and text-to-speech.
Against
- Requires NodeJS 20 or higher.
- Local inference has a recommended NVIDIA GPU requirement.
- Performance can degrade above 1,000 characters.
- No native mobile apps.
The verdict
SillyTavern brings chat, prompt controls and extension capabilities into a locally installed interface. Consider its system requirements and character-library limitation, and note that cloud providers may log data sent to them.
Who it suits
SillyTavern is aimed at AI hobbyists and power users who want control over LLM prompts. It suits people comfortable with locally installed software and, for local inference, the stated system requirements.
Plans and prices
SillyTavern
free and open-source · self-hosted interface · requires separate LLM backend
Read 14 Oct 2026 · docs.sillytavern.app
On the record
- API integrations
- Documented connectors include local KoboldCpp, llama.cpp, Ollama, Oobabooga and TabbyAPI plus cloud services such as OpenAI, Claude, Gemini, Mistral, OpenRouter, DeepSeek, Cohere, Perplexity and others.docs.sillytavern.app · read 14 Oct 2026
- API key storage
- SillyTavern stores API keys in a secrets.json file in the user data directory and hides them in the interface by default after saving and refreshing.docs.sillytavern.app · read 3 Oct 2026
- API trade-offs
- Local APIs are free and private but can require complex setup and 5–50 GB model downloads, while cloud APIs are generally stronger but usually paid and may filter content.docs.sillytavern.app · read 14 Oct 2026
- Audience
- The project describes itself as a tool for savvy AI hobbyists and power users who want control over their LLM prompts.docs.sillytavern.app · read 3 Oct 2026
- Backend dependency
- SillyTavern supplies the interface and requires an LLM backend such as AI Horde, OpenAI-compatible services, KoboldAI or Tabby.docs.sillytavern.app · read 14 Oct 2026
- Character cards
- Character cards store prompts that define an AI character's behavior and support persistent conversations.docs.sillytavern.app · read 14 Oct 2026
- Character chats
- Users can create, import, and switch between character cards, with chat histories they can resume or review.docs.sillytavern.app · read 3 Oct 2026
- Chat features
- Features include group chats, lorebooks, user personas, prompt controls, chat commands, scripting, and built-in retrieval-augmented generation.docs.sillytavern.app · read 3 Oct 2026
- Commands and scripting
- The product includes a chat-command subsystem and its own STscript scripting language.docs.sillytavern.app · read 14 Oct 2026
- Developer extensibility
- STscript, function calling, browser UI extensions and Node.js server plugins allow scripts, event hooks, new endpoints and external-provider integrations.docs.sillytavern.app · read 14 Oct 2026
- Extensions
- Built-in or downloadable extensions provide sprites, summaries, translation, Stable Diffusion/FLUX/DALL-E images, text-to-speech and web search.docs.sillytavern.app · read 14 Oct 2026
- Group chats
- Group-chat rooms allow multiple character bots to converse with the user or one another.docs.sillytavern.app · read 14 Oct 2026
- Image generation integrations
- The project lists Stable Diffusion, FLUX, and DALL-E image generation among its extension capabilities.docs.sillytavern.app · read 3 Oct 2026
- Installation platforms
- Official guides cover Windows, Linux, macOS, Android through Termux and Docker, with release and staging branches.docs.sillytavern.app · read 14 Oct 2026
- Integrations
- SillyTavern supports local and cloud LLM backends, including KoboldCpp, llama.cpp, Ollama, OpenAI, Claude, Mistral, OpenRouter, and AI Horde.docs.sillytavern.app · read 3 Oct 2026
- Licence
- SillyTavern is released under the AGPL-3.0 licence.docs.sillytavern.app · read 14 Oct 2026
- Limit: context management
- An independent benchmark notes that lore consumes context budget and complex multi-character prompting can cause ordering and consistency problems.axiobench.com · read 14 Oct 2026
- Limit: interface
- Users report confusing menus, inconsistent settings locations, weak mobile usability and difficult card management.reddit.com · read 14 Oct 2026
