SillyTavern

LLM Frontend for Power Users.

AGPL-3.0 License

Downloads
374
Stars
6.5K
View Code on GitHub Visit Website
Ecosystems: JavaScript

Bot releases are visible (Hide)

SillyTavern - 1.10.4

Published by Cohee1207 about 1 year ago

SillyTavern 1.10.4

The theme of the update: bringing fan-favorite Extras to Main.

Highlights

  1. Local text classification and image captioning pipelines
  2. Local Vector storage plugin: potential replacement for ChromaDB
  3. Multigen: removed and replaced with auto-continue function.

Improvements

  1. Slash commands to change sprite sets and expression images: /costume and /emote
  2. Custom character expressions (manual or /emote command only)
  3. Loop-around for swipes
  4. Better performance when opening large chats (only max 100 messages are rendered at once).
  5. Saving KoboldAI and TextGen server history
  6. Permanent token counter for characters card is back
  7. Nice-looking Mancer model selector
  8. New translation providers: DeepLX and OneRingTranslator.
  9. Removed truncation of logs in the console window
  10. Refined User Settings menu + settings search
  11. Dynamically adjust the number of hot-swap slots
  12. New UI customization options: UI/Chat/border colors, custom CSS field
  13. Add "Idle" prompts plugin by @city-unit
  14. Add Mirostat presets by @majick
  15. Show worker performance in the Horde model selector
  16. Support for new OpenAI instruct models
  17. More controls for the Dynamic Audio plugin by @Tony-sama
  18. Grammar sampling for Koboldcpp by @kalomaze
  19. Add new position for extensions: before Main Prompt / Story String
  20. In-chat insertion strategy for World Info entries

Bug fixes

  1. Fixed card sorting logic by date
  2. Fixed macro parameters not applying to the Novel preamble
  3. Fixed summary not applying to a new position

Community Contributions

New Contributors

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.10.3...1.10.4

SillyTavern - 1.10.3

Published by Cohee1207 about 1 year ago

Security: WebP cards import/export support removed. See: https://nvd.nist.gov/vuln/detail/CVE-2023-4863

Bug Fixes

  1. Always prefer IPv4 when resolving domain names.
  2. Limit affected Node 20 versions for the Node bug workaround
  3. Fix 3-token prompt overflow for OpenAI models close to the model-defined context limit.
  4. Fix mobile layout breaking in groups and after character import.

Community Updates.

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.10.2...1.10.3

SillyTavern - 1.10.2

Published by Cohee1207 about 1 year ago

Launched script moved to https://github.com/SillyTavern/SillyTavern-Launcher

SillyTavern - 1.10.1

Published by Cohee1207 about 1 year ago

Minor QoL and bugfix release.

Highlights

  1. Add Stable Diffusion via NovelAI and direct AUTOMATIC1111 (no Extras needed).
  2. Add image gallery plugin
  3. Legacy purge:
    • Removed legacy NovelAI models
    • Removed Pygmalion 6B forced formatting
    • Removed outdated setting presets
    • Removed NSFW avoidance prompt from Prompt Manager

Improvements

  1. (Partial) Spanish locale
  2. Add missing asterisks and quotes to Markdown auto-fix logic
  3. Improved preset loading in Prompt Manager
  4. New hotkey: Alt+Enter to Continue
  5. Add optional display of token counts in messages
  6. Add unban EOS and mirostat settings for KoboldAI
  7. Add the ability to set the default voice for TTS
  8. Move toast messages to the center of the screen
  9. Better layout of settings on narrow screens
  10. Support for custom headers sent to ooba/Kobold via config.conf
  11. Add launcher bat script

Bug fixes

  1. Fix prompt overflow on Continue
  2. Fix image cropping with "Never receive avatars"
  3. Fix character duplication suffix
  4. Fix double insertion of persona description to Prompt Manager
  5. Fix SD background generation with landscape w/h settings
  6. Fix negative numbers in prompt itemization for Chat Completions
  7. Prevent possible race conditions in frontend initialization

What's Changed

New Contributors

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.10.0...1.10.1

SillyTavern - 1.10.0

Published by Cohee1207 about 1 year ago

Highlights

  1. Prompt Manager for Chat Completions
  2. Advanced Formatting for Text APIs
  3. Dynamic Audio extension
  4. RVC and Coqui TTS support
  5. Simplified UI mode

Other Improvements

  • Preset management for Context templates and Instruct templates
  • OpenRouter prompt cost calculations
  • Support for Markdown tables
  • Renamed Live2D extension to TalkingHead
  • Proxy passwords hidden by default
  • More NovelAI settings
  • Chat Lazy Loading
  • AI21 API support
  • Per-chat CFG support
  • HotKey: Escape key to close panels and popups.
  • API Icons next to Timestamp
  • Performance improvements and pagination for character list, groups, and world info entries
  • Fuzzy search for characters and groups
  • Improvements to NovelAI API: logit bias, samplers order, banned tokens, etc.
  • Manual UI language selector and new UI languages: Dutch, Italian, and Russian
  • Chat Completion source is shown on timestamp hover
  • More stable file saving to prevent accidental chat deletion during a PC crash
  • New StableDiffusion option to render a background based on chat
  • Add a button to hide the upper portion of the Character panel
  • Console window output coloring
  • Search for past chat via content keywords
  • Auto-clean the Uploads folder
  • Individual Swipes can now be deleted
  • Dialogue examples can be removed from the prompt entirely via toggle
  • Favorited characters stand out more in the character list
  • Token counter for each box in Character Panel, and Persona Description
  • Alternative 'Cookie method' for Scale API
  • Bottom and top bars now resize based on the Main Font Size
  • Fix for accidental slider adjustment on touch devices (300ms delay before activating)
  • Quick 'Continue' button in the chat bar
  • Add support for OpenRouter fallback models
  • Fix bug to preserve Swipes that were Continued upon
  • LibreTranslate added as an auto-translate source
  • Improvements for Instruct mode handling and panel UI

Community Contributions

New Contributors

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.9.7...1.10.0

SillyTavern - 1.9.7

Published by Cohee1207 about 1 year ago

New features

  • OpenRouter max price per prompt calculation
  • Load koboldcpp suggested samplers order
  • Option to encode HTML/XML tags instead of trying to render them

Bug fixes

  • Fix expressions not loading
  • Fix default expressions
  • Fix <rp> tag hiding

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.9.6...1.9.7

SillyTavern - 1.9.6

Published by Cohee1207 about 1 year ago

Fix a server crash on certain API replies

SillyTavern - 1.9.5

Published by Cohee1207 about 1 year ago

New Features

  • Mancer API support: https://mancer.tech/
  • Block quotes and HTML comments support in chat
  • NovelAI stop sequences and preamble for style influence
  • Added settings and instruct presets to imitate simple-proxy for local models
  • Improved assistant prefill box for Claude
  • Bulk cards deletion
  • "Best choice" tokenizer option
  • Option to skip forced names for groups in instruct mode
  • Option to disable persona change notifications
  • Quick Replies presets
  • Activate Quick Replies with Ctrl+Number keys
  • Confirm text input popups with Enter
  • Power option to disable CSRF protection
  • (WIP) New speech-to-text providers. To be used with the Extras neo branch
  • (WIP) Animated PNG sprites support. To be used with the Extras neo branch

Bug fixes

  • Various fixes for objective extension
  • Unified random/roll syntax across LLM frontends
  • Improved error handling for OpenRouter, Novel, Kobold
  • Lowered preset max context for Novel
  • Fixed links in the help message
  • (ChromaDB) Adjust automatic slider calculation by character description length
  • Fix summarization and objectives in groups
  • Don't activate Horde client if not necessary

Community Contributions

New Contributors

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.9.4...1.9.5

SillyTavern - 1.9.4

Published by Cohee1207 about 1 year ago

New features

  • Assistant prefill for Claude
  • Presets for Quick Replies
  • Customizable insert position, template and "force after X words" for the Summary plugin
  • Option to close current chat
  • Option to hide side/top panels
  • Last character sync between devices
  • Escape key closing panels and popups
  • Overflow alert for WI budget
  • Increase allowed instruct sequence lengths

Bug fixes

  • Fix Objective extension triggering when no objective
  • NovelAI presets fix

Community Contributions

New Contributors

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.9.3...1.9.4

SillyTavern - 1.9.3

Published by Cohee1207 about 1 year ago

New Features

  • "Proxy password" field for Chat completions
  • Preset Manager for Kobold and ooba
  • (experimental) Coqui TTS support. Requires running extras from the neo branch.
  • Editable Stable Diffusion prompt templates
  • Character-specific prompt prefixes for Stable Diffusion
  • New Kayra model for NovelAI
  • More visible parameters for Novel models
  • /send command to add a message without generation
  • Sorting order by character definitions length
  • Fuzzy characters search
  • Various bugfixes

Community Contributions

New Contributors

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.9.2...1.9.3

SillyTavern - Continuous Release (Release)

Published by github-actions[bot] about 1 year ago

SillyTavern - Continuous Release (Staging)

Published by github-actions[bot] about 1 year ago

SillyTavern - 1.9.2

Published by Cohee1207 about 1 year ago

Bug fixes

  • Upgrade default context size max to 4k (local models)
  • Fix OpenAI key usage view (the old method doesn't work anymore)
  • Fix OpenAI model reset on page refresh
  • Fix original JB substitution
  • Fix samplers reordering for phones

Community Contributions

New Contributors

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.9.1...1.9.2

SillyTavern - 1.9.1

Published by Cohee1207 about 1 year ago

This release deprecates the old main and dev branches. Please see this page with instructions on how to migrate: https://docs.sillytavern.app/usage/branches/

New Features

  • Updated default content (characters, world info) with contest winners' submissions
  • Added the possibility to update settings.json and other files without hurting the git users
  • Onboarding experience for newcomers
  • Added ability to use external API models list
  • Added a link to view OpenRouter credits usage

Bug fixes

  • Fixed backgrounds uploading button missing
  • Fixed default expressions not appearing
  • Fixed backgrounds UX on mobile
  • Fixed server startup for Node 20
  • Fixed {{original}} substitution on empty prompts
  • Fixed A/N scrolling

Full Changelog: https://github.com/SillyTavern/SillyTavern/commits/1.9.1

SillyTavern - 1.9.0

Published by Cohee1207 over 1 year ago

API

  • Poe - removed and no longer supported.
  • Updated KAI presets
  • Add k_euler_a sampler for StableHorde
  • Scale API support
  • OpenAI davinci model support
  • Randomization button of API generation settings
  • OpenRouter can be used independently of WindowAI
  • Claude 2 models via Chat Completion API
  • oobabooga mirostat support.

UI

  • Improved moving UI (smoother, no more window overflowing)
  • Moving UI presets to save and load
  • Toggle to 'avoid character card spoilers' (hides the character defs from view)
  • Smooth fade transition when character sprites change
  • Optimized Extensions manager display
  • Unicode icons for colorblind users
  • i18n translations (Japanese WIP, Korean), and improved Chinese
  • New background to celebrate 10-thousand Discord members! by @kallmeflocc
  • Group chat member list can be popped out for easy mute/force talk
  • Character list toggle to display it as a grid instead of a list
  • Chat width is now a slider

FIXES

  • ChromaDB optimization
  • Better prompt token itemization
  • Fix chat window resize on Mac Safari
  • Author's Note is now a built-in function, not an extension.
  • Prompt bias is no longer used when Impersonating

Slash Commands

  • /go slash command to open any character by name
  • /help is easier to read
  • /bgcol to auto-select UI colors based on the background
  • /sysgen command to prompt the AI to generate a response as the 'system' entity
  • /impersonate (/imp) to call an impersonation request
  • /delchat - deletes the current chat.
  • /cancel - deletes all messages from a certain character

New Features

  • Statistic tracking for the user and characters (only local, not shared or tracked anywhere else)
  • Restyled World Info entry display and logic
    • probability is always on
    • the memo is always visible
    • selective is always on (but only active if the box has contents)
  • RegEx auto-substitute for almost anything in the chat/prompt
  • Retroactive bookmarking (create a bookmark from past messages)
  • API and model are now saved in the metadata of each chat message
  • each swipe now gets its own metadata
  • StableDiffusion prompt and Caption results refinement
  • customizable AI response stopping strings
  • Tokenizers can now use the API you are connected to
  • Option to keep chats when you delete a character
  • New character list sorting order: Random
  • Backgrounds can be renamed inside the UI
  • External extension installation via git download

Macros

  • {{random}} macro to select a random item from a list (numbers, text, anything)
  • {{idle_duration}} shows the amount of time elapsed since the last message
  • {{input}} macro to add in whatever exists in the chat bar
  • {{roll}} macro to simulate dice rolling, which is sent to the prompt.

Community Contributions

New Contributors

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.8.4...1.9.0

SillyTavern - Obligatory Poe fix release v2

Published by Cohee1207 over 1 year ago

git pulling is still too hard

What's Changed

New Contributors

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.8.3...1.8.4

SillyTavern - Obligatory Poe fix release

Published by Cohee1207 over 1 year ago

Because doing a git pull takes skill

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.8.2...1.8.3

SillyTavern - 1.8.2

Published by Cohee1207 over 1 year ago

Minor bugfix release

Bug fixes

  • Moving UI for character images fixed
  • Chub embedded lorebooks fixed
  • ChromaDB auto-adjust % strategy fixed
  • Custom group avatar in hotswap bar fixed
  • Sanitation of WI file names fixed
  • Bottom of A/N persona position fixed
  • Correctly show Claude tokenizer in prompt itemizer and token counter
  • Race condition in tags import fixed

Improvements

  • /bgcol slash command to auto-select colors based on the current char background
  • /go slash command to quickly open a character by name
  • Help split into pages
  • k_euler_a sampler for Stable Horde
  • Refactored WI entry display
  • Clean-up of Kobold settings presets

Community contributions

New Contributors

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.8.1...1.8.2

SillyTavern - 1.8.1

Published by Cohee1207 over 1 year ago

Fix settings.json migration

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.8.0...1.8.1

SillyTavern - 1.8.0

Published by Cohee1207 over 1 year ago

SillyTavern 1.8.0

Efficiency Meets Immersion: Moar Lore & Slash Batching

Headliners

  • 'Continue' - makes the AI respond with an inline continuance of the last message
  • Unlimited Quick Reply slots
  • All slash commands are now batchable by using | as a pipe separator
  • Full V2 character card spec support (see below)
  • Massively augmented World Info system (see below)
  • Personas (swappable 'character' cards for the user)

New features

Character cards

  • Complete V2 character card spec integration
    • Character lorebooks
    • Creator notes and metadata
    • Creator notes show up in the character list
    • Jailbreak and 'Main' prompt overrides with optional {{original}} argument
  • Characters will export with linked WI embedded into the PNG
  • Character Author's Note as an optional override for chat/default Authors Note
  • Groups can have custom avatars now
  • Support importing embedded sprites from RisuAI cards
  • Option to display filenames in the character list
  • Import characters and lorebooks from Chub.ai via URL direct download
  • Import tags embedded in cards (safely and smartly, requires a setting to be enabled)
  • Added tag filter for group member search

API / Chat

  • Poe streaming 10x faster and smoother
  • Chat Completion (OAI, Claude, WAI) API preset import/export
  • TextGenWebUI (ooba) 'Prompt Arena' presets
  • New KAI preset - "RestoredRuins" using currently known best practices.
  • KoboldAI sampler order customization
  • OpenRouter (https://openrouter.ai/)
    • No longer needs a browser extension
    • OpenRouter now has PaLM and GPT-4-32k
    • Supports OAuth and API key authentication

World Info (WI)

  • Memos for entries
  • Send any WI entry to the top or bottom of the Author's Note
  • Character lorebooks apply separately from global WI
  • Unlimited WI file layering
  • WI entries can trigger randomly on a definable % rate
  • WI editor can edit any WI file at any time, regardless of what is active
  • WI budget is now based on % of context
  • WI entries are sort-draggable in the editor
  • Lorebook import from NovelAI (incl. Lorebook PNGs), AngAI (JSON), and RisuAI

Extension Improvements

  • Smart Context

    • auto adjust memory injections based on % of chat history
    • option to make SmartContext save a database for a character, spanning multiple chats

  • Summary can now use your primary API for the summary source, instead of the local Extras model

Interface and Usability

  • Story mode (NovelAI-like 'document style' mode with no chat bubbles of avatars)
  • Much more space-efficient character edit panel
  • Chat message timestamps
  • Chat message ID display
  • Negative tag filtering (persists between sessions)
  • Option to 'never resize avatars' when adding them to a character
  • Better multi-selectors for WI and Horde models
  • Set character avatars by clicking on the image in the edit panel, not a separate button
  • Character token warning only shows if using >50% of context
  • Scrolling the chat will stop 'auto-scroll to the bottom' while streaming
  • MovingUI panel locations/sizes are saved between sessions
  • Unlimited Zoomed Avatars
  • DeepL translation API support

Personas

  • Personas are character cards for the user
  • Username, avatar, and description (effectively WI for the user) are all linked and easily swappable

Themes

  • User and AI response messages can be colored differently on Bubble Chat mode
  • New default themes
  • FastUI only removes blur now; most UI panels get a black background instead.

Slash Commands

  • /comment - adds a comment message into the chat that will not affect it or be seen by AI.
  • /dupe - duplicate the currently selected character
  • /world - set or unset an active world
  • /api - quick connect to any API
  • /random - start a new chat with a random character in your list
  • /del # - can now delete a specific number of messages instantly (ex. /del 5)
  • /cut # - cut out an individual message from chat (based on Message-ID)
  • /resetpanels - fixes your UI when you break it.
  • /continue - triggers the Continue response method on the last message.
  • /flat, /bubble, /single - set the Chat display type

Notable Fixes

  • Mobile TTS playback no longer stops on swipes
  • ooba homunculus mode (as a Kobold endpoint) compatibility
  • Graceful Poe API rate limit handling
  • Grammarly browser extension visible on the input bar
  • Settings are automatically backed up on the ST server startup (/backups/ folder)
  • NovelAI Tablet tier context size corrected
  • /name works as a QuickReply now
  • Several..repeated..tedious...Poe API fixes

Community Contributions

New Contributors

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.7.3...1.8.0

Package Rankings
Top 22.77% on Npmjs.org
Related Projects
casibase

Spising: ⚡️Open-source AI LangChain-like RAG (Retrieval-Augmented Generation) knowledge database ...

29 May 2020 2,751
UniLLM

🦄 Consume any LLM from any provider, using the OpenAI API

10 Oct 2023 24
chat-wechat

06 Aug 2023 11