WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding
BSD-3-CLAUSE License
Bot releases are hidden (Show)
We've implemented the context-switching mechanism, and it's available in our latest version of the VS Code plugin. Now, you can change the max context value for models depending on your needs — small context for less memory usage and faster operation or large context for deeper insights.
Our UI updates now flag models slated for removal. This ensures you're always working with the latest and most efficient models.
We've resolved issues with the factory reset process for when you need a fresh start.
Published by mitya52 6 months ago
Published by mitya52 7 months ago
Published by mitya52 9 months ago
Published by mitya52 9 months ago
Open-Source Updates:
Enterprise Updates:
beta
to latest
in docker-compose.yml
. Ensure to update your compose file.Published by mitya52 10 months ago
New Models
Expanding the list of available models with:
Statistics
We are introducing a new cool feature - user stats.
Check out the new page with informative charts to see the impact of having Refact!
Better Docker Flow
We've simplified our Docker image usage! Now, it's just one command:
docker run --rm --gpus all -p 8008:8008 -v perm-storage:/perm_storage -v
refact-database:/var/lib/cassandra smallcloud/refact_self_hosting:latest
UI Enhancements
General Improvements and Chat Handlers
Published by mitya52 11 months ago
Deepseek-Coder Models:
We added support for the deepseek-coder family models, and you can use these models for completion and fine-tuning.
Codellama/7b:
Starting today, the codellama/7b
model is available for fine-tuning.
Faster Fine-Tuning:
Fine-tuning is now faster for GPUs with CUDA capabilities 8.0
and higher.
UI & Performance:
General UI and performance improvements.
Published by mitya52 12 months ago
Starcoder 1b, 3b, and 7b models are now available for completion and finetuning.
Published by mitya52 about 1 year ago