Dot

Standalone app for fully local RAG with Mistral 7B

GPL-3.0 License

Stars
658
Committers
1

Bot releases are visible (Hide)

Dot - ๐Ÿ”ต New features, changes, and fixes! ๐Ÿ”ต Latest Release

Published by alexpinel 6 months ago

Hello!

Made some changes and added a few features! As always Dot can be installed through the website, or the binaries can be found on this very release.

๐Ÿฆ” FEATURES:

  • Dot will now remember what documents you loaded after closing the app!
  • Doc Dot will now display the texts from which it formulated its answers, for PDFs it will also display the actual document on the correct page!

๐Ÿฆ†CHANGES:

  • Dot will not be installed with Mistral 7B anymore but will rather install it when opening the app for the first time.
  • Changed embedding model to BAAI llm-embedder this should increase the quality of Doc Dot's semantic searching capabilities.

๐Ÿ KNOWN BUGS:

  • Sometimes answers that are too long are not displayed at all. This is due to the JSON output generated by python being split due to its length, the JS render process is then unable to read the truncated JSON.

๐Ÿ“ WORKING ON:

  • Docker image
  • Linux version
  • MacOS intel version
  • Improved performance
  • Making it work on 8gb RAM devices

Anyway, hope you enjoy! Please let me know if there are any issues :)

Dot - Windows fix

Published by alexpinel 7 months ago

Hi! After some back and forth it looks like I manged to fix the problems with the windows version.

The new release (available on the website here should address the issue where the app was stuck on "dot is typing..." for windows users. The cause of the issue was the lack of a few dependencies required for llama.cpp to function properly.

Also, I recently learned just how expensive it is to code sign an app for windows, and unfortunately, that is waaaay beyond my budget right now which means windows defender might not like Dot at first...

Please let me know if you are facing any issues!

Package Rankings
Top 6.75% on Proxy.golang.org
Badges
Extracted from project README
Star History Chart
Related Projects