khoj

🎉 New

• Support customization of the OpenAI base url in admin settings by @sabaimran in https://github.com/khoj-ai/khoj/pull/725

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.11.0...1.11.1

🎉 New

• Added indication in the desktop UI for back-end connectivity by @Olatoyan in https://github.com/khoj-ai/khoj/pull/711
• Make Search Models More Configurable. Upgrade Default Cross-Encoder by @debanjum in https://github.com/khoj-ai/khoj/pull/722

🧪 Improve

• Improve the agents UX by @sabaimran in https://github.com/khoj-ai/khoj/pull/702
• Improve Chat Page Load Perf, Offline Chat Perf and Miscellaneous Fixes by @debanjum in https://github.com/khoj-ai/khoj/pull/703
• Add a database lock for jobs that shouldn't be run by multiple workers by @sabaimran in https://github.com/khoj-ai/khoj/pull/706
• Extract run with process lock logic into func. Use it to re-index content by @debanjum in https://github.com/khoj-ai/khoj/pull/710
• Support Llama 3 and Improve Offline Chat Actors by @debanjum in https://github.com/khoj-ai/khoj/pull/724
• Replaced reinitialize and save all button to a sync button in config.… by @AjaySDwivedi1 in https://github.com/khoj-ai/khoj/pull/701

⚒️ Fix

• Use set, inferred max token limits wherever chat models are used by @debanjum in https://github.com/khoj-ai/khoj/pull/713
• Fix loading of offline models on local machines to prevent too much RAM usage
• Fix Chat UI and Indexing on Desktop App by @debanjum in https://github.com/khoj-ai/khoj/pull/723

🎉 New Contributors

• @AjaySDwivedi1 made their first contribution in https://github.com/khoj-ai/khoj/pull/701
• @Olatoyan made their first contribution in https://github.com/khoj-ai/khoj/pull/711

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.10.2...1.11.0

🩹 Fix

• Fix Khoj Desktop app installation by @debanjum
  • Just use file extension to identify indexable file types
  • Fix including PDF files in indexable file types
  • Revert Desktop app size down to ~100 Mb instead of 250Mb (when was using Magika on Desktop app)

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.10.1...1.10.2

🩹 Fix

• Fix identifying text file types more robustly on server by @debanjum

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.10.0...1.10.1

🎉 New

• Send Welcome Emails when a new user signs up by @sabaimran in https://github.com/khoj-ai/khoj/pull/691
• Enable using Python 3.12 with Khoj by @debanjum in https://github.com/khoj-ai/khoj/pull/690
• Support indexing all text file types from Desktop, Github by @debanjum in https://github.com/khoj-ai/khoj/pull/692

🧪 Improve

• Update text chunking strategy to Improve search context by @debanjum in https://github.com/khoj-ai/khoj/pull/645
• Improve chat UI/UX on Desktop, Web app by @debanjum in https://github.com/khoj-ai/khoj/pull/693
• Simplify copying chat messages on Desktop, Web app

🩹 Fix

• Fix recursively indexing folders from Desktop app by @debanjum in https://github.com/khoj-ai/khoj/pull/692
• Fix inferring search queries to run on your documents

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.9.0...1.10.0

🎉 New

• Upgrade Offline Chat in Khoj to use Llama.cpp by @debanjum in https://github.com/khoj-ai/khoj/pull/680
  • Upgrade default chat model to NouseResearch's Hermes-2-Pro
  • Support using any chat model in GGUF format
  • Support more GPUs like AMD, Nvidia, Mac, Vulcan. Previously we just supported Vulcan, Mac
• Stream Khoj's intermediate actions during chat to the Web UI by @sabaimran in https://github.com/khoj-ai/khoj/pull/679

🧪 Improve

• Extract More Dates from entries to improve Date Filter by @debanjum in https://github.com/khoj-ai/khoj/pull/683

⚙️ Fix

• Address Notion, Image tech debt in indexing code path by @sabaimran in https://github.com/khoj-ai/khoj/pull/687

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.8.0...1.9.0

🎉 New

• Khoj Chat now supports 🤖 Custom Agents! by @sabaimran in https://github.com/khoj-ai/khoj/pull/671, https://github.com/khoj-ai/khoj/pull/675, https://github.com/khoj-ai/khoj/pull/682

🧪 Improve

• Ability to directly read web pages even if SERP not enabled by @debanjum in https://github.com/khoj-ai/khoj/pull/676

⚙️ Fix

• Improve Chat Session UX, Fix Login Errors, Chat Message Truncation by @debanjum in https://github.com/khoj-ai/khoj/pull/677

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.7.0...1.8.0

🎉 New

• Make Khoj respond about itself after reading up-to-date Info on Khoj websites by @debanjum in https://github.com/khoj-ai/khoj/pull/673

🧪 Improve

• Improve Search Quality on GPU machines by @debanjum in https://github.com/khoj-ai/khoj/pull/668
• Improve Speed of Chat with Web Lookups by @debanjum in https://github.com/khoj-ai/khoj/pull/670

⚙️ Fix

• Fix Notion indexing by @sabaimran in https://github.com/khoj-ai/khoj/commit/6aae9864d3ab877f7f28b27a02d6d645381204be
• Do not create new Chat Session when an old Chat Session is deleted by @debanjum in https://github.com/khoj-ai/khoj/pull/669
• Fix rendering Online References after streaming chat response by @debanjum in https://github.com/khoj-ai/khoj/commit/a1ce12296f692c83ce5b99bcb4ca9cdd3711fa87
• Fix opening References in Desktop app by @debanjum in https://github.com/khoj-ai/khoj/commit/1aeea3d854ffdb2e330ba31a1e77eec5e48267fe

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.6.2...1.7.0

🎉 New

• Include additional user context in the image generation flow by @sabaimran in https://github.com/khoj-ai/khoj/pull/660
• Support upload for files via drag/drop in the web UI by @sabaimran in https://github.com/khoj-ai/khoj/pull/666
• Upload generated images to s3, if AWS credentials and bucket is available by @sabaimran in https://github.com/khoj-ai/khoj/pull/667

🧪 Improve

• Make loading icons prettier @sabaimran
• Add link to blog in the docs

⚙️ Fix

• Add better error handling when image generation fails due to unsafe prompt @debanjum

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.6.1...1.6.2

🧪 Improve

• Improve Syncing Obsidian Vault by @debanjum in https://github.com/khoj-ai/khoj/pull/657

⚙️ Fix

• Fix, Improve rendering images in Obsidian, Desktop, Web clients by @debanjum in https://github.com/khoj-ai/khoj/pull/659
• Fix and Improve Chat UI in Web, Desktop apps by @debanjum in https://github.com/khoj-ai/khoj/pull/655
• Fix process to retrieve, create, and save conversations for ClientApplications by @sabaimran in https://github.com/khoj-ai/khoj/pull/656
• Various improvements, fixes for chat and settings by @sabaimran in https://github.com/khoj-ai/khoj/pull/652, https://github.com/khoj-ai/khoj/pull/658

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.6.0...1.6.1

🎉 New

• Support multiple chat sessions within the web UI by @sabaimran in https://github.com/khoj-ai/khoj/pull/638
• Add support for multiple chat sessions in the desktop application by @sabaimran in https://github.com/khoj-ai/khoj/pull/639
• Have Khoj dynamically select conversation command(s) in chat by @sabaimran in https://github.com/khoj-ai/khoj/pull/641

🧪 Improve

• Add additional personalization in Chat via Location, Username by @sabaimran in https://github.com/khoj-ai/khoj/pull/644
• Make Production Dependencies for Khoj Cloud Optional to Install by @debanjum in https://github.com/khoj-ai/khoj/pull/647

⚙️ Fix

• Fix process for generating embeddings for Notion entries by @sabaimran in https://github.com/khoj-ai/khoj/pull/648
• Miscellaneous bugs and fixes for chat sessions by @sabaimran in https://github.com/khoj-ai/khoj/pull/646

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.5.1...1.6.0

🎉 New

• Engage with Khoj via the Obsidian mobile app by @debanjum in https://github.com/khoj-ai/khoj/pull/635

🧪 Improve

• Make Offline Chat be aware of the current date and thinks step-by-step by @debanjum in https://github.com/khoj-ai/khoj/pull/636

⚙️ Fix

• Detect subscription state for users based on phone numbers, emails by @sabaimran in https://github.com/khoj-ai/khoj/pull/633

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.5.0...1.5.1

🎉 New

• Khoj can now read websites to answer your /online questions by @sabaimran in https://github.com/khoj-ai/khoj/pull/627
• Include info about privacy in the docs by @sabaimran in https://github.com/khoj-ai/khoj/pull/631

🧪 Improve

• Improve subqueries for online search and prompt generation for image by @sabaimran in https://github.com/khoj-ai/khoj/pull/626
• Add retries in case the embeddings API fails by @sabaimran in https://github.com/khoj-ai/khoj/pull/628
• Improve Khoj Chat and Settings UI by @debanjum in https://github.com/khoj-ai/khoj/pull/630

⚙️ Fix

• Store rate limiter-related metadata in the database for more resilience by @sabaimran in https://github.com/khoj-ai/khoj/pull/629

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.4.0...1.5.0

What's Changed

• Add support for a first-party client app to call into Khoj (Part 1) by @sabaimran in https://github.com/khoj-ai/khoj/pull/601
• Improve Chat Input Pane Actions. Move to 1 Click Audio Chat on Mobile by @debanjum in https://github.com/khoj-ai/khoj/pull/624
• Update the font used across Khoj desktop and web to be Tajawal by @sabaimran in https://github.com/khoj-ai/khoj/pull/622
• Add support for phone number authentication with Khoj (part 2) by @sabaimran in https://github.com/khoj-ai/khoj/pull/621

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.3.0...1.4.0

🎉 New

• Allow using HuggingFace's inference API to generate embeddings, rerank results by @sabaimran in https://github.com/khoj-ai/khoj/pull/609, https://github.com/khoj-ai/khoj/pull/616
• Use Docusaurus for Khoj Docs by @sabaimran, @debanjum in https://github.com/khoj-ai/khoj/pull/603, https://github.com/khoj-ai/khoj/pull/604

🧪 Improve

• Improve server status check and message in Obsidian client by @debanjum in https://github.com/khoj-ai/khoj/pull/617

⚙️ Fix

• Remove the 1000 files limit when syncing from Desktop, Obsidian clients by @debanjum in https://github.com/khoj-ai/khoj/pull/605
• Fix Khoj chat responses in Obsidian plugin when Dataview plugin enabled by @debanjum in https://github.com/khoj-ai/khoj/pull/619
  • Thanks to @ruboks_cube, @edbock, @flowingblaze in helping investigate this issue on Discord, Github 🌈
• Fix Offline Chat without GPU and Decoding Chat Query before Processing by @debanjum in https://github.com/khoj-ai/khoj/pull/611
• Short-circuit API rate limiter for unauthenticated users by @debanjum in https://github.com/khoj-ai/khoj/pull/607

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.2.1...1.3.0

🎉 New

• Understand multi-lingual content. Configure Khoj to use search models that understand 50+ languages by @sabaimran in https://github.com/khoj-ai/khoj/pull/587
• Index PDF, Markdown and Plaintext files using the Khoj Emacs client by @debanjum in e28adf2884c03cccddc3f3016b665f89565ebdef
• Add a health check API to the khoj server by @ayushjha119 in https://github.com/khoj-ai/khoj/pull/592

🧪 Improve

• Improve the Developer Documentation by @sabaimran in https://github.com/khoj-ai/khoj/pull/596

New Contributors

• @ayushjha119 made their first contribution in https://github.com/khoj-ai/khoj/pull/592
• @LiamSwayne made their first contribution in https://github.com/khoj-ai/khoj/pull/576

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.2.0...1.2.1

🎉 New

• Generate Images with Khoj by @debanjum, @sabaimran in https://github.com/khoj-ai/khoj/pull/580, https://github.com/khoj-ai/khoj/pull/585, https://github.com/khoj-ai/khoj/pull/586

🧪 Improve

• Recursively index folders using the Desktop app by @sabaimran in c5d297a9ed4e7160b398a079253eccc72bb9f0dd
• Add a ConversationCommand rate limiter for the chat endpoint by @sabaimran in https://github.com/khoj-ai/khoj/pull/584

⚙️ Fix

• Show system tray icon for Khoj desktop app by @debanjum in a57d529f394e5f14ef98cf7bdcee33d249d61b84
• Fix Chat Streaming on Obsidian, Docker Image Version and First-Run, Chat Error Messages in Clients by @debanjum in https://github.com/khoj-ai/khoj/pull/589
• Fix CSRF cookie for admin login by @sabaimran in https://github.com/khoj-ai/khoj/pull/585

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.1.0...1.2.0

What's Changed

🎉 New

• You can speak to Khoj from the Desktop, Web or Obsidian Client by @debanjum in https://github.com/khoj-ai/khoj/pull/566
• Khoj can search the Internet for real-time answers using Serper by @sabaimran in https://github.com/khoj-ai/khoj/pull/552
• Allow Deleting Conversation History from Web, Desktop, Obsidian Clients by @debanjum in https://github.com/khoj-ai/khoj/pull/551
• Suggest base questions for users to ask Khoj by @sabaimran in https://github.com/khoj-ai/khoj/pull/556

🧪 Improve

• Render Chat Responses as Markdown in Desktop, Obsidian Client by @debanjum in https://github.com/khoj-ai/khoj/pull/571
• Merge Github workflows to dockerize for production by @debanjum in https://github.com/khoj-ai/khoj/pull/575
• Enforce subscription state on the chat API access by @sabaimran in https://github.com/khoj-ai/khoj/pull/569

⚙️ Fix

• Handle Server Unavailable Error from Khoj.el by @debanjum in https://github.com/khoj-ai/khoj/pull/568

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.0.1...1.1.0

What's Changed

• Index Parent Headings of Org-Mode Entries to Improve Search Context by @debanjum in https://github.com/khoj-ai/khoj/pull/548
• Add test separators by @asim-shrestha in https://github.com/khoj-ai/khoj/pull/541
• Improve Self Hosted Khoj Setup by @debanjum in https://github.com/khoj-ai/khoj/pull/557
• Fix ranking search results on Obsidian by @debanjum in https://github.com/khoj-ai/khoj/pull/560
• Fix PyPi package app reference issue by @sabaimran in https://github.com/khoj-ai/khoj/pull/562
• fix: Fix local server usage by @dtkav in https://github.com/khoj-ai/khoj/pull/559
• Clean Logs, Improve Message Rendering and Make Khoj Trusted Host Configurable by @debanjum in https://github.com/khoj-ai/khoj/pull/561

New Contributors

• @asim-shrestha made their first contribution in https://github.com/khoj-ai/khoj/pull/541
• @dtkav made their first contribution in https://github.com/khoj-ai/khoj/pull/559

Full Changelog: https://github.com/khoj-ai/khoj/compare/1.0.0...1.0.1

Ambling Amla - Release 1.0.0

This is Khoj's first major version release 🎺! It prepares Khoj for cloud scale usage and simplifies Desktop, Obsidian and Emacs client setups. As part of this release, we also did some house cleaning and resolved 11 issues in Khoj's backlog 🧹✨

🎉 New

• Khoj now supports multiple users and uses Postgres as DB to host Khoj on the Cloud by @sabaimran, @debanjum in https://github.com/khoj-ai/khoj/pull/549

🧪 Improve

• Improve Khoj UI for Desktop and Web App. Make the settings page a little less confusing by @debanjum in https://github.com/khoj-ai/khoj/pull/538
• Update the chat UI to have richer representation of the references by @sabaimran in https://github.com/khoj-ai/khoj/pull/536
• Update Documentation for simpler setup of clients with Khoj cloud by @sabaimran, @debanjum in https://github.com/khoj-ai/khoj/pull/550

⚙️ Fix

• Reduce RAM utilization by using Postgres DB instead of using JSONL files and in-memory index by @sabaimran

Full Changelog: https://github.com/khoj-ai/khoj/compare/0.14.0...1.0.0