whisperer-ai

Whisperer is a privacy-first, browser-based AI chat application that stores all data locally using the pglite library. It supports advanced AI interactions with Retrieval-Augmented Generation (RAG) using pgvector for enhanced, context-aware conversations, including seamless interactions with PDF documents.

APACHE-2.0 License

Stars
4

Whisperer

Whisperer is a privacy-focused, browser-based AI chat application. All message history is stored locally, ensuring that no data is sent to external servers. Utilizing pglite with pgvector, Whisperer enhances AI interactions and enables seamless conversations with PDF documents.

Features

  • Privacy-First: All data is stored locally, preserving user privacy.
  • Browser-Based: No installation required; accessible directly from the browser.
  • Powerful RAG Capabilities: Leverages pgvector for advanced Retrieval-Augmented Generation (RAG), combining information retrieval and AI-generated responses.
  • PDF Interaction: Load PDFs and interact with the content through AI.
  • Modern Tech Stack: Built with React, Tailwind CSS, shadcn, ai-sdk, Drizzle, and pglite.

How does it work?

Whisperer utilizes the pglite library to store all data locally in IndexedDB. This approach ensures that no data ever leaves the user's device, maintaining privacy and security. Additionally, pglite supports the pgvector extension, allowing Whisperer to implement Retrieval-Augmented Generation (RAG) by leveraging embeddings for more accurate and context-aware AI interactions.

Tech Stack

Installation

  1. Clone the repository:

    git clone https://github.com/HirotoShioi/Whisperer.git
    cd Whisperer
    
  2. Install the required packages:

    npm install
    
  3. Start the development server:

    npm run dev
    
  4. Open http://localhost:3000 in your browser to use the app.

References

License

Apache 2.0