llm-jupyter

Run a IPython interpreter in the LLM virtual environment

Installation

Install this plugin in the same environment as LLM.

pipx install llm
llm install llm-jupyter

Usage

IPython

This plugin adds a new ipython command to LLM. This executes IPython in the same virtual environment as LLM itself.

You can use this to check the Python version

llm ipython --version
# Should output '8.20.0' or similar

Or to start a IPython shell. In that shell you can import llm and use it to interact with models:

llm ipython

In [1]: %llm 'Who are you?'

# LLM output will be set as the next input
In [2]: print("I am a Python programmer using Jupyter Notebook.")
I am a Python programmer using Jupyter Notebook.

In [3]: %llm --help
usage: __main__.py [-h] [--print] [--model MODEL] [--system SYSTEM] [prompt ...]

positional arguments:
  prompt                Prompt to use

optional arguments:
  -h, --help            show this help message and exit
  --print, -p           Only print the output
  --model MODEL, -m MODEL
                        Model to use
  --system SYSTEM, -s SYSTEM
                        System prompt to use

https://github.com/lucasrcezimbra/llm-jupyter/assets/7042915/b7f8a9ec-d269-4b24-bac3-a01ad6802032

Notebook

This plugin also adds a new notebook command to LLM. This executes a Jupyter Notebook in the same virtual environment as LLM itself.

llm notebook

%load_ext llm_jupyter.magic

%llm 'Who are you?'

# LLM output will be set as the next input
print("I am a Python programmer using Jupyter Notebook.")

https://github.com/lucasrcezimbra/llm-jupyter/assets/7042915/58c63b2e-3a7b-43f1-b0aa-ab3daf2e9810

Development

To set up this plugin locally, first checkout the code. Then create a new virtual environment:

git clone [email protected]:lucasrcezimbra/llm-jupyter.git
cd llm-jupyter
python -m venv .venv
source .venv/bin/activate
pip install -e .[test]

Now install the dependencies and test dependencies:

llm install -e '.[test]'

To run the tests:

pytest

Package Rankings

Top 35.69% on Pypi.org

Badges

Extracted from project README

Related Projects

llm-mpt30b

LLM plugin adding support for the MPT-30B language model

08 Jul 2023 31

llm-gemini

LLM plugin to access Google's Gemini family of models

13 Dec 2023 91

llm-command-r

Access the Cohere Command R family of models

04 Apr 2024 30

llm-llamafile

Access llamafile localhost models via LLM

22 Apr 2024 13

llm-anyscale-endpoints

LLM plugin for models hosted by Anyscale Endpoints

23 Aug 2023 31

llm-gguf

Run models distributed as GGUF files using LLM

23 Jul 2024 21

llm-rag

Answer questions against collections stored in LLM using Retrieval Augmented Generation

29 Jan 2024 22

llm-openrouter

LLM plugin for models hosted by OpenRouter

20 Aug 2023 69

llm-python

"llm python" is a command to run a Python interpreter in the LLM virtual environment

27 Oct 2023 20

llm-evals-plugin

Run evals using LLM

20 Apr 2024 20

llm-markov

Plugin for LLM adding a Markov chain generating model

04 Jul 2023 10

llm-cluster

LLM plugin for clustering embeddings

04 Sep 2023 61

llm-cmd

Use LLM to generate and execute commands in your shell

26 Mar 2024 107

llm

Access large language models from the command-line

01 Apr 2023 4,329

llm-claude-3

LLM plugin for interacting with the Claude 3 family of models

04 Mar 2024 213