3.0.0-beta.4 (2024-01-21)

Features

• minor: add --printTimings option to the chat CLI command (#138) (c0f5bd8)

Shipped with llama.cpp release b1892

To use the latest llama.cpp release available, run npx --no node-llama-cpp download --release latest. (learn more)

2.8.5 (2024-01-21)

Features

• minor: add --printTimings option to the chat CLI command (#138) (c0f5bd8)

3.0.0-beta.3 (2024-01-21)

Features

• get embedding for text (#144) (4cf1fba)

Shipped with llama.cpp release b1892

To use the latest llama.cpp release available, run npx --no node-llama-cpp download --release latest. (learn more)

2.8.4 (2024-01-20)

3.0.0-beta.2 (2024-01-20)

Bug Fixes

• adapt to breaking changes of llama.cpp (#117) (595a6bc)
• threads parameter (#139) (5fcdf9b)
• disable Metal for x64 arch by default (#139) (5fcdf9b)

Features

• function calling (#139) (5fcdf9b)
• chat syntax aware context shifting (#139) (5fcdf9b)
• stateless LlamaChat (#139) (5fcdf9b)
• improve chat wrapper (#139) (5fcdf9b)
• LlamaText util (#139) (5fcdf9b)
• show llama.cpp release in GitHub releases (#142) (36c779d)

Shipped with llama.cpp release b1892

To use the latest llama.cpp release available, run npx --no node-llama-cpp download --release latest (learn more)

2.8.3 (2023-12-18)

Bug Fixes

• optional typescript peer dependency (#127) (ba975e9)

2.8.2 (2023-12-09)

Bug Fixes

• adapt to breaking changes of llama.cpp (#117) (595a6bc)

2.8.1 (2023-12-06)

3.0.0-beta.1 (2023-11-26)

Features

• automatic batching (#104) (4757af8)

BREAKING CHANGES

• completely new API (docs will be updated before a stable version is released)

2.8.0 (2023-11-06)

Features

• export llama.cpp release info (#91) (190ef96)

2.7.5 (2023-11-05)

2.7.4 (2023-10-25)

Bug Fixes

• do not download redundant node headers (#80) (ff1644d)
• improve cmake custom options handling (#80) (ff1644d)
• do not set CMAKE_GENERATOR_TOOLSET for CUDA (#80) (ff1644d)
• do not fetch information from GitHub when using a local git bundle (#80) (ff1644d)
• GBNF JSON schema string const formatting (#80) (ff1644d)

Features

• adapt to the latest llama.cpp interface (#80) (ff1644d)
• print helpful information to help resolve issues when they happen (#80) (ff1644d)
• make portable cmake on Windows more stable (#80) (ff1644d)
• update CMakeLists.txt to match llama.cpp better (#80) (ff1644d)

2.7.3 (2023-10-13)

2.7.2 (2023-10-12)

Features

• minor: save and load history to chat command (#71) (dc88531)

2.7.1 (2023-10-11)

Bug Fixes

• GeneralChatPromptWrapper output (#70) (4ff8189)
• improve JSON schema validation error messages (#69) (c41da09)

2.7.0 (2023-10-11)

Features

• add JSON schema grammar support (#68) (8ceac05)
• add promptWithMeta function to LlamaChatSession (#68) (8ceac05)

2.6.3 (2023-10-10)

Bug Fixes

• improve CUDA compilation (#66) (8691585)

2.6.2 (2023-10-09)

Bug Fixes

• add documentation to Google Search (#65) (eb61383)

2.6.1 (2023-10-09)

Bug Fixes

• git bundle info for build (#64) (88e89d2)

2.6.0 (2023-10-09)

Features

• adapt to llama.cpp changes (#60) (3400fce)
• add repeat penalty support (#60) (3400fce)
• improve grammar support (#60) (3400fce)
• better API for customizing context and chat session options, while maintaining compatibility with existing API (#60) (3400fce)
• git release bundle (#61) (ada896b)
• new documentation website (#62) (c0deffd)
• improve chat command (#62) (c0deffd)