lancedb

What's Changed

• Performance improvements in index creation
• Expressions now support escaping column names, timestamp / date literals, and cast expressions
• Allow recreate index with the same name on the same column
• Various Python API Improvements by @wjones127 in https://github.com/lancedb/lancedb/pull/162
• [docs] Fixed Minor typo in embedding.md by @trueutkarsh in https://github.com/lancedb/lancedb/pull/167
• [Python] FIx Contextualizer validation to arguments by @Nithinps021 in https://github.com/lancedb/lancedb/pull/168
• add black to python CI by @TevinWang in https://github.com/lancedb/lancedb/pull/178
• feat(python): add action to tag python releases by @gsilvestrin in https://github.com/lancedb/lancedb/pull/172
• Bump pylance 0.4.17 -> 0.4.20 by @gsilvestrin in https://github.com/lancedb/lancedb/pull/173
• feat(python): add action to build and publish wheel by @gsilvestrin in https://github.com/lancedb/lancedb/pull/179

New Contributors

• @trueutkarsh made their first contribution in https://github.com/lancedb/lancedb/pull/167
• @Nithinps021 made their first contribution in https://github.com/lancedb/lancedb/pull/168
• @TevinWang made their first contribution in https://github.com/lancedb/lancedb/pull/178

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.1.6-python...python-v0.1.8

Work around tantivy issue returning empty results

What's Changed

• js docs, modal example, doc notebook integration, update doc styles by @jaichopra in https://github.com/lancedb/lancedb/pull/131
• update references to end to end examples, use s3 for langchain exampl… by @jaichopra in https://github.com/lancedb/lancedb/pull/133
• fix index docs by @jaichopra in https://github.com/lancedb/lancedb/pull/134
• Minor patch to docs by @jaichopra in https://github.com/lancedb/lancedb/pull/136
• Update mkdocs.yml by @jaichopra in https://github.com/lancedb/lancedb/pull/138
• [Doc] Metrics types. by @eddyxu in https://github.com/lancedb/lancedb/pull/135
• Adding nodejs CHANGELOG.md by @gsilvestrin in https://github.com/lancedb/lancedb/pull/132
• add code snippet for each example by @changhiskhan in https://github.com/lancedb/lancedb/pull/141
• Update broken doc links to refer to new directory and include gallery app for multimodal search by @jaichopra in https://github.com/lancedb/lancedb/pull/142
• add multimodal gif, add copy about fts, sql by @jaichopra in https://github.com/lancedb/lancedb/pull/144
• Modal example using LangChain by @jaichopra in https://github.com/lancedb/lancedb/pull/143
• added projection api for nodejs by @gsilvestrin in https://github.com/lancedb/lancedb/pull/140
• [nodejs] add npm clean task by @gsilvestrin in https://github.com/lancedb/lancedb/pull/146
• [nodejs] deprecated created_index in favor of createIndex. by @gsilvestrin in https://github.com/lancedb/lancedb/pull/145
• [nodejs] bumping version to 0.1.4 by @gsilvestrin in https://github.com/lancedb/lancedb/pull/147
• Better handle empty results from tantivy by @changhiskhan in https://github.com/lancedb/lancedb/pull/155

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.1.5-python...v0.1.6-python

Thanks @gssakash for improving lancedb docs to make it easier for newcomers to use LanceDB!

In this release LanceDB now supports storing tables on S3 and GCS directly.

What's Changed

• Fixed documentation link for the Youtube Transcripts Jupyter Notebook by @gssakash in https://github.com/lancedb/lancedb/pull/105
• Better error granularity for table operations by @gsilvestrin in https://github.com/lancedb/lancedb/pull/113
• refactor: pull node binaries into separate packages by @wjones127 in https://github.com/lancedb/lancedb/pull/88
• Generate image embeddings by @eddyxu in https://github.com/lancedb/lancedb/pull/111
• add openai embedding function to nodejs client by @gsilvestrin in https://github.com/lancedb/lancedb/pull/107
• Multimodal search demo by @changhiskhan in https://github.com/lancedb/lancedb/pull/118
• add existence check by @jaichopra in https://github.com/lancedb/lancedb/pull/112
• Revert "refactor: pull node binaries into separate packages (#88)" by @gsilvestrin in https://github.com/lancedb/lancedb/pull/122
• [Python] Support drop table by @eddyxu in https://github.com/lancedb/lancedb/pull/123
• Bumping vectordb to v0.1.3 by @gsilvestrin in https://github.com/lancedb/lancedb/pull/124
• Use fsspec to implement table_names with cloud storage support by @gsilvestrin in https://github.com/lancedb/lancedb/pull/117

New Contributors

• @gssakash made their first contribution in https://github.com/lancedb/lancedb/pull/105

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.1.4-python...v0.1.5-python

1.5 -> 1.4

Also updated to the latest v0.4.17 in Lance which comes with bug fixes and performance enhancements

What's Changed

• add embedding functions to the nodejs client by @gsilvestrin in https://github.com/lancedb/lancedb/pull/95
• Support S3 and GCS from typescript SDK by @eddyxu in https://github.com/lancedb/lancedb/pull/106

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.1.3...v0.1.4-python

What's Changed

• S3 Lambda example by @jaichopra in https://github.com/lancedb/lancedb/pull/57
• add langchain example by @jaichopra in https://github.com/lancedb/lancedb/pull/61
• update ecosystem in readme by @jaichopra in https://github.com/lancedb/lancedb/pull/63
• add youtube transcript example by @jaichopra in https://github.com/lancedb/lancedb/pull/65
• JavaScript / Node.js library for LanceDB by @gsilvestrin in https://github.com/lancedb/lancedb/pull/70
• bump version and skipping building the native lib during install by @gsilvestrin in https://github.com/lancedb/lancedb/pull/71
• javascript example improvements by @gsilvestrin in https://github.com/lancedb/lancedb/pull/72
• Exposing limit parameter by @gsilvestrin in https://github.com/lancedb/lancedb/pull/73
• updated node example by @gsilvestrin in https://github.com/lancedb/lancedb/pull/74
• nodejs read only example by @jaichopra in https://github.com/lancedb/lancedb/pull/77
• docs build by @jaichopra in https://github.com/lancedb/lancedb/pull/78
• nodejs create_table by @gsilvestrin in https://github.com/lancedb/lancedb/pull/75
• add link to node quickstart to readme by @jaichopra in https://github.com/lancedb/lancedb/pull/81
• node quickstart by @jaichopra in https://github.com/lancedb/lancedb/pull/83
• Added TypeScript example by @gsilvestrin in https://github.com/lancedb/lancedb/pull/82
• JavaScript client initial linux support by @gsilvestrin in https://github.com/lancedb/lancedb/pull/84
• nodejs append records api by @gsilvestrin in https://github.com/lancedb/lancedb/pull/85
• Lint and test vectordb node in CI by @wjones127 in https://github.com/lancedb/lancedb/pull/92
• bugfix: string columns should be converted to Utf8Array by @gsilvestrin in https://github.com/lancedb/lancedb/pull/94
• add query params to to nodejs client by @gsilvestrin in https://github.com/lancedb/lancedb/pull/87
• add create index to nodejs client by @gsilvestrin in https://github.com/lancedb/lancedb/pull/89
• Basic full text search capabilities by @changhiskhan in https://github.com/lancedb/lancedb/pull/62
• move tantivy-py installation to be separate from wheel by @changhiskhan in https://github.com/lancedb/lancedb/pull/97

New Contributors

• @wjones127 made their first contribution in https://github.com/lancedb/lancedb/pull/92

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.1.2...v0.1.3

In this release we've enabled support for cloud storage. Now you can store the LanceDB table directly on S3 or GS buckets.
We've also begun work on a Rust core in LanceDB as well for improved performance.

We'd love to hear from you!

What's Changed

• Rust core directory by @eddyxu in https://github.com/lancedb/lancedb/pull/49
• add new feature to readme.md by @jaichopra in https://github.com/lancedb/lancedb/pull/52
• also update docs index by @jaichopra in https://github.com/lancedb/lancedb/pull/53
• update tagline by @jaichopra in https://github.com/lancedb/lancedb/pull/55
• Add method to get the URI scheme to support cloud storage by @changhiskhan in https://github.com/lancedb/lancedb/pull/58

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.1.1...v0.1.2

Welcome @wilhelmjung to the LanceDB contributor community!

Based on community feedback, we added a lot more documentation about the ANN index and querying features.
We also made the distance metric configurable (currently supports L2 and Cosine, more to come).

What's Changed

• add ann_index to main doc page by @gsilvestrin in https://github.com/lancedb/lancedb/pull/38
• Update index.md by @wilhelmjung in https://github.com/lancedb/lancedb/pull/39
• skipping embeddings rate limit when python version > 3.10 by @gsilvestrin in https://github.com/lancedb/lancedb/pull/37
• Minor notebook fix. Closes #40 by @changhiskhan in https://github.com/lancedb/lancedb/pull/45
• Make distance metric configurable in LanceDB by @changhiskhan in https://github.com/lancedb/lancedb/pull/47
• Add more detailed docs for the ANN index and search features by @changhiskhan in https://github.com/lancedb/lancedb/pull/46

New Contributors

• @wilhelmjung made their first contribution in https://github.com/lancedb/lancedb/pull/39

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.1...v0.1.1

What's Changed

• invalidate cached dataset after create_index and add by @changhiskhan in https://github.com/lancedb/lancedb/pull/26
• [DOC] basic operations by @changhiskhan in https://github.com/lancedb/lancedb/pull/32
• [Doc] Pandas, Parrow, DuckDB integration by @eddyxu in https://github.com/lancedb/lancedb/pull/31
• [DOC] embedding function documentation by @changhiskhan in https://github.com/lancedb/lancedb/pull/33
• expose methods to work with versioning in tables by @changhiskhan in https://github.com/lancedb/lancedb/pull/35
• [DOC] ann indexes documentation by @gsilvestrin in https://github.com/lancedb/lancedb/pull/36
• Add mode to overwrite table if already exists by @changhiskhan in https://github.com/lancedb/lancedb/pull/34

New Contributors

• @eddyxu made their first contribution in https://github.com/lancedb/lancedb/pull/31

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.0.4...v0.1