lancedb

🎉 New Features

• feat(nodejs): merge insert by @universalmind303 in https://github.com/lancedb/lancedb/pull/1351
• feat: upgrade lance to 0.12.2-beta.2 by @westonpace in https://github.com/lancedb/lancedb/pull/1381
• feat(nodejs): feature parity [1/N] - remote table by @universalmind303 in https://github.com/lancedb/lancedb/pull/1378
• feat: enable stemming by @josca42 in https://github.com/lancedb/lancedb/pull/1356
• feat(nodejs): feature parity [2/N] - add table.name and lancedb.connect({args}) by @universalmind303 in https://github.com/lancedb/lancedb/pull/1380
• feat(nodejs): feature parity [3/N] - createTable({name, data, ...options}) by @universalmind303 in https://github.com/lancedb/lancedb/pull/1386
• feat(nodejs): feature parity [4/N] - add 'name' to 'IndexConfig' for 'listIndices' by @universalmind303 in https://github.com/lancedb/lancedb/pull/1390
• feat(nodejs): feature parity [5/N] - add query.filter() alias by @universalmind303 in https://github.com/lancedb/lancedb/pull/1391
• feat(nodejs): table.indexStats by @universalmind303 in https://github.com/lancedb/lancedb/pull/1361
• feat: upgrade to lance 0.13.0 by @westonpace in https://github.com/lancedb/lancedb/pull/1404

🐛 Bug Fixes

• fix: add status to remote listIndices return by @QianZhu in https://github.com/lancedb/lancedb/pull/1364
• fix(java): the JVM crash when using jdk 8 by @beinan in https://github.com/lancedb/lancedb/pull/1372
• fix: use JS naming convention in new index stats fields by @rpgreen in https://github.com/lancedb/lancedb/pull/1377
• fix(node): node build by @universalmind303 in https://github.com/lancedb/lancedb/pull/1396

📚 Documentation

• docs: add retriever guide, address minor onboarding feedbacks & enhancement by @AyushExel in https://github.com/lancedb/lancedb/pull/1326
• docs: fix example path by @AyushExel in https://github.com/lancedb/lancedb/pull/1367
• docs: add note about embedding api not being available on cloud by @AyushExel in https://github.com/lancedb/lancedb/pull/1371
• docs: llama-index integration by @raghavdixit99 in https://github.com/lancedb/lancedb/pull/1347
• docs: remove code-block:: python from docs by @harsha-mangena in https://github.com/lancedb/lancedb/pull/1366

🔧 Build and CI

• ci(node): add description and keywords for lancedb package by @wjones127 in https://github.com/lancedb/lancedb/pull/1398

🎉 New Features

• feat: add support for new cohere models in cohere and bedrock embedding functions by @AyushExel in https://github.com/lancedb/lancedb/pull/1335
• feat(rust): openai embedding function by @universalmind303 in https://github.com/lancedb/lancedb/pull/1275
• feat(nodejs): table.toArrow function by @paulwalsh-sonrai in https://github.com/lancedb/lancedb/pull/1282
• feat(rust): allow to create execution plan on queries by @eddyxu in https://github.com/lancedb/lancedb/pull/1350
• feat(nodejs): table.search functionality by @universalmind303 in https://github.com/lancedb/lancedb/pull/1341
• feat: add fast path to dataset reload by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/1354
• feat: fast path for checkout_latest by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/1355
• feat: make it possible to opt in to using the v2 format by @westonpace in https://github.com/lancedb/lancedb/pull/1352
• feat: bump lance dependency to 0.12.1 by @westonpace in https://github.com/lancedb/lancedb/pull/1357

🐛 Bug Fixes

• fix: update broken blog link on readme by @paulrinaldi in https://github.com/lancedb/lancedb/pull/1310
• fix: error msg when query vector dim is wrong by @QianZhu in https://github.com/lancedb/lancedb/pull/1339
• fix(nodejs): better support for f16 and f64 by @universalmind303 in https://github.com/lancedb/lancedb/pull/1343

🎉 New Features

• feat: add support for new cohere models in cohere and bedrock embedding functions by @AyushExel in https://github.com/lancedb/lancedb/pull/1335
• feat(rust): openai embedding function by @universalmind303 in https://github.com/lancedb/lancedb/pull/1275
• feat(nodejs): table.toArrow function by @paulwalsh-sonrai in https://github.com/lancedb/lancedb/pull/1282
• feat(rust): allow to create execution plan on queries by @eddyxu in https://github.com/lancedb/lancedb/pull/1350
• feat(nodejs): table.search functionality by @universalmind303 in https://github.com/lancedb/lancedb/pull/1341
• feat: add fast path to dataset reload by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/1354
• feat: fast path for checkout_latest by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/1355
• feat: make it possible to opt in to using the v2 format by @westonpace in https://github.com/lancedb/lancedb/pull/1352
• feat: bump lance dependency to 0.12.1 by @westonpace in https://github.com/lancedb/lancedb/pull/1357

🐛 Bug Fixes

• fix: update broken blog link on readme by @paulrinaldi in https://github.com/lancedb/lancedb/pull/1310
• fix: error msg when query vector dim is wrong by @QianZhu in https://github.com/lancedb/lancedb/pull/1339
• fix(nodejs): better support for f16 and f64 by @universalmind303 in https://github.com/lancedb/lancedb/pull/1343

🎉 New Features

• feat: support IVF_HNSW_PQ by @BubbleCal in https://github.com/lancedb/lancedb/pull/1314
• feat(java): add table names java api by @LuQQiu in https://github.com/lancedb/lancedb/pull/1279
• feat: js embedding registry by @universalmind303 in https://github.com/lancedb/lancedb/pull/1308
• feat(nodejs): add compatibility across arrow versions by @universalmind303 in https://github.com/lancedb/lancedb/pull/1337
• feat: upgrade lance to 0.11.1 by @westonpace in https://github.com/lancedb/lancedb/pull/1338

🐛 Bug Fixes

• fix: parse index_stats for scalar index by @QianZhu in https://github.com/lancedb/lancedb/pull/1319
• fix: the bug of async connection context manager by @ChenZhongPu in https://github.com/lancedb/lancedb/pull/1333

🎉 New Features

• feat: support IVF_HNSW_PQ by @BubbleCal in https://github.com/lancedb/lancedb/pull/1314
• feat(java): add table names java api by @LuQQiu in https://github.com/lancedb/lancedb/pull/1279
• feat: js embedding registry by @universalmind303 in https://github.com/lancedb/lancedb/pull/1308
• feat(nodejs): add compatibility across arrow versions by @universalmind303 in https://github.com/lancedb/lancedb/pull/1337
• feat: upgrade lance to 0.11.1 by @westonpace in https://github.com/lancedb/lancedb/pull/1338

🐛 Bug Fixes

• fix: parse index_stats for scalar index by @QianZhu in https://github.com/lancedb/lancedb/pull/1319
• fix: the bug of async connection context manager by @ChenZhongPu in https://github.com/lancedb/lancedb/pull/1333

This release does not contain any changes from 0.7.0 and was created to address CI issues that arose while publishing 0.7.0

🎉 New Features

• feat: support IVF_HNSW_SQ by @BubbleCal in https://github.com/lancedb/lancedb/pull/1284
• feat: add the optimize function to nodejs and async python by @westonpace in https://github.com/lancedb/lancedb/pull/1257
• feat: upgrade lance to 0.11.0 by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/1317

🐛 Bug Fixes

• fix(nodejs): add better error handling when missing embedding functions by @universalmind303 in https://github.com/lancedb/lancedb/pull/1290
• fix: remove accidental console.log by @universalmind303 in https://github.com/lancedb/lancedb/pull/1307
• fix: get the last stable release before we've added a new tag by @westonpace in https://github.com/lancedb/lancedb/pull/1320

Other Changes

• Add ollama embeddings function by @asmith26 in https://github.com/lancedb/lancedb/pull/1263
• Documentation: Langchain Integration by @raghavdixit99 in https://github.com/lancedb/lancedb/pull/1297
• Documentation : Langchain doc bug fix by @raghavdixit99 in https://github.com/lancedb/lancedb/pull/1301
• ci: write down breaking change policy by @wjones127 in https://github.com/lancedb/lancedb/pull/1294
• refactor(nodejs): use biomejs instead of eslint & prettier by @universalmind303 in https://github.com/lancedb/lancedb/pull/1304

🔧 Build and CI

• ci: make preview releases by @wjones127 in https://github.com/lancedb/lancedb/pull/1302
• ci: pin aws sdk versions by @wjones127 in https://github.com/lancedb/lancedb/pull/1318

🎉 New Features

• feat: support IVF_HNSW_SQ by @BubbleCal in https://github.com/lancedb/lancedb/pull/1284
• feat: add the optimize function to nodejs and async python by @westonpace in https://github.com/lancedb/lancedb/pull/1257
• feat: upgrade lance to 0.11.0 by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/1317

🐛 Bug Fixes

• fix(nodejs): add better error handling when missing embedding functions by @universalmind303 in https://github.com/lancedb/lancedb/pull/1290
• fix: remove accidental console.log by @universalmind303 in https://github.com/lancedb/lancedb/pull/1307
• fix: get the last stable release before we've added a new tag by @westonpace in https://github.com/lancedb/lancedb/pull/1320

Other Changes

• Add ollama embeddings function by @asmith26 in https://github.com/lancedb/lancedb/pull/1263
• Documentation: Langchain Integration by @raghavdixit99 in https://github.com/lancedb/lancedb/pull/1297
• Documentation : Langchain doc bug fix by @raghavdixit99 in https://github.com/lancedb/lancedb/pull/1301
• ci: write down breaking change policy by @wjones127 in https://github.com/lancedb/lancedb/pull/1294
• refactor(nodejs): use biomejs instead of eslint & prettier by @universalmind303 in https://github.com/lancedb/lancedb/pull/1304

🔧 Build and CI

• ci: make preview releases by @wjones127 in https://github.com/lancedb/lancedb/pull/1302
• ci: pin aws sdk versions by @wjones127 in https://github.com/lancedb/lancedb/pull/1318

What's Changed

• Remove semvar strict dependancy by @AmanKishore in https://github.com/lancedb/lancedb/pull/1253
• fix rename_table api and cache pop by @QianZhu in https://github.com/lancedb/lancedb/pull/1283
• chore: bump lance to v0.10.18 by @albertlockett in https://github.com/lancedb/lancedb/pull/1287

Bug fixes from Lance 🐛

This release includes some important bug fixes from Lance dependency:

• fix: relax 'take out of bounds' check which could cause failure if flat searching deleted rows by @westonpace https://github.com/lancedb/lance/pull/2314
• fix: fix a panic that could happen when scanning only the row id from fragment with deleted rows by @westonpace https://github.com/lancedb/lance/pull/2302

New Contributors

• @AmanKishore made their first contribution in https://github.com/lancedb/lancedb/pull/1253

Full Changelog: https://github.com/lancedb/lancedb/compare/python-v0.6.12...python-v0.6.13

What's Changed

• chore: upgrade lance to 0.10.17 by @rpgreen in https://github.com/lancedb/lancedb/pull/1280
• chore: bump lance to v0.10.18 by @albertlockett in https://github.com/lancedb/lancedb/pull/1287

Bug fixes from Lance 🐛

This release includes some important bug fixes from Lance dependency:

• fix: relax 'take out of bounds' check which could cause failure if flat searching deleted rows by @westonpace https://github.com/lancedb/lance/pull/2314
• fix: fix a panic that could happen when scanning only the row id from fragment with deleted rows by @westonpace https://github.com/lancedb/lance/pull/2302

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.4.19...v0.4.20

What's Changed

• fix: fix path on remote create_table and check for error response by @rpgreen in https://github.com/lancedb/lancedb/pull/1244
• fix(python): return ValueError if passed unknown args to connect() by @wjones127 in https://github.com/lancedb/lancedb/pull/1265
• Chore (python): Better retry loop logging when embedding api fails by @AyushExel in https://github.com/lancedb/lancedb/pull/1267
• fix: clearer error that FTS is not supported on object stores by @wjones127 in https://github.com/lancedb/lancedb/pull/1273
• ci: better test for test_syntax by @wjones127 in https://github.com/lancedb/lancedb/pull/1278

Documentation changes

• Update embedding_functions.md by @asmith26 in https://github.com/lancedb/lancedb/pull/1250
• docs: update README.md by @eltociear in https://github.com/lancedb/lancedb/pull/1270
• fix: Docs for embed_func fixed in youtube transcript search notebook by @nehiljain in https://github.com/lancedb/lancedb/pull/1269
• Update README.md to correct LangChain URL by @benpoulson in https://github.com/lancedb/lancedb/pull/1262
• docs: add tip about using allow_http on local servers by @wjones127 in https://github.com/lancedb/lancedb/pull/1277

New Contributors

• @rpgreen made their first contribution in https://github.com/lancedb/lancedb/pull/1244
• @asmith26 made their first contribution in https://github.com/lancedb/lancedb/pull/1250
• @eltociear made their first contribution in https://github.com/lancedb/lancedb/pull/1270
• @nehiljain made their first contribution in https://github.com/lancedb/lancedb/pull/1269
• @benpoulson made their first contribution in https://github.com/lancedb/lancedb/pull/1262

Full Changelog: https://github.com/lancedb/lancedb/compare/python-v0.6.11...python-v0.6.12

What's Changed

• Implement convertors to and from Polars DataFrames in Rust SDK using convertors based on C FFI #1099 by @rohitrastogi in https://github.com/lancedb/lancedb/pull/1260
• fix: Docs for embed_func fixed in youtube transcript search notebook by @nehiljain in https://github.com/lancedb/lancedb/pull/1269
• feat: rust embedding registry by @universalmind303 in https://github.com/lancedb/lancedb/pull/1259
• fix(node/vectordb): parse value not key in storage_options by @wjones127 in https://github.com/lancedb/lancedb/pull/1276

Documentation changes

• Update embedding_functions.md by @asmith26 in https://github.com/lancedb/lancedb/pull/1250
• docs: update README.md by @eltociear in https://github.com/lancedb/lancedb/pull/1270
• Update README.md to correct LangChain URL by @benpoulson in https://github.com/lancedb/lancedb/pull/1262
• docs: add tip about using allow_http on local servers by @wjones127 in https://github.com/lancedb/lancedb/pull/1277
• chore(nodejs): update docs on "table.ts" by @universalmind303 in https://github.com/lancedb/lancedb/pull/1255

New Contributors

• @asmith26 made their first contribution in https://github.com/lancedb/lancedb/pull/1250
• @rohitrastogi made their first contribution in https://github.com/lancedb/lancedb/pull/1260
• @eltociear made their first contribution in https://github.com/lancedb/lancedb/pull/1270
• @nehiljain made their first contribution in https://github.com/lancedb/lancedb/pull/1269
• @benpoulson made their first contribution in https://github.com/lancedb/lancedb/pull/1262

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.4.18...v0.4.19

What's Changed

• ci: fix failures in release scripts by @wjones127 in https://github.com/lancedb/lancedb/pull/1215
• docs : Update Reranking docs by @AyushExel in https://github.com/lancedb/lancedb/pull/1213
• fix(python): Update to latest cohere reranking api by @AyushExel in https://github.com/lancedb/lancedb/pull/1212
• [docs] Fix broken links and clarify language in integrations docs by @prrao87 in https://github.com/lancedb/lancedb/pull/1209
• docs : Embedding functions quickstart and minor fixes by @AyushExel in https://github.com/lancedb/lancedb/pull/1217
• doc: fix typo, broken links by @westonpace in https://github.com/lancedb/lancedb/pull/1218
• feat: bump lance version from 0.10.10 to 0.10.12 by @westonpace in https://github.com/lancedb/lancedb/pull/1219
• docs: fix minor typo by @westonpace in https://github.com/lancedb/lancedb/pull/1220
• fix: update lance to 0.10.13 by @albertlockett in https://github.com/lancedb/lancedb/pull/1226
• chore: upgrade lance to 0.10.15 by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/1229
• chore: fix get_registry call in baai embeddings example by @alexkohler in https://github.com/lancedb/lancedb/pull/1230
• add rename_table fn and more data for index_stats to return by @QianZhu in https://github.com/lancedb/lancedb/pull/1234
• chore: disable the remote feature by default by @westonpace in https://github.com/lancedb/lancedb/pull/1239
• chore: fix main branch test failure by @eddyxu in https://github.com/lancedb/lancedb/pull/1240
• fix: passing data to createTable as option by @albertlockett in https://github.com/lancedb/lancedb/pull/1242
• feat: allow the index_cache_size to be configured when opening a table by @westonpace in https://github.com/lancedb/lancedb/pull/1245
• chore: update to Lance version 0.10.16 and Arrow version 51 by @westonpace in https://github.com/lancedb/lancedb/pull/1247
• fix: fix path on remote create_table and check for error response by @rpgreen in https://github.com/lancedb/lancedb/pull/1244
• chore(nodejs): remove "optionalDependencies" by @universalmind303 in https://github.com/lancedb/lancedb/pull/1252

New Contributors

• @alexkohler made their first contribution in https://github.com/lancedb/lancedb/pull/1230
• @rpgreen made their first contribution in https://github.com/lancedb/lancedb/pull/1244
• @universalmind303 made their first contribution in https://github.com/lancedb/lancedb/pull/1252

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.4.17...v0.4.18

What's Changed

• add rename_table fn and more data for index_stats to return by @QianZhu in https://github.com/lancedb/lancedb/pull/1234
• chore: disable the remote feature by default by @westonpace in https://github.com/lancedb/lancedb/pull/1239
• chore: fix main branch test failure by @eddyxu in https://github.com/lancedb/lancedb/pull/1240
• fix: passing data to createTable as option by @albertlockett in https://github.com/lancedb/lancedb/pull/1242
• feat: allow the index_cache_size to be configured when opening a table by @westonpace in https://github.com/lancedb/lancedb/pull/1245
• chore: update to Lance version 0.10.16 and Arrow version 51 by @westonpace in https://github.com/lancedb/lancedb/pull/1247

Full Changelog: https://github.com/lancedb/lancedb/compare/python-v0.6.10...python-v0.6.11

What's Changed

• ci: fix failures in release scripts by @wjones127 in https://github.com/lancedb/lancedb/pull/1215
• docs : Update Reranking docs by @AyushExel in https://github.com/lancedb/lancedb/pull/1213
• fix(python): Update to latest cohere reranking api by @AyushExel in https://github.com/lancedb/lancedb/pull/1212
• [docs] Fix broken links and clarify language in integrations docs by @prrao87 in https://github.com/lancedb/lancedb/pull/1209
• docs : Embedding functions quickstart and minor fixes by @AyushExel in https://github.com/lancedb/lancedb/pull/1217
• doc: fix typo, broken links by @westonpace in https://github.com/lancedb/lancedb/pull/1218
• feat: bump lance version from 0.10.10 to 0.10.12 by @westonpace in https://github.com/lancedb/lancedb/pull/1219
• docs: fix minor typo by @westonpace in https://github.com/lancedb/lancedb/pull/1220
• fix: update lance to 0.10.13 by @albertlockett in https://github.com/lancedb/lancedb/pull/1226
• chore: upgrade lance to 0.10.15 by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/1229
• chore: fix get_registry call in baai embeddings example by @alexkohler in https://github.com/lancedb/lancedb/pull/1230

New Contributors

• @alexkohler made their first contribution in https://github.com/lancedb/lancedb/pull/1230

Full Changelog: https://github.com/lancedb/lancedb/compare/python-v0.6.8...python-v0.6.10

What's Changed

• feat: expose storage options in LanceDB by @wjones127 in https://github.com/lancedb/lancedb/pull/1204
  • This lets you pass authentication and other configurations down to object stores through the storage_options argument.
• python: Bug fixes / tests by @raghavdixit99 in https://github.com/lancedb/lancedb/pull/1210
• chore: restore requests which was lost during rebase by @westonpace in https://github.com/lancedb/lancedb/pull/1205
• BREAKING CHANGE: Check if remote table exists when opening (with caching) by @albertlockett in https://github.com/lancedb/lancedb/pull/1214

Full Changelog: https://github.com/lancedb/lancedb/compare/python-v0.6.7...python-v0.6.8

What's Changed

• feat: expose storage options in LanceDB by @wjones127 in https://github.com/lancedb/lancedb/pull/1204
  • This lets you pass authentication and other configurations down to object stores through the storage_options argument.
• chore: restore requests which was lost during rebase by @westonpace in https://github.com/lancedb/lancedb/pull/1205
• BREAKING CHANGE: Check if remote table exists when opening (with caching) by @albertlockett in https://github.com/lancedb/lancedb/pull/1214

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.4.16...v0.4.17

New features

• feat: add filterable countRows to remote API by @QianZhu in https://github.com/lancedb/lancedb/pull/1169

Performance improvements

• perf: ship fp16kernels in Python wheels by @wjones127 in https://github.com/lancedb/lancedb/pull/1148

Bug fixes

• remote count_rows need to return the number by @QianZhu in https://github.com/lancedb/lancedb/pull/1181
• fix error decoding in nodejs client by @albertlockett in https://github.com/lancedb/lancedb/pull/1184
• ensure table names are uri encoded for tables by @albertlockett in https://github.com/lancedb/lancedb/pull/1189

Other changes

• chore: add social link footer by @eddyxu in https://github.com/lancedb/lancedb/pull/1177
• SQL Documentation includes DataFusion functions by @eduardjbotha in https://github.com/lancedb/lancedb/pull/1179
• chore: upgrade to lance-0.10.9 by @wjones127 in https://github.com/lancedb/lancedb/pull/1192

New Contributors

• @eduardjbotha made their first contribution in https://github.com/lancedb/lancedb/pull/1179

Full Changelog: https://github.com/lancedb/lancedb/compare/python-v0.6.6...python-v0.6.7

New features

• feat: add filterable countRows to remote API by @QianZhu in https://github.com/lancedb/lancedb/pull/1169
• feat: remote count_rows need to return the number by @QianZhu in https://github.com/lancedb/lancedb/pull/1181
• add a default value for search.limit to be consistent with python sdk by @QianZhu in https://github.com/lancedb/lancedb/pull/1191

Bug fixes

• fix error decoding in nodejs client by @albertlockett in https://github.com/lancedb/lancedb/pull/1184
• bug: fix the return value of countRows by @QianZhu in https://github.com/lancedb/lancedb/pull/1186
• ensure table names are uri encoded for tables by @albertlockett in https://github.com/lancedb/lancedb/pull/1189

Other changes

• chore: pass str instead of String to build table names by @eddyxu in https://github.com/lancedb/lancedb/pull/1178
• chore: add social link footer by @eddyxu in https://github.com/lancedb/lancedb/pull/1177
• SQL Documentation includes DataFusion functions by @eduardjbotha in https://github.com/lancedb/lancedb/pull/1179
• chore: upgrade to lance-0.10.9 by @wjones127 in https://github.com/lancedb/lancedb/pull/1192

New Contributors

• @eduardjbotha made their first contribution in https://github.com/lancedb/lancedb/pull/1179

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.4.15...v0.4.16

What's Changed

• New logo on docs site by @albertlockett in https://github.com/lancedb/lancedb/pull/1157
• added new logo to vercel example gif by @albertlockett in https://github.com/lancedb/lancedb/pull/1158
• chore: fix clippy by @westonpace in https://github.com/lancedb/lancedb/pull/1162
• chore: add nodejs to bumpversion by @westonpace in https://github.com/lancedb/lancedb/pull/1161
• ci: fix name collision in npm artifacts for vectordb by @wjones127 in https://github.com/lancedb/lancedb/pull/1164
• docs: add a reference to @lancedb/lance in the docs by @westonpace in https://github.com/lancedb/lancedb/pull/1166
• Update LanceDB Logo in README by @albertlockett in https://github.com/lancedb/lancedb/pull/1167
• chore: bump lance version to 0.10.6 by @westonpace in https://github.com/lancedb/lancedb/pull/1175

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.4.14...v0.4.15