lancedb

What's Changed

• arrow table/f16 example by @QianZhu in https://github.com/lancedb/lancedb/pull/907
• fix the repo link on npm, add links for homepage and bug report by @JacobLinCool in https://github.com/lancedb/lancedb/pull/910
• ci: bump to new version of python action to use node 20 gIthub action runtime by @eddyxu in https://github.com/lancedb/lancedb/pull/909
• feat: add merge_insert to the node and rust APIs by @westonpace in https://github.com/lancedb/lancedb/pull/915
• chore: bump pylance version to latest in pyproject.toml by @westonpace in https://github.com/lancedb/lancedb/pull/918

New Contributors

• @JacobLinCool made their first contribution in https://github.com/lancedb/lancedb/pull/910

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.4.7...v0.4.8

What's Changed

• feat: rework NodeJS SDK using napi by @eddyxu in https://github.com/lancedb/lancedb/pull/847
• Bump lance 0.9.9 by @albertlockett in https://github.com/lancedb/lancedb/pull/851
• feat(rust): create index API improvement by @eddyxu in https://github.com/lancedb/lancedb/pull/853
• docs: document basics of configuring object storage by @wjones127 in https://github.com/lancedb/lancedb/pull/832
• feat(napi): Provide a new createIndex API in the napi SDK. by @eddyxu in https://github.com/lancedb/lancedb/pull/857
• doc: update rust readme to include crate and docs.rs links by @eddyxu in https://github.com/lancedb/lancedb/pull/859
• feat: improve the rust table query API and documents by @eddyxu in https://github.com/lancedb/lancedb/pull/860
• fix: release build for node sdk by @eddyxu in https://github.com/lancedb/lancedb/pull/861
• feat(napi): Issue queries as node SDK by @eddyxu in https://github.com/lancedb/lancedb/pull/868
• chore(rust): simplified version of optimize by @eddyxu in https://github.com/lancedb/lancedb/pull/869
• feat(rust): provide connect and connect_with_options in Rust SDK by @eddyxu in https://github.com/lancedb/lancedb/pull/871
• chore: bump github actions to v4 due to GHA warnings of node version deprecation by @eddyxu in https://github.com/lancedb/lancedb/pull/874
• doc: update quick start for full rust example by @eddyxu in https://github.com/lancedb/lancedb/pull/872
• chore: add one rust SDK e2e example by @eddyxu in https://github.com/lancedb/lancedb/pull/876
• chore: upgrade lance, pylance and datafusion by @eddyxu in https://github.com/lancedb/lancedb/pull/879
• feat(python): Aws Bedrock embeddings integration by @AyushExel in https://github.com/lancedb/lancedb/pull/822
• doc: use code snippet for typescript examples by @eddyxu in https://github.com/lancedb/lancedb/pull/880
• chore: convert all js doc test to use snippet. by @eddyxu in https://github.com/lancedb/lancedb/pull/881
• doc(rust): minor fixes for Rust quick start. by @changhiskhan in https://github.com/lancedb/lancedb/pull/878
• fix: fix doc build to include the source snippet correctly by @eddyxu in https://github.com/lancedb/lancedb/pull/883
• doc: use snippet for rust code example and make sure rust examples run through CI by @eddyxu in https://github.com/lancedb/lancedb/pull/885
• doc: fix js example of create index by @eddyxu in https://github.com/lancedb/lancedb/pull/886
• chore(python): Temporarily extend remote connection timeout by @AyushExel in https://github.com/lancedb/lancedb/pull/888
• feat(python): Embedding fn support for gte-mlx/gte-large by @raghavdixit99 in https://github.com/lancedb/lancedb/pull/873
• doc: Add documentation chatbot for LanceDB by @AyushExel in https://github.com/lancedb/lancedb/pull/890
• Fix image bgcolor by @prrao87 in https://github.com/lancedb/lancedb/pull/891
• feat(python): Hybrid search & Reranker API by @AyushExel in https://github.com/lancedb/lancedb/pull/824
• chore(python): GTE embedding function model name update by @raghavdixit99 in https://github.com/lancedb/lancedb/pull/902
• ci: change apple silicon runner to free OSS macos-14 target by @eddyxu in https://github.com/lancedb/lancedb/pull/901
• chore: update JS/TS example in README by @AbrahamLopez10 in https://github.com/lancedb/lancedb/pull/898
• docs: provide AWS S3 cleanup and permissions advice by @wjones127 in https://github.com/lancedb/lancedb/pull/903
• fix(node): pass AWS credentials to db level operations by @eddyxu in https://github.com/lancedb/lancedb/pull/908
• arrow table/f16 example by @QianZhu in https://github.com/lancedb/lancedb/pull/907
• fix the repo link on npm, add links for homepage and bug report by @JacobLinCool in https://github.com/lancedb/lancedb/pull/910
• ci: bump to new version of python action to use node 20 gIthub action runtime by @eddyxu in https://github.com/lancedb/lancedb/pull/909
• feat: upgrade to lance 0.9.11 and expose merge_insert by @westonpace in https://github.com/lancedb/lancedb/pull/906
• docs: add cleanup_old_versions and compact_files to Table for documentation purposes by @westonpace in https://github.com/lancedb/lancedb/pull/900
• fix: add request retry to python client by @albertlockett in https://github.com/lancedb/lancedb/pull/917
• make it explicit about the vector column data type by @QianZhu in https://github.com/lancedb/lancedb/pull/916
• feat: add merge_insert to the node and rust APIs by @westonpace in https://github.com/lancedb/lancedb/pull/915
• chore: bump pylance version to latest in pyproject.toml by @westonpace in https://github.com/lancedb/lancedb/pull/918

New Contributors

• @raghavdixit99 made their first contribution in https://github.com/lancedb/lancedb/pull/873
• @AbrahamLopez10 made their first contribution in https://github.com/lancedb/lancedb/pull/898
• @JacobLinCool made their first contribution in https://github.com/lancedb/lancedb/pull/910

Full Changelog: https://github.com/lancedb/lancedb/compare/python-v0.5.1...python-v0.5.2

What's Changed

• doc: update quick start for full rust example by @eddyxu in https://github.com/lancedb/lancedb/pull/872
• chore: add one rust SDK e2e example by @eddyxu in https://github.com/lancedb/lancedb/pull/876
• chore: upgrade lance, pylance and datafusion by @eddyxu in https://github.com/lancedb/lancedb/pull/879
• doc: use code snippet for typescript examples by @eddyxu in https://github.com/lancedb/lancedb/pull/880
• chore: convert all js doc test to use snippet. by @eddyxu in https://github.com/lancedb/lancedb/pull/881
• doc(rust): minor fixes for Rust quick start. by @changhiskhan in https://github.com/lancedb/lancedb/pull/878
• fix: fix doc build to include the source snippet correctly by @eddyxu in https://github.com/lancedb/lancedb/pull/883
• doc: use snippet for rust code example and make sure rust examples run through CI by @eddyxu in https://github.com/lancedb/lancedb/pull/885
• doc: fix js example of create index by @eddyxu in https://github.com/lancedb/lancedb/pull/886
• doc: Add documentation chatbot for LanceDB by @AyushExel in https://github.com/lancedb/lancedb/pull/890
• Fix image bgcolor by @prrao87 in https://github.com/lancedb/lancedb/pull/891
• ci: change apple silicon runner to free OSS macos-14 target by @eddyxu in https://github.com/lancedb/lancedb/pull/901
• chore: update JS/TS example in README by @AbrahamLopez10 in https://github.com/lancedb/lancedb/pull/898
• docs: provide AWS S3 cleanup and permissions advice by @wjones127 in https://github.com/lancedb/lancedb/pull/903
• fix(node): pass AWS credentials to db level operations by @eddyxu in https://github.com/lancedb/lancedb/pull/908

New Contributors

• @raghavdixit99 made their first contribution in https://github.com/lancedb/lancedb/pull/873
• @AbrahamLopez10 made their first contribution in https://github.com/lancedb/lancedb/pull/898

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.4.6...v0.4.7

What's Changed

• feat(napi): Issue queries as node SDK by @eddyxu in https://github.com/lancedb/lancedb/pull/868
• chore(rust): simplified version of optimize by @eddyxu in https://github.com/lancedb/lancedb/pull/869
• feat(rust): provide connect and connect_with_options in Rust SDK by @eddyxu in https://github.com/lancedb/lancedb/pull/871

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.4.5...v0.4.6

What's Changed

• feat(python): Add gemini text embedding function by @AyushExel in https://github.com/lancedb/lancedb/pull/806
• feat(python): basic polars integration by @changhiskhan in https://github.com/lancedb/lancedb/pull/811
• Add openai api key not found help by @MrShevan in https://github.com/lancedb/lancedb/pull/815
• chore(python): get rid of Pydantic deprication warning in embedding fcn by @AyushExel in https://github.com/lancedb/lancedb/pull/816
• feat(python): add exist_ok option to create table by @changhiskhan in https://github.com/lancedb/lancedb/pull/813
• feat(python): allow the entire table to be converted a polars dataframe by @changhiskhan in https://github.com/lancedb/lancedb/pull/814
• chore(python): turn off lazy frame ingestion by @changhiskhan in https://github.com/lancedb/lancedb/pull/821
• docs: Updates and refactor by @prrao87 in https://github.com/lancedb/lancedb/pull/683
• Docs updates incl. Polars by @prrao87 in https://github.com/lancedb/lancedb/pull/827
• bump lance to 0.9.7 by @albertlockett in https://github.com/lancedb/lancedb/pull/826
• ci: lint and enforce linting by @wjones127 in https://github.com/lancedb/lancedb/pull/829
• fix: remote python client closes idle connections by @albertlockett in https://github.com/lancedb/lancedb/pull/831
• doc: improve docs for nodejs connect functions by @eddyxu in https://github.com/lancedb/lancedb/pull/833
• [Node] support openai SDK version ^4.24.1 embeddings api by @koolamusic in https://github.com/lancedb/lancedb/pull/743
• bug: add a test for fp16 by @eddyxu in https://github.com/lancedb/lancedb/pull/837
• doc: add index page for rust crate by @eddyxu in https://github.com/lancedb/lancedb/pull/839
• chore(js): remove errant console.log by @changhiskhan in https://github.com/lancedb/lancedb/pull/834
• feat(js): add helper function to create Arrow Table with schema by @eddyxu in https://github.com/lancedb/lancedb/pull/838
• allow passing api key as env var by @albertlockett in https://github.com/lancedb/lancedb/pull/841
• chore(rust): provide a Connection trait to match python and nodejs SDK by @eddyxu in https://github.com/lancedb/lancedb/pull/846
• extend timeout for requests.get and requests.post by @QianZhu in https://github.com/lancedb/lancedb/pull/848
• feat: change create table to accept Arrow table by @eddyxu in https://github.com/lancedb/lancedb/pull/845
• feat: rework NodeJS SDK using napi by @eddyxu in https://github.com/lancedb/lancedb/pull/847
• Bump lance 0.9.9 by @albertlockett in https://github.com/lancedb/lancedb/pull/851
• feat(rust): create index API improvement by @eddyxu in https://github.com/lancedb/lancedb/pull/853
• docs: document basics of configuring object storage by @wjones127 in https://github.com/lancedb/lancedb/pull/832
• feat(napi): Provide a new createIndex API in the napi SDK. by @eddyxu in https://github.com/lancedb/lancedb/pull/857
• doc: update rust readme to include crate and docs.rs links by @eddyxu in https://github.com/lancedb/lancedb/pull/859
• feat: improve the rust table query API and documents by @eddyxu in https://github.com/lancedb/lancedb/pull/860
• fix: release build for node sdk by @eddyxu in https://github.com/lancedb/lancedb/pull/861

New Contributors

• @MrShevan made their first contribution in https://github.com/lancedb/lancedb/pull/815
• @koolamusic made their first contribution in https://github.com/lancedb/lancedb/pull/743

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.4.3...v0.4.5

What's Changed

• feat(python): Add gemini text embedding function by @AyushExel in https://github.com/lancedb/lancedb/pull/806
• feat(python): basic polars integration by @changhiskhan in https://github.com/lancedb/lancedb/pull/811
• Add openai api key not found help by @MrShevan in https://github.com/lancedb/lancedb/pull/815
• chore(python): get rid of Pydantic deprication warning in embedding fcn by @AyushExel in https://github.com/lancedb/lancedb/pull/816
• feat(python): add exist_ok option to create table by @changhiskhan in https://github.com/lancedb/lancedb/pull/813
• feat(python): allow the entire table to be converted a polars dataframe by @changhiskhan in https://github.com/lancedb/lancedb/pull/814
• chore(python): turn off lazy frame ingestion by @changhiskhan in https://github.com/lancedb/lancedb/pull/821
• docs: Updates and refactor by @prrao87 in https://github.com/lancedb/lancedb/pull/683
• Docs updates incl. Polars by @prrao87 in https://github.com/lancedb/lancedb/pull/827
• bump lance to 0.9.7 by @albertlockett in https://github.com/lancedb/lancedb/pull/826
• ci: lint and enforce linting by @wjones127 in https://github.com/lancedb/lancedb/pull/829
• fix: remote python client closes idle connections by @albertlockett in https://github.com/lancedb/lancedb/pull/831
• doc: improve docs for nodejs connect functions by @eddyxu in https://github.com/lancedb/lancedb/pull/833
• [Node] support openai SDK version ^4.24.1 embeddings api by @koolamusic in https://github.com/lancedb/lancedb/pull/743
• bug: add a test for fp16 by @eddyxu in https://github.com/lancedb/lancedb/pull/837
• doc: add index page for rust crate by @eddyxu in https://github.com/lancedb/lancedb/pull/839
• chore(js): remove errant console.log by @changhiskhan in https://github.com/lancedb/lancedb/pull/834
• feat(js): add helper function to create Arrow Table with schema by @eddyxu in https://github.com/lancedb/lancedb/pull/838
• allow passing api key as env var by @albertlockett in https://github.com/lancedb/lancedb/pull/841
• chore(rust): provide a Connection trait to match python and nodejs SDK by @eddyxu in https://github.com/lancedb/lancedb/pull/846
• extend timeout for requests.get and requests.post by @QianZhu in https://github.com/lancedb/lancedb/pull/848
• feat: change create table to accept Arrow table by @eddyxu in https://github.com/lancedb/lancedb/pull/845
• feat: rework NodeJS SDK using napi by @eddyxu in https://github.com/lancedb/lancedb/pull/847
• Bump lance 0.9.9 by @albertlockett in https://github.com/lancedb/lancedb/pull/851
• feat(rust): create index API improvement by @eddyxu in https://github.com/lancedb/lancedb/pull/853
• docs: document basics of configuring object storage by @wjones127 in https://github.com/lancedb/lancedb/pull/832
• feat(napi): Provide a new createIndex API in the napi SDK. by @eddyxu in https://github.com/lancedb/lancedb/pull/857
• doc: update rust readme to include crate and docs.rs links by @eddyxu in https://github.com/lancedb/lancedb/pull/859
• feat: improve the rust table query API and documents by @eddyxu in https://github.com/lancedb/lancedb/pull/860

New Contributors

• @MrShevan made their first contribution in https://github.com/lancedb/lancedb/pull/815
• @koolamusic made their first contribution in https://github.com/lancedb/lancedb/pull/743

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.4.3...v0.4.4

What's Changed

• docs: Updates and refactor by @prrao87 in https://github.com/lancedb/lancedb/pull/683
• Docs updates incl. Polars by @prrao87 in https://github.com/lancedb/lancedb/pull/827
• bump lance to 0.9.7 by @albertlockett in https://github.com/lancedb/lancedb/pull/826
• ci: lint and enforce linting by @wjones127 in https://github.com/lancedb/lancedb/pull/829
• fix: remote python client closes idle connections by @albertlockett in https://github.com/lancedb/lancedb/pull/831
• doc: improve docs for nodejs connect functions by @eddyxu in https://github.com/lancedb/lancedb/pull/833
• [Node] support openai SDK version ^4.24.1 embeddings api by @koolamusic in https://github.com/lancedb/lancedb/pull/743
• bug: add a test for fp16 by @eddyxu in https://github.com/lancedb/lancedb/pull/837
• doc: add index page for rust crate by @eddyxu in https://github.com/lancedb/lancedb/pull/839
• chore(js): remove errant console.log by @changhiskhan in https://github.com/lancedb/lancedb/pull/834
• feat(js): add helper function to create Arrow Table with schema by @eddyxu in https://github.com/lancedb/lancedb/pull/838
• allow passing api key as env var by @albertlockett in https://github.com/lancedb/lancedb/pull/841
• chore(rust): provide a Connection trait to match python and nodejs SDK by @eddyxu in https://github.com/lancedb/lancedb/pull/846
• extend timeout for requests.get and requests.post by @QianZhu in https://github.com/lancedb/lancedb/pull/848
• feat: change create table to accept Arrow table by @eddyxu in https://github.com/lancedb/lancedb/pull/845

New Contributors

• @koolamusic made their first contribution in https://github.com/lancedb/lancedb/pull/743

Full Changelog: https://github.com/lancedb/lancedb/compare/python-v0.5.0...python-v0.5.1

You can now directly ingest Polars dataframes into LanceDB tables and export search results as polars DataFrames.
You can also export LanceDB tables as a polars LazyFrame.

What's Changed

• feat(python): Add gemini text embedding function by @AyushExel in https://github.com/lancedb/lancedb/pull/806
• feat(python): basic polars integration by @changhiskhan in https://github.com/lancedb/lancedb/pull/811
• Add openai api key not found help by @MrShevan in https://github.com/lancedb/lancedb/pull/815
• chore(python): get rid of Pydantic deprication warning in embedding fcn by @AyushExel in https://github.com/lancedb/lancedb/pull/816
• feat(python): add exist_ok option to create table by @changhiskhan in https://github.com/lancedb/lancedb/pull/813
• feat(python): allow the entire table to be converted a polars dataframe by @changhiskhan in https://github.com/lancedb/lancedb/pull/814
• chore(python): turn off lazy frame ingestion by @changhiskhan in https://github.com/lancedb/lancedb/pull/821

New Contributors

• @MrShevan made their first contribution in https://github.com/lancedb/lancedb/pull/815

Full Changelog: https://github.com/lancedb/lancedb/compare/python-v0.4.4...python-v0.5.0

New features

• feat(js): support list of string input by @changhiskhan in https://github.com/lancedb/lancedb/pull/755
• feat(node): support table.schema for LocalTable by @changhiskhan in https://github.com/lancedb/lancedb/pull/789
• feat(node): align incoming data to table schema by @changhiskhan in https://github.com/lancedb/lancedb/pull/802

Other changes

• SaaS JS API sdk doc by @QianZhu in https://github.com/lancedb/lancedb/pull/740
• small bug fix for example code in SaaS JS doc by @QianZhu in https://github.com/lancedb/lancedb/pull/770
• Minor corrections for docs of embedding_functions by @narqo in https://github.com/lancedb/lancedb/pull/780
• Minor Fixes to Ingest Embedding Functions Docs by @chriscorrea in https://github.com/lancedb/lancedb/pull/777
• Make examples work with current version of Openai api's by @sudhirpatil in https://github.com/lancedb/lancedb/pull/779
• fix(rust): not sure why clippy is suddenly unhappy by @changhiskhan in https://github.com/lancedb/lancedb/pull/794
• upgrade lance by @wjones127 in https://github.com/lancedb/lancedb/pull/809

New Contributors

• @narqo made their first contribution in https://github.com/lancedb/lancedb/pull/780
• @chriscorrea made their first contribution in https://github.com/lancedb/lancedb/pull/777
• @sudhirpatil made their first contribution in https://github.com/lancedb/lancedb/pull/779

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.4.2...v0.4.3

New features

• perf(python): Set heap size to get faster fts indexing performance by @changhiskhan in https://github.com/lancedb/lancedb/pull/762
• use requests instead of aiohttp for underlying http client by @SebbyLaw in https://github.com/lancedb/lancedb/pull/803
• feat(python): add phrase query option for fts by @changhiskhan in https://github.com/lancedb/lancedb/pull/798
• feat(python): add count_rows with filter option by @changhiskhan in https://github.com/lancedb/lancedb/pull/801
• feat(python): support new style optional syntax by @changhiskhan in https://github.com/lancedb/lancedb/pull/793

Bug fixes

• fix(python): handle NaN input in fts ingestion by @changhiskhan in https://github.com/lancedb/lancedb/pull/763
• raise exception if fts index does not exist by @lucasiscovici in https://github.com/lancedb/lancedb/pull/776

Other changes

• docs: Add relevant imports for each step by @bengsoon in https://github.com/lancedb/lancedb/pull/764
• docs(python): add docstring for limit behavior by @changhiskhan in https://github.com/lancedb/lancedb/pull/800
• chore(python): document phrase queries in fts by @changhiskhan in https://github.com/lancedb/lancedb/pull/788
• upgrade lance by @wjones127 in https://github.com/lancedb/lancedb/pull/809

New Contributors

• @bengsoon made their first contribution in https://github.com/lancedb/lancedb/pull/764
• @lucasiscovici made their first contribution in https://github.com/lancedb/lancedb/pull/776
• @SebbyLaw made their first contribution in https://github.com/lancedb/lancedb/pull/803

Full Changelog: https://github.com/lancedb/lancedb/compare/python-v0.4.3...python-v0.4.4

What's Changed

• fix: createIndex index cache size by @aidangomar in https://github.com/lancedb/lancedb/pull/741
• feat: add timezone handling for datetime in pydantic by @changhiskhan in https://github.com/lancedb/lancedb/pull/578
• docs: fix link by @haoxins in https://github.com/lancedb/lancedb/pull/752
• chore: bump pylance to 0.9.2 by @eddyxu in https://github.com/lancedb/lancedb/pull/754

New Contributors

• @haoxins made their first contribution in https://github.com/lancedb/lancedb/pull/752

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.4.1...v0.4.2

What's Changed

• feat(python): first cut batch queries for remote api by @changhiskhan in https://github.com/lancedb/lancedb/pull/753
• docs: fix link by @haoxins in https://github.com/lancedb/lancedb/pull/752
• chore: bump pylance to 0.9.2 by @eddyxu in https://github.com/lancedb/lancedb/pull/754

New Contributors

• @haoxins made their first contribution in https://github.com/lancedb/lancedb/pull/752

Full Changelog: https://github.com/lancedb/lancedb/compare/python-v0.4.2...python-v0.4.3

What's Changed

• feat(python): support list of list fields from pydantic schema by @changhiskhan in https://github.com/lancedb/lancedb/pull/747
• fix: createIndex index cache size by @aidangomar in https://github.com/lancedb/lancedb/pull/741
• feat(python): add post filtering for full text search by @changhiskhan in https://github.com/lancedb/lancedb/pull/739
• feat: add timezone handling for datetime in pydantic by @changhiskhan in https://github.com/lancedb/lancedb/pull/578
• chore(python): update embedding API to use openai 1.6.1 by @changhiskhan in https://github.com/lancedb/lancedb/pull/751

Full Changelog: https://github.com/lancedb/lancedb/compare/python-v0.4.1...python-v0.4.2

New features

• feat(python): add option to flatten output in to_pandas by @changhiskhan in https://github.com/lancedb/lancedb/pull/722
• feat(python): support nested reference for fts by @changhiskhan in https://github.com/lancedb/lancedb/pull/723
• feat: add the ability to create scalar indices by @westonpace in https://github.com/lancedb/lancedb/pull/679

Bug fixes

• upgrade lance to v0.9.1 by @wjones127 in https://github.com/lancedb/lancedb/pull/727
• fix: prevent duplicate data in FTS index by @wjones127 in https://github.com/lancedb/lancedb/pull/728
• bug(python): fix path handling in windows by @changhiskhan in https://github.com/lancedb/lancedb/pull/724

Other changes

• docs: enhance Update user guide by @wjones127 in https://github.com/lancedb/lancedb/pull/735
• Update default_embedding_functions.md by @elliottRobinson in https://github.com/lancedb/lancedb/pull/744

New Contributors

• @elliottRobinson made their first contribution in https://github.com/lancedb/lancedb/pull/744

Full Changelog: https://github.com/lancedb/lancedb/compare/python-v0.4.0...python-v0.4.1

New features

• feat: Node Schema API by @aidangomar in https://github.com/lancedb/lancedb/pull/717
• feat: Node create index API by @aidangomar in https://github.com/lancedb/lancedb/pull/720
• feat: node list tables pagination by @aidangomar in https://github.com/lancedb/lancedb/pull/733
• feat: add the ability to create scalar indices by @westonpace in https://github.com/lancedb/lancedb/pull/679

Bug fixes

• upgrade lance to v0.9.1 by @wjones127 in https://github.com/lancedb/lancedb/pull/727
  • See bug fixes in upstream release: https://github.com/lancedb/lance/releases/tag/v0.9.1

Other changes

• doc(javascript): minor improvement on docs for working with tables by @changhiskhan in https://github.com/lancedb/lancedb/pull/736
• docs: fix JS api docs for update method by @albertlockett in https://github.com/lancedb/lancedb/pull/738
• docs: enhance Update user guide by @wjones127 in https://github.com/lancedb/lancedb/pull/735
• docs: update node API reference by @wjones127 in https://github.com/lancedb/lancedb/pull/734
• Update default_embedding_functions.md by @elliottRobinson in https://github.com/lancedb/lancedb/pull/744

New Contributors

• @elliottRobinson made their first contribution in https://github.com/lancedb/lancedb/pull/744

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.4.0...v0.4.1

Summary

• Performance Improvement
• Scalar index
• Stats-based predicate pushdown
• Cosine distance fix

What's Changed

• implement mirroring object store by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/537
• fix stackoverflow by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/542
• Typo cleanup by @JoshWein in https://github.com/lancedb/lancedb/pull/539
• feat: use GPU for index creation. by @eddyxu in https://github.com/lancedb/lancedb/pull/540
• feat: telemetry, error tracking, CLI & config manager by @AyushExel in https://github.com/lancedb/lancedb/pull/538
• Use query.limit(..) in README by @ankrgyl in https://github.com/lancedb/lancedb/pull/543
• feat: add to_list and to_pandas api's by @changhiskhan in https://github.com/lancedb/lancedb/pull/556
• [Docs] Improve visibility of table ops by @AyushExel in https://github.com/lancedb/lancedb/pull/553
• feat: cleanup and compaction by @wjones127 in https://github.com/lancedb/lancedb/pull/518
• Add cohere embedding function by @AyushExel in https://github.com/lancedb/lancedb/pull/550
• [DOCS][PYTHON] Update embeddings API docs & Example by @AyushExel in https://github.com/lancedb/lancedb/pull/516
• chore: bump lance to 0.8.5 by @eddyxu in https://github.com/lancedb/lancedb/pull/561
• docs: switch python examples to be row based by @rok in https://github.com/lancedb/lancedb/pull/554
• feat(python,js): deletion operation on remote tables by @eddyxu in https://github.com/lancedb/lancedb/pull/568
• docs: show source of documented functions by @rok in https://github.com/lancedb/lancedb/pull/569
• implement remote api calls for table mutation by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/567
• doc: fix broken link and add README by @changhiskhan in https://github.com/lancedb/lancedb/pull/573
• Add pyarrow date and timestamp type conversion from pydantic by @prrao87 in https://github.com/lancedb/lancedb/pull/576
• list table pagination draft by @QianZhu in https://github.com/lancedb/lancedb/pull/574
• [Docs] Add posthog telemetry to docs by @AyushExel in https://github.com/lancedb/lancedb/pull/577
• [Python]Embeddings API refactor by @AyushExel in https://github.com/lancedb/lancedb/pull/580
• [Docs] Update embedding function docs by @AyushExel in https://github.com/lancedb/lancedb/pull/581
• chore: bump lance version in python/rust lancedb by @changhiskhan in https://github.com/lancedb/lancedb/pull/584
• [Docs]Versioning docs by @AyushExel in https://github.com/lancedb/lancedb/pull/586
• [Docs] Embeddings API: Add multi-lingual semantic search example by @AyushExel in https://github.com/lancedb/lancedb/pull/582
• [Docs]: Minor Fixes by @AyushExel in https://github.com/lancedb/lancedb/pull/587
• feat: include manifest files in mirrow store by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/589
• feat: add checkout method to table to reuse existing store and connections by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/593
• fix(python): fix multiple embedding functions bug by @changhiskhan in https://github.com/lancedb/lancedb/pull/597
• update lance to 0.8.7 by @albertlockett in https://github.com/lancedb/lancedb/pull/598
• feat: expose optimize index api by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/602
• expose remap index api by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/603
• feat: added data stats apis by @albertlockett in https://github.com/lancedb/lancedb/pull/596
• feat: added dataset stats api to node by @albertlockett in https://github.com/lancedb/lancedb/pull/604
• fix conv version by @albertlockett in https://github.com/lancedb/lancedb/pull/605
• doc: add doc to use GPU for indexing by @eddyxu in https://github.com/lancedb/lancedb/pull/611
• feat: allow prefiltering with index by @westonpace in https://github.com/lancedb/lancedb/pull/610
• added api docs for prefilter flag by @albertlockett in https://github.com/lancedb/lancedb/pull/617
• increment pylance by @wjones127 in https://github.com/lancedb/lancedb/pull/618
• Qian/query option doc by @QianZhu in https://github.com/lancedb/lancedb/pull/615
• fix!: sort table names by @albertlockett in https://github.com/lancedb/lancedb/pull/619
• ci: cancel in progress runs on new push by @albertlockett in https://github.com/lancedb/lancedb/pull/620
• doc: node sdk now supports windows by @changhiskhan in https://github.com/lancedb/lancedb/pull/616
• Disable posthog on docs & reduce sentry trace factor by @AyushExel in https://github.com/lancedb/lancedb/pull/607
• chore: bump lance to 8.10 by @eddyxu in https://github.com/lancedb/lancedb/pull/622
• Exponential standoff retry support for handling rate limited embedding functions by @AyushExel in https://github.com/lancedb/lancedb/pull/614
• fix: node remote connection handles non http errors by @albertlockett in https://github.com/lancedb/lancedb/pull/624
• chore: improve create_table API consistency between local and remote SDK by @eddyxu in https://github.com/lancedb/lancedb/pull/627
• chore: apple silicon runner by @eddyxu in https://github.com/lancedb/lancedb/pull/633
• skip missing file on mirrored dir when deleting by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/635
• upgrade lance to 0.8.14 by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/636
• fix saas open_table and table_names issues by @QianZhu in https://github.com/lancedb/lancedb/pull/640
• Multi-task instructor model with quantization support & weak_lru cache for embedding function models by @AyushExel in https://github.com/lancedb/lancedb/pull/612
• fix: Pydantic 1.x compat for weak_lru caching in embeddings API by @AyushExel in https://github.com/lancedb/lancedb/pull/643
• fix: node send db header for GET requests by @albertlockett in https://github.com/lancedb/lancedb/pull/646
• feat: add RemoteTable.version in Python by @rok in https://github.com/lancedb/lancedb/pull/644
• fix: node remote implement table.countRows by @albertlockett in https://github.com/lancedb/lancedb/pull/648
• SaaS create_index API by @aidangomar in https://github.com/lancedb/lancedb/pull/649
• [Docs][SEO] Add sitemap and robots.txt by @AyushExel in https://github.com/lancedb/lancedb/pull/645
• [Docs]: Add Instructor embeddings and rate limit handler docs by @AyushExel in https://github.com/lancedb/lancedb/pull/651
• feat(python): expose index cache size by @rok in https://github.com/lancedb/lancedb/pull/655
• chore: upgrade lance to v0.8.17 by @wjones127 in https://github.com/lancedb/lancedb/pull/656
• fix: python remote correct open_table error message by @albertlockett in https://github.com/lancedb/lancedb/pull/659
• (docs):Add CLIP image embedding example by @capjamesg in https://github.com/lancedb/lancedb/pull/660
• chore: expose prefilter in lancedb rust by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/674
• feat: enable prefilter in node js by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/675
• fix: fix passing prefilter flag to remote client by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/677
• chore: set error handling to immediate by @changhiskhan in https://github.com/lancedb/lancedb/pull/686
• chore: update package lock by @changhiskhan in https://github.com/lancedb/lancedb/pull/689
• saas python sdk doc by @QianZhu in https://github.com/lancedb/lancedb/pull/692
• chore: Use m1 runner for npm publish by @changhiskhan in https://github.com/lancedb/lancedb/pull/687
• docs: Add badges by @kaushal07wick in https://github.com/lancedb/lancedb/pull/694
• Qian/minor fix doc by @QianZhu in https://github.com/lancedb/lancedb/pull/695
• docs: Update roboflow tutorial position by @AyushExel in https://github.com/lancedb/lancedb/pull/666
• chore(python): Reduce posthog event count by @AyushExel in https://github.com/lancedb/lancedb/pull/661
• Update in Node & Rust by @albertlockett in https://github.com/lancedb/lancedb/pull/696
• feat: LocalTable for vectordb now supports filters without vector search by @changhiskhan in https://github.com/lancedb/lancedb/pull/693
• feat(python): add update query support for Python by @wjones127 in https://github.com/lancedb/lancedb/pull/654
• ci: fix broken npm publication by @wjones127 in https://github.com/lancedb/lancedb/pull/704
• feat: support nested pydantic schema by @changhiskhan in https://github.com/lancedb/lancedb/pull/707
• feat: allow custom column name in query by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/709
• feat: pass vector column name to remote backend by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/710
• implement update for remote clients by @albertlockett in https://github.com/lancedb/lancedb/pull/706
• chore: fix package lock by @albertlockett in https://github.com/lancedb/lancedb/pull/711
• chore: bump lance version to 0.9 by @eddyxu in https://github.com/lancedb/lancedb/pull/715

New Contributors

• @JoshWein made their first contribution in https://github.com/lancedb/lancedb/pull/539
• @ankrgyl made their first contribution in https://github.com/lancedb/lancedb/pull/543
• @rok made their first contribution in https://github.com/lancedb/lancedb/pull/554
• @albertlockett made their first contribution in https://github.com/lancedb/lancedb/pull/598
• @aidangomar made their first contribution in https://github.com/lancedb/lancedb/pull/649
• @capjamesg made their first contribution in https://github.com/lancedb/lancedb/pull/660
• @kaushal07wick made their first contribution in https://github.com/lancedb/lancedb/pull/694

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.3.0...v0.4.0

Summary

• Performance improvement and bug fixes
• Scalar index and stats-based predicate pushdown

Breaking Changes

• New cosine distance calculation for Product Quantization.
• Bump pyarrow to 12.0+

What's Changed

• implement mirroring object store by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/537
• fix stackoverflow by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/542
• Typo cleanup by @JoshWein in https://github.com/lancedb/lancedb/pull/539
• feat: use GPU for index creation. by @eddyxu in https://github.com/lancedb/lancedb/pull/540
• feat: telemetry, error tracking, CLI & config manager by @AyushExel in https://github.com/lancedb/lancedb/pull/538
• Use query.limit(..) in README by @ankrgyl in https://github.com/lancedb/lancedb/pull/543
• feat: add to_list and to_pandas api's by @changhiskhan in https://github.com/lancedb/lancedb/pull/556
• [Docs] Improve visibility of table ops by @AyushExel in https://github.com/lancedb/lancedb/pull/553
• feat: cleanup and compaction by @wjones127 in https://github.com/lancedb/lancedb/pull/518
• Add cohere embedding function by @AyushExel in https://github.com/lancedb/lancedb/pull/550
• [DOCS][PYTHON] Update embeddings API docs & Example by @AyushExel in https://github.com/lancedb/lancedb/pull/516
• chore: bump lance to 0.8.5 by @eddyxu in https://github.com/lancedb/lancedb/pull/561
• docs: switch python examples to be row based by @rok in https://github.com/lancedb/lancedb/pull/554
• feat(python,js): deletion operation on remote tables by @eddyxu in https://github.com/lancedb/lancedb/pull/568
• docs: show source of documented functions by @rok in https://github.com/lancedb/lancedb/pull/569
• implement remote api calls for table mutation by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/567
• doc: fix broken link and add README by @changhiskhan in https://github.com/lancedb/lancedb/pull/573
• Add pyarrow date and timestamp type conversion from pydantic by @prrao87 in https://github.com/lancedb/lancedb/pull/576
• list table pagination draft by @QianZhu in https://github.com/lancedb/lancedb/pull/574
• [Docs] Add posthog telemetry to docs by @AyushExel in https://github.com/lancedb/lancedb/pull/577
• [Python]Embeddings API refactor by @AyushExel in https://github.com/lancedb/lancedb/pull/580
• [Docs] Update embedding function docs by @AyushExel in https://github.com/lancedb/lancedb/pull/581
• chore: bump lance version in python/rust lancedb by @changhiskhan in https://github.com/lancedb/lancedb/pull/584
• [Docs]Versioning docs by @AyushExel in https://github.com/lancedb/lancedb/pull/586
• [Docs] Embeddings API: Add multi-lingual semantic search example by @AyushExel in https://github.com/lancedb/lancedb/pull/582
• [Docs]: Minor Fixes by @AyushExel in https://github.com/lancedb/lancedb/pull/587
• feat: include manifest files in mirrow store by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/589
• feat: add checkout method to table to reuse existing store and connections by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/593
• fix(python): fix multiple embedding functions bug by @changhiskhan in https://github.com/lancedb/lancedb/pull/597
• update lance to 0.8.7 by @albertlockett in https://github.com/lancedb/lancedb/pull/598
• feat: expose optimize index api by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/602
• expose remap index api by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/603
• feat: added data stats apis by @albertlockett in https://github.com/lancedb/lancedb/pull/596
• feat: added dataset stats api to node by @albertlockett in https://github.com/lancedb/lancedb/pull/604
• fix conv version by @albertlockett in https://github.com/lancedb/lancedb/pull/605
• doc: add doc to use GPU for indexing by @eddyxu in https://github.com/lancedb/lancedb/pull/611
• feat: allow prefiltering with index by @westonpace in https://github.com/lancedb/lancedb/pull/610
• added api docs for prefilter flag by @albertlockett in https://github.com/lancedb/lancedb/pull/617
• increment pylance by @wjones127 in https://github.com/lancedb/lancedb/pull/618
• Qian/query option doc by @QianZhu in https://github.com/lancedb/lancedb/pull/615
• fix!: sort table names by @albertlockett in https://github.com/lancedb/lancedb/pull/619
• ci: cancel in progress runs on new push by @albertlockett in https://github.com/lancedb/lancedb/pull/620
• doc: node sdk now supports windows by @changhiskhan in https://github.com/lancedb/lancedb/pull/616
• Disable posthog on docs & reduce sentry trace factor by @AyushExel in https://github.com/lancedb/lancedb/pull/607
• chore: bump lance to 8.10 by @eddyxu in https://github.com/lancedb/lancedb/pull/622
• Exponential standoff retry support for handling rate limited embedding functions by @AyushExel in https://github.com/lancedb/lancedb/pull/614
• fix: node remote connection handles non http errors by @albertlockett in https://github.com/lancedb/lancedb/pull/624
• chore: improve create_table API consistency between local and remote SDK by @eddyxu in https://github.com/lancedb/lancedb/pull/627
• chore: apple silicon runner by @eddyxu in https://github.com/lancedb/lancedb/pull/633
• skip missing file on mirrored dir when deleting by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/635
• upgrade lance to 0.8.14 by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/636
• fix saas open_table and table_names issues by @QianZhu in https://github.com/lancedb/lancedb/pull/640
• Multi-task instructor model with quantization support & weak_lru cache for embedding function models by @AyushExel in https://github.com/lancedb/lancedb/pull/612
• fix: Pydantic 1.x compat for weak_lru caching in embeddings API by @AyushExel in https://github.com/lancedb/lancedb/pull/643
• fix: node send db header for GET requests by @albertlockett in https://github.com/lancedb/lancedb/pull/646
• feat: add RemoteTable.version in Python by @rok in https://github.com/lancedb/lancedb/pull/644
• fix: node remote implement table.countRows by @albertlockett in https://github.com/lancedb/lancedb/pull/648
• SaaS create_index API by @aidangomar in https://github.com/lancedb/lancedb/pull/649
• [Docs][SEO] Add sitemap and robots.txt by @AyushExel in https://github.com/lancedb/lancedb/pull/645
• [Docs]: Add Instructor embeddings and rate limit handler docs by @AyushExel in https://github.com/lancedb/lancedb/pull/651
• feat(python): expose index cache size by @rok in https://github.com/lancedb/lancedb/pull/655
• chore: upgrade lance to v0.8.17 by @wjones127 in https://github.com/lancedb/lancedb/pull/656
• fix: python remote correct open_table error message by @albertlockett in https://github.com/lancedb/lancedb/pull/659
• (docs):Add CLIP image embedding example by @capjamesg in https://github.com/lancedb/lancedb/pull/660
• chore: expose prefilter in lancedb rust by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/674
• feat: enable prefilter in node js by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/675
• fix: fix passing prefilter flag to remote client by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/677
• chore: set error handling to immediate by @changhiskhan in https://github.com/lancedb/lancedb/pull/686
• chore: update package lock by @changhiskhan in https://github.com/lancedb/lancedb/pull/689
• saas python sdk doc by @QianZhu in https://github.com/lancedb/lancedb/pull/692
• chore: Use m1 runner for npm publish by @changhiskhan in https://github.com/lancedb/lancedb/pull/687
• docs: Add badges by @kaushal07wick in https://github.com/lancedb/lancedb/pull/694
• Qian/minor fix doc by @QianZhu in https://github.com/lancedb/lancedb/pull/695
• docs: Update roboflow tutorial position by @AyushExel in https://github.com/lancedb/lancedb/pull/666
• chore(python): Reduce posthog event count by @AyushExel in https://github.com/lancedb/lancedb/pull/661
• Update in Node & Rust by @albertlockett in https://github.com/lancedb/lancedb/pull/696
• feat: LocalTable for vectordb now supports filters without vector search by @changhiskhan in https://github.com/lancedb/lancedb/pull/693
• feat(python): add update query support for Python by @wjones127 in https://github.com/lancedb/lancedb/pull/654
• ci: fix broken npm publication by @wjones127 in https://github.com/lancedb/lancedb/pull/704
• feat: support nested pydantic schema by @changhiskhan in https://github.com/lancedb/lancedb/pull/707
• feat: allow custom column name in query by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/709
• feat: pass vector column name to remote backend by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/710
• implement update for remote clients by @albertlockett in https://github.com/lancedb/lancedb/pull/706
• chore: fix package lock by @albertlockett in https://github.com/lancedb/lancedb/pull/711
• chore: bump lance version to 0.9 by @eddyxu in https://github.com/lancedb/lancedb/pull/715

New Contributors

• @JoshWein made their first contribution in https://github.com/lancedb/lancedb/pull/539
• @ankrgyl made their first contribution in https://github.com/lancedb/lancedb/pull/543
• @rok made their first contribution in https://github.com/lancedb/lancedb/pull/554
• @albertlockett made their first contribution in https://github.com/lancedb/lancedb/pull/598
• @aidangomar made their first contribution in https://github.com/lancedb/lancedb/pull/649
• @capjamesg made their first contribution in https://github.com/lancedb/lancedb/pull/660
• @kaushal07wick made their first contribution in https://github.com/lancedb/lancedb/pull/694

Full Changelog: https://github.com/lancedb/lancedb/compare/python-v0.3.0...python-v0.4.0

What's Changed

• ci: fix broken npm publication by @wjones127 in https://github.com/lancedb/lancedb/pull/704
• feat: support nested pydantic schema by @changhiskhan in https://github.com/lancedb/lancedb/pull/707
• feat: allow custom column name in query by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/709
• feat: pass vector column name to remote backend by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/710
• implement update for remote clients by @albertlockett in https://github.com/lancedb/lancedb/pull/706

Full Changelog: https://github.com/lancedb/lancedb/compare/python-v0.3.5...python-v0.3.6

What's Changed

• feat: allow custom column name in query by @chebbyChefNEQ in https://github.com/lancedb/lancedb/pull/709
• implement update for remote clients by @albertlockett in https://github.com/lancedb/lancedb/pull/706
• chore: fix package lock by @albertlockett in https://github.com/lancedb/lancedb/pull/711

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.3.10...v0.3.11

In Node, you can now scan tables with a filter:

await table.filter("category = 'reciepts'").execute()

In addition, in OSS you can also update existing rows with

await tbl.update({
  filter: "id = 2",
  updates: { vector: [2, 2], name: "Michael" },
})

(Update support is coming soon to LanceDB Cloud.)

What's Changed

• feat: LocalTable for vectordb now supports filters without vector search by @changhiskhan in https://github.com/lancedb/lancedb/pull/693
• Update in Node & Rust by @albertlockett in https://github.com/lancedb/lancedb/pull/696
• chore: set error handling to immediate by @changhiskhan in https://github.com/lancedb/lancedb/pull/686
• chore: update package lock by @changhiskhan in https://github.com/lancedb/lancedb/pull/689
• saas python sdk doc by @QianZhu in https://github.com/lancedb/lancedb/pull/692
• chore: Use m1 runner for npm publish by @changhiskhan in https://github.com/lancedb/lancedb/pull/687
• docs: Add badges by @kaushal07wick in https://github.com/lancedb/lancedb/pull/694
• Qian/minor fix doc by @QianZhu in https://github.com/lancedb/lancedb/pull/695
• docs: Update roboflow tutorial position by @AyushExel in https://github.com/lancedb/lancedb/pull/666

New Contributors

• @kaushal07wick made their first contribution in https://github.com/lancedb/lancedb/pull/694

Full Changelog: https://github.com/lancedb/lancedb/compare/v0.3.9...v0.3.10