Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..
APACHE-2.0 License
Bot releases are visible (Hide)
Published by wjones127 5 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.12.0...v0.12.1
Published by wjones127 5 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.11.1...v0.12.0
Published by wjones127 5 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.11.1...v0.12.0-beta.1
Published by wjones127 5 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.11.0...v0.11.1
Published by wjones127 5 months ago
m_max
and use_heuristic
params from HNSW builder by @BubbleCal in https://github.com/lancedb/lance/pull/2336
Full Changelog: https://github.com/lancedb/lance/compare/v0.10.18...v0.11.0
Published by wjones127 5 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.10.17...v0.10.18
Published by wjones127 6 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.10.17...v0.10.18-beta.1
Published by westonpace 6 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.10.16...v0.10.17
Published by wjones127 6 months ago
mL
value for better performance by @BubbleCal in https://github.com/lancedb/lance/pull/2239
Full Changelog: https://github.com/lancedb/lance/compare/v0.10.15...v0.10.16
Published by wjones127 6 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.10.14...v0.10.15
Published by wjones127 6 months ago
LanceFragment.add_columns
with merge_columns
by @wjones127 in https://github.com/lancedb/lance/pull/2208
Full Changelog: https://github.com/lancedb/lance/compare/v0.10.13...v0.10.14
Published by wjones127 6 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.10.12...v0.10.13
Published by westonpace 6 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.10.11...v0.10.12
Published by wjones127 6 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.10.10...v0.10.11
Published by wjones127 7 months ago
storage_options
first before looking at environment variables.ef
as query parameter by @BubbleCal in https://github.com/lancedb/lance/pull/2155
Full Changelog: https://github.com/lancedb/lance/compare/v0.10.9...v0.10.10
Published by westonpace 7 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.10.8...v0.10.9
Published by eddyxu 7 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.10.7...v0.10.8
Published by wjones127 7 months ago
❗ There was an bug with drop_columns()
. If you've called this on your dataset, you should check if your dataset was affected by running dataset.validate()
. If this raises an error, you can call dataset.delete("false")
to force a repair operation on your dataset. Afterward it will work as expected.
🚀 You can now configure object storage connection in the kwargs
of lance.dataset()
and lance.write_dataset()
with storage_options
. For example:
import lance
ds = lance.dataset(
"s3://bucket/path",
storage_options={
"region": "us-east-1",
"access_key_id": "my-access-key",
"secret_access_key": "my-secret-key",
"session_token": "my-session-token",
}
)
Read more in https://lancedb.github.io/lance/read_and_write.html#object-store-configuration
Full Changelog: https://github.com/lancedb/lance/compare/v0.10.6...v0.10.7
Published by westonpace 7 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.10.5...v0.10.6
Published by westonpace 7 months ago
Fixes a potential panic when reading a fragment that had multiple data files.
Full Changelog: https://github.com/lancedb/lance/compare/v0.10.4...v0.10.5