Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..
APACHE-2.0 License
Bot releases are hidden (Show)
Published by albertlockett 10 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.9.3...v0.9.4
Published by eddyxu 10 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.9.2...v0.9.3
Published by eddyxu 10 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.9.1...v0.9.2
Published by wjones127 10 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.9.0...v0.9.1
Published by eddyxu 10 months ago
pyarrow
version to 12.0+
true
in deletion logic by @Weijun-H in https://github.com/lancedb/lance/pull/1515
dot_distance
interface. by @eddyxu in https://github.com/lancedb/lance/pull/1522
Dataset
by @universalmind303 in https://github.com/lancedb/lance/pull/1526
Dataset.validate()
in Python by @wjones127 in https://github.com/lancedb/lance/pull/1538
index_cache_hit_rate
to index_stats()
by @rok in https://github.com/lancedb/lance/pull/1631
use_stats=False
by @wjones127 in https://github.com/lancedb/lance/pull/1700
Full Changelog: https://github.com/lancedb/lance/compare/v0.8.0...v0.9.0
Published by wjones127 10 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.8.20...v0.8.21
Published by wjones127 11 months ago
use_stats=False
by @wjones127 in https://github.com/lancedb/lance/pull/1700
Full Changelog: https://github.com/lancedb/lance/compare/v0.8.19...v0.8.20
Published by westonpace 11 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.8.18...v0.8.19
Published by wjones127 11 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.8.17...v0.8.18
Published by wjones127 11 months ago
index_cache_hit_rate
to index_stats()
by @rok in https://github.com/lancedb/lance/pull/1631
Previously, there was a performance bug where ANN search would be much slower if an entire fragment was deleted. This release fixes that so there is no drop in performance.
Full Changelog: https://github.com/lancedb/lance/compare/v0.8.16...v0.8.17
Published by chebbyChefNEQ 11 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.8.15...v0.8.16
Published by chebbyChefNEQ 11 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.8.14...v0.8.15
Published by chebbyChefNEQ 12 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.8.13...v0.8.14
Published by chebbyChefNEQ 12 months ago
If a table was written with a Lance version prior to v0.8.0, and then later written by a version >=0.8.0<=0.8.13, it may have incorrect statistics. You can detect whether this affects your table using the LanceDataset.validate()
method. If this affects your table, Lance versions prior to 0.8.13 may not be able to read the table correct. If you do not plan on using older versions of Lance going forward, no action is needed. To fix reads on older Lance versions, commit any write transaction to the table with Lance v0.8.13 or newer. A simple way to make a transaction without changing the data would be:
import lance
dataset = lance.dataset('...')
operation = lance.LanceOperation.Append([])
dataset = lance.LanceDataset.commit(
dataset.uri,
operation,
read_version=dataset.version,
)
(This makes an empty Append commit)
Dataset
by @universalmind303 in https://github.com/lancedb/lance/pull/1526
Dataset.validate()
in Python by @wjones127 in https://github.com/lancedb/lance/pull/1538
Full Changelog: https://github.com/lancedb/lance/compare/v0.8.12...v0.8.13
Published by chebbyChefNEQ 12 months ago
true
in deletion logic by @Weijun-H in https://github.com/lancedb/lance/pull/1515
dot_distance
interface. by @eddyxu in https://github.com/lancedb/lance/pull/1522
Full Changelog: https://github.com/lancedb/lance/compare/v0.8.11...v0.8.12
Published by wjones127 12 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.8.10...v0.8.11
Published by eddyxu 12 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.8.9...v0.8.10
Published by wjones127 12 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.8.8...v0.8.9
Published by albertlockett 12 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.8.7...v0.8.8
Published by eddyxu 12 months ago
Full Changelog: https://github.com/lancedb/lance/compare/v0.8.6...v0.8.7