Change log

Improvements

• https://github.com/qdrant/qdrant/pull/4165 - Handle Out-Of-Disk on insertions gracefully
• https://github.com/qdrant/qdrant/pull/3964 - Faster consensus convergence with batched updates
• https://github.com/qdrant/qdrant/pull/4301 - Deduplicate points by ID for custom sharding

Bug fixes

• https://github.com/qdrant/qdrant/pull/4307 - Fix overflow panic if scroll limit is usize::MAX
• https://github.com/qdrant/qdrant/pull/4322 - Fix panic with missing sparse vectors after recovery of corrupted storage

Web UI

• https://github.com/qdrant/qdrant-web-ui/pull/183 - Notification for miss-configured collections

Full change log: https://github.com/qdrant/qdrant-web-ui/releases/tag/v0.1.26

Change log

Improvements

• https://github.com/qdrant/qdrant/pull/4148 - Greatly improve proxy segment performance when a lot of changes are tracked
• https://github.com/qdrant/qdrant/pull/4176 - Speed up loading of large memory mapped segments
• https://github.com/qdrant/qdrant/pull/4205 - Use distinct gRPC types for shard replication and overwriting payload requests, existing clients remain compatible
• https://github.com/qdrant/qdrant/pull/4163 - Extend sparse vector benchmarks

Bug fixes

• https://github.com/qdrant/qdrant/pull/4206 - Fix potential deadlock with concurrent searches and snapshot creation

Change Log

Improvements

• https://github.com/qdrant/qdrant/pull/4119 - performance of the numerical values range filter
• https://github.com/qdrant/qdrant/pull/4103 - Handle antimeridians in geo bounding box filter
• https://github.com/qdrant/qdrant/pull/3931 - Speedup consensus thread
• https://github.com/qdrant/qdrant/pull/4084 - improve consistency of the scroll API with parallel updates

Bug fixes

• https://github.com/qdrant/qdrant/pull/4155 - fixes usage of snapshot shard transfer with API Key Auth.
• https://github.com/qdrant/qdrant/pull/4156 - resolves panic issue on optimization after restart (https://github.com/qdrant/qdrant/issues/4154)
• https://github.com/qdrant/qdrant/pull/4132 - resolves https://github.com/qdrant/qdrant/issues/4131

Change log

Features 🏎️

• https://github.com/qdrant/qdrant/issues/3477 - Implement and enable shard diff transfer, greatly improve shard transfer speed on node recovery
• https://github.com/qdrant/qdrant/issues/3777 - Role-based access control with JWT
• https://github.com/qdrant/qdrant/pull/3976, https://github.com/qdrant/qdrant/pull/4049, https://github.com/qdrant/qdrant/pull/4065 - Add support for byte vectors, represent your vectors as float32 or uint8

Improvements 🕵️

• https://github.com/qdrant/qdrant/pull/3420, https://github.com/qdrant/qdrant/pull/3938 - Greatly improve write performance while creating a snapshot of a large collection
• https://github.com/qdrant/qdrant/pull/3962, https://github.com/qdrant/qdrant/pull/3971 - Report pending optimizations awaiting an update operation in collection info
• https://github.com/qdrant/qdrant/pull/3998 - Improve indexed_only reliability on proxy shards
• https://github.com/qdrant/qdrant/pull/3798 - Make shard diff transfer fall back to streaming records
• https://github.com/qdrant/qdrant/pull/3784 - Cancel shard transfers when the shard is deleted
• https://github.com/qdrant/qdrant/pull/4037 - Improve sparse vectors search performance by another 7%
• https://github.com/qdrant/qdrant/pull/3982 - Build Qdrant with a single codegen unit to allow better compile-time optimizations
• https://github.com/qdrant/qdrant/pull/4052 - Remove vectors_count from collection info because it is unreliable. Check usage of this field before upgrading
• https://github.com/qdrant/qdrant/pull/3803 - Remove shard transfer method field from abort shard transfer operation

Bug fixes 💔

• https://github.com/qdrant/qdrant/pull/3990 - Fix potentially losing points on crash
• https://github.com/qdrant/qdrant/pull/4034 - Fix potentially losing points on segment flushing
• https://github.com/qdrant/qdrant/pull/4057 - Fix potentially losing points by improper moves between segments when recovering WAL
• https://github.com/qdrant/qdrant/pull/4058 - Fix segments not being flushed properly with rapid sequential optimizations
• https://github.com/qdrant/qdrant/pull/3995, https://github.com/qdrant/qdrant/pull/3996 - Fix read ordering of segments to prevent missing points just being moved
• https://github.com/qdrant/qdrant/pull/3975 - Fix consensus operations getting stuck if they timed out
• https://github.com/qdrant/qdrant/pull/3905 - Fix collection creation if files were left behind on disk
• https://github.com/qdrant/qdrant/pull/4029 - Fix collection deletions conflicting with concurrent collection creation
• https://github.com/qdrant/qdrant/pull/3991 - Fix arbitrary path traversal when uploading snapshots with created collection names
• https://github.com/qdrant/qdrant/pull/4033 - Do not allow symlinks in snapshot archives
• https://github.com/qdrant/qdrant/pull/4047 - Fix recommendation API for sparse vectors
• https://github.com/qdrant/qdrant/pull/3965 - Fix discovery search with sparse vectors over gRPC
• https://github.com/qdrant/qdrant/pull/3928 - Stabilize vector normalization, prevent renormalizing multiple times breaking data consistency
• https://github.com/qdrant/qdrant/pull/4054 - Fix incorrect ordering when using order_by across multiple nodes
• https://github.com/qdrant/qdrant/pull/4067 - Fix timeout being ignored when dropping segment data, potentially leaving them behind forever
• https://github.com/qdrant/qdrant/pull/3980 - Internally forward operations with wait=true during shard transfers
• https://github.com/qdrant/qdrant/pull/3945 - Keep jemalloc only for amd64 and aarch64 to fix build failures

Dashboard 🍱

• https://github.com/qdrant/qdrant-web-ui/pull/175 - Add page to generate RBAC JWT tokens
• https://github.com/qdrant/qdrant-web-ui/pull/169 - Before saving payload changes, ask for confirmation with dialog showing diff
• https://github.com/qdrant/qdrant-web-ui/pull/173 - Validate collection names
• Other changes

Thanks to @abhishek818 @RPallas92 @tellet-q @xzfc @ffuugoo @IvanPleshkov @agourlay @coszio @generall @timvisee for their contributions!

Bug fixes

• https://github.com/qdrant/qdrant/pull/3948 - Fix persisted crash when using space in quoted JSON path

Bug fixes

• https://github.com/qdrant/qdrant/pull/3856, https://github.com/qdrant/qdrant/pull/3867 - Fix arbitrary path traversal vulnerability in full snapshot REST API

Improvements

• https://github.com/qdrant/qdrant/pull/3837 - Improve error message when doing upsertion with malformed data

Dashboard

• https://github.com/qdrant/qdrant-web-ui/pull/167 - Find similar points by payload key:value pair
• https://github.com/qdrant/qdrant-web-ui/pull/166 - Fix find similar point ID not working in some cases
• https://github.com/qdrant/qdrant-web-ui/pull/165 - Support 64-bit numbers
• Other changes

Bug Fixes

• https://github.com/qdrant/qdrant/pull/3832
  • fix propagation of max_optimization_threads on the collection params update
  • Improve of indexing optimizer conditions
• https://github.com/qdrant/qdrant/pull/3835 - prevent unnecessary flushes of WAL Clock
• https://github.com/qdrant/qdrant/pull/3776 - make /readyz check reliable on horizontal scaling
• https://github.com/qdrant/qdrant/pull/3806 - fix memory addresses alignment for HNSW graph

Bug fixes

• https://github.com/qdrant/qdrant/pull/3788 - Allow payload paths starting with numbers

Change log

Features 📅

• Add ability to order Scroll API results by payload value - https://github.com/qdrant/qdrant/pull/3493, https://github.com/qdrant/qdrant/pull/3533, https://github.com/qdrant/qdrant/pull/3562, https://github.com/qdrant/qdrant/pull/3540, https://github.com/qdrant/qdrant/pull/3589, https://github.com/qdrant/qdrant/pull/3726
• Add date time payload index to efficiently filter by date time ranges - https://github.com/qdrant/qdrant/pull/3395, https://github.com/qdrant/qdrant/pull/3516, https://github.com/qdrant/qdrant/pull/3549, https://github.com/qdrant/qdrant/pull/3578, https://github.com/qdrant/qdrant/pull/3622, https://github.com/qdrant/qdrant/pull/3729, https://github.com/qdrant/qdrant/pull/3730
• https://github.com/qdrant/qdrant/pull/3472 - Add API to check if a collection exists
• https://github.com/qdrant/qdrant/pull/3466 - Allow specifying a minimum number of conditions to match in payload filters
• https://github.com/qdrant/qdrant/pull/3548 - Improve set_payload API, adds ability to modify nested fields

Improvements 🏎️

• Sparse vector search performance improvements, making it 16x faster - https://github.com/qdrant/qdrant/pull/3464, https://github.com/qdrant/qdrant/pull/3275, https://github.com/qdrant/qdrant/pull/3327, https://github.com/qdrant/qdrant/pull/3348, https://github.com/qdrant/qdrant/pull/3347, https://github.com/qdrant/qdrant/pull/3368, https://github.com/qdrant/qdrant/pull/3393, https://github.com/qdrant/qdrant/pull/3413, https://github.com/qdrant/qdrant/pull/3424, https://github.com/qdrant/qdrant/pull/3527, https://github.com/qdrant/qdrant/pull/3560, https://github.com/qdrant/qdrant/pull/3609, https://github.com/qdrant/qdrant/pull/3619, https://github.com/qdrant/qdrant/pull/3605
• Improve CPU saturation, greatly speeding up indexing on high CPU systems - https://github.com/qdrant/qdrant/pull/3364, https://github.com/qdrant/qdrant/pull/3115
• Improve various payload indices
  • https://github.com/qdrant/qdrant/pull/3497 - Reduce memory usage for the text index
  • https://github.com/qdrant/qdrant/pull/3297 - Reduce memory usage for geo index
  • https://github.com/qdrant/qdrant/pull/3625 - Improve loading time for test field index
  • https://github.com/qdrant/qdrant/pull/3563 - Compress text index, greatly improving tail latencies and memory usage
• Add new release artifacts to support more platforms
  • https://github.com/qdrant/qdrant/pull/3342 - MUSL binaries for x86_64 and AArch64
  • https://github.com/qdrant/qdrant/pull/3343 - Portable AppImage binary
  • https://github.com/qdrant/qdrant/pull/3344 - Debian package with *.deb archive
• Avoid re-indexing point if fields without an index are updated - https://github.com/qdrant/qdrant/pull/3611
• Refactor payload key parsing - https://github.com/qdrant/qdrant/pull/3674, https://github.com/qdrant/qdrant/pull/3697, https://github.com/qdrant/qdrant/pull/3709
• https://github.com/qdrant/qdrant/pull/3367 - Ensure consistency when an update request is dropped in the middle
• https://github.com/qdrant/qdrant/pull/3525 - Optimize MatchAny performance with a large number of values
• https://github.com/qdrant/qdrant/pull/3629, https://github.com/qdrant/qdrant/pull/3633, https://github.com/qdrant/qdrant/pull/3641 - Performance optimizations for empty payloads
• https://github.com/qdrant/qdrant/pull/2840, https://github.com/qdrant/qdrant/pull/3381 - Add a checksum for snapshot files
• https://github.com/qdrant/qdrant/pull/3374 - Improve "loss" function for discovery search
• https://github.com/qdrant/qdrant/pull/3255 - Add config property to set default shard transfer method
• https://github.com/qdrant/qdrant/pull/3380 - Add ability to selectively disable the range or lookup index for integer payloads to save memory
• https://github.com/qdrant/qdrant/pull/3555 - Report progress of ongoing shard transfers
• https://github.com/qdrant/qdrant/pull/3311 - Also report collection recovery progress in non-interactive terminals
• https://github.com/qdrant/qdrant/pull/3235 - Set custom thread priorities on Linux for better scheduling
• https://github.com/qdrant/qdrant/pull/3257, https://github.com/qdrant/qdrant/pull/3313 - Avoid logging of health and metrics APIs in access log
• https://github.com/qdrant/qdrant/pull/3418 - Report the timestamp of last seen error in cluster, helpful for debugging
• https://github.com/qdrant/qdrant/pull/3419 - Expose the git commit hash of the build at the root endpoint
• https://github.com/qdrant/qdrant/pull/3498 - Allow loading of segments to be stopped in the middle if cancelled
• https://github.com/qdrant/qdrant/pull/3552 - Expose request timing histogram for Prometheus in metrics endpoint
• https://github.com/qdrant/qdrant/pull/3581 - Report version in logs on startup

Bug fixes 🔂

• https://github.com/qdrant/qdrant/pull/3386 - Fix multiple vector updates on same point in batch not working
• https://github.com/qdrant/qdrant/pull/3512 - Expose discover endpoint statistics in the metrics
• https://github.com/qdrant/qdrant/pull/3544 - Fix some REST endpoints not being usable with read-only API key
• https://github.com/qdrant/qdrant/pull/3592 - Fix internal proxy always forwarding successful requests three times
• https://github.com/qdrant/qdrant/pull/3423 - Return better suited status codes in the gRPC API
• https://github.com/qdrant/qdrant/pull/3387 - Disable large limit optimization for plain indices
• https://github.com/qdrant/qdrant/pull/3557, https://github.com/qdrant/qdrant/pull/3565 - Properly configure RocksDB options on all column families, reducing memory usage
• https://github.com/qdrant/qdrant/pull/3580 - Fix reading vector data out of bounds
• https://github.com/qdrant/qdrant/pull/3608 - Fix a potential zero division error in geo filter queries
• https://github.com/qdrant/qdrant/pull/3623 - Security patch for snapshot upload file name

Dashboard 🍱

• https://github.com/qdrant/qdrant-web-ui/pull/153 - Add snapshots for demo collections
• https://github.com/qdrant/qdrant-web-ui/pull/156 - Auto-complete required fields when inserting commands
• https://github.com/qdrant/qdrant-web-ui/pull/155 - Add button to delete points
• https://github.com/qdrant/qdrant-web-ui/pull/134 - Visualize discovery scores
• https://github.com/qdrant/qdrant-web-ui/pull/160 - Fix vector visualisation with optional named vectors
• Other changes

Thanks to @AlexandruCihodaru @Florents-Tselai @Shylock-Hg @amietn @ding-young @Okabe-Rintarou-0 @JojiiOfficial @mrbusche @gabrieldemian @2k4sm @Anush008 @TuanaCelik @kwkr @neo773 @Dhanus3133 @KShivendu @joein @xzfc @ffuugoo @IvanPleshkov @agourlay @coszio @generall @timvisee for their contributions!

Change log

Improvements

• https://github.com/qdrant/qdrant/pull/3318 - Synchronize all nodes after collection or shard key creation, prevents collection inconsistencies across nodes
• https://github.com/qdrant/qdrant/pull/3458 - Limit automatic shard transfers for node recovery to 1, prevents huge load on cluster when recovering a big node

Change log

Improvements

• https://github.com/qdrant/qdrant/pull/3231 - Improve sparse vector search speed when using plain search

Bug fixes

• https://github.com/qdrant/qdrant/pull/3251 - Fix items dropped from payload index when using set-payload operation
• https://github.com/qdrant/qdrant/pull/3230 - Fix sparse vectors not working with very large indices
• https://github.com/qdrant/qdrant/pull/3224 - Report more detailed shard error in API responses

Change log

Bug Fixes

• https://github.com/qdrant/qdrant/pull/3215 - Fix /readyz reporting error for Kubernetes if not enough other nodes are available, preventing full cluster starts

Change log

Bug Fixes

• https://github.com/qdrant/qdrant/pull/3196 - Fix /readyz reporting error if other nodes are still on 1.16, preventing cluster upgrades

Change log

Features 🧀

• https://github.com/qdrant/qdrant/issues/2796, https://github.com/qdrant/qdrant/issues/3124 - Add support for sparse vectors, also supporting SPLADE and BM25 datasets (docs)
• https://github.com/qdrant/qdrant/issues/2790 - Add discovery search, explore and discover vectors in a defined context (docs)
• https://github.com/qdrant/qdrant/issues/2807 - Add user defined sharding, partition data with a custom sharding distribution (docs)
• https://github.com/qdrant/qdrant/issues/2432 - Add shard snapshot transfer, fast transfer of shards using snapshots including their index and quantized data (docs)
• https://github.com/qdrant/qdrant/pull/3079 - Add Manhattan distance metric
• https://github.com/qdrant/qdrant/pull/2979 - Add support for read-only API key (docs)

Improvements 🌌

• https://github.com/qdrant/qdrant/pull/2869 - Improve quality of HNSW index building on high CPU systems
• https://github.com/qdrant/qdrant/pull/2768 - Add index for geo map payloads to improve search performance
• https://github.com/qdrant/qdrant/pull/3013, https://github.com/qdrant/qdrant/pull/3026, https://github.com/qdrant/qdrant/pull/2942, https://github.com/qdrant/qdrant/pull/3103, https://github.com/qdrant/qdrant/pull/3054 - Improve stability of consensus on big high load clusters
• https://github.com/qdrant/qdrant/pull/2931 - Improve search tail latencies with many parallel searches on high CPU systems
• https://github.com/qdrant/qdrant/pull/2748, https://github.com/qdrant/qdrant/pull/2771 - Allow to configure the timeout for searches
• https://github.com/qdrant/qdrant/pull/3067 - Improve group by performance by fetching vectors only once
• https://github.com/qdrant/qdrant/pull/3076 - Improve group by performance by handling with_payloads more efficiently
• https://github.com/qdrant/qdrant/pull/2803 - Improve performance for empty match-any filters
• https://github.com/qdrant/qdrant/pull/3088 - Randomize shard placement to roughly get an even spread across all peers
• https://github.com/qdrant/qdrant/pull/3155 - Make indexed_only more lenient
• https://github.com/qdrant/qdrant/pull/3084 - Improve /readyz health check, only mark as ready when started node has caught up
• https://github.com/qdrant/qdrant/pull/2855 - Add support for using API key with HTTP Bearer authentication
• https://github.com/qdrant/qdrant/pull/2848 - Expose update rate limiter parameter in configuration
• https://github.com/qdrant/qdrant/pull/3169 - Show actual bind address instead of localhost for Web UI in greeting message
• https://github.com/qdrant/qdrant/pull/2846 - Clean up recovered snapshots from an URL instead of leaving them behind
• https://github.com/qdrant/qdrant/pull/3036 - Clean up old RocksDB files more often to save disk space
• https://github.com/qdrant/qdrant/pull/3054 - Improve WAL performance by implementing a faster checksum algorithm

Bug fixes 🫨

• https://github.com/qdrant/qdrant/pull/2933, https://github.com/qdrant/qdrant/pull/3039 - Fix potential divide by zero panic in numeric and geo index
• https://github.com/qdrant/qdrant/pull/2888 - Fix panic if gRPC request has multiple validation errors
• https://github.com/qdrant/qdrant/pull/3034 - Fix overvalidation on vector names in internal requests
• https://github.com/qdrant/qdrant/pull/2904 - Fix best_score formula with just negative examples
• https://github.com/qdrant/qdrant/pull/2927 - Fix duplicate numeric index entry for empty payload
• https://github.com/qdrant/qdrant/pull/2969 - Fix potentially syncing local consensus state when there are still pending commits
• https://github.com/qdrant/qdrant/pull/2895 - Fix custom TLS certificate not working when recovering snapshots from URL
• https://github.com/qdrant/qdrant/pull/3093 - Fix panic when loading from RocksDB with corrupted tail
• https://github.com/qdrant/qdrant/pull/3105 - Fix hard error for missing column family not found when flushing data
• https://github.com/qdrant/qdrant/pull/3156 - Fix shard transfers potentially starting too early
• https://github.com/qdrant/qdrant/pull/2960 - Fix potential memory overallocation in vector storage
• https://github.com/qdrant/qdrant/pull/3079 - Fix binary quantization for euclidean distance
• https://github.com/qdrant/qdrant/pull/2864 - Fix bad recall performance on payload indexes
• https://github.com/qdrant/qdrant/pull/3174 - Fix response codes being too strict, breaking snapshot creation in Python client
• https://github.com/qdrant/qdrant/pull/3073 - Fix NO_COLOR not having an effect on output logs
• https://github.com/qdrant/qdrant/pull/3086 - Fix migration from local to distributed on systems with 1 or 2 CPU cores
• https://github.com/qdrant/qdrant/pull/2921 - Fix storage and snapshot directory permission errors with Qdrant Docker image

Deprecation 🥀

• https://github.com/qdrant/qdrant/pull/2785 - Mark point, vector and index counts as approximate, we may eventually remove these

Dashboard 🍱

• https://github.com/qdrant/qdrant-web-ui/pull/110, https://github.com/qdrant/qdrant-web-ui/pull/116, https://github.com/qdrant/qdrant-web-ui/pull/118, https://github.com/qdrant/qdrant-web-ui/pull/121 - Add interactive tutorial
• https://github.com/qdrant/qdrant-web-ui/pull/123 - Add command palette
• https://github.com/qdrant/qdrant-web-ui/pull/107 - Download/upload snapshots with API key
• Other changes

Thanks to @kaancfidan @keremnc @ava57r @Apmats @julianbraha @golangboy @ilkecan @ologbonowiwi @russcam @dzhao @joein @ffuugoo @IvanPleshkov @agourlay @coszio @timvisee for their contributions!

Changelog

Bug Fixes

• https://github.com/qdrant/qdrant/issues/2787 - fix quantization re-scoring in case of filtering request

Change log

Features 🗺️

• https://github.com/qdrant/qdrant/pull/2538, https://github.com/qdrant/qdrant/pull/2662, https://github.com/qdrant/qdrant/pull/2661 - Add new recommendation engine, score results directly from examples
• https://github.com/qdrant/qdrant/pull/2693 - Extend recommendation API, support raw vectors along with point IDs as input
• https://github.com/qdrant/qdrant/pull/2139, https://github.com/qdrant/qdrant/pull/2315, https://github.com/qdrant/qdrant/pull/2766 - Add support for filtering geo coordinates by polygon
• https://github.com/qdrant/qdrant/pull/2599 - Add option to tune shard update parallelism, improve performance for large clusters
• https://github.com/qdrant/qdrant/pull/2642, https://github.com/qdrant/qdrant/issues/2717, https://github.com/qdrant/qdrant/pull/2728, https://github.com/qdrant/qdrant/pull/2741, https://github.com/qdrant/qdrant/pull/2728, https://github.com/qdrant/qdrant/pull/2746 - Distribute searches to other nodes if the current is busy, improve search latency on large clusters

Improvements 🕵️

• https://github.com/qdrant/qdrant/pull/2756 - Add support for specifying a path to retrieve a subset of payload
• https://github.com/qdrant/qdrant/pull/2710 - Fix cardinality estimation for Any filter, improve search performance
• https://github.com/qdrant/qdrant/pull/2744 - Use boolean index in filtering, improve search performance
• https://github.com/qdrant/qdrant/pull/2628 - Add automatic selection of search rescoring mode, improve binary search accuracy
• https://github.com/qdrant/qdrant/pull/2764 - Improve memory usage of geo index
• https://github.com/qdrant/qdrant/pull/2666 - Add immutable numeric index, decreasing memory usage by a factor of 3
• https://github.com/qdrant/qdrant/pull/2745 - Return validation error if filters only have a key but no value specified
• https://github.com/qdrant/qdrant/pull/2615 - Ensure segment compatibility when a collection is loaded
• https://github.com/qdrant/qdrant/pull/2738 - Add gRPC compliant health check method

Bug fixes 📸

• https://github.com/qdrant/qdrant/pull/2733 - Fix potential collection deadlock by simplifying segment access patterns
• https://github.com/qdrant/qdrant/pull/2638, https://github.com/qdrant/qdrant/pull/2652, https://github.com/qdrant/qdrant/pull/2528, https://github.com/qdrant/qdrant/pull/2683, https://github.com/qdrant/qdrant/pull/2720 - Fix IO errors on snapshot creation
• https://github.com/qdrant/qdrant/pull/2742 - Fix crash when using range filter with same value as lower and upper bound
• https://github.com/qdrant/qdrant/pull/2759 - Fix collection stuck as initializing after crash in single node deployment
• https://github.com/qdrant/qdrant/pull/2755 - Fix ordering parameter not working for batch point update requests
• https://github.com/qdrant/qdrant/pull/2724 - Fix temporary files left behind by snapshot creation
• https://github.com/qdrant/qdrant/pull/2709 - Remove obsolete storage log files more aggressively, prevent them consuming too much space
• https://github.com/qdrant/qdrant/pull/2765 - Improve documentation for collection update vector parameters

FastEmbed ⚡

• https://github.com/qdrant/fastembed/pull/13 - Remove bulky dependencies, reduce dependency size by a factor of 25
• Add new models: sentence-transformers/all-MiniLM-L6-v2, intfloat/multilingual-e5-large
• Add API to list supported models, including: BAAI/bge-small-en, BAAI/bge-base-en
• Other changes

Thanks to @kwkr @etolbakov @smark-d @dzhao @zzzz-vincent @jsoref @ffuugoo @IvanPleshkov @agourlay @coszio @timvisee for their contributions!

Change log

Improvements 🔐

• https://github.com/qdrant/qdrant/pull/2613 - Add unprivileged Docker image more suitable for secure environments

Bug Fixes 🥀

• https://github.com/qdrant/qdrant/pull/2641 - Emergency fix for potential deadlock on segments preventing all updates and flushes

Dashboard 🍱

• https://github.com/qdrant/qdrant-web-ui/pull/113 - Fix downloading snapshots from dashboard

Change log

Features 🪩

• https://github.com/qdrant/qdrant/pull/1951, https://github.com/qdrant/qdrant/pull/2496 - Add batch update endpoint for points API
• https://github.com/qdrant/qdrant/pull/2470 - Add binary quantization
• https://github.com/qdrant/qdrant/pull/2410, https://github.com/qdrant/qdrant/pull/2562, https://github.com/qdrant/qdrant/pull/2571 - Add shard snapshot API
• https://github.com/qdrant/qdrant/pull/2431, https://github.com/qdrant/qdrant/pull/2488 - Add indexed_only parameter to skip unindexed segments speeding up search
• https://github.com/qdrant/qdrant/pull/2483 - Add gRPC reflection server
• https://github.com/qdrant/qdrant/pull/2475 - Add optimizer status and history in telemetry to help debug optimizer failures
• https://github.com/qdrant/qdrant/pull/2409 - Add healthz, livez and readyz endpoints for Kubernetes health checking
• https://github.com/qdrant/qdrant/pull/2457 - Add stack trace API to help debug current state of all threads
• https://github.com/qdrant/qdrant/pull/2549 - Add recovery mode flag in metrics

Improvements 🪥

• https://github.com/qdrant/qdrant/pull/2563 - Improve handling of shard load failure, automatically recover in distributed mode
• https://github.com/qdrant/qdrant/pull/2187, https://github.com/qdrant/qdrant/pull/2506 - Improve log formatting, support better trace logging
• https://github.com/qdrant/qdrant/pull/2339 - Remove unused debug setting from configuration
• https://github.com/qdrant/qdrant/pull/2420, https://github.com/qdrant/qdrant/pull/2446, https://github.com/qdrant/qdrant/pull/2453, https://github.com/qdrant/qdrant/pull/2524 - Share equal point keyword strings to reduce RAM usage
• https://github.com/qdrant/qdrant/pull/2536 - Clean up temporary directories on start
• https://github.com/qdrant/qdrant/pull/2576 - Add OCI labels on Docker image

Bug fixes 🫥

• https://github.com/qdrant/qdrant/pull/2514 - Fix potential loss of points, vectors and payloads on crash
• https://github.com/qdrant/qdrant/pull/2508 - Fix broken raft state due to accidental truncation of last consensus WAL element
• https://github.com/qdrant/qdrant/pull/2485 - Fix error handling when optimizer panics, report fault status
• https://github.com/qdrant/qdrant/pull/2422 - Fix panic when cancelling quantization early
• https://github.com/qdrant/qdrant/pull/2478 - Fix quantization oversampling giving worse results due to wrong ordering
• https://github.com/qdrant/qdrant/pull/2544 - Fix crash on huge dimensionality by limiting vector dimension to 65536
• https://github.com/qdrant/qdrant/pull/2489, https://github.com/qdrant/qdrant/pull/2501, https://github.com/qdrant/qdrant/pull/2523 - Fix vulnerability in Rustls Web PKI
• https://github.com/qdrant/qdrant/pull/2510 - Fix incorrect ID recovery when database is corrupted
• https://github.com/qdrant/qdrant/pull/2528 - Fix temporary snapshot files not being deleted on error

Dashboard 🍱

• https://github.com/qdrant/qdrant-web-ui/pull/103 - Add collection info tab
• https://github.com/qdrant/qdrant-web-ui/pull/107 - Download/upload snapshots with API key
• Other changes

FastEmbed ⚡

Our Python client (qdrant-client) now integrates with our FastEmbed package - a lightweight, fast, Python library built for retrieval embedding generation.

That allows to seamlessly add and search documents in Qdrant, avoiding manual encoding and configuration of the collections.

Read more: https://github.com/qdrant/qdrant-client/releases/tag/v1.5.0

Thanks to @DengYiping @camdencheek @zpp12354321 @dzhao @zzzz-vincent @ffuugoo @IvanPleshkov @agourlay @coszio @timvisee for their contributions!

Change log

Improvements

• https://github.com/qdrant/qdrant/pull/2131 - Skip outdated Raft heartbeats, improve consensus networking footprint
• https://github.com/qdrant/qdrant/pull/2384 - Use seeded randomness for ID tracker point sampling, improves consistency of the search results
• https://github.com/qdrant/qdrant/pull/2407 - Whitelist root endpoint to not require API key, simplifies health-checks in k8s
• https://github.com/qdrant/qdrant/pull/2388 - Optimize RAM usage for keywords index

Bug Fixes

• https://github.com/qdrant/qdrant/pull/2408 - Fix infinite reindexing after mmap threshold patching
• https://github.com/qdrant/qdrant/pull/2414 - Fix incorrect file URI handling in snapshot recovery
• https://github.com/qdrant/qdrant/pull/2399 - Deactivate failed nodes in Initializing state

Change log

Features 🎎

• https://github.com/qdrant/qdrant/pull/2107, https://github.com/qdrant/qdrant/pull/2174 - Add binary index for boolean payloads
• https://github.com/qdrant/qdrant/pull/2083, https://github.com/qdrant/qdrant/pull/2087, https://github.com/qdrant/qdrant/pull/2328, https://github.com/qdrant/qdrant/pull/2090, https://github.com/qdrant/qdrant/pull/2097 - Support changing HNSW/quantization/on_disk parameters of existing collection at runtime
• https://github.com/qdrant/qdrant/pull/2023, https://github.com/qdrant/qdrant/pull/2260 - Add multilingual tokenizer for non-latin alphabets, optionally supporting CJK

Improvements 🔎

• https://github.com/qdrant/qdrant/pull/2293 - Implement cancellation of search requests, stop searching if request is dropped and add timeout
• https://github.com/qdrant/qdrant/pull/2292 - Improve performance and memory use of deduplicating points
• https://github.com/qdrant/qdrant/pull/2316 - Allow to configure name of init file with environment variable
• https://github.com/qdrant/qdrant/pull/2337 - Migrate raft state on disk from CBOR to JSON for easy debugging
• https://github.com/qdrant/qdrant/pull/2319 - Remove leftover temporary segment directory when loading shard
• https://github.com/qdrant/qdrant/pull/2368 - Log shard state changes to easy debugging

Bug fixes 🤯

• https://github.com/qdrant/qdrant/pull/2343 - Fix consensus doing a lot of obsolete work when synchronizing causing consensus to get stuck
• https://github.com/qdrant/qdrant/pull/2286 - Fix memory overallocation in vector storage
• https://github.com/qdrant/qdrant/pull/2372, https://github.com/qdrant/qdrant/pull/2376 - Fix io_uring still being initialized if not used, fixes memory leak on old kernels
• https://github.com/qdrant/qdrant/pull/2272 - Fix deleted segments still being loaded
• https://github.com/qdrant/qdrant/pull/2365 - Fix handling of locally disabled peers
• https://github.com/qdrant/qdrant/pull/2373 - Fix shard state desync on shard transfer if messages are delayed
• https://github.com/qdrant/qdrant/pull/2366 - Fix quantization panic if quantile is very close to 1.0

Dashboard 🍱

• https://github.com/qdrant/qdrant-web-ui/pull/81, https://github.com/qdrant/qdrant-web-ui/pull/78 - Add collection snapshot management: upload, create, download and delete snapshots from browser
• https://github.com/qdrant/qdrant-web-ui/pull/88 - Edit points payload
• https://github.com/qdrant/qdrant-web-ui/pull/85 - Vectors visualization using t-SNE dimensionality reduction algorithm

Thanks to @yarikoptic @hi-rustin @zzzz-vincent @zarkone @ffuugoo @IvanPleshkov @agourlay @coszio @timvisee for their contributions!