Changelog

Improvements

• https://github.com/qdrant/qdrant/pull/1189 - handle collections transition from single-node to cluster. Simplifies migration from single-node deployment into cluster version. Also allows to recover single-node version snapshots into cluster deployment

Changelog

Features 🍰

• Replication support - Now Qdrant can provide a high availability setup with distributed deployment out of the box. Replications in combination with sharding allow horizontally scaling of both - the collection's size and the cluster's throughput. While at the same time eliminating a single point of failure problem. Read more in the docs 📖
• https://github.com/qdrant/qdrant/issues/1119 - New administration API allows disabling write operations to the service. Useful in situations where search availability is more critical than updates. It will enable blocking updates if, e.g., the memory usage watermark is reached. Docs 📖
• https://github.com/qdrant/qdrant/pull/1164 - Report indexed payload points in info API, allows to verify that payload values was properly formatted for indexing
• https://github.com/qdrant/qdrant/pull/1150 - New exact search parameter allows to force exact search of the vectors, even if ANN index is built. Useful for validating accuracy of the current HNSW configuration.

Improvements 🌱

• https://github.com/qdrant/qdrant/pull/1157 - Disable logging for healthchecks
• https://github.com/qdrant/qdrant/pull/1152 - Move connection errors logging into /cluster status API. Prevents flood of error messages in case of other node failure in cluster

Bug fixes 👿

• https://github.com/qdrant/qdrant/pull/1172 - fix issue with consensus WAL, leading to panic on recover in some rare cases

Compatibility 👯

• This release is backward compatible with v0.10.5 storage in single node deployment.
• Distributed deployment is, unfortunately, incompatible with previous versions due to the large amount of changes, required for replica set implementation.
• Clients are tested for backward compatibility with v0.10.x service

Further work 🧑‍🚀

This release finalizes the feature-set of the first road-map of Qdrant. Further updates before v1.0 will be focused on maintainability and stability of the service. The next road-map will be published soon!

Thanks to @IvanPleshkov, @agourlay, and @e-ivkov for contributing into this release

Changelog

Bugfixes

• https://github.com/qdrant/qdrant/pull/1133 - fix propagation of payload index during optimization

Changelog

Bug fixes

• https://github.com/qdrant/qdrant/pull/1125 - improve validation of Geo location payload validation

Changelog

Bug fixes

• https://github.com/qdrant/qdrant/pull/1108 - fix conflict resolution in Raft consensus WAL. Consensus is able to recover after split-brain cluster
• https://github.com/qdrant/qdrant/pull/1109 - fix panic on inconsistent storage updates. Now storage is sound after error recovery
• https://github.com/qdrant/qdrant/pull/1110 - additional guarantees on storage consistency in case of multiple vector collection
• https://github.com/qdrant/qdrant/pull/1102 - more explicit leader election flag in the Raft consensus
• https://github.com/qdrant/qdrant/pull/1083 - properly handle a corner-case of limit = 0 in search API

Changelog

Bug fixes

• https://github.com/qdrant/qdrant/pull/1041 - propagate proper error in case of partial update error across shards
• https://github.com/qdrant/qdrant/pull/1050 - fix the filter-based points remove operation
• https://github.com/qdrant/qdrant/pull/1054 - ensure storage consistency in case of failure during collection creation
• https://github.com/qdrant/qdrant/pull/1061 - increase stability during high load

Backward compatibility release

See: https://github.com/qdrant/qdrant/releases/tag/v0.10.0

Proposed update process:

1. Update qdrant from v0.9.1 -> v0.10.0
2. Update qdrant client to v0.10.0
3. Update qdrant to v0.10.1
4. Update qdrant client to v0.10.1

Changelog

Features 🎡

• https://github.com/qdrant/qdrant/pull/958 - Multiple Vectors per Point. - Docs
  • It is now possible to assign multiple vectors for each point in collection. Update and search APIs now accepts either one anonymous vector (same as before), or multiple named vectors. This functionality might be useful if some object could be represented from multiple aspects by different neural encoders (e.g. image + text, title + abstract).

PUT /collections/{collection_name}/points

{
    "points": [
        {
            "id": 1,
            "vectors": {
                "image": [0.9, 0.1, 0.1, 0.2],
                "text": [0.4, 0.7, 0.1, 0.8, 0.1, 0.1, 0.9, 0.2]
            }
        }
   ]
}

• https://github.com/qdrant/qdrant/pull/813 & https://github.com/qdrant/qdrant/pull/954 - Batch Search and Recommendation API - Docs
  • Allows more efficient search for multiple queries in a single request. Significantly decreases networking overhead and shares the result of filtering computation among batched queries.

POST /collections/{collection_name}/points/search/batch

{
    "searches": [
        { "vector": [0.2, 0.1, 0.9, 0.7], "limit": 3 },
        { "vector": [0.5, 0.3, 0.2, 0.3], "limit": 3 }
    ]
}

• https://github.com/qdrant/qdrant/pull/963 - Full-Text Filtering - Docs
  • Adds minimal full-text search capabilities into all filterable APIs. Specify ngram-prefix or word tokenizer to make queries only among records which contain specified words.

Improvements 🎓

• https://github.com/qdrant/qdrant/pull/1000 - Multi-platform builds for x86_64 and aarch64 - allows natively run Qdrant on arm-based CPUs. Pushes price/performance ratio even further. - DockerHub
• https://github.com/qdrant/qdrant/pull/949 - Use Jemallocator instead of default one. Significantly improves memory usage, prevents heap fragmentation. - Read more
• https://github.com/qdrant/qdrant/pull/1003 - Improve scroll API performance for strict filters. In some cases up to 1000x speed improvement.

Bug fixes 👾

• https://github.com/qdrant/qdrant/pull/973 - fix for snapshot api, do not fail if FS does not support last-update timestamp
• https://github.com/qdrant/qdrant/pull/990 - fix telemetry API (not stabilized yet)
• https://github.com/qdrant/qdrant/pull/1023 - assign proper response code on non-specified payload index type

Compatibility 🔌

There are a lot of fundamental changes in qdrant segment storage and API, but we did our best to make a transition process as smooth as possible. The v0.10 release be performed in 2 steps: on the first step we upgrade qdrant into transition version v0.10.0 which support both - old and new version of the interface. The second update v0.10.1 will remove deprecated fields from the API.

Proposed update process with minimal downtime:

1. Update qdrant from v0.9.1 -> v0.10.0
2. Update qdrant client to v0.10.0
3. Update qdrant to v0.10.1
4. Update qdrant client to v0.10.1

Don't forget to make backups and test the process in development environment!

See API changes in client releases:

• Python
• Rust
• Go

Further work 🔨

Next release will be primarily focused on the Replication Support.

Thanks to @IvanPleshkov, @agourlay, @e-ivkov, @joein and @monatis for contributing into this release

Compatibility fix release

Fixes

• https://github.com/qdrant/qdrant/pull/937 - Fix max_request_size_mb configuration
• https://github.com/qdrant/qdrant/pull/936 - Do not panic if config.optimizer_config.max_optimization_threads is 0

Changelog

Features 🧞

• Dynamic cluster scaling capabilities - docs
  • https://github.com/qdrant/qdrant/issues/861 - Move shard API
  • https://github.com/qdrant/qdrant/pull/894 - Peer removal API

Improvements 🤺

• https://github.com/qdrant/qdrant/pull/900 - Remove temporary snapshot files during full snapshot
• https://github.com/qdrant/qdrant/pull/877 - Disable default mmap threshold
• https://github.com/qdrant/qdrant/pull/901 - Remove default max optimizer threads to enable switching off the optimizer
• https://github.com/qdrant/qdrant/pull/879 - Report progress of indexing with indexed_vectors_count field in the Collection info API

Bug fixes 🪱

• https://github.com/qdrant/qdrant/pull/876 - Handle properly collection with vector dimension of 0
• https://github.com/qdrant/qdrant/pull/898 - Fix various enum conversion in gRPC

Further work 🚧

The next major release will focus on finalizing the Roadmap and bringing frequently requested functionality into the Qdrant.
The next major release will be 0.10.0. After that, we will work on stabilizing the API and storage as preparation for a 1.0 LTS release.

Thanks @agourlay & @e-ivkov for contributing into this release!

Changelog

• Fix backwards compatibility with 0.8.x

Change log

Features 🫐

• https://github.com/qdrant/qdrant/pull/824 - Full storage snapshot - creates a snapshot of all collections and aliases in one call

Improvements 🏭

• https://github.com/qdrant/qdrant/pull/783 - Parallel segment loading - significantly improves service recovery time

• Several distributed deployment stability improvements:

  • https://github.com/qdrant/qdrant/pull/798 - better defaults for internal calls timeout
  • https://github.com/qdrant/qdrant/pull/797 - propagation of wait flag during distributed calls
  • https://github.com/qdrant/qdrant/pull/799 - automatic selection of number of shards
  • https://github.com/qdrant/qdrant/pull/816 - more even point distribution across shards
  • https://github.com/qdrant/qdrant/pull/822 - API for viewing collection shards distribution
  • https://github.com/qdrant/qdrant/pull/851 - better handling of DNS record changes of peers

• https://github.com/qdrant/qdrant/pull/821 - fix backward compatibility with storages created in 0.8.x

Bug fixes 🦐

• https://github.com/qdrant/qdrant/pull/849 - fix possible inconsistency in payload index in case of inserting multiple payloads with the same value

Further work

The main goal for v0.9.0 is a seamless cluster scaling - ability to add more nodes into the cluster and move shards between this nodes.

Thanks @agourlay, @e-ivkov, and @IvanPleshkov for contributing into this release!

Change log

Features 🐣

• Snapshots - https://github.com/qdrant/qdrant/pull/764 https://github.com/qdrant/qdrant/pull/772

  • Allows to safely create a snapshot of running collection and recover it on another machine
  • Useful for backups, tests, and ensuring high availability
  • Documentation: https://qdrant.tech/documentation/snapshots/

• Count API - https://github.com/qdrant/qdrant/pull/777

  • Allows to retrieve a number of points that satisfy given filtering criteria
  • Useful for: pagination, facet search, debugging
  • Documentation: https://qdrant.tech/documentation/points/#counting-points

Improvements 🦅

• Parallel building of HNSW index - https://github.com/qdrant/qdrant/commit/e983b07a1521cd47771b63006defe54f74d181ce
  • Qdrant allows now to utilize multiple processes for building HNSW index.
  • Building of large HNSW segments now benefits from the multi-core systems while significantly decreasing overall index building time.
• Improved condition for creating additional links in HNSW graph. https://github.com/qdrant/qdrant/pull/773
  • Additional links for payload with low variety of values won't be created as they do not have an impact on search performance.
• Improved behavior of Raft consensus during the bootstrap retry - https://github.com/qdrant/qdrant/issues/768

Bug fixes 🐙

• fix db flush ordering to prevent persisting versions for un-persisted points https://github.com/qdrant/qdrant/commit/8ac3eef4c7e1519d78c0036b779b192cab482c94

Thanks @agourlay @e-ivkov for contributing to the release

Change log

Features

• Pagination of search result: https://github.com/qdrant/qdrant/issues/496

Bug Fixes

• Batch upsert with distributed deployment - https://github.com/qdrant/qdrant/issues/758
• Stability improvements: https://github.com/qdrant/qdrant/commit/8ac3eef4c7e1519d78c0036b779b192cab482c94

Change log - Stability improvements

Bug fixes

• Fixed possible deadlock on collection read https://github.com/qdrant/qdrant/pull/725, thanks @BurtonQin
• Stability patch for distributed deployment: https://github.com/qdrant/qdrant/pull/710, https://github.com/qdrant/qdrant/pull/737, https://github.com/qdrant/qdrant/pull/712
• Fixes in concurrent storage update & optimization: https://github.com/qdrant/qdrant/pull/736

Change log

Improvements

• New web-based UI 🎨 available: https://ui.qdrant.tech/, make requests to local qdrant instance right from the browser

Bug fixes

• Fixed bug related to directory removal in case of using volumes mounted with CIFS. Issues: https://github.com/qdrant/qdrant/issues/701 and https://github.com/qdrant/qdrant/issues/308 PR: https://github.com/qdrant/qdrant/pull/705

Change log

🔮 Features

• Experimental support for distributed deployment - [docs] [issues]

  • Cluster topology synchronization via Raft consensus protocol
  • Sharding for the collections
  • Distributed search and updates
  • Cluster status API - https://github.com/qdrant/qdrant/issues/605

• Filtering by similarity score - https://github.com/qdrant/qdrant/issues/113

• On-disk payload storage - https://github.com/qdrant/qdrant/issues/406

  • Store large payload with less RAM usage

• On-flight payload indexing - payload indexes are available without segment re-build

  • Streaming updates for Numeric, Keyword, and Geo indexes: https://github.com/qdrant/qdrant/issues/575, https://github.com/qdrant/qdrant/issues/592, https://github.com/qdrant/qdrant/issues/593

🔧 Improvements

• Faster payload index - https://github.com/qdrant/qdrant/pull/461

• Better error reporting

  • Return errors as JSON https://github.com/qdrant/qdrant/issues/555
  • Better handling of mismatched enums https://github.com/qdrant/qdrant/issues/551

• Enable CORS headers for Swagger UI access - https://github.com/qdrant/qdrant/issues/610

• HNSW Speed improvements (https://github.com/qdrant/qdrant/pull/508, https://github.com/qdrant/qdrant/pull/513)

• Storage optimization

  • RocksDB better log rotation - https://github.com/qdrant/qdrant/issues/516
  • Disable redundant WAL in RocksDB - https://github.com/qdrant/qdrant/pull/576
  • Unite RocksDB columns in single DB - https://github.com/qdrant/qdrant/pull/585
  • Parallel segment creation - https://github.com/qdrant/qdrant/pull/598

• Better support for Int payload in gRPC - https://github.com/qdrant/qdrant/pull/564

🚧 Breaking changes

• Due to significant changes in payload storage, collections created with the previous engine version are not compatible with the new version. The most straightforward migration approach would be to re-create collections with the latest version from scratch. Breaking changes are required to make our v1.0 release as legacy-free as possible. Hope for your understanding.

⌛ Work-in-progress

• We are continuing the development of Distributed Deployment. In next release we will address shard re-balancing and replication issues. Stay tuned and check out our Roadmap for details.

Change log

🎠 Features

• Qdrant now supports any JSON as payload - https://github.com/qdrant/qdrant/pull/306

  • The uploaded payload structure now exactly matches the retrieved results.
  • The payload schema is now obsolete. The payload type is now used for field indexes only.

• Alias API in gRPC - Making up for a lost API https://github.com/qdrant/qdrant/pull/408

• New filtering condition

  • Bool filter and refactoring of Match - https://github.com/qdrant/qdrant/pull/421
  • IsEmpty filter - https://github.com/qdrant/qdrant/pull/423
  • ValuesCount filter - https://github.com/qdrant/qdrant/pull/439

🚀 Improvements

• Geo payload indexing - https://github.com/qdrant/qdrant/pull/366

  • Geolocation queries are now processed with a special type of index.

• Removed BLAS - https://github.com/qdrant/qdrant/pull/182

  • Custom, slim, architecture-aware implementations now perform distance computation.
  • Additional support for neon aarch64.
  • Euclidean metric now uses SIMD - order of magnitude faster performance.

• Use Filtering context instead of Condition Checker - https://github.com/qdrant/qdrant/pull/413

  • Opens up opportunities for additional optimization during the planning phase of the queries.

• sled removed - https://github.com/qdrant/qdrant/pull/402

  • Less overhead resources.

• HNSW Performance improvements

  • Better iteration implementation - https://github.com/qdrant/qdrant/pull/409
  • Chunked Vector storage - https://github.com/qdrant/qdrant/pull/457

❗ Breaking changes

• Due to significant changes in payload format, collections created with the previous engine version are not compatible with the new version. The most straightforward migration approach would be to re-create collections with the latest version from scratch. Breaking changes are required to make our v1.0 release as legacy-free as possible. Hope for your understanding.

🔬 Work-in-progress

• Our main efforts are now focused on the distributed deployment feature. Stay tuned a check out our Roadmap for details.

Change log

Features

• gPRC support for all endpoints
  • Protobug docs: https://github.com/qdrant/qdrant/blob/master/docs/grpc/docs.md
  • Instruction how to enable: https://qdrant.tech/documentation/quick_start/#grpc
• recommend endpoint can now return payload and vector - https://github.com/qdrant/qdrant/issues/353

Bug fixes

• Better logic for segment flushing, prevent accumulating of the large amount of data in WAL - https://github.com/qdrant/qdrant/pull/336
• Fixed payload selector in all retrieval APIs https://github.com/qdrant/qdrant/pull/358

Breaking changes

• REST API is compatible, but if you are using python client, please follow the migration examples here https://github.com/qdrant/qdrant_client/releases/tag/v0.6.0

Change log

Features

• Better error reporting in collection info API: https://github.com/qdrant/qdrant/pull/316
• [geo] validate coordinates in API - https://github.com/qdrant/qdrant/issues/294

Bug fixes

• optimizer parameters update bug: https://github.com/qdrant/qdrant/issues/309