Release date: May 11, 2024

This release comes with several enhancements and bug fixes to improve security and stability. One of the improvements is the inclusion of the channel checkpoint in the flush response. Another enhancement is the ability to check whether autoID is enabled during data insertion, which optimizes the data migration using Milvus-CDC.

The bug fixes address issues such as empty segments in meta, and incorrect data types during data insertion according to the schema. A critical patch has also been implemented to solve the consistent failure and retries of the syncDistribution request to the delegator. We highly recommend updating to the latest version to benefit from these fixes.

• Supported return channel checkpoint info in flush response (#32683)
• Add config to check id during inserting data when autoID enabled (#32840)

• Fixing a bug where the syncDistribution request to the delegator consistently fails and retries persistently. (#32923)

• Fixed a bug where the system could generate empty segments. Added support for the compactor to clean up empty segments. (#32690)
• Fixed a bug that involved validating whether the input data types match the schema. (#32790, #32845)

Release date: May 6, 2024

Milvus version 2.4.1 brings numerous improvements and bug fixes that aim to enhance the software's performance, observability, and stability. These improvements include a declarative resource group API, enhanced bulk insert functionality that supports Float16/BFloat16 vector data types, a refined garbage collection (GC) mechanism that reduces list operations for object storage, and other changes related to performance optimizations. Additionally, bug fixes address issues such as compilation errors, failed fuzzy matches on newline characters, incorrect parameter datatypes for RESTful interfaces, and BulkInsert raising errors on numpy files when dynamic fields are enabled.

• Discontinued support for delete with an empty filter expression. (#32472)

• Added support for Float16/BFloat16 vector data types in bulk insert (#32157)
• Enhanced sparse float vector to support brute force iterator search and range search (#32635)

• Added declarative resource group api (#31930 #32297 #32536 #32666)
• Rewrote the collection observer in QueryCoord to make it task-driven(#32441)
• Refactored the data structure used in the SyncManager of DataNode to reduce memory usage and prevent errors (#32673)
• Revised the implementation of garbage collection to minimize list operations associated with object storage(#31740)
• Reduced the cpu usage when collection number is high (#32245)
• Enhanced the management of milvus.yaml by automatically generating relevant configuration items in the milvus.yaml file through code(#31832 #32357)
• Enhanced the performance of the Query by retrieving the data after performing local reduction (#32346)
• Added WithBlock option for etcd client creation (#32641)
• Used client_request_id specified by the client as the TraceID if client provided(#32264)
• Added db label to the metrics for the delete and bulk insert operations(#32611)
• Added logic to skip the verification through configuration for AutoID and PartitionKey columns(#32592)
• Refined errors related to authentication (#32253)
• Refined error logs for AllocSegmentID in DataCoord(#32351 #32335)
• Removed duplicate metrics(#32380 #32308) and clean up unused metrics(#32404 #32515)
• Added configuration option to control whether to enforce the activation of the partitionKey feature(#32433)
• Added configuration option to control the maximum amount of data that can be inserted in a single request(#32433)
• Parallelize the applyDelete operation at the segment level to accelerate the processing of Delete messages by the Delegator(#32291)
• Used index (#32232 #32505 #32533 #32595) and add cache (#32580) to accelerate frequent filtering operations in QueryCoord.
• Rewrote the data structure(#32273) and refactor code(#32389 ) to accelerate common operations in DataCood.
• Removed openblas from conan(#32002)

• Fixed build milvus in rockylinux8 (#32619)
• Fixed compilation errors for SVE on ARM (#32463 #32270)
• Fixed the crash issue on ARM-based GPU images(#31980).
• Fixed regex query can't handle text with newline (#32569)
• Fixed search get empty result caused by GetShardLeaders return empty node list (#32685)
• Fixed BulkInsert raised error when encountering dynamic fields in numpy files(#32596)
• Fixed bugs related to the RESTFulV2 interface, including an important fix that allows numeric parameters in requests to accept numerical input instead of string type(#32485 #32355)
• Fixed memory leak in proxy by remove watching config event in rate limiter(#32313)
• Fixed the issue where the rate limiter incorrectly reports that the partition cannot be found when partitionName is not specified(#32647)
• Added detection between the cases of Collection being in the recovery state and not being loaded in the error type.（#32447）
• Corrected the negative queryable num entities metric (#32361)

Release note is coming soon...

Release note is coming soon...

Release date: Apr 7, 2024

This release aims to enhance system performance, reliability and observability with key features like improved index information retrieval, secure Minio connections via TLS, and new metrics for better monitoring.

These updates aim to provide a more secure, efficient, and reliable user experience.

• Optimized DescribeIndex performance by implementing bulk index information retrieval(#31239)(#31429)
• Improved access efficiency to formatted keys by caching the formatted key of param item(#31402)
• Add metrics for querycoord current target cp lag(#31463)
• Implemented TLS support for Minio connections(#31292)(#31619)
• Speed up target recovery after QueryCoord restart(#31449)
• Added new metrics for entities statistics(#31511)
• Implementing the API of the resultful(#30430)
• Save collection targets by batches(#31655)
• Added validation checks for the legality of field data types(#31699)

• Fixed the issue in CurrentTargetFirst/NextTargetFirst where it would generate unexpected task behavior(#31419)
• Fixed the bug that does not cause the shard leader to fail when search fails(#31450)
• Fixed a bug where nodes were marked as unreachable when get client failure(#31451)
• Fixed client error handling to enable retries for certain types of unrecoverable errors instead of directly returning them(#31452)
• Fixed an issue where the balance channel would freeze due to deadlocks(#31455)
• Fixed a bug where nodeID was not checked when updating channel checkpoints(#31508)
• Fixed the incorrect use of double buffering for entry size exceeding the max size(#31549)
• Fixed a bug where delegator's filtering removed all delete messages, making deleted messages temporarily accessible(#31587)
• Fixed a bug where the proxy's context was canceled prematurely during session revocation(#31595)
• Fixed the target observer updates manual and automatic tasks were not mutually exclusive(#31603)
• Fixed a bug where channel metadata was updated even when nodeID did not match(#31665)
• Fixed a bug where compaction tasks were not cleaned up when releasing channels(#31694)
• Fixed a bug where the injection was invalid when the queue was empty(#31819)
• Fixed a bug where channel meta mergeFlushSegment was not idempotent cause data loss(#31837)
• Fixed the bug that Datacoord session disconnects before revoking it(#31747)

coming soon..

coming soon

Release date: Mar 8, 2024

Milvus v2.3.11 brings improvements and bug fixes aimed at enhancing performance, security, and stability. The improvements include optimized data loading, enhanced security with TLS support for Kafka connections, memory optimization, and more. Additionally, bug fixes address issues such as search/query failures, incorrect data types in outputs, and disk estimation errors. We encourage you to update to this latest version to take advantage of these enhancements and fixes.

• Optimized JSON loading by reducing 1x memory copy (#30864)
• Implemented TLS support for Kafka connections (#30466 #30925)
• Optimized monitoring: Remove time tick delay metrics when nodes go offline (#30879)
• Optimized memory usage and loading speed for variable length data (#30900)
• Implemented support for varchar autoID in bulk insert operations (#30913)
• Added support for rate limiting for flush operations at the collection level (#29568)
• Improved compatibility for the watch DM channel request (#30954)
• Enhanced stability when reading S3 objects (#30976)
• Reduced contention for locks in the DescribeIndex operation (#30975)
• Optimized automatic balancing in QueryCoord (#30725)
• Enabled Milvus containers to run as a non-root user (#30937)
• Enhanced lock granularity in DataCoord meta (#30986)
• Enhanced memory estimation during loading by adding a load memory factor (#30999)
• Reduced memory consumption for DataNode when dealing with multiple collections (#30991)
• Optimized the connection manager in the proxy to prevent out-of-memory errors (#31009)

• Fixed search/query failed caused by passing an incorrect context and missing error handling (#30818)
• Fixed incorrect data types in the output when using the RESTful query interface (#30738)
• Fixed incorrect disk estimation when loading disk index (or index with mmap enabled) (#30948)
• Fixed the issue where redundant segments with older versions may never be released (#30953)
• Fixed the issue where incorrect disk limits may be read (#30966)
• Fixed a series of issues with the RESTful interface, such as incorrect int64 precision and failed insertion (#30873)
• Fixed panic during rolling upgrade caused by compatibility issues (#30656)
• Fixed an issue where flush and compaction were stalled due to uncleared compaction tasks in the Datanode (#30972)
• Fixed frequent lock contention in the GetCompactionTo operation, which caused channel checkpoints lag (#30965)
• Fixed the issue where Datanode failed to update channel checkpoints with multiple collections (#31024 #31082)
• Fixed insertion failures caused by frequent contention for locks (#31026)
• Fixed proxy panic caused by missing error handling (#31086)

v2.3.10

Release date: Feb 23, 2024

Milvus v2.3.10 is a critical patch release that follows Milvus v2.3.9, featuring several essential bug fixes. A significant fix in this release addresses the issue of missing data in hybrid search results when utilizing partition keys (issue #30607).

Users who have encountered hybrid search issues in release v2.3.5 through v2.3.9, especially those using partition key features, are highly recommended to upgrade to version v2.3.10 promptly.

Critical Bug Fixes

• Missing data in hybrid search results when utilizing partition keys (issue #30607).
• Prevented flush blockages by skipping the filling of segmentID in indexBuildCh (#30749).

Bug Fixes

• Prevented accidental deletion of original data by avoiding the use of absolute paths in ChunkCache (#30679).
• Enforced the use of virtual host for Tencent Cloud object storage (#30685).
• Updated disk usage metrics following segment release (#30707).
• Released loaded growing segments if WatchDmlChannel fails (#30745).
• Resolved a panic caused by using a nil interface in the gRPC client (#30755).

v2.3.9

Release date: Feb 19, 2024

Milvus 2.3.9 is a critical patch release succeeding Milvus 2.3.8, incorporating a number of vital bug fixes. Key among these is the resolution of the DiskANN construction failure issue. We strongly advise users experiencing disk index construction problems in version 2.3.8 to upgrade to version 2.3.9 without delay.

Critial Bug Fixes

• Fixed DiskANN construction failure in Milvus version 2.3.8 (#30640).
• Addressed loading failures due to inability to replace the primary key index (#30578).
• Added collectionName to the response of the ListAliases API (#30533).