milvus/internal/core/unittest
Bingyi Sun a75bb85f3a
feat: support chunked column for sealed segment (#35764)
This PR splits sealed segment to chunked data to avoid unnecessary
memory copy and save memory usage when loading segments so that loading
can be accelerated.

To support rollback to previous version, we add an option
`multipleChunkedEnable` which is false by default.

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-10-12 15:04:52 +08:00
..
bench enhance: optimize milvus core building (#35610) 2024-08-23 12:35:02 +08:00
test_utils feat: support load and query with bm25 metric (#36071) 2024-10-11 10:23:20 +08:00
CMakeLists.txt enhance: the estimate method when loading the collection (#36307) 2024-10-09 17:35:19 +08:00
init_gtest.cpp enhance: async search and retrieve in cgo (#33228) 2024-06-22 09:38:02 +08:00
test_always_true_expr.cpp enhance: refactor executor framework V2 (#35251) 2024-09-13 20:57:09 +08:00
test_array_bitmap_index.cpp enhance: allow many segments for inverted index (#35616) 2024-08-28 11:30:59 +08:00
test_array_expr.cpp enhance: refactor executor framework V2 (#35251) 2024-09-13 20:57:09 +08:00
test_array_inverted_index.cpp enhance: refactor executor framework V2 (#35251) 2024-09-13 20:57:09 +08:00
test_array.cpp feat: support inverted index (#28783) 2023-12-31 19:50:47 +08:00
test_azure_chunk_manager.cpp enhance: optimize milvus core building (#35610) 2024-08-23 12:35:02 +08:00
test_bf_sparse.cpp enhance: sparse float vector to support brute force iterator and range search (#32635) 2024-04-29 14:35:26 +08:00
test_bf.cpp feat: Support knowhere trace using OpenTelemetry (#30750) 2024-02-28 12:29:00 +08:00
test_binary.cpp add growing segment index (#23615) 2023-04-26 10:14:41 +08:00
test_binlog_index.cpp enhance: support null in c data_datacodec and load null value (#32183) 2024-07-23 16:07:51 +08:00
test_bitmap_index.cpp enhance: support bitmap mmap (#35399) 2024-08-27 16:34:59 +08:00
test_bitmap.cpp Support SIMD of several Expr (#23715) (#23717) 2023-05-12 14:11:20 +08:00
test_bitset.cpp enhance: performance improvements for the bitset (#31753) 2024-04-06 05:19:22 +08:00
test_bool_index.cpp Support SIMD of several Expr (#23715) (#23717) 2023-05-12 14:11:20 +08:00
test_c_api.cpp enhance: refactor executor framework V2 (#35251) 2024-09-13 20:57:09 +08:00
test_c_stream_reduce.cpp feat: Support stats task to sort segment by PK (#35054) 2024-09-02 14:19:03 +08:00
test_c_tokenizer.cpp feat: add enable_tokenizer params to VarChar field (#36480) 2024-10-10 20:33:21 +08:00
test_chunk_cache.cpp fix: fix broken Sparse Float Vector raw data mmap (#36183) 2024-09-25 18:59:13 +08:00
test_chunk_vector.cpp enhance: refactor executor framework V2 (#35251) 2024-09-13 20:57:09 +08:00
test_chunk.cpp feat: support chunked column for sealed segment (#35764) 2024-10-12 15:04:52 +08:00
test_common.cpp enhance: add valid_data in span (#35030) 2024-08-02 15:40:14 +08:00
test_concurrent_vector.cpp feat: [Sparse Float Vector] segcore basics and index building (#30357) 2024-03-11 14:45:02 +08:00
test_data_codec.cpp fix: memory leak in unittest and open the USE_ASAN option when build unittest (#35855) 2024-09-02 15:59:04 +08:00
test_disk_file_manager_test.cpp enhance: remove unused code for StorageV2 (#35132) 2024-08-01 12:08:13 +08:00
test_exec.cpp enhance: refactor executor framework V2 (#35251) 2024-09-13 20:57:09 +08:00
test_expr_materialized_view.cpp enhance: refactor executor framework V2 (#35251) 2024-09-13 20:57:09 +08:00
test_expr.cpp enhance: refactor executor framework V2 (#35251) 2024-09-13 20:57:09 +08:00
test_float16.cpp enhance: refactor executor framework V2 (#35251) 2024-09-13 20:57:09 +08:00
test_futures.cpp enhance: async search and retrieve in cgo (#33228) 2024-06-22 09:38:02 +08:00
test_gcp_native_chunk_manager.cpp enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214) 2024-09-30 13:23:32 +08:00
test_group_by.cpp enhance: make search groupby stop when reaching topk groups (#35814) 2024-09-02 18:25:03 +08:00
test_growing_index.cpp enhance: support null in c data_datacodec and load null value (#32183) 2024-07-23 16:07:51 +08:00
test_growing.cpp enhance: revert remove duplicated pk function (#35103) 2024-08-05 10:48:17 +08:00
test_hybrid_index.cpp enhance: allow many segments for inverted index (#35616) 2024-08-28 11:30:59 +08:00
test_index_c_api.cpp feat: [Sparse Float Vector] segcore basics and index building (#30357) 2024-03-11 14:45:02 +08:00
test_index_wrapper.cpp enhance: Use proto for passing info in cgo (#33184) 2024-05-23 10:31:40 +08:00
test_indexing.cpp enhance: Allow empty sparse row (#34700) 2024-08-16 14:14:54 +08:00
test_init.cpp enhance: update cagra index params in config and add params check (#29045) 2023-12-26 11:04:47 +08:00
test_integer_overflow.cpp enhance: refactor executor framework V2 (#35251) 2024-09-13 20:57:09 +08:00
test_inverted_index.cpp enhance: support null value in index (#35238) 2024-08-16 15:30:54 +08:00
test_kmeans_clustering.cpp enhance: support null in c data_datacodec and load null value (#32183) 2024-07-23 16:07:51 +08:00
test_loading.cpp enhance: the estimate method when loading the collection (#36307) 2024-10-09 17:35:19 +08:00
test_local_chunk_manager.cpp Migrate the ability to upload and download binlog to cpp (#22984) 2023-06-25 14:38:44 +08:00
test_minio_chunk_manager.cpp enhance: Support MinIO TLS connection (#31311) 2024-03-21 11:15:20 +08:00
test_mmap_chunk_manager.cpp enhance: use segment id and type to register in MmapChunkManager and opt malloc in variableChunk (#33993) 2024-06-20 17:42:02 +08:00
test_monitor.cpp enhance: add scalar filtering and vector search latency metrics (#34785) 2024-07-19 14:01:39 +08:00
test_offset_ordered_array.cpp enhance: remove timestamp_filter after retrieve (#35207) 2024-08-02 19:32:46 +08:00
test_offset_ordered_map.cpp enhance: remove timestamp_filter after retrieve (#35207) 2024-08-02 19:32:46 +08:00
test_plan_proto.cpp enhance: refactor executor framework V2 (#35251) 2024-09-13 20:57:09 +08:00
test_query.cpp enhance: refactor executor framework V2 (#35251) 2024-09-13 20:57:09 +08:00
test_range_search_sort.cpp feat: [Sparse Float Vector] segcore basics and index building (#30357) 2024-03-11 14:45:02 +08:00
test_reduce_c.cpp Fix search binary pagination failure (#22477) 2023-03-08 11:03:51 +08:00
test_reduce.cpp Fix cpplint (#22657) 2023-03-10 09:47:54 +08:00
test_regex_query_util.cpp fix: regex query can't handle text with newline (#32569) 2024-04-26 12:01:26 +08:00
test_regex_query.cpp enhance: refactor executor framework V2 (#35251) 2024-09-13 20:57:09 +08:00
test_relational.cpp Fix cpplint (#22657) 2023-03-10 09:47:54 +08:00
test_remote_chunk_manager.cpp enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214) 2024-09-30 13:23:32 +08:00
test_retrieve.cpp enhance: refactor executor framework V2 (#35251) 2024-09-13 20:57:09 +08:00
test_scalar_index_creator.cpp feat: [Sparse Float Vector] segcore to support sparse vector search and get raw vector by id (#30629) 2024-03-12 09:16:30 -07:00
test_scalar_index.cpp enhance: support bitmap mmap (#35399) 2024-08-27 16:34:59 +08:00
test_sealed.cpp feat: support chunked column for sealed segment (#35764) 2024-10-12 15:04:52 +08:00
test_segcore.cpp enhance: growing segment support mmap (#32633) 2024-06-18 14:42:00 +08:00
test_similarity_corelation.cpp Add binary metric types SUBSTRUCTURE/SUPERSTRUCTURE back (#26766) 2023-08-31 20:07:00 +08:00
test_span.cpp feat: support chunked column for sealed segment (#35764) 2024-10-12 15:04:52 +08:00
test_storage.cpp enhance: add scalar filtering and vector search latency metrics (#34785) 2024-07-19 14:01:39 +08:00
test_string_expr.cpp enhance: refactor executor framework V2 (#35251) 2024-09-13 20:57:09 +08:00
test_string_index.cpp fix: Make legacy non-lexicographic branch break swtich (#36125) 2024-09-10 10:15:07 +08:00
test_text_match.cpp feat: add enable_tokenizer params to VarChar field (#36480) 2024-10-10 20:33:21 +08:00
test_timestamp_index.cpp Fix cpplint (#22657) 2023-03-10 09:47:54 +08:00
test_tracer.cpp feat: Encode traceID and spanID as hex string (#34807) 2024-08-06 15:20:16 +08:00
test_utils.cpp enhance: revert remove duplicated pk function (#35103) 2024-08-05 10:48:17 +08:00