Commit Graph

304 Commits

Author SHA1 Message Date
Cai Yudong
a37479d728
Upgrade to knowhere-v1.1.2 to support all index types for mac (#16416)
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2022-04-08 15:29:31 +08:00
Cai Yudong
6c4d497d73
Fix mac build error (#16415)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-04-07 17:29:31 +08:00
Cai Yudong
543ec4a209
Rename log to milvus_log (#16383)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-04-05 22:55:30 +08:00
Cai Yudong
7323180861
Move bench to directory unittest (#16386)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-04-05 12:43:30 +08:00
Cai Yudong
0c53f06a33
Fix build error on mac (#16380)
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2022-04-04 21:09:32 +08:00
Jiquan Long
fd589baca7
Integrates marisa trie index (#16192)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-04-01 15:31:29 +08:00
zhenshan.cao
b03da87df5
Accelerate query speed in sealed segment (#16287)
Fix delete duplicate key

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-31 17:33:28 +08:00
Cai Yudong
f4ebd3a9ce
Upgrade to knowhere v1.1.0 (#16186)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-25 13:49:25 +08:00
Jiquan Long
48706f416f
Migrate scalar index from knowhere (#16174)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-24 14:57:26 +08:00
Letian Jiang
321105cc01
Add column-based insert interface in segcore (#16100)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-03-23 19:05:25 +08:00
Jiquan Long
f8d9bc919d
Unify interface of vector index & scalar index. (#15959)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-21 14:23:24 +08:00
Letian Jiang
8f52e5b6c7
Add unit tests in segcore (#15960)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-03-10 16:33:59 +08:00
Cai Yudong
9a6ee61731
Change all fields in Expr to const to avoid modification (#15663)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-22 14:45:51 +08:00
zhenshan.cao
142848fcc3
Abandon using protobuf to pass binaryset parameter (#15626)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-02-18 18:39:50 +08:00
jaime
307a8ce535
Support compile and run on Mac (#15491)
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
2022-02-09 14:27:46 +08:00
bigsheeper
ebed1a68ff
Add log for segcore search (#15159)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-11 18:07:34 +08:00
zhenshan.cao
f729853be7
Add unittest for delete and retrieve (#14373)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-28 22:18:47 +08:00
Cai Yudong
4884541896
Update unittest log (#13161)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-10 15:55:08 +08:00
Cai Yudong
15b932c63c
Add unittest IVFFlatNM for Indexing (#13044)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-09 14:21:28 +08:00
Cai Yudong
1ae249adb5
Update profiler CMakeLists.txt (#13001)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 23:23:06 +08:00
Cai Yudong
45bac3e4ec
Move profiler under core/thirdparty (#12949)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 13:01:04 +08:00
Cai Yudong
41ba52bb28
Support C unittest profiling (#12899)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-07 20:17:03 +08:00
Cai Yudong
b053317545
Rename FaissMetricTypeToString to MetricTypeToString (#12767)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-07 10:13:53 +08:00
Cai Yudong
cbb01051f0
Update Search return type (#12578)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-02 11:45:32 +08:00
dragondriver
a44c00b0d0
Format test_c_api.cpp (#12515)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-01 15:28:00 +08:00
dragondriver
1db1cf2104
Fix similarity correlation (#12511)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-01 15:26:02 +08:00
Cai Yudong
365b5a5d01
Rename SubSearchResult fields for better readability (#12341)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-29 17:07:40 +08:00
Cai Yudong
cb952d6036
Rename SearchResult fields for better readability (#12327)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-29 14:57:18 +08:00
Cai Yudong
45fac75889
Fix segcore unittest fail (#12326)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-29 12:27:17 +08:00
dragondriver
73f18c564f
Refine logs when search with unsupported metric type (#12185)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-23 10:13:14 +08:00
Cai Yudong
3aca73969f
Optimize segcore API arrangement (#12135)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-19 17:23:12 +08:00
dragondriver
8c951217ee
Fix wrong distances caused by metric type (#11901)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-16 19:11:10 +08:00
Cai Yudong
b0054f1b48
Update C API NewSegment (#11809)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 16:57:09 +08:00
Cai Yudong
5fdc6626cb
Change API retrieve return type from CProtoResult to CProto (#11555)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-12 10:04:49 +08:00
dragondriver
daaeb27ee1
Make AdapterMgr.GetAdapter thread-safe (#11674)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-11 20:42:44 +08:00
Cai Yudong
db2a0a3bd3
Fix reduce panic (#11325)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-05 18:17:00 +08:00
zhenshan.cao
cd79fd07c4
Fix timetravel bug on sealed segment (#11152)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-03 12:40:12 +08:00
Cai Yudong
4241326524
Update test API CheckSearchResultDuplicate (#11019)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-01 18:31:59 +08:00
yukun
d8044299a0
Add uids and seg_offsets check in segcore (#10983)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-01 15:21:52 +08:00
groot
57783827fb
Add cpp coverage (#10801)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-28 18:54:35 +08:00
Cai Yudong
1227b9ebae
Rename utils/tools.h to utils/Utils.h (#10665)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 17:28:23 +08:00
yukun
7acb48919b
Add Delete func in Segcore SegmentSealed (#10501)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-24 14:19:10 +08:00
yukun
bc083950a8
Add delete in segcore segment sealed (#10470)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 23:35:18 +08:00
yukun
fe1927c05d
Support delete in SegmentSealed (#10181)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 13:11:11 +08:00
Cai Yudong
48648c818b
Remove duplicated search results in segcore reduce (#10117)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 15:40:49 +08:00
Cai Yudong
eda9d550a8
Code clean for test_timestamp_index (#10148)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-19 11:10:34 +08:00
Cai Yudong
d54f3426e8
Reorder header files for test_segcore (#10051)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-18 18:38:47 +08:00
Cai Yudong
027103b4f6
Reorder header files for test_span (#10053)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-18 18:10:57 +08:00
Cai Yudong
3e3f8b825a
Reorder header files for test_sealed (#10049)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-18 18:09:04 +08:00
Cai Yudong
ffd67de9cb
Reorder header files for test_reduce (#9934)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-15 17:00:43 +08:00
Cai Yudong
356b7e36ba
Reorder header files for test_query (#9932)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-15 16:56:51 +08:00
Cai Yudong
5a8aca01fd
Reorder header files for test_plan_proto (#9871)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-14 16:52:33 +08:00
Cai Yudong
8dbc3db393
Remove dummy test_naive (#9850)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-14 12:52:33 +08:00
Cai Yudong
30661321f2
Remove dummy test_interface (#9848)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-14 12:50:37 +08:00
Cai Yudong
937e59f6c3
Remove dummy test_load (#9847)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-14 11:06:39 +08:00
yukun
6c88774624
Add get final filtered bitmap in SegmentGrowing (#9780)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-13 16:54:34 +08:00
Cai Yudong
92c7eb5a09
Code clean for test_interface (#9767)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 11:06:33 +08:00
Cai Yudong
ca5e3e8644
Code clean for test_indexing (#9765)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 11:00:39 +08:00
Cai Yudong
01db5dc6dd
Code clean for test_init (#9766)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 10:58:33 +08:00
Cai Yudong
2d8e86692a
Format test_expr.cpp (#9698)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-12 12:48:34 +08:00
Cai Yudong
e790ba3e41
Reorder header files (#9700)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-12 12:44:33 +08:00
Cai Yudong
6f7031111a
Update header file (#9696)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-12 12:42:33 +08:00
Cai Yudong
9229d56c96
Clear redundant code line for test_bitmap (#9632)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-11 17:08:29 +08:00
Cai Yudong
b8519416c0
Clear redundant code line (#9631)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-11 17:04:29 +08:00
Cai Yudong
4908b1c461
Update header file (#9625)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-11 16:35:52 +08:00
elfisworking
d4232f88a2
For search funtion adding a round_decimal paramter to precision control (#8574)
Signed-off-by: elfisworking <zymustb@126.com>
2021-10-08 17:39:55 +08:00
Cai Yudong
3e487bde0b
Clean test_concurrent_vector.cpp (#8532)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-25 12:13:56 +08:00
groot
af1bdaf202
Reduce cpp unittest time cost (#8409)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-23 17:55:54 +08:00
groot
8b81ceb5d7
Reduce cpp unittest time cost (#8403)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-23 16:55:54 +08:00
Cai Yudong
83ffa18c37
[skip ci] Update test_concurrent_vector (#8273)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-22 17:21:53 +08:00
Cai Yudong
07aa453270
[skip ci] Update test_segcore (#8270)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-22 17:19:53 +08:00
yukun
82e48fb379
Add more error messages in segcore visitors (#8195)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-18 15:53:51 +08:00
Cai Yudong
2a946707b9
[skip ci] Update test_concurrent_vector.cpp (#8205)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-18 14:41:50 +08:00
zhenshan.cao
4c184921f0
Add comments and enchanme unittest for retrieve (#8114)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-16 23:43:49 +08:00
zhenshan.cao
5cd9ea5f04
Fixbug: init optional retrieve_ret_ when query result is empty (#8068)
Add unittest

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-16 20:11:49 +08:00
Cai Yudong
14ef405a6b
Rename chunk_size to chunk_rows for better code readability (#7953)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 15:15:52 +08:00
Cai Yudong
a0fd2707cb
Support config SIMD type (#7942)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 12:57:48 +08:00
Cai Yudong
e6c384b4d4
Move segcore chunk_size configuration to querynode.yaml (#7913)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 10:35:52 +08:00
Cai Yudong
b5923ff27d
Update segcore unittest format (#7860)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-14 11:22:57 +08:00
Cai Yudong
74ac528095
Improve segcore (#7851)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-14 10:53:04 +08:00
Cai Yudong
27dcf698d3
Support set segcore chunk_size via config file (#7635)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-11 14:40:01 +08:00
yukun
94272bba87
Support query by expression (#7386)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-03 17:12:55 +08:00
xige-16
76066b5659
Fix IVF_FLAT index's wrong meta_data (#7167)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-19 14:26:11 +08:00
Cai Yudong
6c75301c70
optimize search reduce logic (#7066)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-12 18:00:11 +08:00
xaxys
e43b43e7d8
Refactor RangeExpr & CompareExpr (#6786)
* Changed `RangeExpr` proto to `UnaryRangeExpr` & `BinaryRangeExpr`
Several unit test unpassed.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix bugs to pass unit test. Fix format.

Signed-off-by: xaxys <tpnnghd@163.com>

* Remove debug information.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix format.
Remove debug information.
Unify variable name.
Add error information.
Remove `CompareExpr` test in `test_c_api.cpp`.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix code format.

Signed-off-by: xaxys <tpnnghd@163.com>

* Update `Plan.cpp`.

Signed-off-by: xaxys <tpnnghd@163.com>
2021-07-25 10:23:19 +08:00
dragondriver
2821c08560
Add unittests for metric_type: tanimoto (#6773)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-23 20:59:33 +08:00
FluorineDog
aba21baf82
refactor expr executor to use single bitset (#6667)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-23 15:30:12 +08:00
Cai Yudong
744f2c7f51
optimize test_c_api.cpp (#6637)
* optimize test_c_api.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* clean redundant file

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change DIM to const

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize test_c_api.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update reduce testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-20 17:13:21 +08:00
FluorineDog
234954931f
remove deprecated (#6623)
* remove deprecated

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* fix timeout

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-20 15:18:08 +08:00
dragondriver
99249a0224
Fix bug: override the compare function of SearchResultPair (#6628)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-20 14:38:11 +08:00
Cai Yudong
724f10b9a0
Unify the usage of query and search (#6467)
Unify the usage of query and search

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-13 22:20:33 +08:00
xaxys
e5f8a77a2d
Extend grammar of boolean expression (#6460)
* Extend grammar of boolean expression

Signed-off-by: xaxys <tpnnghd@163.com>
2021-07-13 14:37:03 +08:00
FluorineDog
2ff072ea7b
Use larger dim for binary test to avoid false positive test failed (#6416)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-09 18:12:40 +08:00
FluorineDog
97b1426666
fix benchmark, add support for primary key in schemaHelper (#6281)
* fix benchmark

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* fix tests

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-06 09:50:01 +08:00
dragondriver
8dd2051a9a
Fix 5045, decrease the nb and nlist in unittest (#6282)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-02 18:20:14 +08:00
FluorineDog
bf8b2be4a7
Deprecate num_groups to simplify search API (#6230)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-01 10:32:15 +08:00
FluorineDog
255e3959af
support time travel (#5894)
* support time travel

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* lint

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-19 17:38:11 +08:00
FluorineDog
9a90313390
Support GetEntityByIDs in CGo, fix segcore bugs (#5563)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-04 10:38:34 +08:00
FluorineDog
b1a9aea6a6
support get entity by ids in segcore (#5456)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-28 10:39:30 +08:00
FluorineDog
3f42a9ed12
reduce unittest time (#5363)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-24 03:54:06 +00:00