Commit Graph

278 Commits

Author SHA1 Message Date
bigsheeper
1722431699
Checking for existence in map in segcore (#17700)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-22 18:16:14 +08:00
Jiquan Long
fdccfb4273
Fix ut heap overflow (#17706)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-06-22 16:56:13 +08:00
bigsheeper
92d06b2e30
Purge memory by the memory state and try to purge after each search (#17565)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-17 17:46:10 +08:00
xige-16
36ad989590
Fix segOffset grater than insert barrier when mark delete (#17444)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-10 20:02:08 +08:00
bigsheeper
f38637c227
Pass PlaceholderGroup pointer to prevent memory copy in SegCore (#17389)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-06 21:34:05 +08:00
Jiquan Long
e88ffb8a57
Enable marisa trie ut on MacOS (#17316)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-06-02 10:48:03 +08:00
xige-16
56778787be
Reverse data from scalar index (#17145)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-26 14:58:01 +08:00
xige-16
7d810ac159
Fix query empty when insert same pk after deletion (#17222)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-25 22:06:00 +08:00
xige-16
a8829554eb
Merge multiple sets of expr's optypes in diff dirs (#17192)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-24 21:56:00 +08:00
zhenshan.cao
08a4dff41d
Add logic for search merging and a simple task scheduler for read tasks (#17022)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-23 16:41:58 +08:00
Jiquan Long
77b0f290a8
Fix prefix match on sealed segment (#17050)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-05-17 20:15:55 +08:00
xige-16
935b729a0c
Fix multiple deletes not taking effect (#17033)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-16 18:39:56 +08:00
Jiquan Long
c5149c7e85
Replace text codec of pb with binary codec (#16955)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-05-13 09:53:53 +08:00
xige-16
08ad77c71b
Delete all repeated primary keys (#16863)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-12 14:09:53 +08:00
bigsheeper
64d2793fe9
Fix wrong result topks when reduce search result (#16815)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-06 21:17:51 +08:00
Cai Yudong
21a1311f66
Merge utils/Utils.h into common/Utils.h (#16762)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-05-03 12:05:50 +08:00
Cai Yudong
6a62ff18bf
Support easylogging config for segcore and knowhere (#16751)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-05-03 08:39:49 +08:00
Cai Yudong
d5db4ae463
Merge utils/Types.h with common/Types.h (#16445)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-05-02 22:21:51 +08:00
xige-16
515d0369de
Support string type in segcore (#16546)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: dragondriver <jiquan.long@zilliz.com>
2022-04-29 13:35:49 +08:00
Aivin V. Solatorio
04fffb08ef
Support arithmetic operations on numerical fields for scalar filtering (#16520)
Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
2022-04-24 16:43:45 +08:00
yah01
3f5733b738
Return the local variable directly, make RVO enabled (#16201)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-04-22 17:43:42 +08:00
zhenshan.cao
58ea38142f
Use boost dynamic_bitset in segcore (#16476)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-04-14 22:37:34 +08:00
Cai Yudong
70bd6b6e6d
Remove dependency on knowhere::scalar (#16458)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-04-12 09:49:33 +08:00
xige-16
27b4cbc098
Cherry pick remove translateHits commit to mater (#16436)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2022-04-08 20:27:31 +08:00
Cai Yudong
a37479d728
Upgrade to knowhere-v1.1.2 to support all index types for mac (#16416)
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2022-04-08 15:29:31 +08:00
Cai Yudong
6c4d497d73
Fix mac build error (#16415)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-04-07 17:29:31 +08:00
Cai Yudong
543ec4a209
Rename log to milvus_log (#16383)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-04-05 22:55:30 +08:00
Cai Yudong
7323180861
Move bench to directory unittest (#16386)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-04-05 12:43:30 +08:00
Cai Yudong
0c53f06a33
Fix build error on mac (#16380)
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2022-04-04 21:09:32 +08:00
Jiquan Long
fd589baca7
Integrates marisa trie index (#16192)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-04-01 15:31:29 +08:00
zhenshan.cao
b03da87df5
Accelerate query speed in sealed segment (#16287)
Fix delete duplicate key

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-31 17:33:28 +08:00
Cai Yudong
f4ebd3a9ce
Upgrade to knowhere v1.1.0 (#16186)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-25 13:49:25 +08:00
Jiquan Long
48706f416f
Migrate scalar index from knowhere (#16174)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-24 14:57:26 +08:00
Letian Jiang
321105cc01
Add column-based insert interface in segcore (#16100)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-03-23 19:05:25 +08:00
Jiquan Long
f8d9bc919d
Unify interface of vector index & scalar index. (#15959)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-21 14:23:24 +08:00
Letian Jiang
8f52e5b6c7
Add unit tests in segcore (#15960)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-03-10 16:33:59 +08:00
Cai Yudong
9a6ee61731
Change all fields in Expr to const to avoid modification (#15663)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-22 14:45:51 +08:00
zhenshan.cao
142848fcc3
Abandon using protobuf to pass binaryset parameter (#15626)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-02-18 18:39:50 +08:00
jaime
307a8ce535
Support compile and run on Mac (#15491)
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
2022-02-09 14:27:46 +08:00
bigsheeper
ebed1a68ff
Add log for segcore search (#15159)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-11 18:07:34 +08:00
zhenshan.cao
f729853be7
Add unittest for delete and retrieve (#14373)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-28 22:18:47 +08:00
Cai Yudong
4884541896
Update unittest log (#13161)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-10 15:55:08 +08:00
Cai Yudong
15b932c63c
Add unittest IVFFlatNM for Indexing (#13044)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-09 14:21:28 +08:00
Cai Yudong
1ae249adb5
Update profiler CMakeLists.txt (#13001)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 23:23:06 +08:00
Cai Yudong
45bac3e4ec
Move profiler under core/thirdparty (#12949)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 13:01:04 +08:00
Cai Yudong
41ba52bb28
Support C unittest profiling (#12899)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-07 20:17:03 +08:00
Cai Yudong
b053317545
Rename FaissMetricTypeToString to MetricTypeToString (#12767)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-07 10:13:53 +08:00
Cai Yudong
cbb01051f0
Update Search return type (#12578)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-02 11:45:32 +08:00
dragondriver
a44c00b0d0
Format test_c_api.cpp (#12515)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-01 15:28:00 +08:00
dragondriver
1db1cf2104
Fix similarity correlation (#12511)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-01 15:26:02 +08:00