Cai Yudong
|
87d78a4a85
|
Ignore cases when comparing metric type in segcore (#19437)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-09-26 17:58:52 +08:00 |
|
aoiasd
|
2b58bd5c0a
|
Optimize large memory usage of InsertRecord by using vector instead of unordered_map if InsertRecord used in sealed segment (#19245)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
|
2022-09-23 17:08:51 +08:00 |
|
xige-16
|
428840178c
|
Support diskann index for vector field (#19093)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-09-21 20:16:51 +08:00 |
|
aoiasd
|
58d3a49b62
|
Optimize large memory usage of Variant used in InsertRecord (#19197)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
|
2022-09-16 10:52:47 +08:00 |
|
xige-16
|
4de1bfe5bc
|
Add cpp data codec (#18538)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: zhagnlu lu.zhang@zilliz.com
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-09-09 22:12:34 +08:00 |
|
Cai Yudong
|
7b5eb85205
|
Remove redundant parameter for segcore Search() (#19025)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-09-06 12:05:11 +08:00 |
|
Cai Yudong
|
765907ab77
|
Optimize segcore Reduce (#18902)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-09-06 10:55:12 +08:00 |
|
Cai Yudong
|
686b0ce796
|
Upgrade to knowhere-v1.3.0, remove following index support: (#18935)
- IVF_SQ8H
- RHNSW_FLAT/RHNSW_PQ/RHNSW_SQ
- NGT
- NSG
- SPTAG
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-09-05 10:41:11 +08:00 |
|
Cai Yudong
|
da96659569
|
[skip e2e] Add more testcases with different parameter combinations in test_reduce (#18967)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-09-01 16:59:02 +08:00 |
|
Cai Yudong
|
4ded45394a
|
[skip e2e] Optimize test_reduce (#18957)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-09-01 11:09:00 +08:00 |
|
Cai Yudong
|
9dc3bbecbd
|
Change the type of slice_nqs and slice_topks from int32_t[] to int64_t[] (#18867)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-08-29 11:36:56 +08:00 |
|
Letian Jiang
|
c6d9d0df5e
|
Fix segcore benchmark (#18675)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
|
2022-08-17 20:24:49 +08:00 |
|
Cai Yudong
|
d878cc2ec0
|
Rename real_topK_per_nq_ to topks_per_nq_prefix_sum_ in SearchResult struct (#18634)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-08-16 00:32:48 +08:00 |
|
zhenshan.cao
|
a287a2b3fd
|
Return empty result in advance if all data filtered out (#18329) (#18438)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-07-28 12:36:30 +08:00 |
|
bigsheeper
|
cef8b1e7cc
|
Enable jemalloc (#18349)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-07-20 22:22:31 +08:00 |
|
Jeng.Gwan
|
638f6c36e9
|
Support to get real row count of segment (#18115)
Signed-off-by: xaxys <zheng.guan@zilliz.com>
|
2022-07-18 09:58:28 +08:00 |
|
Cai Yudong
|
015a2f0866
|
Let growing segment call knowhere brute search API (#18227)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-07-12 11:58:25 +08:00 |
|
bigsheeper
|
22508f36d3
|
Get search field id from search plan and log if loaded index when search segments (#18183)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-07-08 20:18:22 +08:00 |
|
zhagnlu
|
257da153ce
|
Fix core dump when nq has no topk result (#17923) (#18051)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
|
2022-07-05 19:48:20 +08:00 |
|
xige-16
|
0702993106
|
Fix query not empty after delete string (#17953)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-07-04 16:54:20 +08:00 |
|
Jiquan Long
|
6954a5ba3e
|
Fix search successfully with invalid metric type (#17977)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
|
2022-07-01 22:28:23 +08:00 |
|
bigsheeper
|
641fb96958
|
Return malloc_trim result and log if malloc_trim successfully (#17959)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-07-01 10:44:18 +08:00 |
|
Cai Yudong
|
a001412e12
|
Replace faiss::MetricType with knowhere::MetricType (#17891)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-06-29 14:20:19 +08:00 |
|
Letian Jiang
|
4ae1ca2cac
|
Fix arrow builder nullptr check in FinishPayloadWriter (#17873)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
|
2022-06-28 20:04:17 +08:00 |
|
Enwei Jiao
|
16c3aedc15
|
refine complie configuration (#17502)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
|
2022-06-24 21:12:15 +08:00 |
|
Cai Yudong
|
7385770014
|
Upgrade to knowhere-v1.1.12 (#17692)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-06-24 10:34:18 +08:00 |
|
bigsheeper
|
1722431699
|
Checking for existence in map in segcore (#17700)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-22 18:16:14 +08:00 |
|
Jiquan Long
|
fdccfb4273
|
Fix ut heap overflow (#17706)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
|
2022-06-22 16:56:13 +08:00 |
|
bigsheeper
|
92d06b2e30
|
Purge memory by the memory state and try to purge after each search (#17565)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-17 17:46:10 +08:00 |
|
xige-16
|
36ad989590
|
Fix segOffset grater than insert barrier when mark delete (#17444)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-06-10 20:02:08 +08:00 |
|
bigsheeper
|
f38637c227
|
Pass PlaceholderGroup pointer to prevent memory copy in SegCore (#17389)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-06 21:34:05 +08:00 |
|
Jiquan Long
|
e88ffb8a57
|
Enable marisa trie ut on MacOS (#17316)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
|
2022-06-02 10:48:03 +08:00 |
|
xige-16
|
56778787be
|
Reverse data from scalar index (#17145)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-05-26 14:58:01 +08:00 |
|
xige-16
|
7d810ac159
|
Fix query empty when insert same pk after deletion (#17222)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-05-25 22:06:00 +08:00 |
|
xige-16
|
a8829554eb
|
Merge multiple sets of expr's optypes in diff dirs (#17192)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-05-24 21:56:00 +08:00 |
|
zhenshan.cao
|
08a4dff41d
|
Add logic for search merging and a simple task scheduler for read tasks (#17022)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-05-23 16:41:58 +08:00 |
|
Jiquan Long
|
77b0f290a8
|
Fix prefix match on sealed segment (#17050)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
|
2022-05-17 20:15:55 +08:00 |
|
xige-16
|
935b729a0c
|
Fix multiple deletes not taking effect (#17033)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-05-16 18:39:56 +08:00 |
|
Jiquan Long
|
c5149c7e85
|
Replace text codec of pb with binary codec (#16955)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
|
2022-05-13 09:53:53 +08:00 |
|
xige-16
|
08ad77c71b
|
Delete all repeated primary keys (#16863)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-05-12 14:09:53 +08:00 |
|
bigsheeper
|
64d2793fe9
|
Fix wrong result topks when reduce search result (#16815)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-05-06 21:17:51 +08:00 |
|
Cai Yudong
|
21a1311f66
|
Merge utils/Utils.h into common/Utils.h (#16762)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-05-03 12:05:50 +08:00 |
|
Cai Yudong
|
6a62ff18bf
|
Support easylogging config for segcore and knowhere (#16751)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-05-03 08:39:49 +08:00 |
|
Cai Yudong
|
d5db4ae463
|
Merge utils/Types.h with common/Types.h (#16445)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-05-02 22:21:51 +08:00 |
|
xige-16
|
515d0369de
|
Support string type in segcore (#16546)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
|
2022-04-29 13:35:49 +08:00 |
|
Aivin V. Solatorio
|
04fffb08ef
|
Support arithmetic operations on numerical fields for scalar filtering (#16520)
Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
|
2022-04-24 16:43:45 +08:00 |
|
yah01
|
3f5733b738
|
Return the local variable directly, make RVO enabled (#16201)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-04-22 17:43:42 +08:00 |
|
zhenshan.cao
|
58ea38142f
|
Use boost dynamic_bitset in segcore (#16476)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-04-14 22:37:34 +08:00 |
|
Cai Yudong
|
70bd6b6e6d
|
Remove dependency on knowhere::scalar (#16458)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-04-12 09:49:33 +08:00 |
|
xige-16
|
27b4cbc098
|
Cherry pick remove translateHits commit to mater (#16436)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-04-08 20:27:31 +08:00 |
|