Commit Graph

6607 Commits

Author SHA1 Message Date
Xiaofan
d0510210df
Add config for disable BF load (#22996)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-03-28 20:06:10 +08:00
XuanYang-cn
9691315c21
Fix flush deltabuf with segmentID=0 (#23059)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-03-28 19:14:01 +08:00
wei liu
ed60b434fa
fix unstable ut (#23070)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-03-28 19:06:01 +08:00
aoiasd
5d172d0f4f
Refine errors of datanode (#22852)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-03-28 19:04:00 +08:00
zhenshan.cao
e3c3c949c4
Fix datarace of flow_graph_manager_test.go in package datanode (#23043)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-03-28 10:42:00 +08:00
Bingyi Sun
d6bfe8fbb9
Change frequent logs to debug level (#23012)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2023-03-28 07:12:01 +08:00
zhenshan.cao
d55c860383
Align the maximum dim of the diskann index and collection (#23039)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-03-28 00:06:00 +08:00
yah01
ae0f467c02
Fix segment/channel may be re-loaded/subscribed (#22969)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-27 18:28:00 +08:00
Enwei Jiao
ef57ba3bac
Remove easylogging and replace by GLog (#22979)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-03-27 18:22:02 +08:00
yihao.dai
b21f03682a
Fix flowgraph manager test (#23009)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-03-27 18:00:05 +08:00
congqixia
4008ee6d60
Remove datanode ddNode forward delta logic (#23005)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-27 14:18:00 +08:00
yah01
081572d31c
Refactor QueryNode (#21625)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: aoiasd <zhicheng.yue@zilliz.com>
2023-03-27 00:42:00 +08:00
cai.zhang
977943463e
Check index params and type params (#22988)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-03-26 22:15:59 +08:00
Xiaofan
5a914aedf3
Make Datacoord TT to be configurable (#22956)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-03-24 22:24:04 +08:00
XuanYang-cn
da58ba6a49
Fix endless appending sids (#22977)
See also: #22976

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-03-24 18:00:03 +08:00
Cai Yudong
8aebc6f3b7
Remove faiss GPU index support (#22966)
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
2023-03-24 17:53:58 +08:00
Jiquan Long
0be96ab610
Check if all columns aligned with same num_rows (#22968)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-03-24 17:09:58 +08:00
smellthemoon
3dae84f065
Use merr in proxy (#22904)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-03-24 15:27:58 +08:00
Gao
8b3e5189e1
Add querynode plugin (#22379)
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2023-03-24 15:21:59 +08:00
Jiquan Long
ef93e24da7
Fix cpp lint (#22955)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-03-24 11:23:59 +08:00
congqixia
8f847884c2
Fix misc copylocks and remove exclude rule (#22962)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-24 11:17:58 +08:00
Cai Yudong
0e9a4478e3
Remove useless index mode (#22934)
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
2023-03-23 21:39:59 +08:00
XuanYang-cn
93bc805933
Enhance ID allocator in DataNode (#22905)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-03-23 19:43:57 +08:00
congqixia
5bf6e69381
Fix refresher copylocks and once not guaranteed (#22949)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-23 19:27:58 +08:00
congqixia
1b4e29e1ee
Fix copylocks for EnvSource (#22948)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-23 19:26:02 +08:00
SimFG
e8f8c1b445
Check the collection num when creating the collection (#22946)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-03-23 16:47:57 +08:00
smellthemoon
af458017f4
Add some locks when write (#22938)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-03-23 15:57:57 +08:00
congqixia
31c22e5d24
Fix NodeID rw race (#22945)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-23 11:45:57 +08:00
congqixia
980aaeceb9
Fill coordinators client target node id (#22899)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-22 10:07:57 +08:00
yihao.dai
f2ffb5db26
Use buffer size at memory sync policy (#22825)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-03-21 21:37:56 +08:00
yah01
2b81933d13
Refine logs of DistHandler (#22879)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-21 18:11:57 +08:00
yah01
68b9cabb87
Fix GetShardLeader returns old leader (#22887)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-21 16:57:57 +08:00
Enwei Jiao
fd974df09f
OTEL integration in cpp (#22175)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-03-21 16:31:57 +08:00
yah01
9efebb3df7
Optimize load segment, make load fields concurrent (#22856)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-21 16:27:57 +08:00
yah01
532d12c4cf
Fix the code lost with multi errors (#22877)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-21 14:07:57 +08:00
smellthemoon
4c603cd02c
Fix upsert msgid (#22839)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-03-21 14:06:01 +08:00
SimFG
8259ca6929
Add the user rpc counter (#22872)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-03-21 11:37:56 +08:00
yihao.dai
254cd4f15f
Fix MockQueryNode (#22859)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-03-20 17:25:56 +08:00
congqixia
0317e0458b
Use Set[string] instead of map[string]interface{} ServerType (#22853)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-20 16:21:57 +08:00
yihao.dai
1f718118e9
Dynamic load/release partitions (#22655)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-03-20 14:55:57 +08:00
zhagnlu
7c633e9b9d
Support aliyun OSS for chunk manager (#22663) (#22842)
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2023-03-20 14:45:57 +08:00
yah01
3202eb0d9f
Optimize rounding distances, avoid promoting to double (#22846)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-20 14:09:56 +08:00
xige-16
9aa99aedbb
[Cherry-Pick] Remove arrow uasge in FieldData (#22726)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-03-20 10:41:56 +08:00
aoiasd
b8b7d1f47e
CreateIndex should wait all segments which has data insert before CreateIndex finish (#22561)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-03-20 10:21:56 +08:00
yah01
005d178a0e
Optimize performance of insert & query & search (#22829)
- Reduce 1x copy of inserting int8/int16 into growing segment
- Reduce 1x copy of retrieving primary keys
- Reduce 1x copy of inserting/loading/deleting/filtering primary keys
- Reduce 1x copy of reducing string results

Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-20 10:19:56 +08:00
yah01
20974711a1
Optimize range search for nq > 1 (#22831)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-20 10:17:56 +08:00
yah01
65c58b3e41
Optimize performance of querying on InsertRecord (#22838)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-20 10:13:56 +08:00
MrPresent-Han
77c9e33e70
support dml channel balancer on datacoord (#22324) (#22377) (#22692)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-03-20 10:01:56 +08:00
wei liu
5f571ea915
remove debug log (#22828)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-03-17 18:05:56 +08:00
yah01
99f31dc37a
Fix data after travel timestamp is still visible (#22813)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-17 18:03:55 +08:00