Commit Graph

18011 Commits

Author SHA1 Message Date
yihao.dai
4b2802033d
Fix datanode panic due to concurrent compaction and delete processing (#27167)
Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-09-18 19:35:29 +08:00
yah01
0459a662e4
use MADV_WILLNEED for scalar column data (#27170)
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-09-18 18:05:22 +08:00
Enwei Jiao
8e17bc3013
Use merr to handle segcore errors (#27137)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-09-18 14:07:22 +08:00
yah01
a6b98740b7
Replace all status with only error string (#27125)
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-09-18 14:05:28 +08:00
binbin
0aa7503d54
Enable test cases (#27163)
Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2023-09-18 13:01:22 +08:00
sre-ci-robot
b5de4341fe
Update Pytest image changes (#27131)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-09-18 12:59:27 +08:00
MrPresent-Han
7939f0e7d5
enable ctx traceId for assignsegment on dc(#26972) (#27108) (#27030)
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
2023-09-18 11:39:20 +08:00
Xiaofan
e51cb739eb
Remove some logs in querynode delegator (#27156)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-09-18 10:57:20 +08:00
MrPresent-Han
4f6122dd4a
enable ctx traceId for assignsegment on dc(#26972) (#27108)
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
2023-09-18 09:53:22 +08:00
sre-ci-robot
a11136b158
Update knowhere commit (#27159)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-09-18 09:41:22 +08:00
xige-16
488b423e1b
Fix high cpu usage caused by proto.size (#27054)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-09-17 20:55:21 +08:00
yihao.dai
c162c6a4c8
Increase FlushChannel retry times (#27140)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-09-16 00:41:20 +08:00
zhuwenxing
895b94ab6b
[skip e2e]Fix get latest image with wrong arch and etcd followers chaos apply (#27144)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-09-15 22:27:20 +08:00
congqixia
6ee5fedfef
Fix lock not applied in quota center (#27133)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-09-15 19:11:25 +08:00
Bennu
4ddeddf758
[skip e2e] Add action to check issue (#27135)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-09-15 18:03:20 +08:00
yihao.dai
7a59de1fb1
Fix flush slowly (#27123)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-09-15 17:45:21 +08:00
XuanYang-cn
361bb34e33
Update etcd-sdk-python to 0.0.4 (#27114)
See also: https://github.com/XuanYang-cn/pyetcd/releases/tag/v0.0.4

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-09-15 17:07:19 +08:00
zhuwenxing
4a959d9161
[skip e2e]Update config of milvus crd for rolling update (#27126)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-09-15 15:55:21 +08:00
zhuwenxing
83d37a677a
[skip e2e]Add retry when getting image tag from dockerhub (#27107)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-09-15 15:53:26 +08:00
yihao.dai
060d3563ba
Fix compile error at core/storage (#27121)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-09-15 14:41:21 +08:00
sre-ci-robot
c85c255eb1
Update knowhere commit (#27109)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-09-15 13:59:19 +08:00
yihao.dai
bb6711f28c
Add ChunkCache: support get vector from storage (#26142)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-09-15 10:21:20 +08:00
yah01
168e82ee10
Fix panic while handling with the nil status (#27040)
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-09-15 10:09:21 +08:00
cai.zhang
22d7fa4e1c
Use GetXXX instead of directly using dots to get value (#27045)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-09-15 10:07:19 +08:00
foxspy
18cbe26876
fix growing hasRawData (#27105)
Signed-off-by: xianliang <xianliang.li@zilliz.com>
2023-09-14 21:11:18 +08:00
yihao.dai
fe5781e2b8
Maintain compatibility of GetFlushState with old client (#27077)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-09-14 19:57:20 +08:00
Jiquan Long
6f2c1214ed
Fix cloudProvider not passed (#27065)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-09-14 19:21:20 +08:00
Jiquan Long
24a04effe9
Delete failed index tasks ASAP (#27093)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-09-14 19:19:20 +08:00
yah01
0f2883ef9d
Optimize the generic zero value (#27102)
allocate by declare,
this make it possible to allocate the value in stack,
faster and less presure for GC

Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-09-14 19:05:20 +08:00
yah01
7bb20fa394
Fix the double nil return values from RPC call (#27101)
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-09-14 19:01:19 +08:00
congqixia
c32a9a1d4a
Fix grpcclient use needReset as needRetry for cancel&timeout code (#27091)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-09-14 17:47:26 +08:00
yihao.dai
8c65791a3d
Fix proxy panic (#27066)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-09-14 14:27:26 +08:00
Enwei Jiao
0afdfdb9af
Remove other Exceptions, keeps SegcoreError only (#27017)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-09-14 14:05:20 +08:00
congqixia
f7b2ad6650
Fix component pointer to component interface never be nil caused panic (#27072)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-09-14 13:37:18 +08:00
zhuwenxing
17375541a7
[skip e2e]Update etcd follower num to apply chaos (#27083)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-09-14 12:13:18 +08:00
congqixia
edde3cf1c7
Add tracer for querycoord tasks (#27058)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-09-14 09:59:19 +08:00
sre-ci-robot
2ed13ba6d5
Update Builder image changes (#27061)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-09-13 20:23:18 +08:00
PowderLi
8e142ff39f
[amazonlinux:2023]install perl-IPC-Cmd (#27049)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-09-13 18:53:18 +08:00
zhuwenxing
2166986834
[skip e2e]Update index config in test (#27059)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-09-13 18:35:19 +08:00
Jiquan Long
af5619e73e
Fix misusing chunk manager (#27051)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-09-13 18:11:20 +08:00
XuanYang-cn
ea2b909c6d
Fix historm metrics buckets range for index (#26976)
See also: #26743

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-09-13 17:21:18 +08:00
cai.zhang
4fa878d03c
Remove unused log (#27032)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-09-13 16:07:18 +08:00
yah01
3d05ddf505
Reduce cpp test time (#27043)
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-09-13 15:41:18 +08:00
congqixia
f0d0651989
Do not reset connection immediately if grpc code is Canceled or DeadlineExceeded (#27014)
We found lots of connection reset & canceled due to recent retry change
Current implementation resets connection no matter what the error code is
To sync behavior to previous retry, skip reset connection only if cancel error happens too much.

Also adds a config item for minResetInterval for grpc reset connection

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-09-13 15:01:18 +08:00
chyezh
791e6ef6c6
[Improvement] add pulsar metrics and fix timeout (#26907)
Signed-off-by: chyezh <ye.zhen@zilliz.com>
2023-09-13 12:03:19 +08:00
PowderLi
c033580af4
show index info while GetSegmentInfo (#26981)
according to QueryNode::GetSegmentInfo

Signed-off-by: PowderLi <min.li@zilliz.com>
2023-09-13 11:37:18 +08:00
congqixia
394c898b4c
Discard SyncDistribution set action from legacy querycoord (#27027)
Since Milvus in lower version (< 2.3.0), there is no load info in set action
which may corrupt data integrity and cause panicking

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-09-13 09:35:18 +08:00
yihao.dai
dd2cb1d44a
Flush by flush channels (#26859)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-09-12 21:07:19 +08:00
cqy123456
0ff4ddc76c
remove VectorMemNMIndex (#27000)
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2023-09-12 17:13:18 +08:00
zhuwenxing
a37b422acd
[skip e2e]Set resource for worker node in chaos test (#27025)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-09-12 16:57:17 +08:00