Ten Thousand Leaves
a8c7199a52
Fix segment_num, stored_rows_num and stored_rows_count metrics ( #20704 )
...
TODO: better track segment with state other than flushed and dropped.
/kind bug
issue: #20146 , #20145
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-22 19:21:13 +08:00
XuanYang-cn
d1cb380ee0
Enable to gen compaction plan for stale segments ( #20741 )
...
See also: #20502
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-22 17:33:16 +08:00
yah01
f76ea292d2
Change LRU to a generic type ( #20744 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-22 12:11:11 +08:00
congqixia
e35b523a99
Use embed etcd for allocator ut ( #20749 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-22 09:47:16 +08:00
jaime
c761de19bc
Fix broken kafka UT ( #20743 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-21 20:43:13 +08:00
sre-ci-robot
234a4577cf
Update all contributors
...
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-11-21 12:00:59 +00:00
xige-16
1ad702cc40
Reduce the memory used by load disk index ( #20475 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-21 19:35:11 +08:00
wei liu
67403fcb3b
fix mannual balance with empty segment list ( #20738 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-21 19:29:12 +08:00
wayblink
b32f99e2e4
Update datanode.segment.insertBufSize default value to 16777216 ( #20713 )
...
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-11-21 19:19:11 +08:00
jaime
d84cda22ad
Fix start fail with kafka model ( #20726 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-21 17:49:12 +08:00
xige-16
34c88cea32
Fix GetDiskUsedSize not work ( #20474 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-21 17:47:17 +08:00
xige-16
15badd0263
Fix cache disk index error ( #20419 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-21 17:45:23 +08:00
xige-16
82570e057c
Limit MinDim to build disk index ( #20724 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-21 17:43:10 +08:00
xige-16
81b6703201
Fix spell PQ error ( #20725 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-21 16:35:11 +08:00
xige-16
ec617d4952
Avoid delete segment which has been loaded ( #20730 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-21 16:33:12 +08:00
smellthemoon
8283d32ac4
Only balance segement in targets ( #20709 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-11-21 16:21:11 +08:00
Enwei Jiao
0a289c0052
Prepare builder image for conan ( #20482 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-11-21 14:11:10 +08:00
smellthemoon
f5ab719f21
timestamp decided if the pks were the same ( #20166 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-11-21 10:55:10 +08:00
MrPresent-Han
d44d50e735
fix getting query segment info error during the period of loading and unloading segments ( #20549 )
...
issue: #20281
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2022-11-21 10:41:10 +08:00
groot
bf2107ecf5
Fix a regression of local storage ( #20653 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-21 10:19:10 +08:00
groot
c8022ea63c
Change import task timeout value ( #20717 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-21 10:11:11 +08:00
jaime
0a5270e8c0
Fix alter collection hang ( #20694 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-21 10:09:10 +08:00
edward.zeng
a54b40e7ac
Bump milvus version to v2.2.0 ( #20718 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-11-18 21:59:09 +08:00
Jenny Li
f8d071a5be
Show milvus config after install milvus ( #20712 )
...
Signed-off-by: Jenny Li <jing.li@zilliz.com>
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-18 20:43:09 +08:00
SimFG
dffcd974ff
Make sure that the segment path matches the segment id ( #20677 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-11-18 15:35:09 +08:00
Xiaofan
633a749880
Recude IndexCodec Load Memory ( #20621 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-18 10:47:08 +08:00
Bingyi Sun
2390095232
Fix load uses compacted segments' binlogs ( #20655 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-11-17 20:37:10 +08:00
bigsheeper
fef87f879c
Disable tt delay protection ( #20657 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-17 20:21:14 +08:00
Enwei Jiao
c05b9ad539
Add event dispatcher for config ( #20393 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-11-17 18:59:09 +08:00
yah01
cc371d6801
Task/Action won't finish util the RPC returned ( #20669 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-17 17:55:09 +08:00
Enwei Jiao
19524a5344
Fix nodeID mismatch at standalone mode ( #20648 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-11-17 17:15:08 +08:00
wei liu
1177ed1a33
fix duplicate watch channel task ( #20667 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-17 15:05:08 +08:00
congqixia
e6831d5029
Stop querynode for unit tests ( #20665 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-17 14:23:08 +08:00
XuanYang-cn
bd20536c6a
Reduce unnecessary logs of get compaction results ( #20642 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-17 10:09:12 +08:00
groot
8da44638ac
Refine json parser for import ( #20545 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-16 19:05:08 +08:00
ThreadDao
a8b6906084
[test] Fix compaction case for insert during compact ( #20628 )
...
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-11-16 16:53:08 +08:00
yah01
31872f436c
Only balance segments in targets ( #20635 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-16 14:33:11 +08:00
cai.zhang
35db3d2352
Reduce log frequency in IndexCoord ( #20629 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-16 14:23:09 +08:00
Jenny Li
7a413468ab
[skip e2e] Fix replace image tag logic ( #20609 )
...
Signed-off-by: Jenny Li <jing.li@zilliz.com>
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-16 14:21:14 +08:00
congqixia
b0a07983ce
Limit concurrency of decoded index file and do force gc ( #20587 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 21:15:11 +08:00
cai.zhang
3c09a5f2e8
Use GetSegmentUnsafe when get unhealthy segment ( #20617 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-15 19:55:07 +08:00
bigsheeper
2d307c1909
Set delBuf's start-end position of compacted segment ( #20614 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-15 19:41:16 +08:00
zhuwenxing
50791bd932
[skip e2e]Fix verification of chaos delete ( #20604 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-11-15 19:27:12 +08:00
zhuwenxing
f077cfea68
[skip e2e]Fix deploy test ( #20582 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-11-15 19:25:14 +08:00
zhuwenxing
aa04787f32
[skip e2e]Add compact before verification ( #20618 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-11-15 19:23:08 +08:00
XuanYang-cn
51093dfccd
Add a string func for allocation ( #20611 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-15 19:21:12 +08:00
ThreadDao
5cb0de9daf
[test] Fix case compact during insert ( #20561 )
...
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-11-15 19:11:06 +08:00
congqixia
ac9a993a39
Fix querynode panics when watch/unsub runs concurrently ( #20606 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 19:03:08 +08:00
aoiasd
d8f8296b03
Make internal proxy use internal port and isolate internal interface and external interface in proxy grpc server ( #20558 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-11-15 16:53:07 +08:00
Ten Thousand Leaves
f3ef430c2e
Keep individual segment's updates in a single Etcd operation ( #20525 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-15 16:45:07 +08:00