Commit Graph

671 Commits

Author SHA1 Message Date
cai.zhang
eefa29a5e8
Fix bug for get index state (#22396)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-28 10:29:50 +08:00
Xiaofan
3d6bded115
Fix Row Number Mismatch (#22307)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-02-27 10:41:46 +08:00
Enwei Jiao
697dedac7e
Use cockroachdb/errors to replace other error pkg (#22390)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-26 11:31:49 +08:00
zhenshan.cao
e768437681
Correct usage of Timer and Ticker (#22228)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-02-23 18:59:45 +08:00
Enwei Jiao
0a9a9058b9
Fix UT timeout (#22261)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-20 21:14:25 +08:00
congqixia
fef12b53ef
Fix 2.2.2 possible broken channel cp (#22205)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-16 16:46:35 +08:00
congqixia
f2575e5fa8
Add unconvert & durationcheck linters and fix issues (#22161)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-15 17:22:34 +08:00
aoiasd
148a024e05
Add tickle for datacoord watch event (#21193)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-02-15 16:20:34 +08:00
aoiasd
1894766235
Update datacoord compaction plan after datanode update plan to ensure consistency (#22143)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-02-15 16:00:33 +08:00
cai.zhang
511265c68c
Modify lastSyncTime in advance to prevent multiple flush binlogs (#22048) (#22088)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-12 18:56:33 +08:00
cai.zhang
66b3566ac1
Update component state to healthy after start (#22118)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-10 17:40:32 +08:00
yah01
b1f31da77a
Fix activate standby server ignores all errors (#22073)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-02-09 15:24:31 +08:00
congqixia
7adabe09f1
Fix Alloc timstamp failure blocks compaction queue forever (#22039)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-07 19:02:31 +08:00
XuanYang-cn
a8db19fbdb
Fix ut multi-remove the timer (#22021)
See also: #22019

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-02-07 14:15:54 +08:00
cai.zhang
e25f987a5c
Fix bug that calculated an extra DataNode of register policy (#21927)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-06 10:33:54 +08:00
cai.zhang
ae305a54bd
Set scheduler duration of index task can be configurable (#21944)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-05 17:21:53 +08:00
Ten Thousand Leaves
f9495fef00
Minor fix on segment metric (#21976)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-02-03 19:33:52 +08:00
jaime
748a935a11
Modify segment seal policy with number of statslog files (#21957)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-02-03 17:07:52 +08:00
congqixia
787ce7c121
Add Rated group for checkpoint gc skip case (#21949)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-03 14:23:56 +08:00
Xiaofan
2213ed7bed
Fix bulkload segment can not be flushed (#21919)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-02-02 13:11:51 +08:00
congqixia
11a3d0a50b
Use embed ETCD for datacoord unit test (#21890)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-01-31 14:47:49 +08:00
Xiaofan
f1daef22a1
Fix failed bulkload segment marked as sealed (#21799)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-01-31 12:41:53 +08:00
cai.zhang
bcae97b125
Register after start to prevent there are tow coordinator at the same time (#21641) (#21707)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-01-30 11:11:50 +08:00
congqixia
5986106037
Make paramtable init only once (#21782)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-01-19 14:53:44 +08:00
jaime
1dcd9eeb79
Support rename collection (#21693)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-01-19 14:13:43 +08:00
yah01
78fd1987eb
Fix data race caused by no clone while updating index (#21772)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-01-17 18:11:42 +08:00
Enwei Jiao
90d9e165d4
Fix some configs not shown (#21653)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-01-13 15:31:41 +08:00
congqixia
204db183f3
Prevent panicking when index segment info not exists (#21664)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-01-12 21:39:40 +08:00
wayblink
6a722396bd
Integration test framework (#21283)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-01-12 19:49:40 +08:00
Enwei Jiao
fb42466c65
Use opentelemetry (#21509)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-01-12 16:09:39 +08:00
Jiquan Long
9fd9bed2b9
Remove collection meta after GC finished (#21595)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-01-12 09:55:42 +08:00
Ten Thousand Leaves
8c2c04517e
Fix an issue where flushed segments can turn into sealed (#21566)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-01-11 18:57:43 +08:00
cai.zhang
f02ccfb422
Set GetIndexBuildProgress is compatible with SDK version 2.1 (#21622)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-01-11 16:59:42 +08:00
cai.zhang
e127cf7b99
Reset indexpb for upgrade (#21620)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-01-11 14:35:40 +08:00
cai.zhang
5d660f16d6
Forbid IndexCoord start with version<2.3 (#21597)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-01-10 14:33:38 +08:00
Ten Thousand Leaves
23ceb9c638
Remove index checking phase for bulk insert (#21578)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-01-09 21:15:38 +08:00
congqixia
42ab1b0a48
Add segment gc restraint of dml position before channel cp (#21564)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-01-06 21:33:36 +08:00
jaime
73d8509600
Improve ListSegments performance for datacoord catalog (#21477)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-01-06 14:33:36 +08:00
cai.zhang
aa203acfb3
Low IndexCoord weight (#21548)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-01-06 14:21:37 +08:00
cai.zhang
e5f408dceb
Merge IndexCoord and DataCoord (#21267)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-01-04 19:37:36 +08:00
yah01
7b39873ae0
limit the frequency of GetMetrics() log (#21514)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-01-04 17:39:35 +08:00
Jiquan Long
ff2a68e65a
Fix collection not exist when tried to do recovery (#21471)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-01-04 16:37:35 +08:00
bigsheeper
cf40bb9b5c
Improve datacoord log (#21453)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-12-30 15:37:31 +08:00
Xiaofan
5d044c4f29
Add check for stats log and bin log number (#21264)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-12-26 16:35:30 +08:00
jaime
d401608899
Add a segment seal policy by number of binlog files (#21263)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-12-20 14:09:25 +08:00
Ten Thousand Leaves
ef3fcdf65b
Small candidate compaction should only happen with >1 segments (#21249)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-16 10:01:23 +08:00
jaime
0954014c6d
[skip e2e] Fix broken default parameters for seal segment policy (#21207)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-12-15 18:31:23 +08:00
bigsheeper
fc10c74005
Use channel-cp as seekPosition when FromDmlCPLoadDelete (#21110)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-12-13 16:17:22 +08:00
Ten Thousand Leaves
a81c9cc11c
Recalculate segment max size during compaction (#21077)
issue: #21077

/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-13 15:39:21 +08:00
XuanYang-cn
71cab36e37
Fix channelmanager ut (#21140)
See also: #17199

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-12-12 19:31:22 +08:00