Commit Graph

224 Commits

Author SHA1 Message Date
congqixia
7e43b568ee
Add dropped ts and apply when gc scan dropped segments (#11838)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-16 14:23:21 +08:00
shaoyue
6322eb31e7
[skip ci] Add comments for exported things in policy.go (#11876)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-16 13:21:16 +08:00
Bingyi Sun
b8c5239784
Add compaction retention config (#11793)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-16 11:47:10 +08:00
Bingyi Sun
8b60aa8c4e
Skip single compaction if there's no delta log in a segment (#11806)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-16 11:23:11 +08:00
Bingyi Sun
902e856a06
[skip ci]Remove redundancy log (#11732)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-15 10:25:09 +08:00
congqixia
d38043f235
Filter with partition id in GetVChanPosition (#11746)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-13 08:45:09 +08:00
Xiaofan
71e814f796
Remove common.yaml and component.yaml (#11661)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-12 21:25:08 +08:00
bigsheeper
93149c5ad9
Load growing segment in query node (#11664)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 18:27:10 +08:00
Bingyi Sun
5c8978e5d6
Fix drop segment bug (#11709)
issue: #11708
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-12 17:31:11 +08:00
Bingyi Sun
54b40da4c5
Add segment drop logic (#11621)
issue: #11558
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-12 00:22:42 +08:00
Bingyi Sun
002b854590
Move compaction and garbage switch to milvus.yaml (#11654)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-11 23:38:42 +08:00
Bingyi Sun
7a3873960b
Fix watch channel with nil seek position (#11650)
issue: #11649
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-11 19:32:43 +08:00
Bingyi Sun
5574a104c9
Add triggerInfo in compactionTask (#11517)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-11 15:54:42 +08:00
godchen
5357e301f4
Fix retrieve search error (#11501)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-11 00:54:45 +08:00
Bingyi Sun
f01063a020
[skip ci]Add comment for GetCompactionState (#11599)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-11 00:00:45 +08:00
Bingyi Sun
1104f752f5
[skip ci]Add comment for ManualCompaction (#11598)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-10 23:58:57 +08:00
Bingyi Sun
adea19352c
[skip ci]Add comment for CompleteCompaction (#11597)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-10 23:57:38 +08:00
congqixia
3c9610cb1b
Add garbage collector for DataCoord (#11554)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-10 19:03:38 +08:00
Xiaofan
5f08b67156
Move node.yaml to component.yaml (#11363)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-10 14:27:37 +08:00
Bingyi Sun
c3f0c5a3ff
Add compaction interfaces in proxy (#11431)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-09 14:47:02 +08:00
sunby
05681364c9
Fix some review comments in compaction. related pr #9906 (#11399)
issue: #9904
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2021-11-08 21:45:00 +08:00
sunby
db6ecd58f2
Fix UpdateFlushSegmentsInfo bug (#11407)
issue: #7313
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2021-11-08 14:16:56 +08:00
congqixia
0c4e09e341
Add comment for datacoord Server.startDataNodeTtLoop (#11033)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-05 23:01:02 +08:00
sunby
c26cd79532
Add compaction (#9906)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-05 22:25:00 +08:00
sunby
a55019825b
Fix stale segments selector (#11051)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-01 22:30:04 +08:00
godchen
7108612398
[skip ci]Fix allocator typo (#10998)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-01 16:54:07 +08:00
godchen
0970aea7e7
[skip ci]Fix allocator typo (#10997)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-01 16:52:19 +08:00
godchen
d0ee395de5
[skip ci]Fix allocator typo (#10996)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-01 16:50:33 +08:00
congqixia
54738d2ac5
[skip ci] Fix lint for datacoord/channel_store.og (#10964)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-30 21:08:00 +08:00
congqixia
2b07876827
[skip ci] Fix lint for AvgAssignRegisterPolicy (#10965)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-30 21:03:52 +08:00
Xiaofan
2df2d488e1
Fix Unit test fatal fail (#10933)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-30 10:24:38 +08:00
congqixia
390fad4eb7
Fix LatestPosition option conflict with earliest patch (#10907)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-29 21:30:49 +08:00
godchen
ad2cfdd99f
[skip ci]Fix datanode typo error (#10880)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-29 13:04:04 +08:00
godchen
7071ded008
[skip ci]Fix datanode typo error (#10879)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-29 12:03:38 +08:00
Xiaofan
93f205b49e
Rename param names (#10853)
* Rename param names

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

* Rename configs

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-28 23:16:40 +08:00
congqixia
c019e80dbb
Change SeekPosition to earliest of all segments (#10771)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-28 14:30:26 +08:00
Xiaofan
6fddcb3925
Fix Session checker for proxy (#10737)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-27 21:58:33 +08:00
congqixia
169af67eb1
Fix segments not removed from flushingCache (#10738)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-27 16:06:24 +08:00
congqixia
5c0b5c42ca
Fix merge caused compile error (#10693)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-26 21:46:21 +08:00
sunby
7fbb469081
Change channel's field to upper case to log details (#10567)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-26 20:15:41 +08:00
sunby
2de3131bb3
Change default balance policy (#10563)
issue: #10198
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-26 19:40:44 +08:00
sunby
9b8e1c657e
Split watch operations to many transactions (#10655)
issue: #10633
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-26 19:38:20 +08:00
godchen
095a2378ca
Add datanode ut (#10433)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-25 22:52:27 +08:00
godchen
3030454eb9
[skip ci]Fix datacoord package name missing (#10608) 2021-10-25 21:21:40 +08:00
XuanYang-cn
102bb36440
[skip ci]Update license for dc cluster (#10593)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 20:23:16 +08:00
XuanYang-cn
fe955b888f
[skip ci]Update license for dc meta (#10592)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 20:21:18 +08:00
XuanYang-cn
acb4dd2069
[skip ci]Update license for dc channel manager (#10591)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 20:19:25 +08:00
XuanYang-cn
23c7691d59
[skip ci]Update license for dc policy (#10590)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 19:48:23 +08:00
XuanYang-cn
e5a88374bd
[skip ci]Update license for dc server (#10589)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 19:46:28 +08:00
XuanYang-cn
548634ff05
[skip ci]Update license for dc segmentinfo (#10588)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 19:44:37 +08:00