groot
bee66631e3
Refine bulkload ( #19671 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-10-27 16:21:34 +08:00
SimFG
a55f739608
Separate public proto files ( #19782 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-16 20:49:27 +08:00
congqixia
2a2d32c4fc
Fix datacoord panics when collection info not found ( #19706 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-11 21:39:24 +08:00
Ten Thousand Leaves
b30c9d4f60
Support Bulk Load in Milvus 2.2 ( #18982 )
...
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-09-26 18:06:54 +08:00
Jiquan Long
5141e05c47
Add policy to seal long time idle segment ( #19222 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-09-20 20:54:50 +08:00
SimFG
d7f38a803d
Separate some proto files ( #19218 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
Ten Thousand Leaves
f0b036a35a
Move bulk load segment lock happen early ( #17612 )
...
issue: #17600
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-06-27 13:56:17 +08:00
Bingyi Sun
05273309e8
Drop empty sealed segment ( #17708 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-06-24 15:16:14 +08:00
groot
f31be941bb
Fix bulkload row count bug for multi datanodes ( #17384 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-06-07 16:56:07 +08:00
Enwei Jiao
67ce206cf0
make SegmentMaxLifetime configurable ( #16783 )
...
Signed-off-by: Enwei Jiao <jiaoew2011@gmail.com>
2022-05-06 23:41:51 +08:00
Ten Thousand Leaves
e66ac6a77c
Resolve an issue with bulk load where segments in flow graph replica are not updated ( #16609 )
...
issue: #15604
/kind enhancement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-25 11:07:47 +08:00
Xiaofan
bd7d294c6d
Refine log level in data ( #15821 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-03-02 15:35:55 +08:00
Nemo
3eb074a9b0
Update some comments for data coord with some minor code refactoring. ( #15686 )
...
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-02-22 13:15:51 +08:00
Cai Yudong
891c202b73
Use GlobalParamTable for all components ( #13885 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
Xiangyu Wang
011f54e4ac
Improve import statement ( #13729 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-23 10:29:08 +08:00
congqixia
1dcd06cc78
Add log file info for all kind of segment binlogs ( #13606 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-19 20:00:42 +08:00
godchen
f4caa94ea8
[skip e2e]Fix segment manager typo ( #13644 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 22:34:42 +08:00
edward.zeng
d5791289fc
[skip e2e] Refine datacoord segment manager comment ( #13605 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-17 18:49:09 +08:00
JackLCL
f90410fe8e
[skip ci]Fix error log output format in segment_manager.go ( #12856 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-07 14:36:27 +08:00
Bingyi Sun
0778e6f715
Fix alloc segment with dropped segment ( #12572 )
...
issue: #12465
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-01 22:39:37 +08:00
Bingyi Sun
e3e4dc7153
Improve GetVChanPosistion and fix unit tests ( #11888 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-16 21:41:50 +08:00
Bingyi Sun
5c8978e5d6
Fix drop segment bug ( #11709 )
...
issue: #11708
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-12 17:31:11 +08:00
Bingyi Sun
54b40da4c5
Add segment drop logic ( #11621 )
...
issue: #11558
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-12 00:22:42 +08:00
XuanYang-cn
548634ff05
[skip ci]Update license for dc segmentinfo ( #10588 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 19:44:37 +08:00
groot
0a1529cf7e
Fix a typo ( #10339 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-21 14:16:37 +08:00
Xiaofan
a0b98dacda
Skip reconsume tt msgstream when datacoord restart ( #9684 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-15 11:46:33 +08:00
sunby
006303285f
Fix a nil pointer bug and improve comments ( #7625 )
...
Issue: #7624
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-08 19:05:25 +08:00
congqixia
a5cd484ff2
Add Manager implemenation assertion ( #9038 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-02 14:45:56 +08:00
sunby
745221e87d
Check error in segment_manager.go ( #8705 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-27 22:46:12 +08:00
congqixia
ffbfaf7f76
Apply collection start position when open segment ( #8697 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-27 20:34:03 +08:00
congqixia
01c8341a2e
[skip ci]Add comments for SegmentManager ( #8087 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-16 19:55:49 +08:00
sunby
eed856d626
Change error message to lower case ( #7890 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-14 17:33:48 +08:00
sunby
9c2fb0bccb
Recorrect comment for Allocation ( #7887 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-14 17:27:55 +08:00
congqixia
5b22697ec4
Add segment manager unit tests ( #7525 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-07 13:59:58 +08:00
congqixia
fb4e23bc79
Add datacoord server unit tests ( #7499 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-06 17:02:41 +08:00
congqixia
f5451d12f3
Refactor datacoord allocator ( #7226 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-23 17:59:51 +08:00
sunby
6e34f4c7f1
Add a seal policy which restrict the lifetime of a segment ( #7172 )
...
issue: #7164
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-20 15:42:12 +08:00
sunby
31182e52a9
Fix expire allocation bug ( #7053 )
...
issue: #7052
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-12 10:48:08 +08:00
zhenshan.cao
8a1a841011
FixBug: Incorrect handling of time synchronization ( #6814 )
...
* FixBug: proxy send wrong sync timetick and DataCoord did not filter channel
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-07-27 14:34:48 +08:00
sunby
fc74a0f578
Auto create new segments when allocating rows more than ( #6665 )
...
max number of rows per segment
If user insert too much rows in a request. Now we will return a failed
response. Maybe auto creating new segments to hold that much rows is a
better way.
issue: #6664
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-23 21:58:33 +08:00
sunby
83be910baa
Refactor segment manager ( #6441 )
...
issue: #6440
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-12 17:24:25 +08:00
sunby
017484e093
Refactor meta in data coord ( #6300 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-07 14:02:01 +08:00
sunby
25d3fead9f
Change error type to error functions in data coord ( #6076 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-24 19:05:42 +08:00
congqixia
f6761bbc33
Refactor datacoord segment status ( #6039 )
...
* Refactor datacoord segment status
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* Remove lastExpireTime
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-06-24 14:20:10 +08:00
sunby
46f86a0354
Return sealed segments when calling flush ( #6011 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-23 16:56:11 +08:00
sunby
0978b93a21
Refactor data coordinator ( #5982 )
...
Rename variable name and make error msg more clear
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-22 18:24:08 +08:00
sunby
d2c8462dac
Rename params in data_coord.yaml ( #5968 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-22 16:18:21 +08:00
sunby
c863a193de
Rename filename from dataservice to datacoordinator ( #5946 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-22 10:42:07 +08:00