xige-16
d7cd1c849d
Fix indexnode and datanode num metric ( #25919 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-07-28 10:23:02 +08:00
congqixia
41af0a98fa
Use go-api/v2 for milvus-proto ( #24770 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-09 01:28:37 +08:00
congqixia
d83654c33f
Add Close method for ChannelManager in datacoord ( #23493 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-18 17:54:31 +08:00
jaime
c9d0c157ec
Move some modules from internal to public package ( #22572 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-04-06 19:14:32 +08:00
Xiaofan
3d6bded115
Fix Row Number Mismatch ( #22307 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-02-27 10:41:46 +08:00
bigsheeper
cd19d99ad7
Add channel level checkpoint ( #20350 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-10 22:13:04 +08:00
Enwei Jiao
956c5e1b9d
Make Params singleton ( #20088 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-11-04 14:25:38 +08:00
congqixia
f557af1143
Verify target id for FlushSegments request in datanode ( #20308 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-03 22:47:35 +08:00
congqixia
2e6ddd7f2a
Add datanode&channel match check for Flush ( #19985 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-22 12:09:28 +08:00
smellthemoon
581e1d8c35
Fill MsgBase ALL ( #19912 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-10-21 15:57:28 +08:00
SimFG
a55f739608
Separate public proto files ( #19782 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-16 20:49:27 +08:00
Ten Thousand Leaves
b30c9d4f60
Support Bulk Load in Milvus 2.2 ( #18982 )
...
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-09-26 18:06:54 +08:00
SimFG
d7f38a803d
Separate some proto files ( #19218 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
Ten Thousand Leaves
f5e63177d2
Fix an issue with bulk load with multiple DataNodes ( #17324 )
...
issue: #17300
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-06-02 18:54:04 +08:00
Ten Thousand Leaves
5e1e7a6896
Fix an issue that causes flush hanging ( #17169 )
...
issue: #16628
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-05-25 14:34:00 +08:00
Ten Thousand Leaves
e66ac6a77c
Resolve an issue with bulk load where segments in flow graph replica are not updated ( #16609 )
...
issue: #15604
/kind enhancement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-25 11:07:47 +08:00
Xiaofan
89b4a34892
Fix Data race in NodeID ( #16603 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-24 22:03:44 +08:00
Ten Thousand Leaves
45be3deb3f
Implement RC, DC, DN calling path for import. ( #16321 )
...
/kind feature
issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-01 11:33:28 +08:00
XuanYang-cn
a77dd1034c
Adopt the extended state in DataCoord ( #16200 )
...
ChannelWatchInfo with ToWatch, ToRelease will trigger a timer.
ChannelManager now reacts to different ChannelWatch states.
- WatchSuccess > log this info
- WatchFailure/WatchTimeout > ToRelease
- ReleaseSuccess > Delete, reassign if not from DropCollection
- ReleaseFailure/ReleaseTimeout > Cleanup subscription and Delete,
reassgin if not from DropCollection.
Some Notes:
1. Reassignment will add this channel to buffer if there's only one node.
See also: #15846
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-28 22:33:27 +08:00
XuanYang-cn
a00968fdfe
Fix unregister in datacoord cluster ( #16182 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-25 12:09:25 +08:00
zhenshan.cao
f3eeecf146
Reduce the number of metrics ( #16030 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-15 21:51:21 +08:00
Xiaofan
bd7d294c6d
Refine log level in data ( #15821 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-03-02 15:35:55 +08:00
Nemo
3eb074a9b0
Update some comments for data coord with some minor code refactoring. ( #15686 )
...
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-02-22 13:15:51 +08:00
congqixia
9e036af714
Set collectionID in FlushSegmentsRequest ( #14563 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-30 19:11:30 +08:00
Cai Yudong
891c202b73
Use GlobalParamTable for all components ( #13885 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
edward.zeng
f8b85c4646
[skip ci] Refine datacoord cluster comment ( #13408 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-15 11:58:31 +08:00
edward.zeng
446b5a3a48
[skip ci] Refine datacoord cluster comment ( #12562 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-01 19:29:31 +08:00
sunby
7fbb469081
Change channel's field to upper case to log details ( #10567 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-26 20:15:41 +08:00
XuanYang-cn
102bb36440
[skip ci]Update license for dc cluster ( #10593 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 20:23:16 +08:00
congqixia
7ce7cb7a5e
Add a timed flush trigger mechanism ( #10197 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-20 15:02:36 +08:00
sunby
044b06421a
Use etcd to watch channel on datanode ( #7115 )
...
issue: #6578
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-14 15:44:34 +08:00
godchen
5c14f96dc4
[skip ci]Fix cluster go comment typo ( #9377 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-10-07 10:32:13 +08:00
zhenshan.cao
d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal ( #8542 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-29 20:26:00 +08:00
congqixia
d3be316bc2
Add Comment for datacoord cluster ( #7676 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-10 11:26:00 +08:00
congqixia
1f590d6c26
Add datacoord services related unit tests ( #7467 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-06 11:12:42 +08:00
congqixia
0281bd8d22
Change context to correct package ( #7331 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-27 15:37:56 +08:00
congqixia
be5c492e5a
Add datacoord unit tests ( #7197 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-20 17:50:12 +08:00
sunby
23bffe399d
Enhance log print in data coordinator ( #6681 )
...
issue: #6680
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-28 11:43:22 +08:00
sunby
ee38d14f5d
Fix channel lost after data node crash ( #6545 )
...
If we start up 2 data nodes and one of them crashes. We expect that all
channels of crashed node will be allcoated to the alive node. But now we
discover that these channels are lost after data node crash. The reason
is we pass a NodeInfo with empty channel info. We fix it and improve log
print.
issue: #6501
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-15 16:38:31 +08:00
sunby
a8e5fd2024
Refactor cluster in dataservice ( #6356 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-12 11:03:52 +08:00
congqixia
76fd9ad339
Fix restart node logic ( #6265 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-07-02 16:48:30 +08:00
congqixia
580e3a57cf
stop add new node into cluster before validated ( #6241 )
...
* stop add new new into cluster
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* Fix startup & test cases
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-07-01 14:32:16 +08:00
congqixia
3119ce2a6c
Stop create session in watch op ( #6222 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-06-30 16:50:20 +08:00
congqixia
ae072b4f1d
Add candidate management for datacoord dn cluster ( #6196 )
...
* Add candidate management for datacoord dn cluster
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* Fix test cases
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-06-30 10:20:15 +08:00
congqixia
c49ce4ddc2
Add datacoord Server comment and improve para ( #6182 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-06-29 10:46:13 +08:00
congqixia
b27e6b52bf
Force cluster refresh for each dn change event ( #6161 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-06-28 13:28:14 +08:00
congqixia
d6259d2dd6
Refactor policy ( #6003 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-06-23 14:28:08 +08:00
sunby
fe8432016d
Refactor data coordinator ( #6008 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-23 12:10:12 +08:00
sunby
c863a193de
Rename filename from dataservice to datacoordinator ( #5946 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-22 10:42:07 +08:00