Bingyi Sun
e3e4dc7153
Improve GetVChanPosistion and fix unit tests ( #11888 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-16 21:41:50 +08:00
congqixia
d38043f235
Filter with partition id in GetVChanPosition ( #11746 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-13 08:45:09 +08:00
Xiaofan
71e814f796
Remove common.yaml and component.yaml ( #11661 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-12 21:25:08 +08:00
bigsheeper
93149c5ad9
Load growing segment in query node ( #11664 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 18:27:10 +08:00
Bingyi Sun
54b40da4c5
Add segment drop logic ( #11621 )
...
issue: #11558
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-12 00:22:42 +08:00
Bingyi Sun
7a3873960b
Fix watch channel with nil seek position ( #11650 )
...
issue: #11649
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-11 19:32:43 +08:00
congqixia
3c9610cb1b
Add garbage collector for DataCoord ( #11554 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-10 19:03:38 +08:00
congqixia
0c4e09e341
Add comment for datacoord Server.startDataNodeTtLoop ( #11033 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-05 23:01:02 +08:00
sunby
c26cd79532
Add compaction ( #9906 )
...
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-05 22:25:00 +08:00
sunby
a55019825b
Fix stale segments selector ( #11051 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-01 22:30:04 +08:00
Xiaofan
2df2d488e1
Fix Unit test fatal fail ( #10933 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-30 10:24:38 +08:00
congqixia
390fad4eb7
Fix LatestPosition option conflict with earliest patch ( #10907 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-29 21:30:49 +08:00
congqixia
c019e80dbb
Change SeekPosition to earliest of all segments ( #10771 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-28 14:30:26 +08:00
Xiaofan
6fddcb3925
Fix Session checker for proxy ( #10737 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-27 21:58:33 +08:00
XuanYang-cn
548634ff05
[skip ci]Update license for dc segmentinfo ( #10588 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 19:44:37 +08:00
congqixia
285c3f63e3
Trim segmentinfo binlog for VChaninfo usage ( #10425 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-22 14:35:13 +08:00
congqixia
7ce7cb7a5e
Add a timed flush trigger mechanism ( #10197 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-20 15:02:36 +08:00
groot
76b053a11c
Fix a typo ( #10192 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-20 12:46:42 +08:00
Xiaofan
a0b98dacda
Skip reconsume tt msgstream when datacoord restart ( #9684 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-15 11:46:33 +08:00
congqixia
6b8ff60de3
Close event channel when watch event found error ( #9819 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-14 19:20:35 +08:00
congqixia
ec6e8e4127
Hide liveChn into sessionutil and fix liveness init order ( #9860 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-14 16:40:35 +08:00
sunby
044b06421a
Use etcd to watch channel on datanode ( #7115 )
...
issue: #6578
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-14 15:44:34 +08:00
congqixia
02dc2a2453
Add GetVChanPosition new cases ut ( #9544 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-09 20:57:33 +08:00
godchen
937dbf4279
Add flushed segments ( #9476 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-08 19:09:12 +08:00
congqixia
2711b53d57
Apply collection start position ( #9459 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-08 14:51:13 +08:00
sunby
e7e481444b
Check error returned by server stop ( #9015 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-08 10:09:02 +08:00
sunby
f705281884
Check error returned by ExpireAllocations ( #9016 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-08 10:07:02 +08:00
congqixia
768535f31c
Add positionProvider implementation assertion ( #9261 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-05 20:58:04 +08:00
godchen
2792f85211
Handle server error ( #9032 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-03 22:17:56 +08:00
congqixia
e20445987e
Add Datacoord Server implementation Assertion ( #9143 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-03 19:44:11 +08:00
godchen
f18e0628ae
Make NewMeta private ( #9057 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-02 23:09:56 +08:00
Xiaofan
2c2b800ff4
Change Log Name with NodeId ( #8721 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-01 08:52:50 +08:00
zhenshan.cao
d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal ( #8542 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-29 20:26:00 +08:00
congqixia
d374ea71ba
Unify liveness check in datacoord and datanode ( #8480 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-28 16:10:04 +08:00
congqixia
ffbfaf7f76
Apply collection start position when open segment ( #8697 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-27 20:34:03 +08:00
dragondriver
019f18ddf9
Expose created time and updated time to datacoord metrics ( #8172 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-26 17:50:07 +08:00
congqixia
21f15d66bb
Add option for DataNode creation ( #8240 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-18 19:10:07 +08:00
congqixia
c76f91233f
Put errors together ( #7958 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-15 21:05:52 +08:00
congqixia
85d73358cc
Remove ctx from LongTermChecker ( #7792 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-13 16:50:57 +08:00
sunby
49b6c3101d
Remove datacoord useless code ( #7673 )
...
Issue: #7624
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-09 19:08:03 +08:00
dragondriver
9b21b3b5fd
Initialize test framework of proxy ( #7563 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-09 10:06:29 +08:00
congqixia
664aeb09c6
Add ut and comments for datacoord meta ( #7560 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-08 11:35:59 +08:00
congqixia
fb4e23bc79
Add datacoord server unit tests ( #7499 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-06 17:02:41 +08:00
dragondriver
1db573731b
Cache the system information metrics ( #7436 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-03 17:15:26 +08:00
sunby
4d56d53c0b
Add a tool to move binlog path to SegmentInfo ( #7243 )
...
issue: #7214
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-24 15:51:51 +08:00
congqixia
f5451d12f3
Refactor datacoord allocator ( #7226 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-23 17:59:51 +08:00
sunby
3cc210da26
Add flush interval ( #6996 )
...
Time tick message is sent about per 0.2 seconds. DataCoord will call
`FlushSegment` too frequently. We add a min interval for segment flush. A
segment will called `FlushSegment` only once between the interval.
issue: #6995
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-19 14:08:10 +08:00
sunby
4f7c3e7d3a
Save binlog path in SegmentInfo ( #6590 )
...
issue: #6589
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-19 13:00:12 +08:00
sunby
9551dc3b7e
Fix segment auto flush bug ( #7085 )
...
issue: #7084
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-16 11:00:09 +08:00
XuanYang-cn
6c5be83ea1
Refactor NewEtcdKV API ( #7075 )
...
This PR mainly did the following 3 things:
- Refactor NewEtcdKV API
- Add unittests for `kv/etcd/`, raise the coverage
up to 94%
- Correct some APIs from version to revision
The old NewEtcdKV() API took `clientv3.Client` as
one of the input, making everyone who using this API
had to create a new `clientv3.Client`. So there're a lot
of repeated codes everywhere.
Meanwhile, someplace didn't even check whether the
`clientv3.New()` returned error or not, and the old API
also didn't check whether the clientv3.Client was Nil.
This caused issue#6955.
Ectd's version and revision have nothing alike, they
represent different concepts, but our APIs kind of
mixed them all up. So I correct those APIs' names.
Resolves : #6955
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-13 11:04:09 +08:00