Commit Graph

2795 Commits

Author SHA1 Message Date
godchen
664da326e4
Add querynode delete ids in sealed segment (#10638)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-26 14:46:19 +08:00
congqixia
43caa19686
[skip ci] Add comment for types.go - Datacoord.SaveBinlogPaths (#10627)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-26 14:19:02 +08:00
Cai Yudong
04d34bfcd7
Remove redundant code (#10635)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 13:12:21 +08:00
Cai Yudong
4cd83e78ed
Reorder header files for segcore/Collection.cpp (#10634)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 13:10:30 +08:00
Cai Yudong
06dad68f91
Add common/Consts.h (#10631)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 13:08:18 +08:00
xige-16
a414d16c06
Fix remove segment when querynode receive segmentChangeInfo (#10619)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-26 13:04:18 +08:00
zhenshan.cao
bb08df28f3
Fix golint error in proxy (#10620)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-26 10:38:41 +08:00
zhenshan.cao
5e00e9a05b
Fix golint error in proxy (#10623)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-25 23:56:19 +08:00
zhenshan.cao
82983494a0
Fix golint error in proxy (#10622)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-25 23:44:21 +08:00
zhenshan.cao
4b0fd28de7
Fix golint error in proxy (#10621)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-25 23:42:29 +08:00
zhenshan.cao
9458e04538
Fix golint error in proxy (#10618)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-25 23:32:20 +08:00
godchen
095a2378ca
Add datanode ut (#10433)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-25 22:52:27 +08:00
godchen
daaa9428ea
Fix delete msg hash error (#10599)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-25 22:20:20 +08:00
sunby
42480da5d3
[skip ci]Add comment for GetSegmentInfoChannel (#10606)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-25 21:24:22 +08:00
sunby
1888b7e1a1
[skip ci]Add comment for GetRecoveryInfo (#10605)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-25 21:22:31 +08:00
godchen
3030454eb9
[skip ci]Fix datacoord package name missing (#10608) 2021-10-25 21:21:40 +08:00
godchen
6a0a5cf274
Add delete request hash values proto (#10601)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-25 21:20:44 +08:00
yukun
6c13008dc3
Fix sealed segment get deleted bitmap assert (#10572)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-25 21:18:47 +08:00
yukun
5f5949cf2f
[skip ci]Remove unused code (#10597)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-25 20:30:48 +08:00
XuanYang-cn
102bb36440
[skip ci]Update license for dc cluster (#10593)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 20:23:16 +08:00
XuanYang-cn
fe955b888f
[skip ci]Update license for dc meta (#10592)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 20:21:18 +08:00
XuanYang-cn
acb4dd2069
[skip ci]Update license for dc channel manager (#10591)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 20:19:25 +08:00
congqixia
ae2a301662
Add injection logic for FlushManager (#10580)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-25 20:17:34 +08:00
yukun
b8fd695838
Fix duplicate delete bug in growing segment (#10570)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-25 20:15:49 +08:00
XuanYang-cn
21d98c2825
Add binlog io for compaction (#10536)
See also: #9530

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 20:13:51 +08:00
nameczz
80f1eb8356
[skip ci] Add IndexDescription comments in milvus.proto (#10246)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-10-25 19:58:18 +08:00
XuanYang-cn
23c7691d59
[skip ci]Update license for dc policy (#10590)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 19:48:23 +08:00
XuanYang-cn
e5a88374bd
[skip ci]Update license for dc server (#10589)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 19:46:28 +08:00
XuanYang-cn
548634ff05
[skip ci]Update license for dc segmentinfo (#10588)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 19:44:37 +08:00
bigsheeper
2df20eaa5a
[skip ci] Add comment for freeAll (#10575)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-25 19:40:05 +08:00
bigsheeper
9ee77bbf01
[skip ci] Add comment for getCollectionIDs (#10574)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-25 19:37:55 +08:00
bigsheeper
75f1c2f230
[skip ci] Add comment for newCollectionReplica (#10573)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-25 19:36:12 +08:00
godchen
d2e0943f21
Fix delete node flush error (#10549)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-25 18:49:20 +08:00
sunby
98be39bada
Add compaction field in querycoord segment info (#10565)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-25 18:09:15 +08:00
cai.zhang
8d38adc7a3
[skip ci]Fix golint error for GetMetrics in QueryNode (#10555)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-25 18:07:24 +08:00
cai.zhang
96e89a9d4c
[skip ci]Fix golint error for GetSegmentInfo in QueryNode (#10554)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-25 18:05:34 +08:00
congqixia
2713988ff2
Merge auto manual flush with same segment id (#10550)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-25 18:03:42 +08:00
congqixia
bd90a3831c
Allow flushed segments trigger flushe process (#10539)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-25 18:01:50 +08:00
cai.zhang
fb7d1271a4
[skip ci]Fix golint error for ReleaseSegments in QueryNode (#10553)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-25 17:59:30 +08:00
cai.zhang
c3cce20413
Reset the msgstream threshold to PulsarMaxMessageSize (#10186)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-25 17:57:14 +08:00
Cai Yudong
e4909c1c0b
Optimize segcore API GetResultData (#10548)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-25 17:53:20 +08:00
Cai Yudong
880e375b00
[skip ci] Remove comments (#10541)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-25 15:25:12 +08:00
Cai Yudong
f6802589eb
Optimize proxy reduce code readability (#10537)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-25 14:29:12 +08:00
Cai Yudong
be57e8fdd8
Remove redundant code (#10343)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-25 14:27:12 +08:00
xige-16
9ebabdac79
Add handoffTask (#10330)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-24 22:39:09 +08:00
zhenshan.cao
66c1f7f197
Fix proxy unittest bug:failed to stop rootcoord (#10524)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-24 16:13:11 +08:00
zhenshan.cao
40750f03c7
Enhance querycoord log (#10523)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-24 15:16:00 +08:00
yukun
7acb48919b
Add Delete func in Segcore SegmentSealed (#10501)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-24 14:19:10 +08:00
cai.zhang
e18debb3cf
Fix the bug of indexcoord meta returns the underlying pointer (#10504)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-24 13:29:10 +08:00
godchen
f7d6fce513
[skip ci]Fix id typo error (#10500)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-24 10:45:10 +08:00
XuanYang-cn
cd06f50645
Remove schema in delete codec (#10517)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-24 09:59:10 +08:00
zhenshan.cao
3af852eafb
Fix golint error in proxy (#10488)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-23 23:17:11 +08:00
cai.zhang
6ea7340dd5
[skip ci]Fix golint error for ReleaseCollection in QueryNode (#10510)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-23 18:27:27 +08:00
zhenshan.cao
51d82fc71d
Fix golint error in proxy (#10487)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-23 18:25:37 +08:00
zhenshan.cao
169359448f
Fix golint error in proxy (#10486)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-23 18:23:44 +08:00
cai.zhang
7669075ae3
[skip ci]Fix golint error for ReleaseCollection in QueryNode (#10509)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-23 18:21:38 +08:00
cai.zhang
dc4ea15339
[skip ci]Fix golint error for LoadSegments in QueryNode (#10508)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-23 18:19:45 +08:00
edward.zeng
ad667beb9a
[skip ci] Refine comments in metrics (#10511)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-10-23 18:15:12 +08:00
godchen
31393d8801
[skip ci]Fix datanode comment typo error (#10502)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-23 16:57:35 +08:00
godchen
3b8c17abf8
[skip ci]Fix global id typo error (#10499)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-23 16:55:44 +08:00
sunby
4036830b2d
Fix modify segment without clone (#10498)
issue: #10430
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-23 13:31:09 +08:00
zhenshan.cao
43ef5d5eb9
Fix golint error in proxy (#10485)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-23 10:53:12 +08:00
yukun
6949350b8b
Call segmentLoadDeletedRecord in segment_loader (#10472)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-23 09:31:10 +08:00
zhenshan.cao
af8fc47518
[skip ci]Fix golint error in querynode (#10484)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-22 23:57:11 +08:00
congqixia
f170658d5b
[skip ci] Add comment for types.go - Datacoord.GetRecoveryInfo (#10483)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-22 23:37:11 +08:00
yukun
bc083950a8
Add delete in segcore segment sealed (#10470)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 23:35:18 +08:00
bigsheeper
5c58924420
Add cgroups to get container memory and check index memory in segment loader (#10363)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-22 20:49:10 +08:00
Xiangyu Wang
99ca6e4ba2
Improve comment in storage (#10448)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-22 20:45:12 +08:00
yukun
0304a8014b
Support delete in query (#10452)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 20:05:12 +08:00
cai.zhang
bf10fc6e7c
[skip ci]Fix golint error for WatchDmChannels in QueryNode (#10476)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-22 19:37:30 +08:00
cai.zhang
ebd7b4eee1
[skip ci]Fix golint error for AddQueryChannel in QueryNode (#10474)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-22 19:33:40 +08:00
cai.zhang
edf0d0bb27
[skip ci]Fix golint error for RemoveQueryChannel in QueryNode (#10475)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-22 19:31:42 +08:00
xige-16
8a046a6495
BroadCast sealedSegmentChangeInfo to queryChannel (#10084)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-22 19:07:15 +08:00
bigsheeper
5a11175bea
[skip ci] Add comment for getExcludedSegments (#10465)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-22 19:05:14 +08:00
bigsheeper
83c835a1d6
[skip ci] Add comment for addExcludedSegments (#10464)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-22 19:03:31 +08:00
bigsheeper
bad8a41494
[skip ci] Add comment for removeExcludedSegments (#10463)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-22 19:01:29 +08:00
yukun
f7c0f5b3da
Add segmentLoadDeletedRecord in querynode (#10449)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 18:51:14 +08:00
Xiangyu Wang
040be8da51
Improve comments in tso (#10446)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-22 17:37:12 +08:00
Xiangyu Wang
99d57beff8
Improve comment in storage (#10447)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-22 17:29:11 +08:00
congqixia
76b64a9d01
Remove not needed ctx from rocksmq client (#10416)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-22 17:25:12 +08:00
edward.zeng
29d1e45f3b
[skip ci] Refine the comments in metrics (#10435)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-10-22 16:19:20 +08:00
godchen
ffc0c07610
Change delete data primary key to int64 (#10438)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 15:37:12 +08:00
congqixia
285c3f63e3
Trim segmentinfo binlog for VChaninfo usage (#10425)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-22 14:35:13 +08:00
groot
73c9ab43e0
Simplify cpp (#10413)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-22 14:33:11 +08:00
godchen
d6bf0c928f
Get stats delta path from datacoord (#10362)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 14:31:13 +08:00
XuanYang-cn
2eff882245
[skip ci]Update license for distributed cm (#10424)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:19:12 +08:00
XuanYang-cn
a111056fe4
[skip ci]Update license for distributed qc.client (#10422)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:17:26 +08:00
XuanYang-cn
64d0a2d37e
[skip ci]Update license for distributed qn.client (#10420)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:15:33 +08:00
XuanYang-cn
a495ffc9f6
[skip ci]Update license for distributed rc.client (#10418)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:13:42 +08:00
groot
70eb275ef4
[skip ci] Fix typo (#10412)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-22 14:11:52 +08:00
groot
6db06ecf81
[skip ci] Fix typo (#10411)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-22 14:10:06 +08:00
XuanYang-cn
a219026142
[skip ci]Update license for distributed qn (#10419)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:03:30 +08:00
XuanYang-cn
d3cd3fc2af
[skip ci]Update license for distributed rc (#10423)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:01:21 +08:00
XuanYang-cn
2db93e70bc
[skip ci]Update license distributed qc (#10421)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 13:59:28 +08:00
yukun
fe1927c05d
Support delete in SegmentSealed (#10181)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 13:11:11 +08:00
godchen
e7738243b9
Fix stats log nil when not int64 field (#10417)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 12:51:11 +08:00
Xiangyu Wang
d9abce6764
Fix unittest failed in schema_test.go (#10401)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-21 22:47:11 +08:00
yukun
319b3282d9
[skip ci]Add comments for rocksmq consumer_impl (#10389)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-21 22:45:22 +08:00
yukun
4a8619619b
[skip ci]Add comments for rocksmq (#10388)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-21 22:43:21 +08:00
cai.zhang
ecfca29adb
[skip ci] Fix golint for GetTimeTickChannel in QueryNode (#10395)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-21 21:59:23 +08:00