Commit Graph

52 Commits

Author SHA1 Message Date
jaime
c9d0c157ec
Move some modules from internal to public package (#22572)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-04-06 19:14:32 +08:00
jaime
d126f06946
Decouple mq module from internal proto definition (#22536)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-03-04 23:21:50 +08:00
yah01
78fd1987eb
Fix data race caused by no clone while updating index (#21772)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-01-17 18:11:42 +08:00
congqixia
204db183f3
Prevent panicking when index segment info not exists (#21664)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-01-12 21:39:40 +08:00
cai.zhang
e5f408dceb
Merge IndexCoord and DataCoord (#21267)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-01-04 19:37:36 +08:00
SimFG
a55f739608
Separate public proto files (#19782)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-16 20:49:27 +08:00
Ten Thousand Leaves
b30c9d4f60
Support Bulk Load in Milvus 2.2 (#18982)
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-09-26 18:06:54 +08:00
Jiquan Long
5141e05c47
Add policy to seal long time idle segment (#19222)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-09-20 20:54:50 +08:00
SimFG
d7f38a803d
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
Ten Thousand Leaves
fc42ee5bb3
Fix # of rows of recovering segment (#18736)
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-08-19 19:50:50 +08:00
congqixia
e5fe46124b
Fix isCompacting flag lost after segment clone (#18248)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-13 10:08:28 +08:00
Xiaofan
54aeb077e9
Refine compaction selection poliy (#17486)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-15 23:14:10 +08:00
godchen
8fe4af3584
[skip e2e]Sort imports (#14809)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-01-05 14:06:48 +08:00
godchen
ef2a62387b
[skip e2e]Sort imports (#14329)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-27 18:54:37 +08:00
godchen
c1cb69ed7e
[skip ci]Fix segment info typo (#13643)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-21 09:19:53 +08:00
congqixia
1dcd06cc78
Add log file info for all kind of segment binlogs (#13606)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-19 20:00:42 +08:00
edward.zeng
6b74aed32a
[skip e2e] Refine datacoord segment info comment (#13602)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-17 18:54:26 +08:00
sunby
c26cd79532
Add compaction (#9906)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-05 22:25:00 +08:00
XuanYang-cn
548634ff05
[skip ci]Update license for dc segmentinfo (#10588)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 19:44:37 +08:00
congqixia
7ce7cb7a5e
Add a timed flush trigger mechanism (#10197)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-20 15:02:36 +08:00
zhenshan.cao
32a029fbed
[skip ci]Fix golint error in datacoord (#10135)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-18 21:32:49 +08:00
sunby
044b06421a
Use etcd to watch channel on datanode (#7115)
issue: #6578
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-14 15:44:34 +08:00
sunby
aba9aa450d
[skip ci]Add comment for SetFlushTime (#9668)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-11 21:06:37 +08:00
sunby
6fc64b836a
[skip ci]Add comment for SetBinlogs (#9667)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-11 21:04:42 +08:00
sunby
1e0c3cbcb9
[skip ci]Add comment for SetCurrentRows (#9526)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-09 00:16:56 +08:00
sunby
7834649dbc
[skip ci]Add comment for AddAllocation (#9525)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-09 00:15:13 +08:00
sunby
292aeeac63
[skip ci]Add comment for SetAllocations (#9524)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-09 00:13:21 +08:00
congqixia
d828a63c94
[skip ci] Add comment for SegmentsInfo AddBinglogPaths (#9386)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-08 17:31:50 +08:00
sunby
21655d54be
[skip ci]Add comment for AddSegmentBinlogs (#9389)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-07 18:32:50 +08:00
sunby
ad15e786cc
[skip ci]Add comment for SetStartPosition (#9399)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-07 17:59:31 +08:00
sunby
d5081783c3
[skip ci]Add comment for SetDmlPosition (#9398)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-07 17:57:47 +08:00
sunby
d41cdbb909
[skip ci]Add comment for SetState (#9397)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-07 17:55:53 +08:00
sunby
cc794354b5
[skip ci]Add comment for SetRowCount (#9394)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-07 17:54:12 +08:00
sunby
82ff4563b3
[skip ci]Add comment for SegmentInfoOption (#9393)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-07 17:52:17 +08:00
sunby
41633aee0a
[skip ci]Add comment for ShadowClone (#9391)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-07 17:50:14 +08:00
sunby
ad6b06ed85
[skip ci]Add comment for Clone (#9390)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-07 17:48:00 +08:00
sunby
6c0b38eb5a
[skip ci]Add comment for SetExpireTime (#9395)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-07 17:45:29 +08:00
congqixia
5031f09073
[skip ci] Add detail comment for SegmentsInfo (#9332)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-06 17:20:07 +08:00
sunby
5467240fca
[skip ci]Add comment for SetFlushTime (#9295)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-05 22:36:48 +08:00
sunby
a1a69a8fef
[skip ci]Add comment for SetBinlogs (#9293)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-05 22:34:49 +08:00
sunby
a51533de7f
[skip ci]Add comment for SetCurrentRows (#9294)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-05 22:28:38 +08:00
congqixia
423f6584da
[skip ci] Add comment for Datacoord SegmentsInfo allocation (#9260)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-05 15:29:03 +08:00
sunby
c54599ae6f
[skip ci]Modify comment for SetState (#9141)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-03 17:50:03 +08:00
congqixia
ca62b1e149
Use clone instead of ShadowClone when update pb data (#8461)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-24 12:53:54 +08:00
congqixia
2bca69596e
Add some comment for SegmentsInfo (#7995)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-15 21:07:53 +08:00
congqixia
664aeb09c6
Add ut and comments for datacoord meta (#7560)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-08 11:35:59 +08:00
sunby
4d56d53c0b
Add a tool to move binlog path to SegmentInfo (#7243)
issue: #7214
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-24 15:51:51 +08:00
sunby
3cc210da26
Add flush interval (#6996)
Time tick message is sent about per 0.2 seconds. DataCoord will call
`FlushSegment` too frequently. We add a min interval for segment flush. A
segment will called `FlushSegment` only once between the interval.

issue: #6995
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-19 14:08:10 +08:00
sunby
4f7c3e7d3a
Save binlog path in SegmentInfo (#6590)
issue: #6589
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-19 13:00:12 +08:00
sunby
fc74a0f578
Auto create new segments when allocating rows more than (#6665)
max number of rows per segment

If user insert too much rows in a request. Now we will return a failed
response. Maybe auto creating new segments to hold that much rows is a
better way.

issue: #6664
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-23 21:58:33 +08:00