yah01
4a2726b3f9
Remove dup config items ( #23653 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-24 19:02:33 +08:00
aoiasd
695cc769df
Fix watch event timeout when IO Pool busy ( #23293 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-04-17 11:02:30 +08:00
cqy123456
7ff6a3a246
Set query node thread pool size in milvus.yaml ( #23286 )
...
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2023-04-17 10:44:29 +08:00
Xiaofan
680ad482b7
Check balance checker chore to 10s ( #23304 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-04-09 16:14:32 +08:00
smellthemoon
ce91f61e5a
Pre-create topics ( #21907 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-04-03 16:44:23 +08:00
yah01
081572d31c
Refactor QueryNode ( #21625 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: aoiasd <zhicheng.yue@zilliz.com>
2023-03-27 00:42:00 +08:00
yihao.dai
f2ffb5db26
Use buffer size at memory sync policy ( #22825 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-03-21 21:37:56 +08:00
MrPresent-Han
77c9e33e70
support dml channel balancer on datacoord ( #22324 ) ( #22377 ) ( #22692 )
...
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-03-20 10:01:56 +08:00
shaoyue
32581e6452
Support aliyun oss as object storage with ak or IAM ( #22376 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2023-03-09 16:33:52 +08:00
Xiaofan
256aaa1944
Change Etcd session timeout to 20s ( #22401 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-02-28 11:13:47 +08:00
Xiaofan
fa101e9751
Change RockMQ page size to 256MB ( #22432 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-02-28 10:45:47 +08:00
wayblink
416866e42f
Add memory usage too large sync policy ( #22244 )
...
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-02-27 17:47:51 +08:00
Enwei Jiao
0851e05014
Gernate milvus.yaml by code ( #22003 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-23 11:37:46 +08:00
aoiasd
148a024e05
Add tickle for datacoord watch event ( #21193 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-02-15 16:20:34 +08:00
wayblink
77a27c6dfc
Support print log to file and console at the same time ( #21946 )
...
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-02-14 16:56:34 +08:00
jaime
a2435cfc4f
[Cherry-Pick]Add a segment metrics for count number of binlog files ( #22103 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-02-13 10:24:33 +08:00
Jiquan Long
004a8c25ca
Remove hardcode max shards num ( #22004 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-02-07 10:17:53 +08:00
jaime
baa035885d
Modify default value of some configurations ( #22013 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-02-07 10:05:56 +08:00
cai.zhang
ae305a54bd
Set scheduler duration of index task can be configurable ( #21944 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-02-05 17:21:53 +08:00
jaime
748a935a11
Modify segment seal policy with number of statslog files ( #21957 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-02-03 17:07:52 +08:00
cai.zhang
a04238c25f
Keep the configuration of indexCoord ( #21879 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-01-31 12:07:50 +08:00
Enwei Jiao
cecd59d940
Disable time-travel by default ( #21775 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-01-18 13:57:43 +08:00
Xiaofan
f8e1566b24
Support zstd compression in grpc ( #21689 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-01-13 10:55:41 +08:00
Enwei Jiao
fb42466c65
Use opentelemetry ( #21509 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-01-12 16:09:39 +08:00
cai.zhang
aa203acfb3
Low IndexCoord weight ( #21548 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-01-06 14:21:37 +08:00
cai.zhang
e5f408dceb
Merge IndexCoord and DataCoord ( #21267 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-01-04 19:37:36 +08:00
SimFG
037ccccfcc
Add the gracefulStopTimeout
config for the node ( #21449 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-12-29 17:33:31 +08:00
congqixia
8b4d60b073
Add guarantee and serviceable lag too large check ( #21441 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-29 15:17:30 +08:00
jaime
d401608899
Add a segment seal policy by number of binlog files ( #21263 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-12-20 14:09:25 +08:00
Ten Thousand Leaves
ef3fcdf65b
Small candidate compaction should only happen with >1 segments ( #21249 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-16 10:01:23 +08:00
Ten Thousand Leaves
9d8f422cb8
Reduce maxFieldNum from 256 to 64 ( #21104 )
...
issue: #21077
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-14 10:39:22 +08:00
aoiasd
9079b1d5a4
Rename default accesslog dir name ( #21086 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-12-09 18:09:19 +08:00
SimFG
4a5c282b62
Add the superuser config ( #21090 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-12-09 16:13:20 +08:00
Ten Thousand Leaves
d67db2ed9b
Make compaction target able to exceed segment max size by a bit ( #21068 )
...
issue: #21053
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-09 16:03:20 +08:00
yah01
9ebaa10dec
Add more logs for GetShardLeaders ( #21046 )
...
Also increase the heartbeatAvailableInterval from 2.5s to 10s
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-08 19:09:18 +08:00
Xiaofan
e131915207
Support 64M Rpc Limit ( #20845 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-12-07 10:07:18 +08:00
SimFG
f8cff79804
Support the graceful stop for the query node ( #20851 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-12-06 22:59:19 +08:00
Ten Thousand Leaves
2f5b03fef7
Split small segment proportion and small segment compactable proportion ( #20996 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-06 14:37:18 +08:00
yah01
aec347e591
Check last heartbeat response time while fetching shard leaders ( #20968 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-05 15:09:20 +08:00
Ten Thousand Leaves
67390d208b
Reduce seal proportion from 0.25 to 0.23 ( #20907 )
...
When segment are sealed with > 0.25 * segment.maxSize, we won't be able to compact 4 segments like these because the total size will be slightly over 0.25 * 4 * segment.maxSize.
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-30 18:47:15 +08:00
yah01
060649b8aa
Refactor task scheduler and executor ( #20828 )
...
Make the performance able to scale out
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-30 13:57:15 +08:00
Ten Thousand Leaves
0700e56008
Increase MaxWatchDuration and make it configurable ( #20884 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-29 17:19:14 +08:00
xige-16
1ad702cc40
Reduce the memory used by load disk index ( #20475 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-21 19:35:11 +08:00
xige-16
81b6703201
Fix spell PQ error ( #20725 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-21 16:35:11 +08:00
bigsheeper
fef87f879c
Disable tt delay protection ( #20657 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-17 20:21:14 +08:00
bigsheeper
fc15789da9
Ensure compatibility of channel seek position and move syncPeriod to config ( #20504 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-12 21:09:04 +08:00
wei liu
701e7b5a6e
support pulsar tenant and auth ( #19727 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-11 10:55:05 +08:00
aoiasd
fca2b71e28
add access log for proxy ( #19927 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-11-10 17:09:06 +08:00
MrPresent-Han
21b54709a2
enable delbuf auto flush function to avoid OOM when del msg accumulating ( #20213 )
...
issue: #19713
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
Co-authored-by: MrPresent-Han <zilliz@zillizdeMacBook-Pro-2.local>
2022-11-07 18:49:02 +08:00
zhagnlu
15b2d1cace
Change default thread core coefficient ( #20120 ) ( #20328 )
...
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-11-04 12:41:35 +08:00