Enwei Jiao
cecd59d940
Disable time-travel by default ( #21775 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-01-18 13:57:43 +08:00
Xiaofan
f8e1566b24
Support zstd compression in grpc ( #21689 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-01-13 10:55:41 +08:00
Enwei Jiao
fb42466c65
Use opentelemetry ( #21509 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-01-12 16:09:39 +08:00
cai.zhang
aa203acfb3
Low IndexCoord weight ( #21548 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-01-06 14:21:37 +08:00
cai.zhang
e5f408dceb
Merge IndexCoord and DataCoord ( #21267 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-01-04 19:37:36 +08:00
SimFG
037ccccfcc
Add the gracefulStopTimeout
config for the node ( #21449 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-12-29 17:33:31 +08:00
congqixia
8b4d60b073
Add guarantee and serviceable lag too large check ( #21441 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-29 15:17:30 +08:00
jaime
d401608899
Add a segment seal policy by number of binlog files ( #21263 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-12-20 14:09:25 +08:00
Enwei Jiao
166e9f0da5
Refactor GrpcConfig ( #21142 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-12-16 15:59:23 +08:00
Ten Thousand Leaves
ef3fcdf65b
Small candidate compaction should only happen with >1 segments ( #21249 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-16 10:01:23 +08:00
Ten Thousand Leaves
9d8f422cb8
Reduce maxFieldNum from 256 to 64 ( #21104 )
...
issue: #21077
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-14 10:39:22 +08:00
aoiasd
9079b1d5a4
Rename default accesslog dir name ( #21086 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-12-09 18:09:19 +08:00
SimFG
4a5c282b62
Add the superuser config ( #21090 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-12-09 16:13:20 +08:00
Ten Thousand Leaves
d67db2ed9b
Make compaction target able to exceed segment max size by a bit ( #21068 )
...
issue: #21053
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-09 16:03:20 +08:00
yah01
9ebaa10dec
Add more logs for GetShardLeaders ( #21046 )
...
Also increase the heartbeatAvailableInterval from 2.5s to 10s
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-08 19:09:18 +08:00
Xiaofan
e131915207
Support 64M Rpc Limit ( #20845 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-12-07 10:07:18 +08:00
SimFG
f8cff79804
Support the graceful stop for the query node ( #20851 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-12-06 22:59:19 +08:00
Ten Thousand Leaves
2f5b03fef7
Split small segment proportion and small segment compactable proportion ( #20996 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-06 14:37:18 +08:00
yah01
aec347e591
Check last heartbeat response time while fetching shard leaders ( #20968 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-05 15:09:20 +08:00
Ten Thousand Leaves
67390d208b
Reduce seal proportion from 0.25 to 0.23 ( #20907 )
...
When segment are sealed with > 0.25 * segment.maxSize, we won't be able to compact 4 segments like these because the total size will be slightly over 0.25 * 4 * segment.maxSize.
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-30 18:47:15 +08:00
yah01
060649b8aa
Refactor task scheduler and executor ( #20828 )
...
Make the performance able to scale out
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-30 13:57:15 +08:00
Ten Thousand Leaves
0700e56008
Increase MaxWatchDuration and make it configurable ( #20884 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-29 17:19:14 +08:00
xige-16
1ad702cc40
Reduce the memory used by load disk index ( #20475 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-21 19:35:11 +08:00
xige-16
81b6703201
Fix spell PQ error ( #20725 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-21 16:35:11 +08:00
bigsheeper
fef87f879c
Disable tt delay protection ( #20657 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-17 20:21:14 +08:00
bigsheeper
fc15789da9
Ensure compatibility of channel seek position and move syncPeriod to config ( #20504 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-12 21:09:04 +08:00
wei liu
701e7b5a6e
support pulsar tenant and auth ( #19727 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-11 10:55:05 +08:00
aoiasd
fca2b71e28
add access log for proxy ( #19927 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-11-10 17:09:06 +08:00
MrPresent-Han
21b54709a2
enable delbuf auto flush function to avoid OOM when del msg accumulating ( #20213 )
...
issue: #19713
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
Co-authored-by: MrPresent-Han <zilliz@zillizdeMacBook-Pro-2.local>
2022-11-07 18:49:02 +08:00
xige-16
6377d9f375
Open c++ log ( #20325 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-04 18:01:41 +08:00
zhagnlu
15b2d1cace
Change default thread core coefficient ( #20120 ) ( #20328 )
...
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-11-04 12:41:35 +08:00
zhagnlu
cb2591d1fe
Parallel operations of disk-ann file manager ( #20120 ) ( #20122 )
...
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-11-03 14:39:40 +08:00
shaoyue
9fac1476f3
Add support for GCS(GoogleCloudStorage) with IAM ( #20164 )
...
go mod tidy
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-11-01 11:07:35 +08:00
bigsheeper
b949fa0ea9
Increase default ttProtection max delay ( #20125 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-27 17:37:32 +08:00
bigsheeper
99df2d9b54
Add binlogSize and ttDelay metrics monitor ( #19872 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-19 15:13:26 +08:00
bigsheeper
760e9c5df2
Enable rate limit and update quota unit ( #19816 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-17 16:23:25 +08:00
SimFG
ae8ec28925
Delete the unrelated content in the yaml file ( #19812 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-17 15:45:25 +08:00
SimFG
a55f739608
Separate public proto files ( #19782 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-16 20:49:27 +08:00
xige-16
a1db9038fb
Move disk index params to config file ( #19714 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-10-14 17:51:24 +08:00
bigsheeper
22b32465e7
Make bulkLoad failed if quota exceeds and remove autoindex config ( #19770 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-14 14:27:25 +08:00
bigsheeper
f1e330a997
Add read result rate protection ( #19728 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-13 14:57:24 +08:00
bigsheeper
e6c76aba0e
Force deny writing if disk quota exceeded ( #19680 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-12 10:03:22 +08:00
bigsheeper
f98dbcf5be
Update quota params and disable limit for showCollection ( #19641 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-09 14:30:58 +08:00
zhenshan.cao
0ac4bc32a5
Add logic of autoindex ( #19570 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-10-08 15:38:58 +08:00
yah01
e6c7286bee
Remove task timeout ( #19583 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-09-30 19:48:55 +08:00
SimFG
ccf30d358c
Revert the milvus.yaml
file ( #19568 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-29 21:53:31 +08:00
yanliang567
3e9376f951
Disable time travel, shorten growing segment lifetime ( #19520 )
...
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2022-09-29 19:42:55 +08:00
wayblink
54e2c079c4
MEP-30:Support basic coordinators active-standby mechanism #16901 ( #19166 )
...
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-09-29 18:35:02 +08:00
bigsheeper
5405dedd2e
Fix DDL rate limit unit, and improve log ( #19504 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-09-28 20:58:54 +08:00
yah01
9dcee37e1c
Skip canceled tasks ( #19513 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-09-28 19:58:54 +08:00