Commit Graph

440 Commits

Author SHA1 Message Date
zhenshan.cao
395d44e55a
[skip ci] Fix golint error in options.go (#9086)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-02 20:03:56 +08:00
dragondriver
1d5062b63a
[skip ci] Add desc comments for GetCPUUsage (#9066)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-02 12:07:56 +08:00
dragondriver
2e47e38b9d
[skip ci] Add desc comments for MetricsCacheManager (#9065)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-02 12:06:05 +08:00
Xiaofan
2c2b800ff4
Change Log Name with NodeId (#8721)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-01 08:52:50 +08:00
yukun
9303a6414d
Format rocksmq code (#8955)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-30 21:27:55 +08:00
yukun
c486007796
Rocksmq support SubscriptionPositionLatest (#8947)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-30 20:51:40 +08:00
congqixia
6bbf0a8f8f
Read datanode insertbuf from env (#8942)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-30 17:45:07 +08:00
dragondriver
3636ade689
Use runtime.CallersFrames to get more detailed stack information (#8868)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-29 22:02:00 +08:00
yukun
7094722fb0
Normalize rocksmq comment (#8886)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-29 20:54:00 +08:00
yukun
0edb2db331
Destroy write batch and write options in DeleteMessages (#8884)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-29 20:46:09 +08:00
congqixia
db944cd09c
Refactor flowgraph and related invocation (#8770)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-29 20:19:59 +08:00
yukun
e85cbea18d
Set CacheIndexAndFilterBlocks to true for rocksdb (#8851)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-29 18:45:59 +08:00
dragondriver
fa7e622f93
Fix trace wrapper StartSpanFromContext (#8826)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-29 14:22:00 +08:00
dragondriver
803d9ae8ca
Fix trace wrapper to catch the correct file name and line number (#8760)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-28 22:14:03 +08:00
yukun
1eb3168254
Unset max open files in rocksdb (#8799)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-28 21:20:03 +08:00
godchen
e236a1ccf9
[skip ci]Add retry comment (#8776)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-28 20:44:03 +08:00
congqixia
788844698e
Add implementation check for ConsumerMessage interface (#8781)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-28 19:24:04 +08:00
congqixia
01b4253a74
Fix mqconsumer data race (#8752)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-28 17:04:04 +08:00
ZhiShen
0e767f0e1b
Change cmake version (#8666)
Change cmake version from 3.16 to 3.18

1. Change the CMakeList's minimum require version.

2. Change the describtion document of cmake version.

Resolves: milvus-io#8407

Signed-off-by: Shen Zhi <m13120163046@163.com>
2021-09-28 14:00:03 +08:00
dragondriver
6065bb50c4
Fix golint warning of funcutil (#8652)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-27 23:18:02 +08:00
Xiaofan
93fc10f8a6
Remove channel&&common.yaml (#8716)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-27 22:32:02 +08:00
yukun
dcf1c27d66
Fix go lint in mqclient (#8685)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-27 20:32:13 +08:00
zhenshan.cao
b71bffe26f
Replace ChannelID with ShardName in DML Request (#8539)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-27 10:01:59 +08:00
Xiaofan
d38adda8c2
Rename log file based on node id (#8517)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-26 21:18:11 +08:00
godchen
d0074c3641
[skip ci]Fix trace comment (#8611)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-26 21:15:56 +08:00
godchen
5eb1a449d2
Make retry config private (#8613)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-26 20:13:58 +08:00
Xiaofan
31ec399edb
Move channel configuration from channel.yaml to milvus.yaml (#8420)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-26 19:46:17 +08:00
yukun
174c6275ca
golint rocksmq client (#8604)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-26 19:35:57 +08:00
yukun
c4c89a639a
Fix go lint in rocksmq (#8559)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-26 18:29:56 +08:00
congqixia
353eeab8b9
Add MessageID return value in producers (#8586)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-26 17:38:07 +08:00
yukun
075d6880a4
Fix rocksmq memleak (#8564)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-26 15:31:56 +08:00
groot
6168c0b9c7
Reduce go unittest time cost (#8555)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-26 12:42:14 +08:00
zhenshan.cao
54331f4aac
[skip ci] Add comments for utility function CompareIndexParams (#8525)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-24 22:05:55 +08:00
yukun
5e25041254
Add rocksmq comments (#8474)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-24 21:45:56 +08:00
jingkl
12fb8290b9
add log to produce.go (#8489)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-09-24 20:48:22 +08:00
dragondriver
82c28d225c
Fix golint warning of metrics info (#8501)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-24 20:35:56 +08:00
yukun
a8a0ae27ae
Add rocksmq client comments (#8475)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-24 16:05:55 +08:00
congqixia
a182326c60
Fix liveness check not quit after canceled (#8454)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-24 12:47:54 +08:00
dragondriver
208f32547f
[skip ci] Fix healthz router path (#8446)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-24 11:29:54 +08:00
Cai Yudong
74d5bb3eef
Update comments for indexparamcheck/utils.go (#8437)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-24 09:41:54 +08:00
zhenshan.cao
98c423480e
[skip ci] Add comments for indexparamcheck (#8436)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-23 22:37:54 +08:00
NotRyan
e3d3834243
Fix debug typos in sesion_util (#8020)
Signed-off-by: NotRyan <ryan.chan@zilliz.com>

Co-authored-by: NotRyan <ryan.chan@zilliz.com>
2021-09-23 21:54:03 +08:00
congqixia
da6d93527d
Add session liveness check (#8408)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-23 18:29:55 +08:00
yukun
f34e5205f7
Fix some memleak in rocksmq (#8405)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-23 17:21:54 +08:00
yukun
78e8e4aa22
Add rocksmq comments (#8362)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-23 16:59:54 +08:00
dragondriver
fb98f06de8
Expose simd type to index node metrics (#8300)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-23 11:29:54 +08:00
dragondriver
b3f6bd2088
Expose simd type to query node metrics (#8299)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-23 11:27:54 +08:00
yukun
9e17fdb598
Improve rocksmq codecov (#8328)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-22 20:16:04 +08:00
godchen
75672abab4
Add lease time (#8064)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-22 17:50:00 +08:00
yukun
06c9f03c59
Refactor rocksmq close logic and improve codecov (#8278)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-22 17:21:00 +08:00
dragondriver
85a6953330
Support healthz check api (#8228)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-22 16:18:21 +08:00
congqixia
bdfb8768d4
Enable gosec (#8202)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-18 14:45:50 +08:00
godchen
b3f965c7d4
Add unrecoverable error for retry. (#7828)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 10:49:51 +08:00
Cai Yudong
d10c6abc9e
Apply for msgstream from pool when creating collection (#7738)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-18 09:13:50 +08:00
godchen
9e1b4dcd6f
Make init private (#8104)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 16:29:51 +08:00
godchen
295ee49472
Add trace comment (#7994)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 11:17:57 +08:00
yukun
e0761271dd
[skip ci]Add rocksmq_retention comment (#8016)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-15 23:29:48 +08:00
godchen
863444cc45
Delete performance (#8000)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-15 20:29:48 +08:00
XuanYang-cn
ff8fef6ad0
Upgrade pulsar-client-go to 0.6.0 (#7909)
MessageID interface of pulsar-client-go adds
4 more methods. So I add these methods into
`MessageID` interface.

Resolves: #7770

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-15 18:13:49 +08:00
yukun
13f9b32452
Improve global_rmq code coverage (#7928)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-15 17:31:49 +08:00
groot
2398dafbca
Add unittest for distributed proxy (#7976)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-15 17:29:49 +08:00
congqixia
06d4faf771
Fix G109 from gosec, prevents overflow (#7896)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-14 18:35:48 +08:00
yukun
4bf3c6889c
Support bool field filter in search and query expression (#7814)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-14 16:15:47 +08:00
yukun
f1366b9451
Rename rocksmq unittests (#7846)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-14 09:55:00 +08:00
groot
c242b8bb25
Rename unittest for flowgraph (#7794)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-13 16:34:26 +08:00
groot
203010524d
Rename unittest for metricsinfo (#7795)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-13 16:33:27 +08:00
Cai Yudong
27dcf698d3
Support set segcore chunk_size via config file (#7635)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-11 14:40:01 +08:00
dragondriver
a872a4357c
Add more test cases for proxy implementation (#7685)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-11 11:36:22 +08:00
yukun
92295b77a1
Add DestroyTopic and DestroyConsumerGroup for CloseRocksMQ (#7730)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-10 20:54:01 +08:00
yukun
d60ea8bc21
Change prefix length to FixedChannelNameLen + 1 (#7717)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-10 17:42:10 +08:00
Cai Yudong
4e23ed9a18
Revert apply physical channels from pool (d5f7e358 and 3b960969) (#7687)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-10 13:00:00 +08:00
yukun
5a303e7672
Fix rocksmq load with prefix (#7678)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-10 10:22:01 +08:00
yukun
34228eb74b
Add topic lock for DestroyConsumerGroup (#7636)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-10 10:20:00 +08:00
dragondriver
596357dc85
Add more data definition test cases (#7623)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-09 19:02:08 +08:00
congqixia
8e814a2972
Make flowgraph Close only once (#7631)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-09 17:12:38 +08:00
zhenshan.cao
89358ad91e
Deep copy rocksdb data to byte slice (#7605)
Add unittest

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-09 10:56:00 +08:00
dragondriver
9b21b3b5fd
Initialize test framework of proxy (#7563)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-09 10:06:29 +08:00
godchen
3c2821e5e2
Add rmq consumer close (#7596)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-08 21:49:59 +08:00
groot
159d3702a0
Rename unittest for indexparamcheck (#7580)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-08 19:10:03 +08:00
groot
ae3a43cf37
Rename unittest for funcutil (#7581)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-08 16:53:30 +08:00
groot
618fef0a43
Add unittest for mqclient (#7578)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-08 16:52:35 +08:00
groot
58700dedbc
Update unittest name of distance (#7537)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-08 11:28:25 +08:00
yukun
fbc352263c
Improve rocksmq client code coverage (#7540)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-08 11:03:59 +08:00
groot
89815a64d7
Update unittest name of paramtable (#7526)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-07 15:20:40 +08:00
groot
1401ed516d
Add unittest for flowgraph (#7512) 2021-09-07 09:39:47 +08:00
dragondriver
42b687bf48
Add unittest for task scheduler (#7508)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-06 20:49:04 +08:00
yukun
7025a6e925
Improve rocksmq code coverage (#7483)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-06 19:36:42 +08:00
groot
af7b7537f0
Update unittest for calc_distance (#7488) 2021-09-06 11:35:02 +08:00
groot
ccfb350bd1
Unittest for funcutil (#7473)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-04 12:13:25 +08:00
Cai Yudong
5a16236768
Improve codecov for paramtable and typeutil (#7471)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-04 10:22:41 +08:00
dragondriver
960741ee16
Support more detailed metrics information (#7472)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-03 19:35:47 +08:00
dragondriver
1db573731b
Cache the system information metrics (#7436)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-03 17:15:26 +08:00
godchen
db8067d61c
Add trace ut (#7445)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-03 15:41:25 +08:00
groot
229965a9bb
Unittest for indexparamcheck (#7464)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-03 14:22:17 +08:00
Cai Yudong
7edd96989f
Improve codecov for paramtable and typeutil (#7451)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-02 22:18:10 +08:00
yukun
d5d73833b2
Add some logs in rocksmq retention (#7403)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-02 20:04:10 +08:00
dragondriver
3721cbfea1
Proxy metrics integrates with other coordinators (#7400)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-01 17:35:00 +08:00
yukun
71aa300499
Fix rocksmq retention panic when delete by message size (#7393)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-01 12:03:58 +08:00
dragondriver
89748ac639
Expose metrics of data cluster (#7177)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-01 10:13:15 +08:00
Cai Yudong
3b9609692b
Apply for msgstream from pool when creating collection (#7377)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-31 18:35:58 +08:00