test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-04 21:09:06 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
16,779 Commits 96 Branches 105 Tags 186 MiB
3febb5e45a
Commit Graph

274 Commits

Author SHA1 Message Date
congqixia
c88514bc49
Remove not used QueryChannel in Proxy and Query Cluster (#16856) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-05-30 19:50:04 +08:00
zhenshan.cao
2512e668f7
Update timestmap according to gracefultime for Bounded Consistency (#17171) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-05-24 12:05:59 +08:00
zhenshan.cao
08a4dff41d
Add logic for search merging and a simple task scheduler for read tasks (#17022) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
 2022-05-23 16:41:58 +08:00
zhenshan.cao
246b22b5ea
Configure indexSliceSize to 16MB (#17080) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-05-23 15:01:58 +08:00
ownbylichaobao
2f8a7e7793
Support tls/ssl connection to etcd (#7703) (#17012) 
Signed-off-by: lichaobao <1527563274@qq.com>
 2022-05-20 12:29:19 +08:00
Jiquan Long
99b4042f8c
Disable segment small index (#16935) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-05-18 15:27:56 +08:00
exia
4ee78eb5ad
proxy support tls (#16706) 
Signed-off-by: xiyichan <2863768433@qq.com>
 2022-05-10 20:05:53 +08:00
Enwei Jiao
67ce206cf0
make SegmentMaxLifetime configurable (#16783) 
Signed-off-by: Enwei Jiao <jiaoew2011@gmail.com>
 2022-05-06 23:41:51 +08:00
Ten Thousand Leaves
1acd256481
Add DataQueryable and DataIndexed states for bulk load tasks (#16725) 
issue: #16607

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-05-05 21:17:50 +08:00
Xiaofan
333b439a6c
Support config grpc log level (#16618) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-05-05 10:35:50 +08:00
shaoyue
fa97f86cda
Clean up not used id_cache related code (#16655) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-05-05 09:59:51 +08:00
Xiaofan
337ad53613
Support config small index nprobe and nlist (#16731) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-05-05 09:49:50 +08:00
shaoyue
2f49db9d3c
Implements remaining rest APIs (#16387) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-04-29 15:15:47 +08:00
Xiaofan
ed51ffd50f
Fix Compact Entity ttl param (#16665) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-04-28 11:51:47 +08:00
Ten Thousand Leaves
4855ba6fa3
Optimize Mac M1 support some tweaks to embedded Milvus (#16650) 
issue: #16500
issue: #16621

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-26 14:21:46 +08:00
Ten Thousand Leaves
14724013ba
[skip e2e]Update config for embedded Milvus (#16614) 
issue: #15711

/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-25 14:17:45 +08:00
codeman
f5e1ded854
fix #16504 (#16523) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-19 16:35:39 +08:00
jaime
ed3c29eae7
Support Kafka (#16149) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-04-12 19:47:33 +08:00
Cai Yudong
71cd7ba67a
Add configuration common.indexSliceSize (#16438) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-04-08 20:29:33 +08:00
godchen
bb7a0766fe
Add dependency factory (#16204) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-04-07 22:05:32 +08:00
Ten Thousand Leaves
2bd0a9526a
Implement task expiring logic and make all deadlines configurable. (#16355) 
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-03 11:37:29 +08:00
godchen
478f6ca11e
Add cache for vector chunk (#15912) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-03-26 22:05:26 +08:00
Ten Thousand Leaves
d5bae6710f
Make all logs configurable for standalone/embedded Milvus. (#15926) 
Resolves: #15919, #15708
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-03-10 10:35:59 +08:00
Cai Yudong
3e862ecdfb
Merge msgChannelConfig and knowhereConfig into commonConfig (#15843) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-04 11:17:56 +08:00
Nemo
cdcb3627b4
Make Etcd log level configurable. (#15737) 
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-02-25 15:03:53 +08:00
shaoyue
83fdc1da7c
Add web server in proxy with sample handler (#15647) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-02-23 14:37:52 +08:00
JunSung Park
f6873d3dc1
Implement automatic item expiration on compaction (#14418) 
* Implement automatic item expiration on compaction

Signed-off-by: JunSung Park <writtic@gmail.com>

* Change entityExpiration value comparison logic

Signed-off-by: JunSung Park <writtic@gmail.com>

* Add logging for the number of expired entity

Signed-off-by: JunSung Park <writtic@gmail.com>

* Set default value of CompactionEntityExpiration to off

Signed-off-by: JunSung Park <writtic@gmail.com>

* Fix errors for code checker

Signed-off-by: JunSung Park <writtic@gmail.com>

* Set default entityExpiration to max value

Signed-off-by: JunSung Park <writtic@gmail.com>
 2022-02-07 22:45:46 +08:00
Cai Yudong
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-07 10:09:45 +08:00
Cai Yudong
4bccc85534
Use MsgChannelConfig in GlobalParams for all components (#15163) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-02 00:35:43 +08:00
xige-16
1cd2363bd8
Delete usless params SkipQueryChannelRecovery (#15289) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-21 21:43:40 +08:00
XuanYang-cn
e69e7de9c2
[skip e2e]Remove not in use config proxy msgStream insert and search (#14877) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-06 15:13:20 +08:00
XuanYang-cn
06ae5b19a3
Remove not inuse configs (#14836) 
- segmentBinlgoSubPath
- collectionBinlogSubPath
- flushStreamPosSubPath
- statsStreamPosSubPath

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-06 14:49:20 +08:00
Cai Yudong
d01931d8d9
[skip e2e] Remove useless configuration rootcoord.timeout (#14852) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-05 19:05:25 +08:00
XuanYang-cn
c64ad70d43
[skip e2e]Correct comments for proxy config (#14855) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-05 15:31:20 +08:00
zhenshan.cao
32a5126705
Add the limitation of the traceable interval to timeTravel (#14498) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-12-29 21:29:45 +08:00
Cai Yudong
30382d8bf9
Let rootcoord share proxy.TimeTickInterval (#14326) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-27 21:38:45 +08:00
ThreadDao
1dd8d2f397
Enable auto compaction (#13086) 
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2021-12-10 14:41:14 +08:00
congqixia
aea5a61e9a
Add switch for auto compaction (#12974) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-08 19:47:05 +08:00
Bennu
cb4711425e
[skip ci] Add comment for milvus.yaml (#12759) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-08 15:02:09 +08:00
Bennu
d85240779f
[skip ci] Add comments for milvus.yaml (#12948) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-08 13:29:39 +08:00
Bennu
1d0847fb8a
[skip ci] Add comments for milvus.yaml (#12947) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-08 13:27:48 +08:00
XuanYang-cn
f1ac6e2092
Enable compaction in config.yaml (#12844) 
Helm chart and python tests enabled compaction, yet
the milvus.yaml disabled. This caused local smoke tests
failure

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-07 19:35:13 +08:00
yanliang567
e464708556
[skip ci]Refine comments for milvus yaml (#12866) 
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2021-12-07 14:45:45 +08:00
Bennu
4cd314d41c
[Skip ci] Add comments for milvus.yaml (#12842) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-07 14:14:08 +08:00
Bennu
86d3784277
[Skip ci] Add comments for milvus.yaml (#12841) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-07 14:08:12 +08:00
Bennu
bcef4a1711
[skip ci] Add comments for milvus.yaml (#12848) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-07 14:05:46 +08:00
Bennu
69902378cc
[skip ci] Add comment for milvus.yaml (#12760) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-06 18:05:32 +08:00
Bennu
519fb5d9a2
[skip ci] Add comment for milvus.yaml (#12758) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-06 18:02:50 +08:00
xige-16
7d723abdff
Start balanceLoop when Params.autoBalance equal to true (#12660) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-06 10:19:41 +08:00
Bennu
d1aeed2802
[skip ci] Add comments for milvus.yaml (#12676) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-03 13:34:06 +08:00
Bennu
d076f3629e
[skip ci] Add comments for milvus.yaml (#12675) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-03 13:32:12 +08:00
Bennu
864165689d
[skip ci] Add comments for milvus.yaml (#12674) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-03 13:30:16 +08:00
Bennu
d40f4a6c94
[skip ci] Add comment for milvus.yaml (#12610) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-02 18:19:33 +08:00
Bennu
856e2f4c9a
[skip ci] Add comment for milvus.yaml (#12609) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-02 18:17:37 +08:00
Bennu
db9387da0e
[skip ci] Add comment for milvus.yaml (#12608) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-02 18:15:44 +08:00
groot
22f04f90ff
Enlarge field number limitation (#12517) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-12-01 15:53:31 +08:00
Bennu
2ebe59e0b4
[skip ci] Add comment for milvus.yaml (#12510) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-01 13:17:31 +08:00
Bennu
b87756b54f
[skip ci] Add comment for milvus.yaml (#12508) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-01 13:15:35 +08:00
Bennu
da0088996b
[Skip ci] Add comments for milvus.yaml (#12429) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-01 13:09:49 +08:00
Bennu
191f6996f8
[Skip ci] Add comments for milvus.yaml (#12384) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-01 13:07:53 +08:00
Bennu
cbf877a5e2
[skip ci] Add comment for milvus.yaml (#12509) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-01 13:05:37 +08:00
Bennu
8ea9c00c8a
[Skip ci] Add comments for milvus.yaml (#12430) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-11-30 19:26:08 +08:00
groot
a4f11c9da5
Change proxy default rpc transfer limitation (#12351) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-11-30 15:44:19 +08:00
Bennu
aceb08a067
[Skip ci] Add comments for milvus.yaml (#12382) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-11-30 14:19:10 +08:00
Bennu
373290d351
[Skip ci] Add comments for milvus.yaml (#12381) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-11-30 14:17:12 +08:00
Bennu
f034f893c9
[Skip ci] Add comments for milvus.yaml (#12428) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-11-30 14:05:57 +08:00
congqixia
b99164f43d
Add datacoord GC configuration (#12061) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-18 22:29:40 +08:00
shaoyue
5b50731ff4
Fix searchResultBufFlags & queryResultBufFlags memory leak (#11585) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-16 14:13:12 +08:00
Bingyi Sun
b8c5239784
Add compaction retention config (#11793) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-16 11:47:10 +08:00
Xiaofan
3cd47cd89e
Remove common.yaml and component.yaml (#11662) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-12 18:53:11 +08:00
xige-16
d857577a7b
Postpone the execution of handoff until index creation is complete (#11648) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-12 18:49:10 +08:00
Bingyi Sun
002b854590
Move compaction and garbage switch to milvus.yaml (#11654) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-11 23:38:42 +08:00
yukun
f51ef71b51
Change default retentionSizeInMB to 8192(8GB) (#11436) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-11 17:18:43 +08:00
yanliang567
a5305a482e
[skip ci]Update milvus yaml config (#11361) 
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2021-11-08 10:21:04 +08:00
yukun
8ec040a35c
Add rocksmqPageSize to config (#11113) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-08 10:17:18 +08:00
Bennu
dcf4cecea4
Add comments for milvus.yaml (#11268) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-11-06 14:32:56 +08:00
Xiaofan
d81b15163f
Seek Query/Query Result channel to Latest (#10985) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-05 14:57:44 +08:00
Bennu
9ece3b65e4
Add comments for milvus.yaml (#11269) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-11-04 19:19:21 +08:00
Bennu
bb16d14ba5
Add comments for milvus.yaml (#11267) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-11-04 19:17:30 +08:00
Cai Yudong
a2ad88237d
Add deltaChannels in rootcoord core (#11097) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-03 21:04:14 +08:00
Xiaofan
385eed1d17
Remove knowhere config (#10614) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-01 10:26:03 +08:00
Bennu
2c9776feaa
[skip ci] Add comments for milvus.yaml (#10825) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-10-28 20:22:59 +08:00
Bennu
997fed0ddd
[skip ci] Add comments for milvus.yaml (#10827) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-10-28 19:51:03 +08:00
xige-16
9ebabdac79
Add handoffTask (#10330) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-10-24 22:39:09 +08:00
bigsheeper
132f57f5b7
Set gracefulTime to 0 (#10114) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-10-21 10:55:12 +08:00
Bennu
b57d7a7508
[skip ci] Add comments for milvus.yaml (#10061) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-10-18 18:02:57 +08:00
Bennu
b9a904a1d3
[skip ci] Add comments for Milvus.yaml (#9565) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-10-12 08:20:33 +08:00
Bennu
e2638a3232
[skip ci] Add comments for Milvus.yaml (#9611) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-10-11 21:31:16 +08:00
Bennu
ab72753c4b
[skip ci] Add comments for Milvus.yaml (#9609) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-10-11 21:29:27 +08:00
Bennu
ce4e848663
Add comments for Milvus.yaml (#9553) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-10-11 21:21:47 +08:00
Bennu
24de3fa76d
Add comments for Milvus.yaml (#9555) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-10-11 21:19:40 +08:00
XuanYang-cn
8d8d53beeb
[skip ci]Change license on config files (#9642) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-11 21:15:00 +08:00
Bennu
8f3b8ed1da
[skip ci] Add comments for Milvus.yaml (#9610) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-10-11 16:28:05 +08:00
shiyu22
7caccd36ce
[skip ci]Update the comment of yaml to uppercase (#9502) 
Signed-off-by: shiyu22 <shiyu.chen@zilliz.com>
 2021-10-09 10:55:14 +08:00
bigsheeper
9d6c95bf25
Add cacheSize to prevent OOM in query node (#8765) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-28 22:24:03 +08:00
Xiaofan
31ec399edb
Move channel configuration from channel.yaml to milvus.yaml (#8420) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-26 19:46:17 +08:00
sunby
816bac82ec
Add root path in minio and replace etcd.rootPath in datanode (#8272) 
issue: #7905
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-24 20:50:23 +08:00
shiyu22
8cc78b2a97
[skip ci] Add comments about minio in yaml (#8493) 
Signed-off-by: shiyu22 <shiyu.chen@zilliz.com>
 2021-09-24 18:40:13 +08:00
shiyu22
11de20c8e5
[skip ci] Add comments for etcd (#8366) 
Signed-off-by: shiyu22 <shiyu.chen@zilliz.com>
 2021-09-23 16:38:24 +08:00
shiyu22
51aa4f0254
Add comments with localStorage in yaml (#7892) 
Signed-off-by: shiyu22 <shiyu.chen@zilliz.com>

Add comments with localStorage in yaml

Signed-off-by: shiyu22 <shiyu.chen@zilliz.com>
 2021-09-22 19:23:59 +08:00
shiyu22
fc962d856a
Add comments to log in yaml (#7614) 
Signed-off-by: shiyu22 <shiyu.chen@zilliz.com>
 2021-09-09 18:48:02 +08:00
godchen
8cc24e09c9
Make users get vectors without using local storage (#7134) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-08-18 16:30:11 +08:00
yukun
847586eb95
Add rocksmq retention (#6617) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-08-16 18:46:10 +08:00
dragondriver
ad77a6e0d4
Fix #6859, increase the MaxCallRecvMsgSize and MaxCallSendMsgSize of grpc client (#6861) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-04 13:03:24 +08:00
godchen
346e9cba4a
Add minio FGet method (#6386) 
* Add minio FGet method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change el append

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-07-09 11:44:40 +08:00
yukun
39614aa8eb
Add rocksmq_path in config and paramtable (#6099) 
* Add rocksmq_path in config and paramtable

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add rocksdbPath in NewRmsFactory

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change rdb default path to /vat/lib/milvus/rdb_data

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-25 19:44:11 +08:00
Cai Yudong
7dbf33b788
Update component names in config files (#5989) 
* rename master/indexService in .yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxyNode to proxy in config files

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move master.yaml to root_coord.yaml, move proxy_node.yaml to proxy.yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proto/query_service.proto to proto/query_coord.proto

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proxy_node_manager.go to proxy_manager.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add query_coord.pb.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 19:08:03 +08:00
xige-16
2af1c27811
Rename queryservice to querycoordinator (#5931) 
* Rename queryservice to querycoordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix param table

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix unittest

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* service to coordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set querycoord in ci

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-22 16:44:09 +08:00
sunby
7f2d7c1da3
Rename dataservice to datacoordinator (#5912) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-21 18:22:13 +08:00
sunby
da1f9f9241
Rename dataservice to datacoordinator (#5904) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-21 11:40:15 +08:00
XuanYang-cn
ab7f642740
Add alias in paramtable (#5878) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-06-19 12:38:06 +08:00
yukun
e9a8d1c404
Add vChannels in proxy for query results (#5802) 
* Fix proxynode for new retrieve logic

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Remove querynodenum from proxynode and querynode

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Remove QueryNodeIDList from proxy

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-16 20:15:59 +08:00
XuanYang-cn
75f2b3c2ba
Add Unittest for allocator (#5781) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-06-15 19:11:55 +08:00
Cai Yudong
0f4bd50ce3 Support ETCD endpoints array (#5755) 2021-06-15 16:36:36 +08:00
congqixia
ef7339ceda DataService stores flush msgstream pos at VChannel granularity (#5397) 
SaveBinLogPaths saves stream positions at VChannel granularity

resolves #5396

Signed-off-by: Congqi Xia congqi.xia@zilliz.com
 2021-06-15 15:54:57 +08:00
congqixia
4aa6a8fe18
Dataservice use lastest grpc design and saves ddl/dml pos pair (#5348) 
Dataservice use lastest grpc design and saves ddl/dml pos pair

* Update SaveBinlogPaths grpc definition
* Saves segment ddl & dml flush pos pair(start, end)

See also #5220 

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-05-21 11:38:58 +00:00
congqixia
38f5b0826f
Add SaveBinlogPaths grpc in dataservice (#5277) 
* Add SaveBinlogPaths grpc in dataservice

* fix merged compile error

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-05-20 11:34:45 +08:00
congqixia
d5ab8ac345
Restore flush and stats stream pos (#5284) 
Restore segment flush stream & statistic stream to last success pos

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-05-19 06:13:53 +00:00
XuanYang-cn
cebdfb34f7
Enable multiple datanode (#5068) 
Now it's able to start multiple datanode, however, they will process the same insert data.
Further changes are needed to truly enable multiple datanode:

While registering, dataservice need to return different insert channels for different datanode.

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-04-28 18:43:48 +08:00
bigsheeper
c4b379be8b
Set search graceful time from config (#5014) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-04-24 07:53:37 +00:00
XuanYang-cn
e281f6a4a1 Remove useless configs in config files 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-04-13 10:04:39 +08:00
zhenshan.cao
ab200e5598 Change querynode num to one 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-03-16 21:30:44 +08:00
dragondriver
af32f442bb Split big insert message into serveral smaller 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-03-09 16:18:58 +08:00
sunby
76480fcefe Change default log output to stdout 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-03-08 16:24:55 +08:00
dragondriver
801396e3ef Disable register link logic, use proxy node directly 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-03-04 22:27:12 +08:00
cai.zhang
1d899513dd Unify service name in config file 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-02-24 18:46:19 +08:00
zhenshan.cao
7c5e2d89f6 Read node port from config 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-02-23 18:08:17 +08:00
sunby
5769c000a1 Find failed python tests and add skip mark "r0.3-test" 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-02-19 15:37:04 +08:00
bigsheeper
d8f41db823 Fix search crash error 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-02-19 13:56:01 +08:00
sunby
5b61182140 Add zap log 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-02-18 19:53:55 +08:00
xige-16
7c210310dc Add load function for query service 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-01-26 15:13:20 +08:00
XuanYang-cn
b445587e11 Add datanode main 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-26 14:46:54 +08:00
cai.zhang
f940cc455a Add dockerfile for index 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-26 09:38:40 +08:00
XuanYang-cn
9fe672ab86 Enchance datanode interface 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-24 21:20:11 +08:00
xige-16
511aa419fa Refactor query service 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-01-22 14:28:06 +08:00
dragondriver
cd52adc18b Add proxy service to ci workflow 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-22 12:57:23 +08:00
dragondriver
eba6bb288c Refactor the sructure of proto file 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-22 09:36:18 +08:00
neza2017
9828a52999 Add create index 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-21 10:01:29 +08:00
cai.zhang
83c60fd84f Update proto about index 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-21 15:20:23 +08:00
cai.zhang
fb493cc235 Update interface name of GetIndexStates 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-19 18:32:57 +08:00
XuanYang-cn
6a13386393 Add DataNode package 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-19 11:37:16 +08:00
quicksilver
7fe061b846 Raneme init_devcontainer.sh to devcontainer.sh 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-15 14:38:36 +08:00
neza2017
56ab2bda2d Update proto:add partition id 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-15 11:53:22 +08:00
zhenshan.cao
63b21321d6 Refactor indexservice and update doc 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-15 13:50:27 +08:00
bigsheeper
cb3ca1ab7c Refactor kvPath param and unify the segment flush kvPath in write node 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-04 14:17:59 +08:00
bigsheeper
5b9e8c4f60 Add write node client segment flushing 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-12-28 15:25:16 +08:00
XuanYang-cn
e316533a3a Add Flush Sync service 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-12-26 16:28:55 +08:00
XuanYang-cn
7ce0f27ebc Add buffer to minIO for binlogs 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-12-23 18:06:04 +08:00
zhenshan.cao
3f6e926aef Refactor indexbuilder 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-13 06:48:05 +08:00
zhenshan.cao
fc054874d3 Add index_builder 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-10 17:55:55 +08:00