Commit Graph

401 Commits

Author SHA1 Message Date
Cai Yudong
3e862ecdfb
Merge msgChannelConfig and knowhereConfig into commonConfig (#15843)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-04 11:17:56 +08:00
Nemo
cdcb3627b4
Make Etcd log level configurable. (#15737)
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-02-25 15:03:53 +08:00
shaoyue
83fdc1da7c
Add web server in proxy with sample handler (#15647)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-02-23 14:37:52 +08:00
JunSung Park
f6873d3dc1
Implement automatic item expiration on compaction (#14418)
* Implement automatic item expiration on compaction

Signed-off-by: JunSung Park <writtic@gmail.com>

* Change entityExpiration value comparison logic

Signed-off-by: JunSung Park <writtic@gmail.com>

* Add logging for the number of expired entity

Signed-off-by: JunSung Park <writtic@gmail.com>

* Set default value of CompactionEntityExpiration to off

Signed-off-by: JunSung Park <writtic@gmail.com>

* Fix errors for code checker

Signed-off-by: JunSung Park <writtic@gmail.com>

* Set default entityExpiration to max value

Signed-off-by: JunSung Park <writtic@gmail.com>
2022-02-07 22:45:46 +08:00
Cai Yudong
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-07 10:09:45 +08:00
Cai Yudong
4bccc85534
Use MsgChannelConfig in GlobalParams for all components (#15163)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-02 00:35:43 +08:00
xige-16
1cd2363bd8
Delete usless params SkipQueryChannelRecovery (#15289)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-21 21:43:40 +08:00
XuanYang-cn
e69e7de9c2
[skip e2e]Remove not in use config proxy msgStream insert and search (#14877)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-06 15:13:20 +08:00
XuanYang-cn
06ae5b19a3
Remove not inuse configs (#14836)
- segmentBinlgoSubPath
- collectionBinlogSubPath
- flushStreamPosSubPath
- statsStreamPosSubPath

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-06 14:49:20 +08:00
Cai Yudong
d01931d8d9
[skip e2e] Remove useless configuration rootcoord.timeout (#14852)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-05 19:05:25 +08:00
XuanYang-cn
c64ad70d43
[skip e2e]Correct comments for proxy config (#14855)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-05 15:31:20 +08:00
zhenshan.cao
32a5126705
Add the limitation of the traceable interval to timeTravel (#14498)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-29 21:29:45 +08:00
Cai Yudong
30382d8bf9
Let rootcoord share proxy.TimeTickInterval (#14326)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-27 21:38:45 +08:00
ThreadDao
1dd8d2f397
Enable auto compaction (#13086)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-12-10 14:41:14 +08:00
congqixia
aea5a61e9a
Add switch for auto compaction (#12974)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-08 19:47:05 +08:00
Bennu
cb4711425e
[skip ci] Add comment for milvus.yaml (#12759)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-08 15:02:09 +08:00
Bennu
d85240779f
[skip ci] Add comments for milvus.yaml (#12948)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-08 13:29:39 +08:00
Bennu
1d0847fb8a
[skip ci] Add comments for milvus.yaml (#12947)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-08 13:27:48 +08:00
XuanYang-cn
f1ac6e2092
Enable compaction in config.yaml (#12844)
Helm chart and python tests enabled compaction, yet
the milvus.yaml disabled. This caused local smoke tests
failure

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-07 19:35:13 +08:00
yanliang567
e464708556
[skip ci]Refine comments for milvus yaml (#12866)
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2021-12-07 14:45:45 +08:00
Bennu
4cd314d41c
[Skip ci] Add comments for milvus.yaml (#12842)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-07 14:14:08 +08:00
Bennu
86d3784277
[Skip ci] Add comments for milvus.yaml (#12841)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-07 14:08:12 +08:00
Bennu
bcef4a1711
[skip ci] Add comments for milvus.yaml (#12848)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-07 14:05:46 +08:00
Bennu
69902378cc
[skip ci] Add comment for milvus.yaml (#12760)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-06 18:05:32 +08:00
Bennu
519fb5d9a2
[skip ci] Add comment for milvus.yaml (#12758)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-06 18:02:50 +08:00
xige-16
7d723abdff
Start balanceLoop when Params.autoBalance equal to true (#12660)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-06 10:19:41 +08:00
Bennu
d1aeed2802
[skip ci] Add comments for milvus.yaml (#12676)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-03 13:34:06 +08:00
Bennu
d076f3629e
[skip ci] Add comments for milvus.yaml (#12675)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-03 13:32:12 +08:00
Bennu
864165689d
[skip ci] Add comments for milvus.yaml (#12674)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-03 13:30:16 +08:00
Bennu
d40f4a6c94
[skip ci] Add comment for milvus.yaml (#12610)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-02 18:19:33 +08:00
Bennu
856e2f4c9a
[skip ci] Add comment for milvus.yaml (#12609)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-02 18:17:37 +08:00
Bennu
db9387da0e
[skip ci] Add comment for milvus.yaml (#12608)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-02 18:15:44 +08:00
groot
22f04f90ff
Enlarge field number limitation (#12517)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-12-01 15:53:31 +08:00
Bennu
2ebe59e0b4
[skip ci] Add comment for milvus.yaml (#12510)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-01 13:17:31 +08:00
Bennu
b87756b54f
[skip ci] Add comment for milvus.yaml (#12508)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-01 13:15:35 +08:00
Bennu
da0088996b
[Skip ci] Add comments for milvus.yaml (#12429)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-01 13:09:49 +08:00
Bennu
191f6996f8
[Skip ci] Add comments for milvus.yaml (#12384)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-01 13:07:53 +08:00
Bennu
cbf877a5e2
[skip ci] Add comment for milvus.yaml (#12509)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-12-01 13:05:37 +08:00
Bennu
8ea9c00c8a
[Skip ci] Add comments for milvus.yaml (#12430)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-11-30 19:26:08 +08:00
groot
a4f11c9da5
Change proxy default rpc transfer limitation (#12351)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-11-30 15:44:19 +08:00
Bennu
aceb08a067
[Skip ci] Add comments for milvus.yaml (#12382)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-11-30 14:19:10 +08:00
Bennu
373290d351
[Skip ci] Add comments for milvus.yaml (#12381)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-11-30 14:17:12 +08:00
Bennu
f034f893c9
[Skip ci] Add comments for milvus.yaml (#12428)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-11-30 14:05:57 +08:00
congqixia
b99164f43d
Add datacoord GC configuration (#12061)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-18 22:29:40 +08:00
shaoyue
5b50731ff4
Fix searchResultBufFlags & queryResultBufFlags memory leak (#11585)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-16 14:13:12 +08:00
Bingyi Sun
b8c5239784
Add compaction retention config (#11793)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-16 11:47:10 +08:00
Xiaofan
3cd47cd89e
Remove common.yaml and component.yaml (#11662)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-12 18:53:11 +08:00
xige-16
d857577a7b
Postpone the execution of handoff until index creation is complete (#11648)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-12 18:49:10 +08:00
Bingyi Sun
002b854590
Move compaction and garbage switch to milvus.yaml (#11654)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-11 23:38:42 +08:00
yukun
f51ef71b51
Change default retentionSizeInMB to 8192(8GB) (#11436)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-11 17:18:43 +08:00
yanliang567
a5305a482e
[skip ci]Update milvus yaml config (#11361)
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2021-11-08 10:21:04 +08:00
yukun
8ec040a35c
Add rocksmqPageSize to config (#11113)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-08 10:17:18 +08:00
Bennu
dcf4cecea4
Add comments for milvus.yaml (#11268)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-11-06 14:32:56 +08:00
Xiaofan
d81b15163f
Seek Query/Query Result channel to Latest (#10985)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-05 14:57:44 +08:00
Bennu
9ece3b65e4
Add comments for milvus.yaml (#11269)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-11-04 19:19:21 +08:00
Bennu
bb16d14ba5
Add comments for milvus.yaml (#11267)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-11-04 19:17:30 +08:00
Cai Yudong
a2ad88237d
Add deltaChannels in rootcoord core (#11097)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 21:04:14 +08:00
Xiaofan
385eed1d17
Remove knowhere config (#10614)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-01 10:26:03 +08:00
Bennu
2c9776feaa
[skip ci] Add comments for milvus.yaml (#10825)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-10-28 20:22:59 +08:00
Bennu
997fed0ddd
[skip ci] Add comments for milvus.yaml (#10827)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-10-28 19:51:03 +08:00
xige-16
9ebabdac79
Add handoffTask (#10330)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-24 22:39:09 +08:00
bigsheeper
132f57f5b7
Set gracefulTime to 0 (#10114)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-21 10:55:12 +08:00
Bennu
b57d7a7508
[skip ci] Add comments for milvus.yaml (#10061)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-10-18 18:02:57 +08:00
Bennu
b9a904a1d3
[skip ci] Add comments for Milvus.yaml (#9565)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-10-12 08:20:33 +08:00
Bennu
e2638a3232
[skip ci] Add comments for Milvus.yaml (#9611)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-10-11 21:31:16 +08:00
Bennu
ab72753c4b
[skip ci] Add comments for Milvus.yaml (#9609)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-10-11 21:29:27 +08:00
Bennu
ce4e848663
Add comments for Milvus.yaml (#9553)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-10-11 21:21:47 +08:00
Bennu
24de3fa76d
Add comments for Milvus.yaml (#9555)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-10-11 21:19:40 +08:00
XuanYang-cn
8d8d53beeb
[skip ci]Change license on config files (#9642)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-11 21:15:00 +08:00
Bennu
8f3b8ed1da
[skip ci] Add comments for Milvus.yaml (#9610)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2021-10-11 16:28:05 +08:00
shiyu22
7caccd36ce
[skip ci]Update the comment of yaml to uppercase (#9502)
Signed-off-by: shiyu22 <shiyu.chen@zilliz.com>
2021-10-09 10:55:14 +08:00
bigsheeper
9d6c95bf25
Add cacheSize to prevent OOM in query node (#8765)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-28 22:24:03 +08:00
Xiaofan
31ec399edb
Move channel configuration from channel.yaml to milvus.yaml (#8420)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-26 19:46:17 +08:00
sunby
816bac82ec
Add root path in minio and replace etcd.rootPath in datanode (#8272)
issue: #7905
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-24 20:50:23 +08:00
shiyu22
8cc78b2a97
[skip ci] Add comments about minio in yaml (#8493)
Signed-off-by: shiyu22 <shiyu.chen@zilliz.com>
2021-09-24 18:40:13 +08:00
shiyu22
11de20c8e5
[skip ci] Add comments for etcd (#8366)
Signed-off-by: shiyu22 <shiyu.chen@zilliz.com>
2021-09-23 16:38:24 +08:00
shiyu22
51aa4f0254
Add comments with localStorage in yaml (#7892)
Signed-off-by: shiyu22 <shiyu.chen@zilliz.com>

Add comments with localStorage in yaml

Signed-off-by: shiyu22 <shiyu.chen@zilliz.com>
2021-09-22 19:23:59 +08:00
shiyu22
fc962d856a
Add comments to log in yaml (#7614)
Signed-off-by: shiyu22 <shiyu.chen@zilliz.com>
2021-09-09 18:48:02 +08:00
godchen
8cc24e09c9
Make users get vectors without using local storage (#7134)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-18 16:30:11 +08:00
yukun
847586eb95
Add rocksmq retention (#6617)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-08-16 18:46:10 +08:00
dragondriver
ad77a6e0d4
Fix #6859, increase the MaxCallRecvMsgSize and MaxCallSendMsgSize of grpc client (#6861)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-04 13:03:24 +08:00
godchen
346e9cba4a
Add minio FGet method (#6386)
* Add minio FGet method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change el append

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-09 11:44:40 +08:00
yukun
39614aa8eb
Add rocksmq_path in config and paramtable (#6099)
* Add rocksmq_path in config and paramtable

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add rocksdbPath in NewRmsFactory

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change rdb default path to /vat/lib/milvus/rdb_data

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-25 19:44:11 +08:00
Cai Yudong
7dbf33b788
Update component names in config files (#5989)
* rename master/indexService in .yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxyNode to proxy in config files

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move master.yaml to root_coord.yaml, move proxy_node.yaml to proxy.yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proto/query_service.proto to proto/query_coord.proto

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proxy_node_manager.go to proxy_manager.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add query_coord.pb.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 19:08:03 +08:00
xige-16
2af1c27811
Rename queryservice to querycoordinator (#5931)
* Rename queryservice to querycoordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix param table

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix unittest

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* service to coordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set querycoord in ci

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-22 16:44:09 +08:00
sunby
7f2d7c1da3
Rename dataservice to datacoordinator (#5912)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-21 18:22:13 +08:00
sunby
da1f9f9241
Rename dataservice to datacoordinator (#5904)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-21 11:40:15 +08:00
XuanYang-cn
ab7f642740
Add alias in paramtable (#5878)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-06-19 12:38:06 +08:00
yukun
e9a8d1c404
Add vChannels in proxy for query results (#5802)
* Fix proxynode for new retrieve logic

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Remove querynodenum from proxynode and querynode

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Remove QueryNodeIDList from proxy

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-16 20:15:59 +08:00
XuanYang-cn
75f2b3c2ba
Add Unittest for allocator (#5781)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-06-15 19:11:55 +08:00
Cai Yudong
0f4bd50ce3 Support ETCD endpoints array (#5755) 2021-06-15 16:36:36 +08:00
congqixia
ef7339ceda DataService stores flush msgstream pos at VChannel granularity (#5397)
SaveBinLogPaths saves stream positions at VChannel granularity

resolves #5396

Signed-off-by: Congqi Xia congqi.xia@zilliz.com
2021-06-15 15:54:57 +08:00
congqixia
4aa6a8fe18
Dataservice use lastest grpc design and saves ddl/dml pos pair (#5348)
Dataservice use lastest grpc design and saves ddl/dml pos pair

* Update SaveBinlogPaths grpc definition
* Saves segment ddl & dml flush pos pair(start, end)

See also #5220 

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-21 11:38:58 +00:00
congqixia
38f5b0826f
Add SaveBinlogPaths grpc in dataservice (#5277)
* Add SaveBinlogPaths grpc in dataservice

* fix merged compile error

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-20 11:34:45 +08:00
congqixia
d5ab8ac345
Restore flush and stats stream pos (#5284)
Restore segment flush stream & statistic stream to last success pos

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-19 06:13:53 +00:00
XuanYang-cn
cebdfb34f7
Enable multiple datanode (#5068)
Now it's able to start multiple datanode, however, they will process the same insert data.
Further changes are needed to truly enable multiple datanode:

While registering, dataservice need to return different insert channels for different datanode.

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-04-28 18:43:48 +08:00
bigsheeper
c4b379be8b
Set search graceful time from config (#5014)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-24 07:53:37 +00:00
XuanYang-cn
e281f6a4a1 Remove useless configs in config files
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-04-13 10:04:39 +08:00
zhenshan.cao
ab200e5598 Change querynode num to one
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-16 21:30:44 +08:00
dragondriver
af32f442bb Split big insert message into serveral smaller
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-09 16:18:58 +08:00
sunby
76480fcefe Change default log output to stdout
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-08 16:24:55 +08:00
dragondriver
801396e3ef Disable register link logic, use proxy node directly
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-04 22:27:12 +08:00
cai.zhang
1d899513dd Unify service name in config file
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-24 18:46:19 +08:00
zhenshan.cao
7c5e2d89f6 Read node port from config
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-23 18:08:17 +08:00
sunby
5769c000a1 Find failed python tests and add skip mark "r0.3-test"
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-19 15:37:04 +08:00
bigsheeper
d8f41db823 Fix search crash error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-19 13:56:01 +08:00
sunby
5b61182140 Add zap log
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-18 19:53:55 +08:00
xige-16
7c210310dc Add load function for query service
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-26 15:13:20 +08:00
XuanYang-cn
b445587e11 Add datanode main
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-26 14:46:54 +08:00
cai.zhang
f940cc455a Add dockerfile for index
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-26 09:38:40 +08:00
XuanYang-cn
9fe672ab86 Enchance datanode interface
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-24 21:20:11 +08:00
xige-16
511aa419fa Refactor query service
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-22 14:28:06 +08:00
dragondriver
cd52adc18b Add proxy service to ci workflow
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 12:57:23 +08:00
dragondriver
eba6bb288c Refactor the sructure of proto file
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 09:36:18 +08:00
neza2017
9828a52999 Add create index
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-21 10:01:29 +08:00
cai.zhang
83c60fd84f Update proto about index
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-21 15:20:23 +08:00
cai.zhang
fb493cc235 Update interface name of GetIndexStates
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-19 18:32:57 +08:00
XuanYang-cn
6a13386393 Add DataNode package
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-19 11:37:16 +08:00
quicksilver
7fe061b846 Raneme init_devcontainer.sh to devcontainer.sh
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-15 14:38:36 +08:00
neza2017
56ab2bda2d Update proto:add partition id
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-15 11:53:22 +08:00
zhenshan.cao
63b21321d6 Refactor indexservice and update doc
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-15 13:50:27 +08:00
bigsheeper
cb3ca1ab7c Refactor kvPath param and unify the segment flush kvPath in write node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-04 14:17:59 +08:00
bigsheeper
5b9e8c4f60 Add write node client segment flushing
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-28 15:25:16 +08:00
XuanYang-cn
e316533a3a Add Flush Sync service
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-26 16:28:55 +08:00
XuanYang-cn
7ce0f27ebc Add buffer to minIO for binlogs
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-23 18:06:04 +08:00
zhenshan.cao
3f6e926aef Refactor indexbuilder
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-13 06:48:05 +08:00
zhenshan.cao
fc054874d3 Add index_builder
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-10 17:55:55 +08:00
XuanYang-cn
32977e270c Add impl cgo of parquet
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-08 14:41:04 +08:00
zhenshan.cao
7bbbc14637 Fix bug: address already used
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-07 15:22:20 +08:00
xige-16
37d7526d31 Fix search test failure
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-07 14:37:42 +08:00
neza2017
aeca8f85a5 Run cwrapper unittest in ci
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-05 17:39:58 +08:00
cai.zhang
806a97505c Add query node for CI progress
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-05 16:12:45 +08:00
neza2017
70710dee47 Add parquet payload
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-05 16:11:03 +08:00
FluorineDog
6412ebc0d4 Add support of metric type in schema, enable binary vector, fix segfault
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-05 06:46:01 +08:00
zhenshan.cao
0b6fe0a8cf Refactor paramtable
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-04 14:18:17 +08:00
cai.zhang
85a544b79b Add dockerfile for each component
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-28 19:06:48 +08:00
cai.zhang
115d0732af Update docker-compose file for unittest
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-28 16:43:39 +08:00
dragondriver
eb6c0e0a28 Fix the bug when reduce the multiple search result from query nodes
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-28 15:57:49 +08:00
godchen
92bf09c7e6 Add ddstream and scheduler implements
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-28 15:26:39 +08:00
FluorineDog
c9fb34142c Enable primary_key switch
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-28 09:16:00 +08:00
XuanYang-cn
3e605ae25f Rename reader to querynode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-27 10:56:53 +08:00
bigsheeper
1decc1a4ca Add metaRootPath and kvRootPath
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-27 09:59:40 +08:00
dragondriver
72a7af3f4a Add time tick logic to Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-26 17:47:46 +08:00
neza2017
32445dd02b Add cpu profile
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-26 16:01:31 +08:00
cai.zhang
57da66ba72 Update read config logic in docker
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-26 15:18:36 +08:00
zhenshan.cao
045fc3d808 Fix segment fault
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-26 14:29:01 +08:00
XuanYang-cn
0a16a9a651 Add logic of getting milvus distributed config from master by grpc
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-26 13:21:06 +08:00
dragondriver
a7b3efecd7 Read query node num from param table instead of hardcode
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-25 16:17:33 +08:00
cai.zhang
4bcb460c98 Add clang-format
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-25 15:25:00 +08:00
sunby
24b29bec30 Add collectionName/partitionTag/fieldName validation.
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-25 14:44:30 +08:00
bigsheeper
dd3654f953 Fix query node param table
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-20 17:10:24 +08:00