Commit Graph

234 Commits

Author SHA1 Message Date
groot
33776cdabb
[skip ci] Fix scripts/README (#9061)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-02 11:20:05 +08:00
groot
d51d8ce39b
[skip ci] Comment for go coverage script (#9060)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-02 11:18:13 +08:00
groot
9cd291d2a6
[skip ci] Macro for go coverage script (#8999)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-01 20:28:33 +08:00
groot
5d4c59d3c4
[skip ci] Print out cpp coverage report path (#8998)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-01 12:26:10 +08:00
BUPTAnderson
f918fe18c1
Fix compile protocol buffer files error (#8045) (#8833)
Signed-off-by: BUPTAnderson <yunlongkong@126.com>
2021-09-29 20:44:09 +08:00
groot
7aa210f595
[skip ci] Update script comment (#8857)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-29 17:36:01 +08:00
groot
b62b13040b
[skip ci] Update script comment (#8859)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-29 17:20:00 +08:00
groot
bfec8269a1
[skip ci] Update script comment (#8858)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-29 17:18:01 +08:00
ZhiShen
0e767f0e1b
Change cmake version (#8666)
Change cmake version from 3.16 to 3.18

1. Change the CMakeList's minimum require version.

2. Change the describtion document of cmake version.

Resolves: milvus-io#8407

Signed-off-by: Shen Zhi <m13120163046@163.com>
2021-09-28 14:00:03 +08:00
groot
69d683c693
Update codecov api to v2 (#8471)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-24 16:41:55 +08:00
Jael Gu
c412fd76b6
[skip ci]Fix typo for scripts/README (#8455)
Signed-off-by: Jael Gu <mengjia.gu@zilliz.com>
2021-09-24 16:10:30 +08:00
Xiangyu Wang
43ad33ecea
Support to get nproc on macOS in the compilation (#8281)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-22 17:09:53 +08:00
groot
77e88144fc
Update code coverage script (#8280)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-22 16:01:53 +08:00
groot
334297b49d
[skip ci] Update OWNERS files (#8211)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-18 15:30:37 +08:00
groot
cd0ca6727a
[skip ci] Update cpp codecov script (#8158)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-17 18:21:52 +08:00
groot
2a528e31d0
[skip ci] script typo (#7966)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-15 16:47:48 +08:00
groot
f12fa50f6f
Prepare for cpp codecoverage (#7900)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-14 19:05:52 +08:00
edward.zeng
b37f33cb61
Add daily release (#7626)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-09-09 16:05:56 +08:00
wt
780a4d2c8e
Update script of run_go_codecov (#7248)
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2021-08-23 22:01:51 +08:00
Xiangyu Wang
5e78fd6a97
[skip ci]Update approvers (#7063)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-08-12 19:36:09 +08:00
quicksilver
9322cf7484
[skip ci] Update DEVELOPMENT.md for compile on CentOS (#6407)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-09 16:24:39 +08:00
quicksilver
da628863bc
Update main.yaml for Github Action (#6381)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-09 11:59:09 +08:00
quicksilver
7d920e9c9c
Fix compile error on CentOS (#6359)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-08 15:43:45 +08:00
quicksilver
2834c8532f
[skip ci] Update README.md and DEVELOPMENT.md (#6173)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-28 16:30:17 +08:00
Cai Yudong
a09a3a1905
rename service to coord (#6020)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-23 16:14:08 +08:00
Cai Yudong
7dbf33b788
Update component names in config files (#5989)
* rename master/indexService in .yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxyNode to proxy in config files

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move master.yaml to root_coord.yaml, move proxy_node.yaml to proxy.yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proto/query_service.proto to proto/query_coord.proto

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proxy_node_manager.go to proxy_manager.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add query_coord.pb.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 19:08:03 +08:00
xige-16
2af1c27811
Rename queryservice to querycoordinator (#5931)
* Rename queryservice to querycoordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix param table

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix unittest

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* service to coordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set querycoord in ci

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-22 16:44:09 +08:00
Cai Yudong
d5f4ee6f44
Rename proto master/index_service/proxy_service (#5973)
* rename proto proxy_service to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proto index_service to index_coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proto master to root_coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 16:14:09 +08:00
sunby
c863a193de
Rename filename from dataservice to datacoordinator (#5946)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-22 10:42:07 +08:00
Cai Yudong
92e429d812
Rename IndexService to IndexCoord (#5932)
* rename package indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix queryservice static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/indexservice to distributed/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/indexservice to internal/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename MasterComponent to RootCoordComponent

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for queryservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for dataservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for datanode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for proxynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for querynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix rebase issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-21 17:28:03 +08:00
quicksilver
d13cf2da2f
Cache cpp thirdparty package (#5891)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-19 13:28:07 +08:00
Cai Yudong
5a1f7e4feb
rename masterservice to rootcoord (#5875)
* rename masterservice to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix build error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename package

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename masterservice to rootcoord under distributed

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update scripts

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* enable more unittests

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-18 21:30:08 +08:00
bigsheeper
710ac1a4f1
remove query node id env dependency and fix start script (#5874)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-18 19:00:15 +08:00
zhenshan.cao
f74ea3beee [skip ci] Remove ProxyService (#5738)
* [skip ci] Remove ProxyService

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Change helm branch

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fix bug: paramstable crashed

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-15 16:36:35 +08:00
FluorineDog
bec9f2c182
Split segcore and plan proto for future feature (#5767)
* Split segcore and plan proto for future feature

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* lint

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-15 14:43:57 +08:00
zhenshan.cao
b0b8f58192
Fix bug: search timeout (#5557)
* Fix bug: search timeout

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Add log and fix unittest bug

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-03 14:58:34 +08:00
quicksilver
cc517570ab
Load variables into shell scripts (#5518)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-01 14:52:31 +08:00
quicksilver
9e91860ae9
Fix install dependencies scripts file bug (#5511)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-31 16:33:30 +08:00
Xiangyu Wang
ca0993c274 Update OWNERS
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-30 18:58:47 +08:00
yukun
c63524deb9
Add dablooms (#5440)
* Add dablooms cwrapper

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix undefined reference bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add cwrapper_dablooms_build shell script

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-28 10:23:30 +08:00
quicksilver
6204e4546a
Update devcontainer.sh (#5351)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-22 01:20:41 +00:00
godchen
ccc0130bb4
Add exclusive parameter (#5278)
Add exclusive parameter.
Issue #5174 

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-18 11:07:27 +00:00
godchen
cca75583a6
Add session util (#5269)
Add session util.
Issue #5174 

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-18 03:39:21 +00:00
FluorineDog
88f5642603
Add plan proto and support basic boolean expr parser (#5088)
**What type of PR is this?**
- [x] Feature

**What this PR does / why we need it:**
This PR supports boolean expression as DSL.
1. The goal of this PR is to support predicates
    like `A > 3 && not B < 5 or C in [1, 2, 3]`. 
2. Defines `plan.proto`, as Intermediate Representation (IR) 
    used between go and cpp. 
3. Support expr parser, convert predicate expr to IR
    in proxynode, while doing static check there
4. Support IR to AST in cpp, enable the execution
2021-04-29 08:48:06 +00:00
quicksilver
136cd7a704
Run KinD Inside A Kubernetes Cluster For Continuous Integration (#5085)
**What type of PR is this?**

- [x] Improvement

**Which issue(s) this PR fixes:**

Fixes #5038

**What this PR does / why we need it:**

Run KinD Inside A Kubernetes Cluster For Continuous Integration
2021-04-29 08:45:17 +00:00
quicksilver
eb338d4620
Provide install dependencies for Ubuntu and CentOS (#5076)
* Provide install dependencies for Ubuntu and CentOS

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update scripts/install_deps.sh

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-04-28 14:46:18 +08:00
quicksilver
3b529f3b5d
Update milvus project name (#5032)
* Update milvus project name
2021-04-26 13:59:28 +08:00
Xiangyu Wang
746fc556a0
[skip ci]Add go code coverage (#5024)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-24 15:10:24 +08:00
cai.zhang
a54097708d Adjust the DropIndex logic of the indexservice
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-04-16 15:37:13 +08:00
godchen
f3649f0419 Refactor interface and proto
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-12 14:22:09 +08:00
quicksilver
e30b18a8f1 Add publish test images workflows
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-08 19:32:46 +08:00
neza2017
2835bcdc4e Update masterservice unittest
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-05 20:41:34 +08:00
zhenshan.cao
007e7ea858 Add tso unittest and EnableMaxLogic
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-26 13:05:52 +08:00
quicksilver
e3e68f7fef Add build option in devcontainer.sh
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-02-26 11:37:03 +08:00
quicksilver
c249137757 Optimize the workflow for build Devcontainer
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-02-25 19:22:21 +08:00
neza2017
c36c532c70 Remove unused test code
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-02-25 19:12:40 +08:00
zhenshan.cao
bbfcbbdd68 Fix ci: paramstable and startup logic refactor
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-23 11:40:30 +08:00
cai.zhang
4c5a898e9a Add masterservice docker
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-20 11:15:19 +08:00
zhenshan.cao
2c9e226703 Add log for segment logic in proxy
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-07 16:44:11 +08:00
dragondriver
7e1887da12 Add start.sh and stop.sh, remove them later
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-05 14:31:40 +08:00
neza2017
854accf95b Remove master and writenode
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-30 16:41:47 +08:00
Xiangyu Wang
99cef4b5c8 Add Distributed main entrypoint
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-29 17:08:31 +08:00
bigsheeper
73d2b6a101 Get index param from minio and filter by vector fields
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-29 15:22:24 +08:00
neza2017
bdf84f08ab Add watcher_test and fix some bugs
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-29 14:40:19 +08:00
sunby
f088467dde Add watcher_test and fix some bugs
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-28 10:14:31 +08:00
XuanYang-cn
b597a637f3 Add datanode metatable tests
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-29 12:03:10 +08:00
zhenshan.cao
ee0faddb07 Refactor proxy
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-29 09:27:26 +08:00
dragondriver
c6a6b1436c Add soft time tick in proxy service
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-26 13:41:41 +08:00
XuanYang-cn
b794921b7e Add enum Role in internal.proto
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-23 18:56:08 +08:00
neza2017
e2b45f9866 Init param table and open unittest at ci
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-23 17:56:57 +08:00
dragondriver
eba6bb288c Refactor the sructure of proto file
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 09:36:18 +08:00
xige-16
d22c2cd203 Add proto for query service loading collection
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-18 19:32:08 +08:00
xige-16
0164e78bb5 Add query service module
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-16 15:31:10 +08:00
zhenshan.cao
bfe720bfec Update doc
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-15 18:03:16 +08:00
godchen
0971cf65b2 Remove opentracing stdlog
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-15 15:28:27 +08:00
quicksilver
7fe061b846 Raneme init_devcontainer.sh to devcontainer.sh
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-15 14:38:36 +08:00
neza2017
56ab2bda2d Update proto:add partition id
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-15 11:53:22 +08:00
zhenshan.cao
63b21321d6 Refactor indexservice and update doc
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-15 13:50:27 +08:00
XuanYang-cn
fb63983eb2 Modify rocksdb compilation
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-14 15:12:08 +08:00
yukun
6e36f10a26 Fix rocksdb illegal instruction in some machine
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-14 14:24:14 +08:00
FluorineDog
63ca5f8031 Add span and segment interface, rename segment_growing and use interface as base
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-01-13 18:46:25 +08:00
GuoRentong
1104f059ee Update doc:module interfaces
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-13 11:08:03 +08:00
quicksilver
8e9d8e36e1 Update run_go_unittest.sh
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-13 10:40:46 +08:00
bigsheeper
2d2af1505a Improve mutex usage in query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-12 18:03:24 +08:00
GuoRentong
f3d2afa4f4 Update doc:detailed interface definition
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-11 18:35:54 +08:00
quicksilver
a6690dbc99 Fix syntax error: Bad fd number
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-11 15:25:19 +08:00
yukun
18cfd31d40 Fix Load and Remove with prefix
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-11 15:17:06 +08:00
quicksilver
0c2f40f580 Archive milvus distributed server logs in Jenkins CI
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-10 12:10:11 +08:00
zhenshan.cao
02df310fa5 Fix data race
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-09 12:30:22 +08:00
sunby
5dfe9448ae Modify test_index
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-08 16:00:16 +08:00
yukun
d11f00cd9f Add rocksdb in kv
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-08 19:07:57 +08:00
GuoRentong
82ad488555 Update doc: rocksmq
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 18:37:24 +08:00
XuanYang-cn
65089ea362 Fix flush sync test bug and remove unecessary lock in meta_table
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-08 17:20:59 +08:00
GuoRentong
c4599e26de Update doc: node api
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 16:59:19 +08:00
bigsheeper
e13822043d Fix search test when partition not exists, add binary vector search validation
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-08 16:41:27 +08:00
godchen
fa73f17f94 Add opentracing doc
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-08 15:32:38 +08:00
quicksilver
f6d4214bbe Optimize the workflow for cache go mod
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-08 15:00:58 +08:00
zhenshan.cao
6a3ec57fef Fix docker lib dependency
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-07 21:08:23 +08:00
dragondriver
a4860beae2 Parse type params and index params when buildindex is invoked
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-07 17:38:46 +08:00
quicksilver
c7d31825c6 Fix connect to multiple containers at once with VSCode bug
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-07 17:14:33 +08:00