Commit Graph

314 Commits

Author SHA1 Message Date
quicksilver
7d920e9c9c
Fix compile error on CentOS (#6359)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-08 15:43:45 +08:00
Cai Yudong
1d9c10bead
Keep soft link to save docker image size (#6124)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-25 18:10:09 +08:00
Cai Yudong
64d1fa2de2
Banner use UTC time (#6102)
* banner use UTC time

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-25 10:24:11 +08:00
Cai Yudong
438e7fb4da
Print Milvus banner when start service (#5953)
* print Milvus banner when start service

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update banner

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update messages

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 11:34:04 +08:00
Cai Yudong
3b0951e3e6
Combine standalone binary into milvus (#5866)
* rename service to coord for cmd

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update docs

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update variable name

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize roles.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* support milvus run standalone

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove cmd/standalone

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord for compoments

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add comments for codacy check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* set helm chart branch

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-18 15:20:08 +08:00
zhenshan.cao
f74ea3beee [skip ci] Remove ProxyService (#5738)
* [skip ci] Remove ProxyService

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Change helm branch

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fix bug: paramstable crashed

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-15 16:36:35 +08:00
yukun
c63524deb9
Add dablooms (#5440)
* Add dablooms cwrapper

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix undefined reference bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add cwrapper_dablooms_build shell script

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-28 10:23:30 +08:00
neza2017
a124568664
fix makefile (#5236)
just remove standalone and milvus from $GOPATH/bin,
not every thing, on command of make clean

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-15 02:02:48 +00:00
Cai Yudong
4cec3924cc
rename all singlenode to standalone (#5051)
* rename all singlenode to standalone

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update docker image name

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix merge conflict

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* Rename all singlenode to standalone (#1)

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-04-26 10:35:57 +00:00
Xiangyu Wang
746fc556a0
[skip ci]Add go code coverage (#5024)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-24 15:10:24 +08:00
Cai Yudong
e4256a4400 Combine all service/node binaries into one binary with named 'milvus'
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2021-04-15 09:28:46 +08:00
Cai Yudong
687d48b75e Improve code readibility
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2021-04-12 14:11:06 +08:00
Cai Yudong
952f70af2a Clean makefile
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2021-04-09 14:07:03 +08:00
XuanYang-cn
32660d547b Add endPositions in datanode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-03-16 17:55:42 +08:00
XuanYang-cn
7dd531d159 Fix release collection bug
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-03-11 18:42:25 +08:00
Xiangyu Wang
c875fdf913 Add logs in rocksmq
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-03-10 10:02:55 +08:00
zhenshan.cao
b3891ca199 Correct docker file
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-20 10:15:37 +08:00
XuanYang-cn
90d471b133 Refactor main of queryservice and querynode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-02 09:52:42 +08:00
neza2017
854accf95b Remove master and writenode
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-30 16:41:47 +08:00
dragondriver
f660caca0c Refactor the client interface of proxy service
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-29 17:29:31 +08:00
Xiangyu Wang
99cef4b5c8 Add Distributed main entrypoint
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-29 17:08:31 +08:00
zhenshan.cao
ee0faddb07 Refactor proxy
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-29 09:27:26 +08:00
bigsheeper
4f914a2c30 Add docker file and main function of query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-27 09:50:52 +08:00
neza2017
d1b23cb8c5 Add debug info
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-26 19:24:09 +08:00
sunby
f632ed0272 Fix data service init
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-26 18:45:12 +08:00
zhenshan.cao
e83ac41bca Add component for index
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-26 18:01:32 +08:00
XuanYang-cn
0b1c4f0420 Add building datanode cmd in Makefile
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-26 17:40:26 +08:00
sunby
b4997a37a2 Add make dataservice in Makefile
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-26 16:36:26 +08:00
XuanYang-cn
b445587e11 Add datanode main
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-26 14:46:54 +08:00
cai.zhang
346bb1ba49 Delete some unused code and some debug logs
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-26 14:31:31 +08:00
dragondriver
c6a6b1436c Add soft time tick in proxy service
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-26 13:41:41 +08:00
cai.zhang
f940cc455a Add dockerfile for index
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-26 09:38:40 +08:00
neza2017
7f3aa92d10 Add docker file for masterservice
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-25 15:58:04 +08:00
dragondriver
cd52adc18b Add proxy service to ci workflow
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 12:57:23 +08:00
dragondriver
eba6bb288c Refactor the sructure of proto file
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 09:36:18 +08:00
cai.zhang
7619d968fd Generate random node port for indexService
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-20 18:26:20 +08:00
yukun
527c0c49df Add rocksmq unittest with goroutines
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-20 16:46:58 +08:00
cai.zhang
c35079d7e7 Update registerNode in indexservice
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-20 10:15:43 +08:00
xige-16
d22c2cd203 Add proto for query service loading collection
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-18 19:32:08 +08:00
XuanYang-cn
fb63983eb2 Modify rocksdb compilation
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-14 15:12:08 +08:00
yukun
51ca741a49 Add singlenode launch main
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-14 09:52:03 +08:00
cai.zhang
3d885742ee Reopen ruleguard and format code
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-13 13:36:27 +08:00
bigsheeper
2d2af1505a Improve mutex usage in query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-12 18:03:24 +08:00
GuoRentong
f3d2afa4f4 Update doc:detailed interface definition
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-11 18:35:54 +08:00
quicksilver
a6690dbc99 Fix syntax error: Bad fd number
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-11 15:25:19 +08:00
yukun
18cfd31d40 Fix Load and Remove with prefix
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-11 15:17:06 +08:00
sunby
5dfe9448ae Modify test_index
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-08 16:00:16 +08:00
yukun
d11f00cd9f Add rocksdb in kv
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-08 19:07:57 +08:00
GuoRentong
82ad488555 Update doc: rocksmq
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 18:37:24 +08:00
XuanYang-cn
65089ea362 Fix flush sync test bug and remove unecessary lock in meta_table
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-08 17:20:59 +08:00
GuoRentong
c4599e26de Update doc: node api
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 16:59:19 +08:00
bigsheeper
e13822043d Fix search test when partition not exists, add binary vector search validation
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-08 16:41:27 +08:00
godchen
fa73f17f94 Add opentracing doc
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-08 15:32:38 +08:00
cai.zhang
d17442d5be Disable ruleguard
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-08 12:44:11 +08:00
dragondriver
ced56c84f8 Add support to build binary vector index
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-07 14:56:17 +08:00
godchen
8f1f118b26 Add query opentracing
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-07 14:24:35 +08:00
bigsheeper
810be533ab Add gcNode, and remove msg's downstream index
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-06 14:02:25 +08:00
cai.zhang
1cfc2ff0a5 Add make clean in Makefile
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-06 13:50:48 +08:00
bigsheeper
b7fc945aca Add flush msg unmarshal function register
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-31 17:25:45 +08:00
xige-16
bfb18df7e7 Parse result_id from target entry
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-31 16:53:57 +08:00
quicksilver
1927eaf88b Add revive linter
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-31 16:38:37 +08:00
neza2017
e05c441fc9 Modify Makefile to compile binlog
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-30 14:09:00 +08:00
quicksilver
b1b8747477 Add logic of incremental check for go code
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-29 17:19:44 +08:00
XuanYang-cn
9577da9fce Add writenode main
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-28 18:52:34 +08:00
FluorineDog
d5daa18392 Enable most DSL-related cases
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-21 14:45:00 +08:00
sunby
c71cd40f68 Refactor segment manager
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-19 12:55:24 +08:00
FluorineDog
e65cfe1e3d Enable complex dsl parser
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-19 10:36:49 +08:00
zhenshan.cao
3f6e926aef Refactor indexbuilder
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-13 06:48:05 +08:00
XuanYang-cn
881be7f3e3 Impl minimum runable writenode and writenode flowgraph
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-09 20:07:27 +08:00
quicksilver
d09ad77fb2 Add archiving file workflow for cache thirdparty
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-08 19:53:22 +08:00
XuanYang-cn
32977e270c Add impl cgo of parquet
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-08 14:41:04 +08:00
zhenshan.cao
7bbbc14637 Fix bug: address already used
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-07 15:22:20 +08:00
xige-16
37d7526d31 Fix search test failure
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-07 14:37:42 +08:00
neza2017
aeca8f85a5 Run cwrapper unittest in ci
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-05 17:39:58 +08:00
cai.zhang
806a97505c Add query node for CI progress
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-05 16:12:45 +08:00
neza2017
70710dee47 Add parquet payload
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-05 16:11:03 +08:00
FluorineDog
6412ebc0d4 Add support of metric type in schema, enable binary vector, fix segfault
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-05 06:46:01 +08:00
cai.zhang
18a9ffb617 Increase timeout for golangci-lint
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-04 17:57:24 +08:00
godchen
7ab5b5d80d Add MinIO kv implements
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-03 19:00:11 +08:00
neza2017
cec903da19 Add parquet payload
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-02 18:31:56 +08:00
zhenshan.cao
23aebe7e2a Fix proxy unittest
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-01 19:53:53 +08:00
neza2017
17cc7bc337 Use MetaRootPath instead
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-01 17:03:39 +08:00
FluorineDog
6b74d82259 Support some validation for dsl parser
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-01 02:16:53 +08:00
zhenshan.cao
fda8d62b38 Fix make error
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-30 22:14:19 +08:00
dragondriver
2358fae703 Check the status of search results before reduce in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-30 19:08:32 +08:00
bigsheeper
0cd3e8d86c Use exception instead of runtime error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-30 17:58:23 +08:00
cai.zhang
546beb333d Compile master and proxy without cgo
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-30 16:40:13 +08:00
quicksilver
86573d0053 Create Jenkins pipeline
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-30 10:07:04 +08:00
FluorineDog
77fa75b1ec Add binary insert and warper of binary search, rename vector
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-30 05:18:44 +08:00
neza2017
32445dd02b Add cpu profile
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-26 16:01:31 +08:00
cai.zhang
57da66ba72 Update read config logic in docker
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-26 15:18:36 +08:00
zhenshan.cao
045fc3d808 Fix segment fault
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-26 14:29:01 +08:00
XuanYang-cn
0a16a9a651 Add logic of getting milvus distributed config from master by grpc
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-26 13:21:06 +08:00
sunby
f4c643f1bd Add number limitation of partition and field. And Change default partition tag to "_default"
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-25 18:39:05 +08:00
cai.zhang
a13638b172 Add cpplint and optimize the check of c++ code
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-23 19:57:05 +08:00
cai.zhang
7b86d7ad63 Check the go code and C++ code in CI progress
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-19 16:43:39 +08:00
cai.zhang
c7861c2dba Add the check of C++ code in the CI progress
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-18 10:07:05 +08:00
quicksilver
792f0679e5 Running as root is not permitted on build environment
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-13 12:27:41 +08:00
cai.zhang
cfee642a11 Add ruleguard and open ruleguard check
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-13 10:00:32 +08:00
cai.zhang
b68322d469 Open golangci-lint check
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-12 17:58:05 +08:00
cai.zhang
62a59d094b Run unittest in CI
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-09 18:47:37 +08:00
cai.zhang
19fbf3d616 Check the directory containing the go file when make verifiers
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-09 14:51:46 +08:00
neza2017
d18c17e786 Add Meta table implementation
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-04 16:28:14 +08:00
godchen
bade037fb2 Add meta_table implementation
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-04 16:01:28 +08:00
neza2017
1bd7938d72 Modify logic of time tick
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-04 14:52:03 +08:00
cai.zhang
4194cb5d56 Add cmake_build directory to gitignore and optimize the logic of golangci-lint
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-03 20:19:08 +08:00
cai.zhang
9d212505d8 Add Makefile
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-03 11:25:47 +08:00
quicksilver
5429614462 Add make all command in docker-compose.yml
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-31 16:30:20 +08:00
quicksilver
b5dd9ddd69 Change base image in Build environment Dockerfile
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-30 16:25:06 +08:00
zhenshan.cao
4965a315ad Refact proto generating procedure
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-19 10:36:40 +08:00
zhenshan.cao
64295db471 Refact master and proxy and add etcdutil
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-15 21:31:50 +08:00
zhenshan.cao
be58ccb65e Delete unused
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-09-12 16:57:37 +08:00
shengjh
4cf6e079bc Add etcd watcher
Signed-off-by: shengjh <1572099106@qq.com>
2020-09-11 18:55:43 +08:00
rain
c10cf9bf8f Update the collection proto and add the go files generated by proto
Signed-off-by: rain <boyan.wang@zilliz.com>
2020-09-10 19:55:03 +08:00