Commit Graph

319 Commits

Author SHA1 Message Date
quicksilver
b37861ad5f
Increase ephemeral storage size for jenkins slave (#5235)
Signed-off-by: jeffoverflow zhifeng.zhang@zilliz.com
2021-05-15 02:13:17 +00:00
quicksilver
d17ed98fff
Allow jenkins slave pod to remain active for a while (#5232)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-14 14:09:40 +00:00
quicksilver
9ffb42d448
Deny jenkins slave pod to remain active for a while (#5225)
* Deny jenkins slave pod to remain active for a while

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-14 18:23:30 +08:00
XuanYang-cn
eb557b289b
Add docs in package datanode (#5117)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-05-08 07:24:12 +00:00
zhenshan.cao
dab38f6c3d
Change cron job schedule (#5130)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-07 08:56:32 +00:00
quicksilver
ad1c889824
Upload Milvus images to internal mirror repository when Push triggered (#5092)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

**What type of PR is this?**

- [x] enhancement

**What this PR does / why we need it:**

Upload Milvus images to internal mirror repository when Push triggered
2021-04-29 09:47:44 +00:00
quicksilver
136cd7a704
Run KinD Inside A Kubernetes Cluster For Continuous Integration (#5085)
**What type of PR is this?**

- [x] Improvement

**Which issue(s) this PR fixes:**

Fixes #5038

**What this PR does / why we need it:**

Run KinD Inside A Kubernetes Cluster For Continuous Integration
2021-04-29 08:45:17 +00:00
quicksilver
7a188a8ae5
Update openblas images (#5082)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-04-29 11:28:27 +08:00
quicksilver
27af87e4d8
Used for local development or CI in Kubernetes in Docker (#5061)
* Used for local development or CI in Kubernetes in Docker
2021-04-27 19:27:50 +08:00
quicksilver
521f423326
Update milvus builder image version (#5058)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-04-27 02:11:50 +00:00
Cai Yudong
4cec3924cc
rename all singlenode to standalone (#5051)
* rename all singlenode to standalone

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update docker image name

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix merge conflict

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* Rename all singlenode to standalone (#1)

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-04-26 10:35:57 +00:00
quicksilver
3b529f3b5d
Update milvus project name (#5032)
* Update milvus project name
2021-04-26 13:59:28 +08:00
Cai Yudong
e4256a4400 Combine all service/node binaries into one binary with named 'milvus'
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2021-04-15 09:28:46 +08:00
quicksilver
bea21a823c Download tini binary into milvus base image
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-04-10 15:22:29 +08:00
quicksilver
035db4e475 Disable failFast in Jenkins CI
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-30 16:30:28 +08:00
zhenshan.cao
0be85b3a62 Change cron job schedule
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-30 11:43:55 +08:00
quicksilver
2fbdb30907 Output all thirdparty component logs in Jenkins CI
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-27 18:59:29 +08:00
quicksilver
8464e8d447 Add go mod cache in Jenkins CI
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-24 11:00:41 +08:00
quicksilver
d561379485 Remove go mod cache in Jenkins CI
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-22 18:27:55 +08:00
quicksilver
321d020b0f Schedule cron job in Jenkins CI
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-22 11:55:17 +08:00
quicksilver
7d8f0e759b Set failfast true for all subsequent parallel stages in Jenkins pipeline
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-20 16:09:34 +08:00
quicksilver
f9118aa841 Clean go module cache into devcontainer
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-18 17:03:35 +08:00
quicksilver
66a2ec9fe2 Update devcontainer version
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-18 14:56:52 +08:00
quicksilver
4b0210d723 Avoid vscode extension reinstalls on container rebuild
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-17 15:51:28 +08:00
quicksilver
846f801d29 Add regression docker compose file
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-12 09:58:04 +08:00
quicksilver
ddb37fe498 Optimize regression workflow
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-11 18:34:26 +08:00
quicksilver
a08feb8a1f Update pytest docker images version
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-11 16:22:28 +08:00
ThreadDao
ca916a5c47 Add ci nightly
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-03-11 14:14:29 +08:00
quicksilver
ba3270112a Simplify testing Kubernetes application deployment within CI pipeline by using Helm
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-11 12:01:05 +08:00
del-zhenwu
b1763c3690 Disable xdist in test cases
Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>
2021-03-10 15:27:26 +08:00
ThreadDao
b91696c657 Add pytest reruns
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-03-09 11:45:45 +08:00
quicksilver
e30b18a8f1 Add publish test images workflows
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-08 19:32:46 +08:00
del-zhenwu
3c72f09d63 Disable -n 4 during run tests
Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>
2021-03-08 16:10:27 +08:00
zhenshan.cao
529079b342 Remove -s and failfast
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-06 10:56:21 +08:00
quicksilver
5c569e51a0 Add standalone deployment pipeline for regression
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-05 15:31:00 +08:00
cai.zhang
3489362137 Add pytest-tags in requirements.txt
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-03-05 10:18:54 +08:00
dragondriver
801396e3ef Disable register link logic, use proxy node directly
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-04 22:27:12 +08:00
quicksilver
fb000d0060 Break docker pull rate limit
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-04 18:43:50 +08:00
cai.zhang
0e16a786e7 Use python_test requirements.txt instead of requirements.txt
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-03-04 18:00:45 +08:00
quicksilver
887299596e Disable regression pipeline
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-04 14:21:09 +08:00
quicksilver
235979996c Distinguish between regression and regression_0331 during Dev Test stage
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-01 16:42:55 +08:00
del-zhenwu
64d7f09ae2 Fix testcases
Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>
2021-03-01 13:27:51 +08:00
del-zhenwu
24eebc5c72 Add tags demo in test case
Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>
2021-03-01 11:05:34 +08:00
quicksilver
f0a0ae433f Add PyTest 0331 Regression pipeline
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-02-27 18:32:23 +08:00
quicksilver
f853ddc030 Optimize Milvus Distributed Dockerfile
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-02-27 10:51:52 +08:00
cai.zhang
379e4d5fae Integrate dockerfile
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-25 10:09:03 +08:00
quicksilver
000e30d2cf Update devcontainer version
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-02-24 09:58:22 +08:00
quicksilver
3cc071c1b5 Reap zombie processes and perform singal forward in dev container
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-02-23 19:34:41 +08:00
zhenshan.cao
bbfcbbdd68 Fix ci: paramstable and startup logic refactor
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-23 11:40:30 +08:00
cai.zhang
4c5a898e9a Add masterservice docker
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-20 11:15:19 +08:00
zhenshan.cao
b3891ca199 Correct docker file
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-20 10:15:37 +08:00
cai.zhang
4f2a1e7912 Fix bug for dataservice dockerfile
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-04 18:11:19 +08:00
sunby
ca9c2f5c12 Add GetCount and implement GetCollectionStatistics
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-02 14:25:58 +08:00
neza2017
854accf95b Remove master and writenode
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-30 16:41:47 +08:00
bigsheeper
4f914a2c30 Add docker file and main function of query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-27 09:50:52 +08:00
XuanYang-cn
0e6985b42c Add datanode DockerFile
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-26 16:56:36 +08:00
cai.zhang
346bb1ba49 Delete some unused code and some debug logs
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-26 14:31:31 +08:00
dragondriver
c6a6b1436c Add soft time tick in proxy service
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-26 13:41:41 +08:00
cai.zhang
f940cc455a Add dockerfile for index
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-26 09:38:40 +08:00
neza2017
7f3aa92d10 Add docker file for masterservice
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-25 15:58:04 +08:00
zhenshan.cao
aef4e41e91 Enable proxynode microbatch pulsar msg and enable parallel test
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-23 20:58:46 +08:00
dragondriver
cd52adc18b Add proxy service to ci workflow
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 12:57:23 +08:00
dragondriver
eba6bb288c Refactor the sructure of proto file
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 09:36:18 +08:00
cai.zhang
3d885742ee Reopen ruleguard and format code
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-13 13:36:27 +08:00
bigsheeper
2d2af1505a Improve mutex usage in query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-12 18:03:24 +08:00
GuoRentong
f3d2afa4f4 Update doc:detailed interface definition
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-11 18:35:54 +08:00
quicksilver
a6690dbc99 Fix syntax error: Bad fd number
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-11 15:25:19 +08:00
yukun
18cfd31d40 Fix Load and Remove with prefix
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-11 15:17:06 +08:00
sunby
5dfe9448ae Modify test_index
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-08 16:00:16 +08:00
GuoRentong
82ad488555 Update doc: rocksmq
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 18:37:24 +08:00
XuanYang-cn
65089ea362 Fix flush sync test bug and remove unecessary lock in meta_table
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-08 17:20:59 +08:00
GuoRentong
c4599e26de Update doc: node api
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 16:59:19 +08:00
bigsheeper
e13822043d Fix search test when partition not exists, add binary vector search validation
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-08 16:41:27 +08:00
godchen
fa73f17f94 Add opentracing doc
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-08 15:32:38 +08:00
zhenshan.cao
6a3ec57fef Fix docker lib dependency
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-07 21:08:23 +08:00
quicksilver
6bcca0a9b7 Connect to multiple containers at once with VSCode
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-06 18:16:37 +08:00
zhenshan.cao
af1941b6fe Add docker for indexbuilder
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-05 15:25:01 +08:00
XuanYang-cn
05f1350e19 Add writenode to ci
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-05 15:14:59 +08:00
XuanYang-cn
c0797333ce Add ddl binlog metaTable in writenode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-24 20:55:40 +08:00
neza2017
4dbf4ade41 Add test for master
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-24 16:19:42 +08:00
xige-16
f5198bcaee Add LoadIndexService in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-24 14:51:55 +08:00
xige-16
14332d49fb Add minio for regression
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-24 14:34:14 +08:00
quicksilver
046aa3529f Publish image using Docker-in-Docker
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-10 15:27:30 +08:00
quicksilver
21721d2e03 Cache go mod workflow for jenkins pipeline
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-10 09:57:14 +08:00
XuanYang-cn
881be7f3e3 Impl minimum runable writenode and writenode flowgraph
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-09 20:07:27 +08:00
quicksilver
d09ad77fb2 Add archiving file workflow for cache thirdparty
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-08 19:53:22 +08:00
XuanYang-cn
32977e270c Add impl cgo of parquet
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-08 14:41:04 +08:00
zhenshan.cao
7bbbc14637 Fix bug: address already used
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-07 15:22:20 +08:00
xige-16
37d7526d31 Fix search test failure
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-07 14:37:42 +08:00
neza2017
aeca8f85a5 Run cwrapper unittest in ci
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-05 17:39:58 +08:00
cai.zhang
806a97505c Add query node for CI progress
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-05 16:12:45 +08:00
neza2017
70710dee47 Add parquet payload
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-05 16:11:03 +08:00
cai.zhang
18a9ffb617 Increase timeout for golangci-lint
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-04 17:57:24 +08:00
godchen
7ab5b5d80d Add MinIO kv implements
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-03 19:00:11 +08:00
neza2017
cec903da19 Add parquet payload
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-02 18:31:56 +08:00
quicksilver
a0729f9202 Add regression tests based on the Milvus Python SDK
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-02 16:50:57 +08:00
dragondriver
2358fae703 Check the status of search results before reduce in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-30 19:08:32 +08:00
bigsheeper
0cd3e8d86c Use exception instead of runtime error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-30 17:58:23 +08:00
quicksilver
bb8ebc82e9 Remove environment values
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-30 16:08:35 +08:00
quicksilver
86573d0053 Create Jenkins pipeline
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-30 10:07:04 +08:00
FluorineDog
77fa75b1ec Add binary insert and warper of binary search, rename vector
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-30 05:18:44 +08:00
cai.zhang
85a544b79b Add dockerfile for each component
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-28 19:06:48 +08:00
quicksilver
3b7415a70d Optimize the workflow for publish builder
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-20 17:27:04 +08:00
quicksilver
1728a4f419 Update .devcontainer.json
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-20 15:02:26 +08:00
cai.zhang
7b86d7ad63 Check the go code and C++ code in CI progress
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-19 16:43:39 +08:00
xige-16
cf11212932 Refactor reduce using cgo in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-11-19 14:13:39 +08:00
quicksilver
16c96fa170 Install only static libraries into the build environment
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-19 11:16:18 +08:00
quicksilver
057673edc9 Fix permission denied in gdbserver container
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-18 16:38:28 +08:00
cai.zhang
c7861c2dba Add the check of C++ code in the CI progress
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-18 10:07:05 +08:00
quicksilver
72ed65d7f8 Check builder images
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-17 18:36:03 +08:00
quicksilver
3f4e0e5851 Update build environment
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-16 21:11:52 +08:00
quicksilver
00b4b67a1f Update the version of build environment
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-14 16:01:12 +08:00
quicksilver
792f0679e5 Running as root is not permitted on build environment
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-13 12:27:41 +08:00
quicksilver
5429614462 Add make all command in docker-compose.yml
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-31 16:30:20 +08:00
quicksilver
b5dd9ddd69 Change base image in Build environment Dockerfile
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-30 16:25:06 +08:00
quicksilver
d66d48c6b6 Enable UnitTest
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-27 15:51:16 +08:00
shengjh
77b2fcf015 Refactor manipulationreq and add tso(pre-alloc from master)
Signed-off-by: shengjh <1572099106@qq.com>
2020-10-27 12:01:27 +08:00
quicksilver
eb64839aef Update build environment
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-26 15:45:18 +08:00
quicksilver
1b31b85ef7 Refactor the build and scripts folders
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-24 11:36:42 +08:00