Commit Graph

180 Commits

Author SHA1 Message Date
Enwei Jiao
0a289c0052
Prepare builder image for conan (#20482)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-11-21 14:11:10 +08:00
Jenny Li
091291f99c
Make docker base separate from milvus image (#20473)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-15 15:15:07 +08:00
Jenny Li
0883599af8
[skip e2e]Remove entrypoint for migration image (#19908)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-10-19 21:47:31 +08:00
Jenny Li
6f5ff61ac3
[skip e2e] Add publish migration image (#19869)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-10-18 18:49:26 +08:00
xige-16
428840178c
Support diskann index for vector field (#19093)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-09-21 20:16:51 +08:00
zhagnlu
a466b9494d
[skip e2e] add unzip tool (#19252)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-09-17 16:10:48 +08:00
Jenny Li
d8b11121a8
Decrease build time by removing compiling openblas (#19207)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-09-16 17:46:47 +08:00
Jenny Li
18817a4ef8
[skip e2e] Update builder image for new openblas (#19209)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-09-15 22:06:33 +08:00
presburger
179ea77e6d
[skip e2e] optimize openblas compile in pod (#19202)
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>

Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
2022-09-14 21:28:35 +08:00
xige-16
0bfd2c95b8
[skip e2e] Add diakann index dependency (#19196)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-09-14 17:44:33 +08:00
presburger
4c992c5fc0
optimize openblas compile flags (#19122)
Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>

Signed-off-by: Yusheng.Ma <Yusheng.Ma@zilliz.com>
2022-09-13 15:20:32 +08:00
Jenny Li
256be143c2
[skip e2e]Remove mkl for build (#18878)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-08-29 11:54:55 +08:00
Jenny Li
2069f63cb3
[skip e2e]Add deps for diskann build (#18847)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-08-29 09:55:06 +08:00
Jenny Li
c4a9e13e03
Fix cache path for 20.04 (#18859)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-08-26 23:46:54 +08:00
Jenny Li
5269ac39da
[skip e2e]Add deps to fix pkg-config error (#18854)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-08-26 17:08:54 +08:00
Jenny Li
0bb6526d1a
[skip e2e] Add 20.04 (#18831)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-08-25 21:24:55 +08:00
XuanYang-cn
769606cce2
Add zstd lib in docker images (#18823)
See also: #18304, #18335

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-08-25 14:24:53 +08:00
bigsheeper
004ba37436
Set LD_PRELOAD env for jemalloc (#18612)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-08-11 19:50:37 +08:00
Enwei Jiao
33e25a2ddc
add heaptrack dockerfile (#18472)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-08-04 10:16:36 +08:00
Su Yang
554994d8d7
Remove invalid build parameters for openblas (https://github.com/milvus-io/milvus/issues/18360) (#18464)
Signed-off-by: soulteary <soulteary@gmail.com>
2022-08-02 11:32:33 +08:00
Enwei Jiao
c5b5afb502
upgrade image to Go 1.18 (#18112)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-07-08 10:20:27 +08:00
bigsheeper
cdcdfa1ea5
Disable jemalloc and use malloc_trim instead (#17538)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-14 11:12:09 +08:00
bigsheeper
c77bc81057
Set jemalloc LD_PRELOAD env to linux image (#17494)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-10 21:58:08 +08:00
Jiquan Long
70c10d4a16
Add automake to builder image (#16260)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-29 20:07:29 +08:00
Jiquan Long
3353da7c94
Add m4 and autoconf to builder image (#16228)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-28 21:29:27 +08:00
Jiquan Long
9cf96abbd3
Add libtool to builder image (#16194)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-28 10:11:26 +08:00
Cai Yudong
26544fb77f
Support to build docker image for centos7 (#15787)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-01 10:01:55 +08:00
edward.zeng
de9ee84bbb
Upgrade pulsar image for apple silicon (#15591)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-02-16 19:13:49 +08:00
Volodymyr Stoiko
280ee2eee8
Add ca-certificates to Dockerfile (#15417)
Signed-off-by: vol <me@volodymyrstoiko.com>
2022-01-28 10:51:40 +08:00
edward.zeng
96b49f14f5
Upgrade golang from 1.15.2 to 1.16.9 (#11393)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-01-27 15:57:40 +08:00
Jenny Li
f0093f8838
[skip e2e]Remove fullstatus plugin (#13699)
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2021-12-20 19:03:56 +08:00
Jenny Li
3a349a3703
[skip ci] add helm full status plugin for better debug (#13099)
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2021-12-09 19:37:07 +08:00
Xiangyu Wang
ad4c808207
Upgrade the golangci-lint version in Dockerfile (#12878)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-07 17:59:02 +08:00
edward.zeng
27b9a5c35e
Add debug commands to milvus docker image (#12175)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-11-22 17:39:14 +08:00
Jenny Li
8dd21269fb
[skip ci] Add comment for entrypoint.sh (#11947)
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2021-11-17 10:35:20 +08:00
Jenny Li
7fc2bd0fac
[skip ci] Add comment for entrypoint.sh (#11891)
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2021-11-16 15:07:16 +08:00
quicksilver
86f711dd26
Support Code debug in Devcontainer (#10095)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-10-18 20:06:41 +08:00
ZhiShen
5ff2c41c97
Change the cmake version in docker envirorment (#8647)
Change the cmake version in ubuntu and centOS

Resolves: milvus-io#8407

Signed-off-by: Shen Zhi <m13120163046@163.com>
2021-09-27 14:27:57 +08:00
quicksilver
806d13f5b2
Bumped KinD version to v0.11.1 for CI (#6717)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-22 11:46:32 +08:00
quicksilver
da628863bc
Update main.yaml for Github Action (#6381)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-09 11:59:09 +08:00
quicksilver
7d920e9c9c
Fix compile error on CentOS (#6359)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-08 15:43:45 +08:00
quicksilver
745280eeef
Optimize builder image (#6066)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-24 14:30:12 +08:00
quicksilver
b66ab9d809
User and group are not created when they already exist in builder image (#6014)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-23 15:10:07 +08:00
quicksilver
ba43eb4d75
Update docker compose deployments (#5886)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-19 11:14:08 +08:00
quicksilver
7a188a8ae5
Update openblas images (#5082)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-04-29 11:28:27 +08:00
quicksilver
27af87e4d8
Used for local development or CI in Kubernetes in Docker (#5061)
* Used for local development or CI in Kubernetes in Docker
2021-04-27 19:27:50 +08:00
quicksilver
3b529f3b5d
Update milvus project name (#5032)
* Update milvus project name
2021-04-26 13:59:28 +08:00
quicksilver
bea21a823c Download tini binary into milvus base image
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-04-10 15:22:29 +08:00
quicksilver
f9118aa841 Clean go module cache into devcontainer
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-18 17:03:35 +08:00
quicksilver
4b0210d723 Avoid vscode extension reinstalls on container rebuild
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-17 15:51:28 +08:00
quicksilver
ddb37fe498 Optimize regression workflow
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-11 18:34:26 +08:00
quicksilver
a08feb8a1f Update pytest docker images version
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-11 16:22:28 +08:00
quicksilver
ba3270112a Simplify testing Kubernetes application deployment within CI pipeline by using Helm
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-11 12:01:05 +08:00
del-zhenwu
b1763c3690 Disable xdist in test cases
Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>
2021-03-10 15:27:26 +08:00
ThreadDao
b91696c657 Add pytest reruns
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-03-09 11:45:45 +08:00
quicksilver
e30b18a8f1 Add publish test images workflows
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-08 19:32:46 +08:00
del-zhenwu
3c72f09d63 Disable -n 4 during run tests
Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>
2021-03-08 16:10:27 +08:00
zhenshan.cao
529079b342 Remove -s and failfast
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-06 10:56:21 +08:00
quicksilver
5c569e51a0 Add standalone deployment pipeline for regression
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-05 15:31:00 +08:00
cai.zhang
3489362137 Add pytest-tags in requirements.txt
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-03-05 10:18:54 +08:00
dragondriver
801396e3ef Disable register link logic, use proxy node directly
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-04 22:27:12 +08:00
cai.zhang
0e16a786e7 Use python_test requirements.txt instead of requirements.txt
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-03-04 18:00:45 +08:00
quicksilver
f0a0ae433f Add PyTest 0331 Regression pipeline
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-02-27 18:32:23 +08:00
quicksilver
f853ddc030 Optimize Milvus Distributed Dockerfile
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-02-27 10:51:52 +08:00
cai.zhang
379e4d5fae Integrate dockerfile
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-25 10:09:03 +08:00
quicksilver
3cc071c1b5 Reap zombie processes and perform singal forward in dev container
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-02-23 19:34:41 +08:00
zhenshan.cao
bbfcbbdd68 Fix ci: paramstable and startup logic refactor
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-23 11:40:30 +08:00
cai.zhang
4c5a898e9a Add masterservice docker
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-20 11:15:19 +08:00
zhenshan.cao
b3891ca199 Correct docker file
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-20 10:15:37 +08:00
cai.zhang
4f2a1e7912 Fix bug for dataservice dockerfile
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-04 18:11:19 +08:00
sunby
ca9c2f5c12 Add GetCount and implement GetCollectionStatistics
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-02 14:25:58 +08:00
neza2017
854accf95b Remove master and writenode
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-30 16:41:47 +08:00
bigsheeper
4f914a2c30 Add docker file and main function of query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-27 09:50:52 +08:00
XuanYang-cn
0e6985b42c Add datanode DockerFile
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-26 16:56:36 +08:00
cai.zhang
346bb1ba49 Delete some unused code and some debug logs
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-26 14:31:31 +08:00
dragondriver
c6a6b1436c Add soft time tick in proxy service
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-26 13:41:41 +08:00
cai.zhang
f940cc455a Add dockerfile for index
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-26 09:38:40 +08:00
neza2017
7f3aa92d10 Add docker file for masterservice
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-25 15:58:04 +08:00
zhenshan.cao
aef4e41e91 Enable proxynode microbatch pulsar msg and enable parallel test
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-23 20:58:46 +08:00
dragondriver
cd52adc18b Add proxy service to ci workflow
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 12:57:23 +08:00
dragondriver
eba6bb288c Refactor the sructure of proto file
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 09:36:18 +08:00
cai.zhang
3d885742ee Reopen ruleguard and format code
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-13 13:36:27 +08:00
bigsheeper
2d2af1505a Improve mutex usage in query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-12 18:03:24 +08:00
GuoRentong
f3d2afa4f4 Update doc:detailed interface definition
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-11 18:35:54 +08:00
quicksilver
a6690dbc99 Fix syntax error: Bad fd number
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-11 15:25:19 +08:00
yukun
18cfd31d40 Fix Load and Remove with prefix
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-11 15:17:06 +08:00
sunby
5dfe9448ae Modify test_index
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-08 16:00:16 +08:00
GuoRentong
82ad488555 Update doc: rocksmq
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 18:37:24 +08:00
XuanYang-cn
65089ea362 Fix flush sync test bug and remove unecessary lock in meta_table
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-08 17:20:59 +08:00
GuoRentong
c4599e26de Update doc: node api
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 16:59:19 +08:00
bigsheeper
e13822043d Fix search test when partition not exists, add binary vector search validation
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-08 16:41:27 +08:00
godchen
fa73f17f94 Add opentracing doc
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-08 15:32:38 +08:00
zhenshan.cao
6a3ec57fef Fix docker lib dependency
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-07 21:08:23 +08:00
zhenshan.cao
af1941b6fe Add docker for indexbuilder
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-05 15:25:01 +08:00
XuanYang-cn
05f1350e19 Add writenode to ci
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-05 15:14:59 +08:00
XuanYang-cn
c0797333ce Add ddl binlog metaTable in writenode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-24 20:55:40 +08:00
neza2017
4dbf4ade41 Add test for master
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-24 16:19:42 +08:00
xige-16
f5198bcaee Add LoadIndexService in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-24 14:51:55 +08:00
xige-16
14332d49fb Add minio for regression
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-24 14:34:14 +08:00
XuanYang-cn
881be7f3e3 Impl minimum runable writenode and writenode flowgraph
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-09 20:07:27 +08:00