Commit Graph

180 Commits

Author SHA1 Message Date
Zhen Ye
f07aa72589
enhance: make milvus image with asan available (#37050)
issue: #35854

Signed-off-by: chyezh <chyezh@outlook.com>
2024-10-24 10:05:29 +08:00
yellow-shine
ac736ad472
enhance: friendly for docker cache (#35789)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-30 13:05:34 +08:00
sthuang
d8668fe405
enhance: upgrade go version to 1.21.11 (#35257)
issue: #35142

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-08-05 16:12:15 +08:00
yellow-shine
7bf68d8657
enhance: upgrade conan version (#35215)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-02 19:22:15 +08:00
sammy.huang
2cc9df5c50
[automated] Update cpu Builder image changes (#34078)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-25 10:56:10 +08:00
GenkenWei
a1248a19f8
fix: update ubuntu base image version (#33944)
related to #33945
FIX CVEs of milvus base image: MEDIUM: 8, **Total FIX: 8** for master
branch

![image](https://github.com/milvus-io/milvus/assets/27683687/71708028-265e-4f20-8732-56b7e76864fc)

Signed-off-by: weizhenkun <zhenkun.wei@qq.com>
Co-authored-by: weizhenkun <zhenkun.wei@qq.com>
2024-06-24 14:12:02 +08:00
sammy.huang
5be9929d64
enhance: upgrade build-env to ubuntu 22.04 and gcc12 (#33959)
issue: #33960

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-20 15:22:02 +08:00
shaoting-huang
eb3197eb1e
enhance: update amazonlinux2023 image builder (#33948)
#32982

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-06-19 16:44:01 +08:00
Yinzuo Jiang
7d74edd6dd
fix: update clang-tidy and clang-format from 10 to 12 (#33141)
Default llvm toolchain version in Ubuntu 20.04 is 10, while Ubuntu 22.04
does not have `clang-tidy-10` or `clang-format-10` by default.

issue: #33142

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
2024-06-13 15:27:58 +08:00
GenkenWei
516f39b616
fix: remove date in the end of ubuntu base image version (#33073)
CVE issues https://github.com/milvus-io/milvus/issues/31997
This PR will fix **32** LOW and **42** MEDIUM CVEs

**ubuntu:focal-20220426 (ubuntu 20.04)**
Total: 99 (UNKNOWN: 0, LOW: 55, MEDIUM: 44, HIGH: 0, CRITICAL: 0)
**ubuntu:focal (ubuntu 20.04)**
Total: 25 (UNKNOWN: 0, LOW: 23, MEDIUM: 2, HIGH: 0, CRITICAL: 0)

![image](https://github.com/milvus-io/milvus/assets/27683687/49719035-8e28-498a-b00d-9c862d531c19)

![image](https://github.com/milvus-io/milvus/assets/27683687/7efc76c0-d333-4569-9455-4aa1a1aa3619)

---------

Signed-off-by: weizhenkun <zhenkun.wei@qq.com>
Co-authored-by: weizhenkun <zhenkun.wei@qq.com>
2024-06-05 10:25:50 +08:00
shaoting-huang
d27db99697
enhance: upgrade amazonlinux2023 builder image go version to 1.21 (#33176)
Signed-off-by: shaoting-huang [shaoting-huang@zilliz.com]

issue: https://github.com/milvus-io/milvus/issues/32982

Go 1.21 introduces several improvements and changes over Go 1.20, which
is quite stable now. This PR is mainly for upgrading images Golang
version from 1.20 to 1.21.

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-05-20 21:11:39 +08:00
shaoting-huang
c35eaaa358
enhance: upgrade images golang version from 1.20 to 1.21 (#33150)
Signed-off-by: shaoting-huang [shaoting-huang@zilliz.com]

issue: https://github.com/milvus-io/milvus/issues/32982

Go 1.21 introduces several improvements and changes over Go 1.20, which
is quite stable now. This PR is mainly for upgrading images Golang
version from 1.20 to 1.21.

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-05-20 15:01:43 +08:00
Yinzuo Jiang
2cc50d80a3
fix: add openblas in install_deps.sh (#33065)
Install openblas using apt or yum in scripts/install_deps.sh, update
documentations and fix some typos related to build and installation.

issue: #33056, #33066

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
2024-05-17 14:53:37 +08:00
PowderLi
6289f3a9eb
fix: build milvus in rockylinux8 (#32619)
issue: #32299

1. xz utils recovers
2. forget to install ninja

Signed-off-by: PowderLi <min.li@zilliz.com>
2024-04-29 14:53:26 +08:00
sammy.huang
d343d2f3fc
enhance: add vcpkg for rockylinux8 (#32300)
issues:#32299

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-18 11:05:20 +08:00
sammy.huang
df2ca7f312
enhance: use openblas-devel instead (#32284)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-15 22:14:43 +08:00
sammy.huang
053347637b
enhance: add openblas-devel (#32049)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-15 19:47:20 +08:00
sammy.huang
703fcac819
enhance: add openblas in runtime env (#31974)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-08 14:57:16 +08:00
sammy.huang
db698756dc
enhance: make gpu builder both support amd64 and gpu64 (#31888)
the purpose of this pr is to build arm-based and x86-based
milvusdb/milvus-env for milvus gpu. milvusdb/milvus-env would be based
on ubuntu22.04

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-05 10:09:22 +08:00
sammy.huang
b11c2da930
enhance: for supporting ARM-based GPU images (#31757)
This PR is for supporting ARM-based GPU images.
issue: #31862

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-03 11:49:14 +08:00
sammy.huang
f7a59766df
enhance: support rockylinux8 (#31751)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-01 10:23:12 +08:00
sammy.huang
b0a941c2fb
enhance: to reduce container image size (#31576)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-01 09:39:12 +08:00
sammy.huang
1b31824f83
enhance: add openblas dependency (#31437)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-03-21 15:59:12 +08:00
Guillaume Moutier
d15db7596d
fix: fix permissions on /milvus for OpenShift compatibility (#30775)
OpenShift runs Pods with a random uid and gid 0.
As Milvus needs to write into the /milvus directory, this fix modifies
the group permissions to allow the root group (gid 0) to write into it.
This is a simple solution that allows to run Milvus on OpenShift without
adding security constraints, use special ServiceAccounts or whatever.
This should also not impact any other kubernetes platform as it's a
simple group permission change, nothing regarding the userid.

Note: Other actions are necessary to properly deploy the full stack
(Minio, Pulsar,...) on OpenShift. I will document them in the helm chart
project.

Fixes #25565

Signed-off-by: Guillaume Moutier <guillaume.moutier@gmail.com>
2024-02-28 16:29:05 +08:00
Jiquan Long
4651f89944
enhance: specify version while rust-init (#29108)
This will reduce the size of builder image.
/kind improvement

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-12 22:10:41 +08:00
Jiquan Long
52594c8596
enhance: add libasan to amazon linux runner (#29039)
fix: #29038

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-07 14:14:42 +08:00
Jiquan Long
fccec125b2
enhance: [skip-e2e] add rust to builder image (#28838)
https://github.com/milvus-io/milvus/issues/27704

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-04 10:10:35 +08:00
PowderLi
90997a5ddb
enhance: update the base image: milvusdb/milvus-env (#28505)
issue: #28683
to avoid downloading installation packages in CI workload install vcpkg
and install some packages in advance

Signed-off-by: PowderLi <min.li@zilliz.com>
2023-11-23 19:58:25 +08:00
sammy.huang
ca42cbdad1
enhance: update cmake version to 3.27.5 (#28599)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-11-22 12:02:22 +08:00
yah01
6f59510723
Upgrade go to 1.20 (#24390)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-11-10 07:46:18 +08:00
PowderLi
a951c7570f
publish builder gpu image (#27861)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-10-25 14:20:12 +08:00
Enwei Jiao
4faba61647
Upgrade conan to 1.61.0 (#27870)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-10-24 17:50:10 +08:00
Bennu
2446aa0cd7
[skip e2e] update gpu builder image (#27835)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-10-24 09:24:23 +08:00
PowderLi
11b521392e
install ninja in advance for arm64 (#27579)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-10-11 11:51:32 +08:00
PowderLi
8e142ff39f
[amazonlinux:2023]install perl-IPC-Cmd (#27049)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-09-13 18:53:18 +08:00
Enwei Jiao
2a755baaa5
Fix amazonlinux cache not work (#26883)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-09-07 15:43:15 +08:00
PowderLi
30ca45868d
install zip because we want to use vcpkg (#26664)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-08-30 14:19:00 +08:00
Bennu
148446cfb9
Update milvus gpu image builder version (#26505)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-23 10:54:21 +08:00
xige-16
9131a0aa56
Add default MALLOC_CONF env (#26352)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-08-22 16:32:27 +08:00
liliu-z
1e28c6e356
Update CUDA version to 11.8 (#26492)
Signed-off-by: Li Liu <li.liu@zilliz.com>
2023-08-21 15:36:20 +08:00
Enwei Jiao
f2a6683a97
Update doc for remove Centos7 (#26476)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-21 09:54:20 +08:00
Enwei Jiao
533f0ddf6d
Add amazonlinux image, prepare to remove Centos7 image, remove openblas image (#26368)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-18 18:32:19 +08:00
Enwei Jiao
c9d9940918
Remove Ubuntu18.04 support (#24666)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-06-06 14:06:36 +08:00
yah01
10c779d3d3
Upgrade image go version to 1.20.4 (#24393)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-05-25 14:51:26 +08:00
Bennu
f547c1f8f4
Add ci for milvus gpu (#22845)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-03-20 19:03:57 +08:00
Enwei Jiao
5351fee733
Upgrade gcc11 for centos7 (#22190)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-15 17:16:33 +08:00
Enwei Jiao
e1ec24895d
Upgrade gcc in CentOS (#22086)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-09 17:32:31 +08:00
Enwei Jiao
39377fde4e
Upgrade gcc and conan for builder (#22033)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-07 17:58:30 +08:00
Bennu
539d9b52c9
[skip e2e]Update meta-migratition build (#21686)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-01-12 20:01:41 +08:00
Enwei Jiao
958e94f6f0
Use Conan as c++ package manager (#19920)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-11-23 10:39:11 +08:00