Commit Graph

437 Commits

Author SHA1 Message Date
yellow-shine
139f4e5ab5
enhance: [codecov]split code coverage into components (#37137)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-10-25 17:42:14 +08:00
yellow-shine
8902e2220e
enhance: enable asan for cpp unittest (#37041)
https://github.com/milvus-io/milvus/issues/35854

Signed-off-by: chyezh <chyezh@outlook.com>
Co-authored-by: chyezh <chyezh@outlook.com>
2024-10-23 17:21:27 +08:00
yellow-shine
5b2658327d
enhance: change way to bump milvus bersion (#36776)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-10-12 10:41:25 +08:00
Rijin-N
a05a37a583
enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214)
Native support for Google cloud storage using the Google Cloud Storage
libraries. Authentication is performed using GCS service account
credentials JSON.

Currently, Milvus supports Google Cloud Storage using S3-compatible APIs
via the AWS SDK. This approach has the following limitations:

1. Overhead: Translating requests between S3-compatible APIs and GCS can
introduce additional overhead.
2. Compatibility Limitations: Some features of the original S3 API may
not fully translate or work as expected with GCS.

To address these limitations, This enhancement is needed.

Related Issue: #36212
2024-09-30 13:23:32 +08:00
yellow-shine
2694551757
enhance: fix a security vulnerability (#36154)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-09-10 19:09:27 +08:00
congqixia
97ca65c732
enhance: [skip e2e] Add git safe dir for code check env (#36009)
Related to #36008

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-09-05 18:09:11 +08:00
zhuwenxing
e34b0c43a1
enhance: add GitHub Actions to delete spam issues comments (#35807)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-08-29 13:19:00 +08:00
yellow-shine
e373687a07
enhance: turnoff USE_ASAN in ci (#35721)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-27 14:01:11 +08:00
yellow-shine
2b6e6f4040
feat: [skip e2e] effective way to use cache (#35598)
issue: https://github.com/milvus-io/milvus/issues/34876

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-21 18:46:55 +08:00
yellow-shine
1275005fc1
enhance: [skip e2e] enable ubuntu20.04 os (#35482)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-16 10:06:58 +08:00
ThreadDao
a62118ca33
test: update cases for index describe and upsert with autoID (#35191)
issue: #33419

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-08-05 18:00:16 +08:00
sthuang
d8668fe405
enhance: upgrade go version to 1.21.11 (#35257)
issue: #35142

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-08-05 16:12:15 +08:00
yellow-shine
241c71fdde
enhance: use docker compose instead of docker-compose (#35208)
https://github.com/milvus-io/milvus/issues/35209

---------

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-02 19:32:32 +08:00
yellow-shine
7bf68d8657
enhance: upgrade conan version (#35215)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-02 19:22:15 +08:00
yellow-shine
273e9203f4
feat: [skip e2e] effective way to use cache (#34774) (#35109)
See also #34483

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-07-30 18:41:51 +08:00
congqixia
b787bb4783
enhance: [skip e2e] Skip Amazon&Rockylinux instead of commenting job (#35108)
Related to #35084

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-07-30 16:23:49 +08:00
congqixia
de8a266d8a
enhance: Enable linux code checker (#35084)
See also #34483

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-07-30 15:53:51 +08:00
yellow-shine
e62f6b2f4e
enhance: [skip e2e] enlarge timeout of UT for go up to 90 mins (#35035)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-07-29 15:51:49 +08:00
yellow-shine
1f55061717
feat: [skip e2e] effective way to use cache (#34774)
issue: https://github.com/milvus-io/milvus/issues/34876
1. try best to download cache
2. upload cache if it is not pull request

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-07-23 10:49:51 +08:00
sammy.huang
ac2840243a
enhance: revert dead try on uploading codecov (#34130)
This reverts commit 19936d9994.

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-25 11:51:30 +08:00
sammy.huang
2cc9df5c50
[automated] Update cpu Builder image changes (#34078)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-25 10:56:10 +08:00
sammy.huang
5be9929d64
enhance: upgrade build-env to ubuntu 22.04 and gcc12 (#33959)
issue: #33960

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-20 15:22:02 +08:00
sammy.huang
19936d9994
fix:[skip e2e] make more retries on codecov uploader (#33683)
fix #32235

inspired by
https://github.com/Kong/kubernetes-testing-framework/blob/main/.github/workflows/tests.yaml#L53-L69

### What is changing:
Introducing the
[wretry.action](https://github.com/Wandalen/wretry.action) to
automatically retry the
[codecov-action](https://github.com/codecov/codecov-action) in our CI/CD
pipeline. This change is intended to enhance the robustness of our
workflow by mitigating transient failures in the codecov-action.

### Follow-up changes needed:
This retry mechanism will be removed once the issue
[codecov/codecov-action#926](https://github.com/codecov/codecov-action/issues/926)
is resolved or if GitHub Actions provides a built-in retry feature for
actions.

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-07 10:33:52 +08:00
shaoting-huang
3c7d0209d4
enhance: update checker for go version (#33351)
Signed-off-by: shaoting-huang [shaoting-huang@zilliz.com]

issue: https://github.com/milvus-io/milvus/issues/32982

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-05-24 14:23:40 +08:00
congqixia
ef41f80bd0
enhance: Sync go.mod version & dep to main pkg (#32973)
Related to #31293
See also #32951 #32952 #32953 #32954

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-05-13 10:25:32 +08:00
congqixia
244d2c04f6
feat: Add milvusclient package and migrate GoSDK (#32907)
Related to #31293

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-05-10 18:01:30 +08:00
congqixia
29d3c576a3
enhance: [skip e2e] Enlarge integration test timeout to 90min (#32686)
The running time of integration is above 50 minutes and may surpass 60
and timeout in some cases. This PR enlarge timeout first.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-29 11:33:25 +08:00
sammy.huang
2a4dfde2de
enhance: revert [skip e2e] use pull_request_target event instead (#32426)
This reverts commit ab6ddf6929.

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-18 17:15:37 +08:00
sammy.huang
66fae53cd2
enhance: hotfix HOME variable (#32411)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-18 14:49:26 +08:00
sammy.huang
70beec3e47
enhance: hotfix HOME variable (#32405)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-18 13:08:32 +08:00
sammy.huang
ab6ddf6929
enhance: [skip e2e] use pull_request_target event instead (#32236)
issue: #32235

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-13 21:17:17 +08:00
congqixia
a938951eea
enhance: [skip e2e] fix upload code cov if syntax (#32128)
The re-upload step is always true since the syntax is wrong

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-11 10:05:19 +08:00
sammy.huang
08bfb431b7
enhance: [skip e2e]add prefix to differentiate (#32025)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-09 10:57:24 +08:00
sammy.huang
2aa6f3d3ec
enhance: bump codecod-action to v4 (#31984)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-08 16:57:17 +08:00
sammy.huang
db698756dc
enhance: make gpu builder both support amd64 and gpu64 (#31888)
the purpose of this pr is to build arm-based and x86-based
milvusdb/milvus-env for milvus gpu. milvusdb/milvus-env would be based
on ubuntu22.04

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-05 10:09:22 +08:00
sammy.huang
f7a59766df
enhance: support rockylinux8 (#31751)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-01 10:23:12 +08:00
congqixia
f399416b92
enhance: Use gotestsum to run go unit test (#31622)
See also #31490

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-03-27 15:29:10 +08:00
congqixia
4da8b6607d
enhance: Add scripts to use gotestsum to execute integration test (#31490)
See also #31489

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-03-22 10:29:06 +08:00
sammy.huang
ed1197ea50
enhance: Revert[skip e2e] bump milvus version for scripts/standalone_embed.sh (#30892)
This reverts commit cdb3f61fc8.

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-02-28 16:55:06 +08:00
sammy.huang
1200bcc65d
enhance: [skip e2e]bump milvus version for scripts/standalone_embed.sh (#30696)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-21 09:32:54 +08:00
sammy.huang
d097d558b6
enhance: Maximize build space at the begin (#30540)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-06 10:29:40 +08:00
sammy.huang
32914a3ddf
enhance: [skip e2e]cleanup unnecessary part in the github action (#30425)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-01 14:39:04 +08:00
sammy.huang
265453f400
enhance: [skip e2e]revert back to original way to archive, upload and download (#30248)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-01 10:15:04 +08:00
sammy.huang
927d310959
enhance: [skip e2e]change to a better name (#30329)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-29 09:45:08 +08:00
sammy.huang
ae4f62ab4b
enhance: [skip e2e]Revert changes from pr 29890 (#29957)
Revert changes from pr #29890

This reverts commit 61acda4948.

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-22 10:00:55 +08:00
sammy.huang
e7dc82d8cc
enhance: [skip e2e]to workaround the error "HOME not set" (#30047)
issue: #30046

to workaround the error "HOME not set"  happened in self hosted runner

solution from
https://alexanderhose.com/aws-codecommit-with-instance-role-and-user-data/

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-17 16:12:54 +08:00
sammy.huang
750166fd97
enhance: [skip e2e] failed to run all-contributors workflow (#29974)
issue: #30025

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-16 16:24:52 +08:00
congqixia
2dacca7b84
enhance: [skip e2e] use checkout action to get ".git" for codecov (#30014)
Ignoring .git may result "unusable report" in codecov. Use checkout
action to get .git information in upload codecov step

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-16 13:56:53 +08:00
sammy.huang
61acda4948
enhance: [skip e2e]debug why no configuration file when docker-compose up (#29890)
#29889

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-12 10:38:51 +08:00
sammy.huang
0b3b753ef6
enhance: clean .github/workflow/main.yaml (#29524)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-11 18:20:52 +08:00