Commit Graph

483 Commits

Author SHA1 Message Date
Rijin-N
a05a37a583
enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214)
Native support for Google cloud storage using the Google Cloud Storage
libraries. Authentication is performed using GCS service account
credentials JSON.

Currently, Milvus supports Google Cloud Storage using S3-compatible APIs
via the AWS SDK. This approach has the following limitations:

1. Overhead: Translating requests between S3-compatible APIs and GCS can
introduce additional overhead.
2. Compatibility Limitations: Some features of the original S3 API may
not fully translate or work as expected with GCS.

To address these limitations, This enhancement is needed.

Related Issue: #36212
2024-09-30 13:23:32 +08:00
yellow-shine
9aa01c69f8
enhance: add a env (#36142)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-09-10 15:19:13 +08:00
yellow-shine
a802aea13c
enhance: bump etcd version (#35978)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-09-06 10:23:05 +08:00
yellow-shine
241c71fdde
enhance: use docker compose instead of docker-compose (#35208)
https://github.com/milvus-io/milvus/issues/35209

---------

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-02 19:32:32 +08:00
edward.zeng
95c4600958
enhance: Refine milvus dashboard for milvus 2.3 and 2.4 (#34994)
/kind improvement
cc @yanliang567 
issue: https://github.com/milvus-io/milvus/issues/34476

Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2024-07-25 15:41:46 +08:00
SimFG
2944971507
enhance: fix the dev docker yaml and use go install to install the gotestsum (#32197)
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-04-12 19:17:18 +08:00
sammy.huang
c895093959
enhance: add some parameters in docker-compose (#31454)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-03-20 20:45:11 +08:00
cai.zhang
7b5110d73b
enhance: Support azurite docker for develope env (#29021)
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2023-12-31 17:16:43 +08:00
sammy.huang
11687dce60
enhance: [skip e2e]upgrade minio version (#28971)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-05 14:14:34 +08:00
PowderLi
a1c505dbd5
add internal storage metrics (#28278)
/kind improvement
issue: #28277

Signed-off-by: PowderLi <min.li@zilliz.com>
2023-11-19 17:22:25 +08:00
Bennu
8c71e2bd64
Update milvs helm repo for ci (#28042)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-11-01 18:54:16 +08:00
Bennu
8bd125b122
[skip e2e]Update etcd health check (#27980)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-10-30 14:42:12 +08:00
Bennu
905d4b389a
[skip e2e] Bump milvus gpu version to 2.3.0 (#26631)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-28 13:56:25 +08:00
Bennu
8d3398c1fa
[skip e2e] Bump milvus version to 2.3.0 (#26590)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-08-23 22:12:23 +08:00
Gao
87e2cef77b
Support some knowhere metric in grafana dashboard (#26432)
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2023-08-18 16:20:18 +08:00
LiuHanCheng
19497247b8
fix typo in milvus-dashboard.json (#24005)
Signed-off-by: Liu Hancheng <liuhancheng.cn@gmail.com>
2023-05-18 14:25:23 +08:00
Enwei Jiao
940ead200a
Update Development.md (#23207)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-04 13:38:28 +08:00
smellthemoon
ce91f61e5a
Pre-create topics (#21907)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-04-03 16:44:23 +08:00
Bennu
f8c9c527c9
[skip e2e]Add docker-compose for gpu (#22878)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-03-21 17:59:57 +08:00
Bennu
7305feb536
[skip e2e] Bump milvus to 2.3.0 (#22869)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-03-20 20:27:57 +08:00
edward.zeng
4899d84439
Refine docker-compose environment variable value (#22834)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2023-03-18 00:37:55 +08:00
Bennu
6fa217568e
[skip e2e] Bump milvus to 2.2.4 (#22832)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-03-17 18:31:56 +08:00
edward.zeng
500aede384
Enable activestandby for milvus coordinators (#22531)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2023-03-02 17:51:48 +08:00
Bennu
15220f32e5
Bump etcd version (#22213)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-02-16 15:56:35 +08:00
Sheldon
7c49530349
script for rolling update milvus's componet which installed by helm (#21820)
script for rolling update milvus's componet which installed by helm
1. only support simple upgrade now,will upgrade the component in a safe order
2. won't keep old version information and don't support rollback now
3. the topology is hard-coded now
4. will patch instance's configmap and turn on standby mode
5. will patch instance's update strategy to rollingUpdate mode
6. not support milvus standalone with rocksmp

Signed-off-by: Sheldon <chuanfeng.liu@zilliz.com>
2023-02-13 16:58:33 +08:00
Bennu
9b8f04fd84
Upgrade etcd image version to 3.5.5 (#22130)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-02-10 19:02:32 +08:00
Bennu
50a3645d71
Bump milvus to 2.2.3 (#22125)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-02-10 18:14:31 +08:00
congqixia
f66d36f111
Add segment_state legend in Milvus dashboard (#22108)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-10 10:16:31 +08:00
Filip Haltmayer
aa84124d24
fix migrate_pod version (#21876)
Signed-off-by: Filip Haltmayer <filip.haltmayer@zilliz.com>
2023-01-31 09:43:50 +08:00
edward.zeng
6511e38634
Update default image tag for meta migration (#21709)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2023-01-13 16:51:40 +08:00
zhuwenxing
76c0292bca
[skip e2e]Update export log script (#21654)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-01-12 19:27:40 +08:00
Bennu
ae435768f2
[skip e2e] Update docker-compoer.yaml to open minio 9000 port (#21675)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-01-12 15:15:40 +08:00
Bennu
98088e3be6
Bump milvus version to v2.2.2 (#21350)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2022-12-22 17:47:27 +08:00
edward.zeng
a4e6c2ce79
Bump milvus version to v2.2.1 (#21259)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>

Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-12-15 17:11:22 +08:00
Bennu
ab801a1d67
[skip e2e] Add log export for milvus installed by operator (#20982)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>

Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2022-12-08 09:47:32 +08:00
edward.zeng
170bbde0de
Add storageclass check for meta migration (#20804)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>

Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-11-28 09:19:14 +08:00
edward.zeng
a54b40e7ac
Bump milvus version to v2.2.0 (#20718)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>

Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-11-18 21:59:09 +08:00
jaime
4c2b20378d
Refine dashboard (#20449)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-11 14:23:06 +08:00
jaime
709a0a94e9
Add some msgstream metrics (#20296)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-07 10:15:02 +08:00
Bennu
ebda9fec52
[skip e2e] Add role_name for time_tick_delay panel of milvus dashboard (#20336)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>

Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2022-11-04 17:11:36 +08:00
edward.zeng
d737a66155
Fix session alive bug for meta migration script (#20230)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>

Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-11-01 14:21:34 +08:00
edward.zeng
79ef03eb3e
Fix meta migration bug (#20105)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>

Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-10-26 19:29:32 +08:00
edward.zeng
e91e68c286
Add a flag to change the image tag for meta migration pod (#20080)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>

Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-10-26 16:33:31 +08:00
Yiyun Ni
336809e180
Refine meta migration guide (#19964)
Signed-off-by: YiyunNi <yiyun.ni@zilliz.com>

Signed-off-by: YiyunNi <yiyun.ni@zilliz.com>
2022-10-26 08:23:34 +08:00
Bennu
3a2b8e4c51
[skip e2e] Add dashboard panels for new milvus metrics (#19989)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>

Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2022-10-25 15:31:30 +08:00
edward.zeng
8d09bb8d8e
Fix -d flag for meta migration script (#19975)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>

Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-10-21 15:55:28 +08:00
edward.zeng
cfdcf77277
Add an option to automatically cleanup after successful meta migration (#19928)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>

Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-10-20 15:17:27 +08:00
edward.zeng
35844c70a2
Fix meta migration script (#19923)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>

Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-10-20 12:57:27 +08:00
edward.zeng
c9d4f10ce5
Add meta migration script for milvus installation in kubernetes (#19861)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>

Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-10-20 08:57:30 +08:00
Bennu
4d1ab28d4f
change some metric names for milvus dashboards (#19510)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>

Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2022-10-19 15:09:28 +08:00