Commit Graph

71 Commits

Author SHA1 Message Date
Jay Chung
91d56f4860
fix: data quality may fail in docker mode (#15563) 2024-02-05 17:14:59 +08:00
Wenjun Ruan
7b9c9e0eb2
Enable set ServerLoadProtection fot Master/Worker (#15439) 2024-01-14 22:17:58 +08:00
Gallardot
1c1d4bd592
[Improvement][Helm] using helm-docs to generate docs automatically (#15299) 2023-12-29 11:24:37 +08:00
Wenjun Ruan
90250998c4
Add deploy on Terraform on README (#15189) 2023-11-20 16:19:07 +08:00
Gallardot
2f2825784a
[Improvement][Helm] support task type filter (#15179) 2023-11-19 15:15:10 +08:00
旺阳
b532fe5eda
[Improvement][Registry][Jdbc] Add jdbc registry config in helm charts (#14431)
* k8s support jdbc registryt

* fix spotless

* fix

* update

* update

* update

* update
2023-10-11 20:52:11 -05:00
Gallardot
4fe41ac57f
[Feature][Helm] Supports deploying only partial components (#14985)
* [Feature][Helm] Supports deploying only partial components

* chore: add doc

* chore: miss some doc
2023-10-10 20:58:49 +08:00
Gallardot
11d1df2f32
[Improvement][helm] configmap changes automatically trigger restart (#14657)
* [Improvement][helm] configmap changes automatically trigger restarts

Signed-off-by: Gallardot <gallardot@apache.org>

* feat: add an optional parameter

Signed-off-by: Gallardot <gallardot@apache.org>

---------

Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-08-09 10:30:20 +08:00
Gallardot
5a550dd628
[Improvement][CI] deploy to k8s (#14555)
* [Improvement][CI] deploy to k8s

Signed-off-by: Gallardot <gallardot@apache.org>

---------

Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
2023-07-26 17:18:04 +08:00
Gallardot
0188f40b84
[Improvement][HELM] add driver-class-name (#14614)
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-07-24 11:58:33 +08:00
Jay Chung
de2d215aee
impv: Correct datax execute and python execute script name (#14523)
* impv: Correct datax execute and python execute script name

we use PYTHON_LAUNCHER for python script execute and
DATAX_LAUNCHER for datax script name

* Add pr number

* fix ut

* style

---------

Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-20 09:13:55 +08:00
Gallardot
f5be784044
[Feature][K8S] add prometheus serviceMonitor (#14539)
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-07-17 16:01:05 +08:00
Jay Chung
b5d88f2a6f
fix terrafrom config bug (#14362) 2023-07-14 09:52:16 +08:00
旺阳
f186cd5dab
[Feature][Api] LDAP SSL supports&& Add LDAP K8s configuration (#14349) 2023-06-29 16:14:37 +08:00
旺阳
1c0dfbb044
[Improvement][Etcd] Support SSL In Etcd And Enhance Etcd In Helm (#13924) 2023-06-14 13:29:50 +08:00
Rick Cheng
4fa0ab4d7e
[feature][Resource] Add support for Azure Blob Storage in the resource center (#14082) 2023-06-12 12:05:49 +08:00
Aaron Wang
41e3ce35a7
fix: disordered comments in values.yaml (#14197) 2023-05-24 21:06:18 +08:00
eye-gu
0a5b32e8b6
[Improvement-13785][docker] upgrade zk and pg image version to support arm architecture (#13789)
Co-authored-by: eye <eye.gu@aloudata.com>
2023-04-19 16:37:01 +08:00
Wenjun Ruan
61a689aa5a
Use percentage to represent memory/cpu usage (#13896) 2023-04-13 15:48:20 +08:00
kezhenxu94
664d2e4ed3
Add init schema job to Helm hooks so that schema can be updated when upgrading deployment (#13898) 2023-04-10 15:44:20 +08:00
Wenjun Ruan
41a8ba9aab
Support alert server HA (#13865)
* Support alert server cluster

* Remove WORKER_ALERT_LISTEN_HOST in statefulset-dolphinscheduler-worker.yaml
2023-04-05 17:31:50 +08:00
Rick Cheng
2dceb6b8ca
[Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center (#13562) 2023-03-15 19:29:27 +08:00
Aaron Wang
34d49e0d28
remove WORKER_GROUP conf in values.yaml (#13718) 2023-03-10 15:12:06 +08:00
Aaron Wang
047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes (#13550) 2023-02-21 23:26:21 +08:00
qindongliang
6a0f48e533
[Feature-13354][deploy] Add configurable busybox image in values.yaml (#13354) (#13560) 2023-02-14 12:53:49 +08:00
kezhenxu94
a6550bc4a2
Set init job as a helm hook so that DS can be upgraded using helm upgrade, also remove legacy registryPluginDir˚ (#13547) 2023-02-11 16:35:57 +08:00
kezhenxu94
a843e0b96d
Add documentation to release Helm Chart (#13385) 2023-01-15 10:10:31 +08:00
Eric Gao
366f999167
[Feature][Deployment] Add KEDA autoscaler support for worker deployment when deployed in K8S cluster (#13367)
* Add keda autoscaler support for worker deployment when deployed in K8S cluster

* Add mysql scaler for worker autoscaling

* Add docs for worker autoscaler

* Add support for external postgresql db
2023-01-14 13:51:15 +08:00
Eric Gao
dd0d73036e
Fix minio version in helm chart (#13368) 2023-01-11 00:40:17 +08:00
陈家名
9199049180
[Improvement][docker] Add SPRING_JACKSON_TIME_ZONE to .env file (#13271)
* tz in docker

* update default tz and update doc

Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
2022-12-27 14:41:34 +08:00
Amy0104
1f7f900e78
[Fix][Doc] Replace the links. (#13276)
* [Fix][Doc] Replace the links.

* [Fix][Doc] Revised `.dlc.json`

* [Fix] Fix the dead link.
2022-12-26 14:32:40 +08:00
kezhenxu94
de6bc56aee
Add Terraform deploy manifests for quick setup in AWS (#13252) 2022-12-22 16:55:32 +08:00
Amy0104
dcf02eab45
[Fix] Replaced dead links in the docs. (#13170)
* [Fix] Replaced dead links.

* [Improvement] Format markdowns.
2022-12-13 14:36:53 +08:00
旺阳
e180e16981
[Fix] Fix Java path in Kubernetes Helm Chart (#12987) 2022-11-24 15:35:03 +08:00
kezhenxu94
454f1303a0
Add minio as demo storage for helm charts (#12861) 2022-11-11 10:26:57 +08:00
旺阳
23e9d2698c
fix and enhance helm db config (#12707) 2022-11-05 18:20:03 +08:00
旺阳
6766ec04df
Add pythonNodePort in config file (#12685) 2022-11-03 17:47:06 +08:00
Aaron Wang
08335b1032
[Improvement][Task] Improved way to collect yarn job's appIds (#12197)
* Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code.
* Add user property `appId.collect` for user to decide how to collect applicationId.
* Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh`
* Update docs to declare how to use aop way.
* Update `LogUtils` to support fetch applicationId in different ways based on the user property.

Co-authored-by: gabrywu <gabrywu@apache.com>
2022-10-31 16:52:53 +08:00
kezhenxu94
d4e7ae96a9
Add configmap resource permissions so config hot reload can work (#12572) 2022-10-28 10:27:44 +08:00
kezhenxu94
fdac751379
Add mysql support to helm chart (#12517) 2022-10-25 09:20:14 +08:00
司马琦昂
1e792186d0
[Fix][Worker] fix wrong env var name for alert in K8S (#12369) 2022-10-14 16:19:57 +08:00
rickchengx
6332fee2b5
[Improvement-12289][k8s] update the common.properties in values.yaml (#12290) 2022-10-12 15:55:36 +08:00
rickchengx
08a4c7981f
[improve] Remove the spark version of spark task (#11860) 2022-09-21 20:27:28 +08:00
Eric Gao
a44817fc46
[Doc][Style] Fix doc format once for all (#12006) 2022-09-17 11:33:32 +08:00
shiyu li
cc5f710147
[helm] fix worker template persistentVolumeClaim link (#11248) 2022-09-11 20:46:55 +08:00
陈家名
28469fc9b2
[bug][k8s] Change the config file keys in K8s to be the same as those in common.properties (#11812) 2022-09-07 10:35:50 +08:00
陈家名
6f3b0b2432
[k8s] Delete unnecessary configurations. (#11808) 2022-09-06 21:31:56 +08:00
爱穿格子裤
1c15a7d605
[fix-11404]: make the common.properties to configurable on values.yaml (#11441)
and set the resource.storage.type default to hdfs
2022-08-19 14:06:30 +08:00
caishunfeng
b03f2e22cd
fix k8s master and worker start error (#11156) 2022-07-27 09:23:17 +08:00
Lyle Shaw
5855274b26
[Fix-10652] fix docker-compose.yml (#10653)
* [Fix-10652] fix docker-compose.yml

* [Fix-10652] fix docker-stack.yml

* [Fix-10652] fix python api port in k8s config

* Update deploy/kubernetes/dolphinscheduler/templates/deployment-dolphinscheduler-api.yaml

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>

* [Fix-10652] fix { { to {{

* [Fix-10652] del space between {{ and -

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-06-30 15:43:19 +08:00