Commit Graph

39 Commits

Author SHA1 Message Date
Amy0104
dcf02eab45
[Fix] Replaced dead links in the docs. (#13170)
* [Fix] Replaced dead links.

* [Improvement] Format markdowns.
2022-12-13 14:36:53 +08:00
旺阳
e180e16981
[Fix] Fix Java path in Kubernetes Helm Chart (#12987) 2022-11-24 15:35:03 +08:00
kezhenxu94
454f1303a0
Add minio as demo storage for helm charts (#12861) 2022-11-11 10:26:57 +08:00
旺阳
23e9d2698c
fix and enhance helm db config (#12707) 2022-11-05 18:20:03 +08:00
旺阳
6766ec04df
Add pythonNodePort in config file (#12685) 2022-11-03 17:47:06 +08:00
Aaron Wang
08335b1032
[Improvement][Task] Improved way to collect yarn job's appIds (#12197)
* Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code.
* Add user property `appId.collect` for user to decide how to collect applicationId.
* Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh`
* Update docs to declare how to use aop way.
* Update `LogUtils` to support fetch applicationId in different ways based on the user property.

Co-authored-by: gabrywu <gabrywu@apache.com>
2022-10-31 16:52:53 +08:00
kezhenxu94
d4e7ae96a9
Add configmap resource permissions so config hot reload can work (#12572) 2022-10-28 10:27:44 +08:00
kezhenxu94
fdac751379
Add mysql support to helm chart (#12517) 2022-10-25 09:20:14 +08:00
司马琦昂
1e792186d0
[Fix][Worker] fix wrong env var name for alert in K8S (#12369) 2022-10-14 16:19:57 +08:00
rickchengx
6332fee2b5
[Improvement-12289][k8s] update the common.properties in values.yaml (#12290) 2022-10-12 15:55:36 +08:00
rickchengx
08a4c7981f
[improve] Remove the spark version of spark task (#11860) 2022-09-21 20:27:28 +08:00
Eric Gao
a44817fc46
[Doc][Style] Fix doc format once for all (#12006) 2022-09-17 11:33:32 +08:00
shiyu li
cc5f710147
[helm] fix worker template persistentVolumeClaim link (#11248) 2022-09-11 20:46:55 +08:00
陈家名
28469fc9b2
[bug][k8s] Change the config file keys in K8s to be the same as those in common.properties (#11812) 2022-09-07 10:35:50 +08:00
陈家名
6f3b0b2432
[k8s] Delete unnecessary configurations. (#11808) 2022-09-06 21:31:56 +08:00
爱穿格子裤
1c15a7d605
[fix-11404]: make the common.properties to configurable on values.yaml (#11441)
and set the resource.storage.type default to hdfs
2022-08-19 14:06:30 +08:00
caishunfeng
b03f2e22cd
fix k8s master and worker start error (#11156) 2022-07-27 09:23:17 +08:00
Lyle Shaw
5855274b26
[Fix-10652] fix docker-compose.yml (#10653)
* [Fix-10652] fix docker-compose.yml

* [Fix-10652] fix docker-stack.yml

* [Fix-10652] fix python api port in k8s config

* Update deploy/kubernetes/dolphinscheduler/templates/deployment-dolphinscheduler-api.yaml

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>

* [Fix-10652] fix { { to {{

* [Fix-10652] del space between {{ and -

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-06-30 15:43:19 +08:00
旺阳
0b377f72b1
[Fix-10400]Fix K8s deployment bitnami version error (#10567)
* Fix k8s bitnami bug

* add comments
2022-06-24 15:29:26 +08:00
旺阳
388b214aca
[fix] Change K8s postgresql password key name (#10545) 2022-06-23 11:37:56 +08:00
Mr.An
a7e20798cb
Update chart.yaml dependencies version (#10420) 2022-06-13 10:27:34 +08:00
Hwting
5803d5c07c
[fix][deploy]fix run on kubernetes bug (#10379)
* [fix][kubernetes]fix run on kubernetes bug

Fix the problem that the "REGISTRY_ZOOKEEPER_CONNECT_STRING" variable zookeeper port number is "nil"

* [fix][kubernetes]fix run on kubernetes bug

Fix the problem that the "REGISTRY_ZOOKEEPER_CONNECT_STRING" variable zookeeper port number is "nil"
2022-06-09 15:57:20 +08:00
caishunfeng
4351148f36
[Bug] init docker compose DATABASE env (#10244)
skip source env if in docker
2022-05-26 13:50:59 +08:00
caishunfeng
b1885c7a26
[Bug] fix run on docker and k8s (#10026)
* fix docker-compose init schema

* recovery depend on zk

* update doc and dockerfile

* fix run on k8s

* udpate doc

* add DOCKER flag & update doc

* remove repeat DOCKER env
2022-05-16 15:41:45 +08:00
Jiajie Zhong
8d17fd20f9
[ci] Dead link check all markdown file (#10004)
there are 162 markdown files in dir `docs`
and all file in project is 175 files, so I
think check all file will not add too much
load for our ci, but it could discovered
the dead link in time to avoid some thing
like #9998
2022-05-12 11:30:01 +08:00
jiachuan.zhu
24e455304c
Add ingress annotations (#9492) 2022-04-19 20:01:57 +08:00
Eric Gao
fd6b43bc81
[Dev] Switch version in pom.xml to dev-SNAPSHOT (#9223) (#9299) 2022-04-07 18:15:19 +08:00
Jiajie Zhong
3457cee960
[python] Migrate pythonGatewayServer into api server (#9372)
Currently the size of our distribute package is up to
800MB, this patch is migrate python gateway server into
api server

The distribute package size before and after this patch is:

```sh
# before
796M   apache-dolphinscheduler-2.0.4-SNAPSHOT-bin.tar.gz

# after
647M   apache-dolphinscheduler-2.0.4-SNAPSHOT-bin.tar.gz
```
2022-04-07 14:41:15 +08:00
Jiajie Zhong
9f84dbbda0
[doc] Migrate dev doc from website repository (#9291)
* [doc] Migrate dev doc from website repository

* Correct release language

* Fix license issue

* Add all images from website

* Delete unused images

* Add CI

* Fix ci

* fix ci

* Remove no need file

* Add latest commit from website

* correct img_utils.py script

* Remove unused imgs
2022-04-02 10:43:34 +08:00
simsicon
a38adcb579
Fix https://github.com/apache/dolphinscheduler/issues/8602 (#8604) 2022-03-12 20:51:52 +08:00
Kerwin
103ccb01da
change version to 2.0.4-SNAPSHOT (#8188) 2022-01-25 15:17:17 +08:00
kezhenxu94
df26be89ed
Fix wrong Python gateway docker image name (#8143) 2022-01-21 09:43:28 +08:00
wind
c16f65e0d1
[conf] Update master config on k8s (#8045)
Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-14 17:41:43 +08:00
Jiajie Zhong
da4a85943c
[python] Add independent deployment for python gateway server (#7549)
* [python] Add independent deployment to python gateway server

* Correct some error

* Add missing deployment change

* Add missing expose port

* Add missing standalone config

* Keyword change from rpc to socket

* try to fix

* Add python gateway server to scp-hosts.sh
2022-01-07 15:16:05 +08:00
Aaron Lin
7fd94ffa40
[Improvement][Logger]Remove the logger server from the deployment (#7837) 2022-01-06 20:05:05 +08:00
kezhenxu94
b350dc70c9
Build and publish snapshot Docker images for testing (#7454) 2021-12-17 00:26:09 +08:00
kezhenxu94
12b46dfaa6
Adjust Helm Chart templates in dev branch (#7353) 2021-12-12 23:17:50 +08:00
kezhenxu94
bacb7c1598
Fix typo in docker swarm (#7336) 2021-12-12 12:02:21 +08:00
kezhenxu94
67cc260d52
Split the components into individual package, refactor configurations to use Spring properties (#7160)
* Split the components into individual package

A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.

* Split the components into individual package

A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.

* Split the components into individual package

A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.
2021-12-10 11:28:53 +08:00