Commit Graph

42 Commits

Author SHA1 Message Date
kezhenxu94
4114cb07f6
Add actuator and enable metrics, add Grafana configs (#6840) 2021-11-14 20:22:13 +08:00
Shiwen Cheng
94a08c8f32
[Improvement] Remove incubating (#5305) 2021-04-16 22:56:51 +08:00
Kirs
ac15f45b0b
Update the main repository link (#5286) 2021-04-16 10:56:48 +08:00
Shiwen Cheng
1cd62b4a5e
[Improvement][Datax] Re-assign DATAX_HOME to /opt/soft/datax instead of /opt/soft/datax/bin/datax.py (#5019) 2021-03-17 14:38:04 +08:00
wenjun
fd4b59ad6c
[Improvement][Worker] Rename worker.weight to worker.host.weight (#4997) (#5014) 2021-03-10 08:55:04 +08:00
zt-1997
afd201e6fa
[FIX-#4592]Fix that the worker group management IP is not displayed correctly. (#4620)
Co-authored-by: zt-1997 <“18841012545@163.com”>
2021-01-29 16:54:39 +08:00
baoliang
381d23ea4f merge from 1.3.3-release 2020-11-06 00:03:20 +08:00
lgcareer
ccdaee9c04
[ambari-plugin]change version 1.3.2 to 1.3.3 (#3935) 2020-10-18 10:47:00 +08:00
lgcareer
bef180aeb9
[Feature][ambari_plugin]support one worker can belongs different worker groups when execute install script (#3410) 2020-08-05 13:50:02 +08:00
lgcareer
bc5a4dfd2a
[bug fix][ambari-plugin]cherry pr3096 that write unit into config file (#3367)
* resolve #3096 fixbug ambari plugin the config options which has unit doesnt write unit into config file (#3209)

Co-authored-by: zhangchunyang <zhangchunyang@analysys.com.cn>

* remove 1.2.1 directory and cherry pick pr 3096

* change 1.3.0 to 1.3.2 of the ambari plugin

Co-authored-by: zhangchunyang <zhangchunyang0123@gmail.com>
Co-authored-by: zhangchunyang <zhangchunyang@analysys.com.cn>
2020-08-01 11:00:06 +08:00
BoYiZhang
32e8a9d50c
[bugfix] Default JVM parameter bug (#3212)
* fix bug

Delete invalid field: executorcores

Modify verification prompt

* fix bug

Delete invalid field: executorcores

Modify verification prompt

* fix bug

Delete invalid field: executorcores

Modify verification prompt

* dag  add close button

* reset last version

* reset last version

* dag add close buttion

dag add close buttion

* update  CLICK_SAVE_WORKFLOW_BUTTON  xpath

* updae CLICK_SAVE_WORKFLOW_BUTTON xpath

* updae CLICK_SAVE_WORKFLOW_BUTTON xpath

* updae CLICK_SAVE_WORKFLOW_BUTTON xpath

* Update CreateWorkflowLocator.java

modify submit workflow button

* Update CreateWorkflowLocator.java

* Update CreateWorkflowLocator.java

modify CLICK_ADD_BUTTON

* Update CreateWorkflowLocator.java

delete print

* Update CreateWorkflowLocator.java

1

* Update CreateWorkflowLocator.java

1

* Setting '-XX:+DisableExplicitGC ' causes netty memory leaks

in addition

update '- XX: largepagesizeinbytes = 128M' to '- XX: largepagesizeinbytes = 10M'

* Update dag.vue

* Update dag.vue

* Update dag.vue

* Update CreateWorkflowLocator.java

* Revert "Setting '-XX:+DisableExplicitGC ' causes netty memory leaks"

This reverts commit 3a2cba7a

* Setting '-XX:+DisableExplicitGC ' causes netty memory leaks

in addition

update '- XX: largepagesizeinbytes = 128M' to '- XX: largepagesizeinbytes = 10M'

* Update dolphinscheduler-daemon.sh

Co-authored-by: dailidong <dailidong66@gmail.com>
Co-authored-by: xingchun-chen <55787491+xingchun-chen@users.noreply.github.com>
2020-07-23 10:59:51 +08:00
rockxsj
b6a0d55949
fix and update k8s deploy (#3215)
* Modify the AWS S3 request encryption method to V4.

* * update Dockerfile to add mysql-client for mysql database service test
* update wechat alert config replace placeholder from  to {xx} because of the  will be treat as env variable
* fix unit test of EnterpriseWeChatUtilsTest
* update values.yaml default config for helm deploy DS cluster
* update values.yaml default config for custom install
* update templates of helm for custom install
* update some name of env varibale, for example change from POSTGRESQL_HOST to DATABASE_HOST
* delele the redundancy requirements.yaml for heml
* update README* in the docker dir and subdir
* update startup scripts for support mysql as backend database

* * fix the ENV name wrong in docker-compose.yml and docker-stack.yml
* remove the didn't need port mapping in postgresql & zookeeper & dolphinscheduler-api

* * keep expose the port of postgresql & zk & api because of unit test needed

* * remove mysql-client package from dockerfile

Co-authored-by: rockxsj <junjun@mgtv.com>
2020-07-16 16:36:29 +08:00
zhangchunyang
438a009a3e
resolve #3096 fixbug ambari plugin the config options which has unit doesnt write unit into config file (#3209)
Co-authored-by: zhangchunyang <zhangchunyang@analysys.com.cn>
2020-07-14 16:11:54 +08:00
zhangchunyang
3485f45db5 [feature] readme.md adds instructions for changing environment variables (#3031)
Co-authored-by: zhangchunyang1024 <zhangchunyang0123@gamil.com>
2020-06-30 14:18:34 +08:00
zhangchunyang
2031528add [bugfix] 1. fix alert.json includes repeated tag 'DOLPHIN_ALERT' 2. metainfo.xml The version number of the RPM package is no longer specified in the metainfo.xml (#3032)
Co-authored-by: zhangchunyang1024 <zhangchunyang0123@gamil.com>
2020-06-30 14:18:23 +08:00
zhangchunyang
0f8cb383a3 [bugfix] remove Conflicting configuration sudo and user (#3038)
Co-authored-by: zhangchunyang1024 <zhangchunyang0123@gamil.com>
2020-06-30 14:18:09 +08:00
lenboo
9c78e2888b merge from dev 2020-06-30 11:18:42 +08:00
lenboo
cb6c711833 merge from dev-1.3.0 2020-06-30 11:15:14 +08:00
zhangchunyang
8c29e2a1c0
[feature] readme.md adds instructions for changing environment variables (#3031)
Co-authored-by: zhangchunyang1024 <zhangchunyang0123@gamil.com>
2020-06-30 11:02:25 +08:00
zhangchunyang
0fc49b2023
[bugfix] 1. fix alert.json includes repeated tag 'DOLPHIN_ALERT' 2. metainfo.xml The version number of the RPM package is no longer specified in the metainfo.xml (#3032)
Co-authored-by: zhangchunyang1024 <zhangchunyang0123@gamil.com>
2020-06-30 10:44:52 +08:00
gaojun2048
3cf9afc195 merge 1.3.0-release branch code 2020-06-29 18:42:18 +08:00
zhangchunyang
86dcc61731 Added instructions for ambari to add and remove Dolphin Schdumer components on nodes (#2806)
* delete unnecessary configuration items

* Added instructions for ambari to add and remove Dolphin Schdumer components on nodes

* Added instructions for ambari to add and remove Dolphin Schdumer components on nodes
2020-06-29 17:39:34 +08:00
zhangchunyang
6be6076e22 delete unnecessary configuration items (#2803) 2020-06-29 17:39:33 +08:00
zhangchunyang
331b1078d4 Modify the ambari-plugin readme for packing RPM packages and add a description of the replication plug-in directory (#2786) 2020-06-29 17:39:30 +08:00
zhangchunyang
99098bb4cf 1. add file add README.md2. delete ambari_plugin/common-services/DOLPHIN/2.0.0 (#2546)
* Ambari plugin development for the dolphin scheduler in version 2.0.0 is complete

* Update the Ambari plugin of DS  usage documentation

* delete readme whic is not completed

* update version 2.0.0 backup to 1.3.0

* update ambari plugin version to 1.3.0

* add readme doc

* delete common-services/DOLPHIN/2.0.0

* update the version in doc

Co-authored-by: zhangchunyang <zhangchunyang@analysys.com.cn>
Co-authored-by: zhangchunyang <18910529250@163.com>
Co-authored-by: dailidong <dailidong66@gmail.com>
2020-06-29 17:39:05 +08:00
zhangchunyang
dbe504cded update version 2.0.0 backup to 1.3.0 (#2531)
* Ambari plugin development for the dolphin scheduler in version 2.0.0 is complete

* Update the Ambari plugin of DS  usage documentation

* delete readme whic is not completed

* update version 2.0.0 backup to 1.3.0

* update ambari plugin version to 1.3.0

Co-authored-by: zhangchunyang <zhangchunyang@analysys.com.cn>
Co-authored-by: zhangchunyang <18910529250@163.com>
2020-06-29 17:38:58 +08:00
zhangchunyang
ff4200b19e resolve #2475 Ambari plugin development for the dolphin scheduler in version 2.0.0 … (#2488)
* Ambari plugin development for the dolphin scheduler in version 2.0.0 is complete

* Update the Ambari plugin of DS  usage documentation

* delete readme whic is not completed

Co-authored-by: zhangchunyang <zhangchunyang@analysys.com.cn>
2020-06-29 17:38:52 +08:00
khadgarmage
416e0417ad license and checkoutv2 fix (#2261) 2020-06-29 17:36:29 +08:00
gaojun2048
eebf5fa796 fix rpmbuild and DS Ambari plugin bug (#2144)
* Update quick-start.md

* 更新demo的地址

* add rpm plugin

* delete the git ignore files

* 测试git ignore

* 测试ignore

* optimize the .gitignore file

* add rpm package, delete unuse copy jar action in assembly

* delete docs dir

* add rpm plugin support

* add rpm plugin support

* add rpm plugin support

* dolphinscheduler-common have not bin dir

* dolphinscheduler-common have not bin dir

* delete unuse config about assembly

* add defineSatement

* add rpm plugin support

* add rpm plugin support

* add rpm plugin support

* add rpm support

* update install dirname , make front and backend together

* update rpm name

* update rpm name

* update rpm config

* add jars excludes

* add jars excludes

* add rpm plugion

* add rpm plugion

* add rpm plugion

* add auto create /opt/soft

* The install dir can not be fixed to apache-dolphinscheduler-incubating-1.2.1 , its version is 1.2.2

* install from rpm will create a link

* the ui install thrown rpm only support jetty not nginx

* the ui install thrown rpm only support jetty not nginx

* sql目录里加上soft_version文件

* env dir need in conf dir

* remove no use module

* add module

* updaate

* rpmbuild add dolphinscheduler-service module
2020-06-29 17:36:27 +08:00
zhangchunyang
39b3a37abd
[bugfix] remove Conflicting configuration sudo and user (#3038)
Co-authored-by: zhangchunyang1024 <zhangchunyang0123@gamil.com>
2020-06-28 11:37:59 +08:00
lenboo
714ae33e40 merge from dev 2020-06-19 14:20:24 +08:00
Erik-ly
eef397675b
Fix bug #2991 duplicate key: DOLPHIN_ALERT (#2993)
edit duplicate DOLPHIN_ALERT and label

Co-authored-by: dailidong <dailidong66@gmail.com>
2020-06-17 14:38:27 +08:00
zhangchunyang
9994878005
Added instructions for ambari to add and remove Dolphin Schdumer components on nodes (#2806)
* delete unnecessary configuration items

* Added instructions for ambari to add and remove Dolphin Schdumer components on nodes

* Added instructions for ambari to add and remove Dolphin Schdumer components on nodes
2020-05-25 17:59:30 +08:00
zhangchunyang
15504bdde0
delete unnecessary configuration items (#2803) 2020-05-23 15:20:46 +08:00
zhangchunyang
cada877079
Modify the ambari-plugin readme for packing RPM packages and add a description of the replication plug-in directory (#2786) 2020-05-21 19:09:11 +08:00
zhangchunyang
ad90df2057
1. add file add README.md2. delete ambari_plugin/common-services/DOLPHIN/2.0.0 (#2546)
* Ambari plugin development for the dolphin scheduler in version 2.0.0 is complete

* Update the Ambari plugin of DS  usage documentation

* delete readme whic is not completed

* update version 2.0.0 backup to 1.3.0

* update ambari plugin version to 1.3.0

* add readme doc

* delete common-services/DOLPHIN/2.0.0

* update the version in doc

Co-authored-by: zhangchunyang <zhangchunyang@analysys.com.cn>
Co-authored-by: zhangchunyang <18910529250@163.com>
Co-authored-by: dailidong <dailidong66@gmail.com>
2020-04-30 19:36:08 +08:00
zhangchunyang
1185cdafb6
update version 2.0.0 backup to 1.3.0 (#2531)
* Ambari plugin development for the dolphin scheduler in version 2.0.0 is complete

* Update the Ambari plugin of DS  usage documentation

* delete readme whic is not completed

* update version 2.0.0 backup to 1.3.0

* update ambari plugin version to 1.3.0

Co-authored-by: zhangchunyang <zhangchunyang@analysys.com.cn>
Co-authored-by: zhangchunyang <18910529250@163.com>
2020-04-26 18:50:38 +08:00
Kevin
2f5427ca33
reset default zookeeper parameter #2494 (#2495)
* reset default zookeeper parameter

* fix install.sh zookeeper.properties

Co-authored-by: dailidong <dailidong66@gmail.com>
2020-04-22 20:14:13 +08:00
zhangchunyang
276e3f9a20
resolve #2475 Ambari plugin development for the dolphin scheduler in version 2.0.0 … (#2488)
* Ambari plugin development for the dolphin scheduler in version 2.0.0 is complete

* Update the Ambari plugin of DS  usage documentation

* delete readme whic is not completed

Co-authored-by: zhangchunyang <zhangchunyang@analysys.com.cn>
2020-04-22 18:42:51 +08:00
khadgarmage
cddf803ba0
license and checkoutv2 fix (#2261) 2020-03-21 20:23:13 +08:00
gaojun2048
a0088c1137
fix rpmbuild and DS Ambari plugin bug (#2144)
* Update quick-start.md

* 更新demo的地址

* add rpm plugin

* delete the git ignore files

* 测试git ignore

* 测试ignore

* optimize the .gitignore file

* add rpm package, delete unuse copy jar action in assembly

* delete docs dir

* add rpm plugin support

* add rpm plugin support

* add rpm plugin support

* dolphinscheduler-common have not bin dir

* dolphinscheduler-common have not bin dir

* delete unuse config about assembly

* add defineSatement

* add rpm plugin support

* add rpm plugin support

* add rpm plugin support

* add rpm support

* update install dirname , make front and backend together

* update rpm name

* update rpm name

* update rpm config

* add jars excludes

* add jars excludes

* add rpm plugion

* add rpm plugion

* add rpm plugion

* add auto create /opt/soft

* The install dir can not be fixed to apache-dolphinscheduler-incubating-1.2.1 , its version is 1.2.2

* install from rpm will create a link

* the ui install thrown rpm only support jetty not nginx

* the ui install thrown rpm only support jetty not nginx

* sql目录里加上soft_version文件

* env dir need in conf dir

* remove no use module

* add module

* updaate

* rpmbuild add dolphinscheduler-service module
2020-03-13 13:04:33 +08:00
zhangchunyang
b4f2e5f421
Add ambari plugin #1469 (#1970)
* ambari plugin

* add readme.pdf

* ambari plugin

* add readme.md

* add readme.pdf

* 1.add license 2. update master cardinality 3. nesessary paramaters default empty 4. update alert message
2020-02-22 18:28:02 +08:00