Commit Graph

5014 Commits

Author SHA1 Message Date
JuFeng Li
a0a2c9141b
[FIX-4876]Http alert plugin fix (#4877)
* remove header in  httpRequest

* codestyle fix

Co-authored-by: 李巨丰 <lijf@2345.com>
2021-03-11 22:39:27 +08:00
zhuangchong
c8e31ad58e
[Improvement-4884][Common] fix the subsequent processing of getting the YARN ResourceManager address to be empty (#4885)
* fix yarn application url generate empty.

* removing Excess Processing

* update hadoop utils test class .

* add base exception class.

* update hadoop utils class code style.
2021-03-11 22:14:52 +08:00
wenjun
ea6b1de120
[Improvement][worker] Optimize KillYarnJob (4939) (#4943) 2021-03-11 22:13:44 +08:00
lenboo
6ef54ebe9b Merge remote-tracking branch 'upstream/dev' into spilit 2021-03-11 17:01:29 +08:00
Shiwen Cheng
beb5adb985
[Feature][MR] Support mapreduce name (#5029) 2021-03-11 12:35:08 +08:00
JuFeng Li
3769066803
[Fix-5032][Alert]Support email multiple format (#5033)
* support multilple email format

Co-authored-by: 李巨丰 <lijf@2345.com>
2021-03-11 11:35:25 +08:00
lenboo
461e6334ae Merge remote-tracking branch 'upstream/dev' into spilit 2021-03-10 19:08:17 +08:00
fredster33
9a3ae48396
Update PULL_REQUEST_TEMPLATE.md (#5022)
When commented out, even if the PR creator forgets to remove the tips, they will not appear in the PR when it is submitted.
2021-03-10 11:40:21 +08:00
fredster33
3197b321a1
Grammar changes for README (#5021) 2021-03-10 11:06:17 +08:00
Simon
c4d9ceffd1
[Feature][jsonsplit]add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix (#5012)
* Modify Project and ProjectUser Mapper

* Modify Project and ProjectUser Mapper

* project_code is bigint(20)

* modify ERROR name

* modify saveProcessDefine, remove the duplicate code with createTaskAndRelation

* modify import/export processdefinition, add genProcessData

* fix ut and bug

* code style

* repalce project_id with code

* conflicts solve

* conflicts solve

* conflicts solve

* bugfix

* modify listResources mothod and remove getResourceIds mothod

* 1

* conflicts solve

* modify listResources mothod and remove getResourceIds mothod

* modify listResources mothod and remove getResourceIds mothod

* replace processDefinitionVersion with processDefinitionLog

* codestyle

* codestyle

* add mapper module ut

* codestyle

* fix ProcessInstanceMapperTest

* codestyle

* conflicts solve

* conflicts solve

* conflicts solve

* conflicts solve

* conflicts solve

* fix ProcessInstanceMapperTest

* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest

* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest

* fix TaskInstanceMapperTest

* add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix

* codestyle

* codestyle
2021-03-10 10:50:49 +08:00
dddyszy
28dfde7002
[Fix-4862][Server] Kill yarn application command won't be execute whe… (#4936)
* [Fix-4862][Server] Kill yarn application command won't be execute when kill error
2021-03-10 09:21:34 +08:00
wenjun
fd4b59ad6c
[Improvement][Worker] Rename worker.weight to worker.host.weight (#4997) (#5014) 2021-03-10 08:55:04 +08:00
lenboo
81dcd6873d Merge remote-tracking branch 'upstream/dev' into spilit 2021-03-09 18:19:08 +08:00
Simon
40bcb2e818
[Feature][jsonsplit]fix TaskInstanceMapperTest (#5010)
* fix TaskInstanceMapperTest
2021-03-09 12:55:56 +08:00
JinyLeeChina
c010ac1f1d
[Feature][JsonSplit] Fix logical bug in saving process definition (#5009)
* modify checkDAGRing and ProcessService method

* modify process instance for project home page

* fix save process bug

* Fix logical bug in saving process definition

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-03-09 12:54:25 +08:00
Shiwen Cheng
e74932cfc2
[Feature-4960][Spark] Add name input for Spark and improve Spark & MR args (#4959)
* [Improvement][Spark] Improve spark args and add name input

* [Improvement][MR] Improve map reduce args

* [Improvement][Spark] Fix check style

* [Improvement][Spark] Fix check style for spark, flink and mr
2021-03-09 12:51:35 +08:00
xingchun-chen
0ac0f31548
Merge pull request #5002 from chengshiwen/improve-docker-compatibility
[Improvement-4837][Docker] Support docker compose file 3.1+ version and Optimize k8s template
2021-03-09 10:06:19 +08:00
zhuangchong
d13fab7497
fix mybatis mapper sql judgment condition of foreach statement. (#4964) 2021-03-09 09:44:11 +08:00
chengshiwen
a2aeeb7dab [Improvement][Docker] Add tenant tip for quick start 2021-03-08 23:37:24 +08:00
wenjun
89c9b51740
[Improvement]Add comments to ZKMasterClient.java(#5005) 2021-03-08 21:47:02 +08:00
guohaozhang
c3f43a1924
[Improvement-#4972] add kerberos init before yarn kill (#4973)
* [Improvement-#4972] add kerberos init before yarn kill

* [Improvement-#4972] fix code smell

* [Improvement-#4972] add ut
2021-03-08 20:17:28 +08:00
chengshiwen
6d2ae7523f [Improvement][K8s] Optimize metadata name 2021-03-08 19:08:20 +08:00
chengshiwen
167a768b32 [Improvement][K8s] Optimize fullname 2021-03-08 17:27:27 +08:00
JinyLeeChina
7f0678d3be
[Feature][JsonSplit] Fix save process bug (#5001)
* modify checkDAGRing and ProcessService method

* merge

* modify dagRing

* modify process instance for project home page

* fix save process bug

* codeStyle

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-03-08 17:01:02 +08:00
chengshiwen
b689630970 [Improvement][K8s] Optimize image pull secret 2021-03-08 16:25:24 +08:00
chengshiwen
e20ffacf22 [Improvement][K8s] Support local image 2021-03-08 16:11:59 +08:00
xingchun-chen
fd581af726
Merge pull request #4977 from chengshiwen/fix-docker-image-build-on-windows
[Fix-3124][Docker] Fix that can not build a docker image on Windows
2021-03-08 15:56:35 +08:00
Simon
ab18ca0acb
[Feature][jsonsplit]fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest (#5000)
* Modify Project and ProjectUser Mapper

* Modify Project and ProjectUser Mapper

* project_code is bigint(20)

* modify ERROR name

* modify saveProcessDefine, remove the duplicate code with createTaskAndRelation

* modify import/export processdefinition, add genProcessData

* fix ut and bug

* code style

* repalce project_id with code

* conflicts solve

* conflicts solve

* conflicts solve

* bugfix

* modify listResources mothod and remove getResourceIds mothod

* 1

* conflicts solve

* modify listResources mothod and remove getResourceIds mothod

* modify listResources mothod and remove getResourceIds mothod

* replace processDefinitionVersion with processDefinitionLog

* codestyle

* codestyle

* add mapper module ut

* codestyle

* fix ProcessInstanceMapperTest

* codestyle

* conflicts solve

* conflicts solve

* conflicts solve

* conflicts solve

* conflicts solve

* fix ProcessInstanceMapperTest

* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest

* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest
2021-03-08 14:36:52 +08:00
chengshiwen
d3afa1f93e [Improvement][Docker] Support docker compose file 3.1+ version 2021-03-08 12:58:17 +08:00
lenboo
eeaa495661 Merge branch 'json_split' of https://github.com/apache/incubator-dolphinscheduler into spilit 2021-03-08 10:53:02 +08:00
lenboo
bb7106d100 Merge remote-tracking branch 'upstream/dev' into spilit 2021-03-08 10:23:16 +08:00
Simon
6111f05250
[Feature][jsonspilt]fix ProcessInstanceMapperTest (#4989)
* Modify Project and ProjectUser Mapper

* Modify Project and ProjectUser Mapper

* project_code is bigint(20)

* modify ERROR name

* modify saveProcessDefine, remove the duplicate code with createTaskAndRelation

* modify import/export processdefinition, add genProcessData

* fix ut and bug

* code style

* repalce project_id with code

* conflicts solve

* conflicts solve

* conflicts solve

* bugfix

* modify listResources mothod and remove getResourceIds mothod

* 1

* conflicts solve

* modify listResources mothod and remove getResourceIds mothod

* modify listResources mothod and remove getResourceIds mothod

* replace processDefinitionVersion with processDefinitionLog

* codestyle

* codestyle

* add mapper module ut

* codestyle

* fix ProcessInstanceMapperTest

* codestyle

* conflicts solve

* conflicts solve

* conflicts solve

* conflicts solve

* conflicts solve

* fix ProcessInstanceMapperTest
2021-03-08 10:22:36 +08:00
Shiwen Cheng
71bd231c95
[Improvement][UI] Unify form model by m-list-box (#4982) 2021-03-08 08:58:38 +08:00
zhuangchong
e68e994d46
when Kerberos authentication is enabled,cannot get application status. (#4980) 2021-03-08 08:54:03 +08:00
bao liang
5e2b97b573
[feature-4417][JsonSplit]refactor json in process instance and process definition (#4993)
* remove the use of json

* remove json in process definition and process instance
2021-03-08 08:44:34 +08:00
JinyLeeChina
39a9c0c392
[Feature][jsonspilt]modify process instance for project home page (#4991)
* modify checkDAGRing and ProcessService method

* merge

* modify dagRing

* modify process instance for project home page

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-03-07 18:12:01 +08:00
lenboo
ce6338b353 Merge remote-tracking branch 'upstream/dev' into spilit 2021-03-07 08:59:36 +08:00
zhuangchong
86600d1328
AlertClientService null pointer exception in SqlTask. (#4983) 2021-03-06 17:45:38 +08:00
Simon
f24ecff840
[Feature][jsonsplit]add mapper module ut and some bugfix (#4957)
* Modify Project and ProjectUser Mapper

* Modify Project and ProjectUser Mapper

* project_code is bigint(20)

* modify ERROR name

* modify saveProcessDefine, remove the duplicate code with createTaskAndRelation

* modify import/export processdefinition, add genProcessData

* fix ut and bug

* code style

* repalce project_id with code

* conflicts solve

* conflicts solve

* conflicts solve

* bugfix

* modify listResources mothod and remove getResourceIds mothod

* 1

* conflicts solve

* modify listResources mothod and remove getResourceIds mothod

* modify listResources mothod and remove getResourceIds mothod

* replace processDefinitionVersion with processDefinitionLog

* codestyle

* codestyle

* add mapper module ut

* codestyle
2021-03-06 14:25:00 +08:00
Simon
bd4b2f85a9
[Feature][jsonsplit]add ProcessTaskRelationServiceImplTest/TaskDefinitionServiceImplTest (#4949)
* Modify Project and ProjectUser Mapper

* Modify Project and ProjectUser Mapper

* project_code is bigint(20)

* modify ERROR name

* modify saveProcessDefine, remove the duplicate code with createTaskAndRelation

* modify import/export processdefinition, add genProcessData

* fix ut and bug

* code style

* repalce project_id with code

* conflicts solve

* conflicts solve

* conflicts solve

* bugfix

* modify listResources mothod and remove getResourceIds mothod

* 1

* conflicts solve

* modify listResources mothod and remove getResourceIds mothod

* modify listResources mothod and remove getResourceIds mothod

* replace processDefinitionVersion with processDefinitionLog

* codestyle

* codestyle

* add ProcessTaskRelationServiceImplTest/TaskDefinitionServiceImplTest

* conflicts solve

* conflicts solve

* conflicts solve

* add ProcessTaskRelationServiceImplTest/TaskDefinitionServiceImplTest

* codestyle
2021-03-06 10:56:49 +08:00
chengshiwen
467d9f5681 [Fix-3124][Docker] Fix that can not build a docker image on Windows 2021-03-05 23:40:12 +08:00
lenboo
5bda7c344c Merge remote-tracking branch 'upstream/dev' into spilit 2021-03-05 22:11:55 +08:00
Shiwen Cheng
8112f5bcb5
[Fix][API] Fix KeeperException (#4961)
fix #4705
2021-03-05 21:34:54 +08:00
xingchun-chen
e851ec1367
Merge pull request #4962 from chengshiwen/improve-docker-readme
[Improvement][Docker] Improve readme, notes, and long host display
2021-03-05 15:50:10 +08:00
chengshiwen
fb2b55c150 [Improvement][Docker] Improve readme, notes, and long host display 2021-03-05 15:15:23 +08:00
Shiwen Cheng
8c68e2c60b
[Fix][Worker] Fix worker cannot start and alertClientService NullPointerException (#4956)
* [Fix][Worker] Fix worker cannot start

* [Fix][Worker] Fix alertClientService NullPointerException

* [Fix][Worker] Improve ut coverage

* [Improvement][CI] Improve workflow ci
2021-03-05 09:50:49 +08:00
dddyszy
01b71f1a0d
[Fix-4839][Server] Process cannot stop when killed with retry (#4841)
* [Fix-4839][Server] Process cannot stop when killed with retry

* [Fix-4839][Server] Process cannot stop when killed with retry
2021-03-04 21:10:11 +08:00
Simon
8b35e21390
[Feature][jsonsplit] replace processDefinitionVersion with processDefinitionLog (#4942)
* Modify Project and ProjectUser Mapper

* project_code is bigint(20)


* modify saveProcessDefine, remove the duplicate code with createTaskAndRelation

* modify import/export processdefinition, add genProcessData

* modify listResources mothod and remove getResourceIds mothod

* 1

* conflicts solve

* modify listResources mothod and remove getResourceIds mothod

* modify listResources mothod and remove getResourceIds mothod

* replace processDefinitionVersion with processDefinitionLog
2021-03-04 12:57:10 +08:00
xingchun-chen
6d1537aa44
Merge pull request #4945 from CalvinKirs/e2e_test
[CI][e2e]close e2e test
2021-03-04 11:24:10 +08:00
xingchun-chen
969fba8afd
Merge pull request #4783 from chengshiwen/improve-k8s-adapt-alert-server
[Improvement][K8s] Adapt to the latest alert-server with updated config and port 50052
2021-03-04 11:23:29 +08:00