lenboo
f05ba84968
Merge remote-tracking branch 'upstream/dev' into spilit
...
# Conflicts:
# dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/ProcessInstanceMapper.java
# dolphinscheduler-dao/src/test/java/org/apache/dolphinscheduler/dao/mapper/TaskInstanceMapperTest.java
2021-03-25 23:54:01 +08:00
Simon
cd19507271
[feature][jsonsplit]fix copy/export/import processDefinition bugs ( #5146 )
...
* Modify Project and ProjectUser Mapper
* Modify Project and ProjectUser Mapper
* project_code is bigint(20)
* modify ERROR name
* modify saveProcessDefine, remove the duplicate code with createTaskAndRelation
* modify import/export processdefinition, add genProcessData
* fix ut and bug
* code style
* repalce project_id with code
* conflicts solve
* conflicts solve
* conflicts solve
* bugfix
* modify listResources mothod and remove getResourceIds mothod
* 1
* conflicts solve
* modify listResources mothod and remove getResourceIds mothod
* modify listResources mothod and remove getResourceIds mothod
* replace processDefinitionVersion with processDefinitionLog
* codestyle
* codestyle
* add mapper module ut
* codestyle
* fix ProcessInstanceMapperTest
* codestyle
* conflicts solve
* conflicts solve
* conflicts solve
* conflicts solve
* conflicts solve
* fix ProcessInstanceMapperTest
* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest
* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest
* fix TaskInstanceMapperTest
* add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix
* codestyle
* codestyle
* Refactor process lineage
* Refactor process lineage
* codestyle
* codestyle
* Refactor process lineage
* Refactor process lineage
* add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest
* add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest
* add ProcessServiceTest
* 1
* 1
* fix copy/export/import processDefinition bugs
* 1
* codestyle
2021-03-25 18:27:47 +08:00
Simon
3c9b214da7
[Feature][jsonsplit]add ProcessServiceTest ( #5097 )
...
* Modify Project and ProjectUser Mapper
* Modify Project and ProjectUser Mapper
* project_code is bigint(20)
* modify ERROR name
* modify saveProcessDefine, remove the duplicate code with createTaskAndRelation
* modify import/export processdefinition, add genProcessData
* fix ut and bug
* code style
* repalce project_id with code
* conflicts solve
* conflicts solve
* conflicts solve
* bugfix
* modify listResources mothod and remove getResourceIds mothod
* 1
* conflicts solve
* modify listResources mothod and remove getResourceIds mothod
* modify listResources mothod and remove getResourceIds mothod
* replace processDefinitionVersion with processDefinitionLog
* codestyle
* codestyle
* add mapper module ut
* codestyle
* fix ProcessInstanceMapperTest
* codestyle
* conflicts solve
* conflicts solve
* conflicts solve
* conflicts solve
* conflicts solve
* fix ProcessInstanceMapperTest
* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest
* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest
* fix TaskInstanceMapperTest
* add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix
* codestyle
* codestyle
* Refactor process lineage
* Refactor process lineage
* codestyle
* codestyle
* Refactor process lineage
* Refactor process lineage
* add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest
* add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest
* add ProcessServiceTest
* 1
* 1
2021-03-24 15:14:22 +08:00
wen-hemin
e53367bdcc
[Feature][JsonSplit] task page, rename field "description" to "desc" ( #5137 )
...
* fix: task page, rename "description" to "desc"
* fix: The default value of field dependence is null.
* fix: frontend compile check
Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-03-24 15:05:54 +08:00
Simon
21b7b77d50
[Feature][JsonSplit]fix modifyBy field ( #5112 )
...
* Modify Project and ProjectUser Mapper
* Modify Project and ProjectUser Mapper
* project_code is bigint(20)
* modify ERROR name
* modify saveProcessDefine, remove the duplicate code with createTaskAndRelation
* modify import/export processdefinition, add genProcessData
* fix ut and bug
* code style
* repalce project_id with code
* conflicts solve
* conflicts solve
* conflicts solve
* bugfix
* modify listResources mothod and remove getResourceIds mothod
* 1
* conflicts solve
* modify listResources mothod and remove getResourceIds mothod
* modify listResources mothod and remove getResourceIds mothod
* replace processDefinitionVersion with processDefinitionLog
* codestyle
* codestyle
* add mapper module ut
* codestyle
* fix ProcessInstanceMapperTest
* codestyle
* conflicts solve
* conflicts solve
* conflicts solve
* conflicts solve
* conflicts solve
* fix ProcessInstanceMapperTest
* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest
* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest
* fix TaskInstanceMapperTest
* add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix
* codestyle
* codestyle
* Refactor process lineage
* Refactor process lineage
* codestyle
* codestyle
* Refactor process lineage
* Refactor process lineage
* add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest
* add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest
* add ProcessServiceTest
* 1
* 1
* fix modifyBy field
* 1
* ut fix
2021-03-24 14:54:34 +08:00
JinyLeeChina
1eaf1f6234
[Feature][JsonSplit] fix taskId in processDefinitionJson ( #5136 )
...
* modify checkDAGRing and ProcessService method
* merge
* modify dagRing
* modify process instance for project home page
* fix save process bug
* codeStyle
* Fix logical bug in saving process definition
* codeSytle
* Fix bug in interface of queryProcessDefinitionList
* codeSytle
* Fix api bug"
* fix taskId in processDefinitionJson
Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-03-24 11:44:14 +08:00
wenjun
5d264c9f20
[Improvement][Api] Optimize query processInstanceList #5134 ( #5135 )
...
* Batch query user rather than several query
2021-03-23 23:48:13 +08:00
Shiwen Cheng
0d065c0712
[Feature-5062][*] Create/Edit/Delete Worker Group in Web UI ( #5113 )
...
* [Improvement][Server] Rename MASTER_PREFIX to MASTER_TYPE and WORKER_PREFIX to WORKER_TYPE
* [Feature][Api&Dao] Support api and dao of worker group
* [Feature][UI] Support to create, edit and delete worker group
* [Feature][API&UI] Support work groups from database and zookeeper to display together in worker group management
* [Feature][API&Dao] Support long ip list and check request parameters when saving worker group
* [Feature][*] Refactor ipList to addrList
* [Feature][Server] Support host manager to select worker host by worker group in database
* [Improvement][Server] Improve the config of master and worker
* [Improvement][*] Rename zkRegistered to systemDefault
* [Improvement][Test] Fix unit test and improve ui
* [Improvement][Server] Improve getServerMaps
Co-authored-by: dailidong <dailidong66@gmail.com>
2021-03-23 23:47:41 +08:00
Kirs
f109a758f8
[Bug][PGSQL] Delete the stopped workflow without deleting the correspon… ( #5066 )
...
* [Bug][Api] Delete the stopped workflow without deleting the corresponding sub process, the workflow instance name is not displayed in the sub process
* fix ut
* fix ut err
* sql style
* fix error
2021-03-23 11:26:11 +08:00
JinyLeeChina
d99934d0da
[Feature][JsonSplit] Fix api bug ( #5102 )
...
* modify checkDAGRing and ProcessService method
* merge
* modify dagRing
* modify process instance for project home page
* fix save process bug
* codeStyle
* Fix logical bug in saving process definition
* codeSytle
* Fix bug in interface of queryProcessDefinitionList
* codeSytle
* Fix api bug"
Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-03-23 10:44:25 +08:00
lenboo
010b49c933
merge from dev
2021-03-22 15:18:16 +08:00
zhuangchong
ba039dc252
[Improvement][dao] Resource features SQL slow query optimization. ( #4947 )
...
* Resourse features SQL slow query optimization.
* update resource mapper queryResourcePaging method.
* split resource and resource_uesr sql statement.
* determine the size of the collection.
* update process service class code style.
* update ResourceUserMapper java class code style.
* add resourceUserMapper in the test config file.
* solve code smell
* split paging query join statement.
* update ResourceUserMapper class.
* remove sql join statement.
* update resource test class code style.
* update ResourcesServiceTest test class.
* rerun ut.
* update user service test class.
* solve query resource list method code smell.
2021-03-20 12:50:26 +08:00
Shiwen Cheng
8ac72e80e6
[Feature-5087][SqlTask] Add a switch to send mail and print head logs in SqlTask ( #5088 )
...
* [Feature-5087][SqlTask] Add the switch to send mail and print head logs in SqlTask
* [Feature-5087][SqlTask] Add SqlParametersTest
2021-03-19 15:07:39 +08:00
guohaozhang
4a6e8b7afa
[Fix-#5103] fix resource rename cause can not update ( #5107 )
2021-03-19 14:51:12 +08:00
Shiwen Cheng
91c29e6ca3
[Improvement-5094][UI] Improve to add a main switch for refresh_in_switched_tab ( #5095 )
2021-03-19 11:58:33 +08:00
Shiwen Cheng
9008fa4b0c
[Fix-5089][UI] Fix code mirror cannot be displayed normally in sqoop task ( #5090 )
...
* [Improvement][UI] Rename from-mirror to form-mirror
* [Fix-5089][UI] Fix code mirror cannot be displayed normally in sqoop task
2021-03-19 11:57:46 +08:00
wenjun
086e716441
[Improvement][Dao] SQL optimization - check exist #5069 ( #5070 )
2021-03-18 22:49:12 +08:00
Shiwen Cheng
f94cfc620d
[Feature][Worker] Add a configuration item to set whether the tenant is automatically created on Worker ( #5007 )
2021-03-18 18:34:42 +08:00
wangxj3
29d42fd92d
[Feature-#3805][server-master] Task parameter transfer ( #5077 )
...
* fix out param format bug
Co-authored-by: wangxj <wangxj31>
2021-03-18 11:50:10 +08:00
Shiwen Cheng
5856a12855
[Improvement-4984][Worker] Refactor and Improve worker load balance ( #4996 )
...
* [Improvement][Remote] Improve unit tests
* [Improvement][Worker] Improve worker load balance
* [Improvement][Worker] Fix code smells
* [Improvement][Worker] Rename weight to hostWeight
2021-03-18 10:03:58 +08:00
zhuangchong
705715c313
[Improvement-5059][API] Verify that the new workflow definition version is the current version before removing it #5059 ( #5060 )
...
* this process definition version is used, not allowed to delete.
* update ProcessDefinitionVersionServiceTest test class.
* update check has associated process definition sql.
2021-03-18 09:37:17 +08:00
Ts686
6216817861
[Improvement-4971][alert|dao|service]Remove redundant PropertyUtils.class ( #5020 )
...
* [Improvement][alert|dao|service]
1. Remove redundant PropertyUtils.class (#4971 )
2. Remove useless import package.
* [Improvement][alert|dao|service]
1. Remove redundant PropertyUtils.class (#4971 )
2. Remove useless import package.
* [Improvement][alert|dao|service]
1. Remove redundant PropertyUtils.class (#4971 )
2. Remove useless import package.
* [Improvement][alert|dao|service]
1. Remove redundant PropertyUtils.class (#4971 )
2. Remove useless import package.
2021-03-17 15:28:07 +08:00
Shiwen Cheng
1cd62b4a5e
[Improvement][Datax] Re-assign DATAX_HOME to /opt/soft/datax instead of /opt/soft/datax/bin/datax.py ( #5019 )
2021-03-17 14:38:04 +08:00
mrproliu
0ba120e8ab
Fix shell task ${setValue(key,value)} is not working ( #5067 )
...
Co-authored-by: dalekliuhan <dalekliuhan@didiglobal.com>
2021-03-16 21:56:05 +08:00
lenboo
cf63fc1fee
Merge remote-tracking branch 'upstream/dev' into spilit
2021-03-16 15:50:06 +08:00
Simon
00dcc3f78e
[Feature][jsonsplit]add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest ( #5047 )
...
* Modify Project and ProjectUser Mapper
* Modify Project and ProjectUser Mapper
* project_code is bigint(20)
* modify ERROR name
* modify saveProcessDefine, remove the duplicate code with createTaskAndRelation
* modify import/export processdefinition, add genProcessData
* fix ut and bug
* code style
* repalce project_id with code
* conflicts solve
* conflicts solve
* conflicts solve
* bugfix
* modify listResources mothod and remove getResourceIds mothod
* 1
* conflicts solve
* modify listResources mothod and remove getResourceIds mothod
* modify listResources mothod and remove getResourceIds mothod
* replace processDefinitionVersion with processDefinitionLog
* codestyle
* codestyle
* add mapper module ut
* codestyle
* fix ProcessInstanceMapperTest
* codestyle
* conflicts solve
* conflicts solve
* conflicts solve
* conflicts solve
* conflicts solve
* fix ProcessInstanceMapperTest
* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest
* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest
* fix TaskInstanceMapperTest
* add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix
* codestyle
* codestyle
* Refactor process lineage
* Refactor process lineage
* codestyle
* codestyle
* Refactor process lineage
* Refactor process lineage
* add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest
* add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest
2021-03-16 15:44:45 +08:00
JinyLeeChina
d98c2c5cfe
[Feature][JsonSplit] Fix bug in interface of queryProcessDefinitionList ( #5043 )
...
* modify checkDAGRing and ProcessService method
* merge
* modify dagRing
* modify process instance for project home page
* fix save process bug
* codeStyle
* Fix logical bug in saving process definition
* codeSytle
* Fix bug in interface of queryProcessDefinitionList
* codeSytle
Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-03-16 15:44:03 +08:00
Kirs
6bf5031f45
[FIX] fix MySQL datasource jdbc connect parameters ( #4851 )
...
* [FIX-CVE-2020-11974] fix MySQLDataSource Security
* remove useless code
* add ut
* A more reasonable way
* code style
* fix test error
* code style
* update exception msg
2021-03-16 14:40:07 +08:00
lenboo
6ab3892989
Merge remote-tracking branch 'upstream/dev' into spilit
2021-03-15 17:38:49 +08:00
游侠
2d8c4ec86b
[Improvement][Worker-Task] Python Command ( #5036 )
...
* create the interpreter for python command
* Update README.md
Co-authored-by: zhouhong <zhouhong@zhangyue.com>
2021-03-15 10:22:13 +08:00
lenboo
c33cc87af4
Merge remote-tracking branch 'upstream/dev' into spilit
2021-03-14 21:47:30 +08:00
guohaozhang
a3153b5e44
[Bug][Master] Fix First master fault tolerance when startup ( #5045 )
...
* [Fix-#5044] Fix First master fault tolerance when startup
* [Fix-#5044] Fix spell error
2021-03-13 00:01:18 +08:00
Simon
22ec6c069d
[Feature][jsonsplit]Refactor process lineage ( #5034 )
...
* Modify Project and ProjectUser Mapper
* Modify Project and ProjectUser Mapper
* project_code is bigint(20)
* modify ERROR name
* modify saveProcessDefine, remove the duplicate code with createTaskAndRelation
* modify import/export processdefinition, add genProcessData
* fix ut and bug
* code style
* repalce project_id with code
* conflicts solve
* conflicts solve
* conflicts solve
* bugfix
* modify listResources mothod and remove getResourceIds mothod
* 1
* conflicts solve
* modify listResources mothod and remove getResourceIds mothod
* modify listResources mothod and remove getResourceIds mothod
* replace processDefinitionVersion with processDefinitionLog
* codestyle
* codestyle
* add mapper module ut
* codestyle
* fix ProcessInstanceMapperTest
* codestyle
* conflicts solve
* conflicts solve
* conflicts solve
* conflicts solve
* conflicts solve
* fix ProcessInstanceMapperTest
* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest
* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest
* fix TaskInstanceMapperTest
* add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix
* codestyle
* codestyle
* Refactor process lineage
* Refactor process lineage
* codestyle
* codestyle
* Refactor process lineage
* Refactor process lineage
2021-03-12 18:22:34 +08:00
Chenshuai
cc2a94a973
[Improvement-4988][docs] Uppercase the first letter the state of Process Instance ( #4990 )
...
* [DS-4988][docs] Uppercase the first letter the state of Process Instance
* [DS-4988][docs] Fix uppercase the first letter the state of Process Instance
* Fix uppercase the first letter the state of Process Instance
* Fix uppercase the first letter the state of Process Instance
* delete duplicate key name and delete
Co-authored-by: jim <ccit_cs@qq.com>
2021-03-12 16:48:33 +08:00
lenboo
a574d2e38c
Merge remote-tracking branch 'upstream/dev' into spilit
2021-03-12 10:44:43 +08:00
Shiwen Cheng
ae608e024a
[Fix-5037][Server] Fix that both the master and the worker is hanging after restarting and stopping ( #5038 )
...
* [Fix-5037][Server] Fix that both the master and the worker is hanging after restarting and stopping
* [Improvement][*] Replace commons.lang.StringUtils with common.utils.StringUtils
2021-03-12 09:33:30 +08:00
JuFeng Li
a0a2c9141b
[FIX-4876]Http alert plugin fix ( #4877 )
...
* remove header in httpRequest
* codestyle fix
Co-authored-by: 李巨丰 <lijf@2345.com>
2021-03-11 22:39:27 +08:00
zhuangchong
c8e31ad58e
[Improvement-4884][Common] fix the subsequent processing of getting the YARN ResourceManager address to be empty ( #4885 )
...
* fix yarn application url generate empty.
* removing Excess Processing
* update hadoop utils test class .
* add base exception class.
* update hadoop utils class code style.
2021-03-11 22:14:52 +08:00
wenjun
ea6b1de120
[Improvement][worker] Optimize KillYarnJob (4939) ( #4943 )
2021-03-11 22:13:44 +08:00
lenboo
6ef54ebe9b
Merge remote-tracking branch 'upstream/dev' into spilit
2021-03-11 17:01:29 +08:00
Shiwen Cheng
beb5adb985
[Feature][MR] Support mapreduce name ( #5029 )
2021-03-11 12:35:08 +08:00
JuFeng Li
3769066803
[Fix-5032][Alert]Support email multiple format ( #5033 )
...
* support multilple email format
Co-authored-by: 李巨丰 <lijf@2345.com>
2021-03-11 11:35:25 +08:00
lenboo
461e6334ae
Merge remote-tracking branch 'upstream/dev' into spilit
2021-03-10 19:08:17 +08:00
fredster33
9a3ae48396
Update PULL_REQUEST_TEMPLATE.md ( #5022 )
...
When commented out, even if the PR creator forgets to remove the tips, they will not appear in the PR when it is submitted.
2021-03-10 11:40:21 +08:00
fredster33
3197b321a1
Grammar changes for README ( #5021 )
2021-03-10 11:06:17 +08:00
Simon
c4d9ceffd1
[Feature][jsonsplit]add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix ( #5012 )
...
* Modify Project and ProjectUser Mapper
* Modify Project and ProjectUser Mapper
* project_code is bigint(20)
* modify ERROR name
* modify saveProcessDefine, remove the duplicate code with createTaskAndRelation
* modify import/export processdefinition, add genProcessData
* fix ut and bug
* code style
* repalce project_id with code
* conflicts solve
* conflicts solve
* conflicts solve
* bugfix
* modify listResources mothod and remove getResourceIds mothod
* 1
* conflicts solve
* modify listResources mothod and remove getResourceIds mothod
* modify listResources mothod and remove getResourceIds mothod
* replace processDefinitionVersion with processDefinitionLog
* codestyle
* codestyle
* add mapper module ut
* codestyle
* fix ProcessInstanceMapperTest
* codestyle
* conflicts solve
* conflicts solve
* conflicts solve
* conflicts solve
* conflicts solve
* fix ProcessInstanceMapperTest
* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest
* fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest
* fix TaskInstanceMapperTest
* add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix
* codestyle
* codestyle
2021-03-10 10:50:49 +08:00
dddyszy
28dfde7002
[Fix-4862][Server] Kill yarn application command won't be execute whe… ( #4936 )
...
* [Fix-4862][Server] Kill yarn application command won't be execute when kill error
2021-03-10 09:21:34 +08:00
wenjun
fd4b59ad6c
[Improvement][Worker] Rename worker.weight to worker.host.weight ( #4997 ) ( #5014 )
2021-03-10 08:55:04 +08:00
lenboo
81dcd6873d
Merge remote-tracking branch 'upstream/dev' into spilit
2021-03-09 18:19:08 +08:00
Simon
40bcb2e818
[Feature][jsonsplit]fix TaskInstanceMapperTest ( #5010 )
...
* fix TaskInstanceMapperTest
2021-03-09 12:55:56 +08:00
