Commit Graph

5563 Commits

Author SHA1 Message Date
Hua Jiang
226bed1768
fix this issue (#7120) 2021-12-03 16:56:30 +08:00
zwZjut
2bf73603bb
[Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082)
* to #7081

* fix #7081

* to #7081

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2021-12-03 16:56:08 +08:00
Kerwin
3de182dc08
Optimize the display of the pop-up window for creating worker groups (#7148) 2021-12-03 16:55:58 +08:00
zwZjut
8ebe060658
[Feature][dolphinscheduler-api] access control of processDefinition and processInstance in project #7073 (#7080)
* to #7073

* to #7073

* to #7073

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2021-12-03 16:55:20 +08:00
zwZjut
d09d68e109
to #7065: fix ExecutorService and schedulerService (#7072)
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2021-12-03 16:54:39 +08:00
songjianet
99f6ab3847
[Feature][Workflow relationship] Format name. (#7143) 2021-12-03 14:43:45 +08:00
wangxj3
2b519f31e9
[Feature-#6422] task group queue (#6722)
* add task group

* modify task group

* pull dev

* add license header

* modify code style

* fix code style

* fix sql error

* fix error

* fix test

* fix test

* fix test

* fix test

* fix code style

* fix ut

* code style

* fix unit test

* test ut

* ut

* add unittest

* test ut

* modify back ut

* majorization code

* fix conflict

* fix ut

Co-authored-by: wangxj <wangxj31>
2021-12-03 14:02:31 +08:00
Devosend
f480b8adf8
[Feature-6930] [Python]Add workflow as code task type sub_process (#7022)
* [python] add subProcess task

* refactor python gateway server and task for subprocess

* add function comment for getProcessDefinition

* change process_definition usage of Subprocess task
2021-12-03 10:26:45 +08:00
songjianet
3304edee47
[Feature][Workflow relationship] Format time. (#7123) 2021-12-03 10:02:33 +08:00
songjianet
791ed6de77
[Feature][Workflow relationship] Improve English support. (#7129) 2021-12-03 01:05:45 +08:00
Hua Jiang
6beae191e2
[Fix-7103] Fix the issue with the sqoop task missing the verification of props. (#7119)
* add the verification of parameters for the sqoop task
2021-12-02 19:33:51 +08:00
Kerwin
9fffbdb316
add TaskProcessorFactoryTest Ignore. (#7130) 2021-12-02 19:15:57 +08:00
zwZjut
c42531e39c
to #7108 (#7109) 2021-12-02 16:34:38 +08:00
wangyizhi
e0623973e0
[Fix-7083] [UI] The switch task is missing the else branch (#7084) 2021-12-02 14:35:36 +08:00
JinYong Li
b265297fc8
[Improvement][API] fix 6772 new api bug (#7098)
* add processDefinition releaseWorkflowAndSchedule

* add ProcessTaskRelationServiceImpl.moveTaskProcessRelation

* add dependency and subprocess judgement

* fix api bug

* fix codestyle
2021-12-02 14:06:39 +08:00
Hua Jiang
d7eb7453e5
[Fix-7070][UI] Remedy the issue with no saving the timeout's strategy into the database. (#7107) 2021-12-01 21:03:49 +08:00
wangyizhi
173a385618
[Improvement-7092][UI] Optimize DAG to adapt to situations without locations (#7102) 2021-12-01 16:40:11 +08:00
songjianet
b3efcdfeba
[Fix][Create Warning Instance Edit] Fix the problem of incomplete display of the edit form. (#7096) 2021-12-01 14:41:14 +08:00
张俊杰
463fc76bb7
[Fix-6809][dolphinscheduler-task-sql] Fix sql task can't send alert (#7089) 2021-12-01 14:08:40 +08:00
kezhenxu94
2ed3c0c3a7
Recover unit tests that have not been run for some time (#7054) 2021-12-01 13:55:26 +08:00
Sunny Lei
0dcff1425a
[DS-5229][feat] Implement server port custom config (#6947)
* [DS-5229][fix] server port custom config
This closes #5229

* [DS-5229][feat] Implement server port custom config
This closes #5229

* [Bug] [readme] Error link to Docker and k8s in readme apache#6802 (#6862)

* [Bug] [readme] Error link to Docker and k8s in readme #6802
1、modify the error link

* [Bug] [readme] Error link to Docker and k8s in readme #6802
1、modify the error link in readme_zh_cn.md

* [DS-6829][WorkerServer] skip create log dir and print log in dryRun model (#6852)

Co-authored-by: caishunfeng <534328519@qq.com>

* [DS-5229][feat] Implement server port custom config
Modify review suggestion
This closes #5229

Co-authored-by: GaoTianDuo <gaotianduo_yewu@cmss.chinamobile.com>
Co-authored-by: wind <caishunfeng@users.noreply.github.com>
Co-authored-by: caishunfeng <534328519@qq.com>
2021-12-01 00:21:03 +08:00
zwZjut
100a9ba3fc
to #7055: tenant-auto-create: true (#7056)
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2021-11-30 16:44:13 +08:00
kezhenxu94
37ba1eb5ad
Add E2E tests for some core features (#7025) 2021-11-30 13:07:55 +08:00
ouyangyewei
7b20f4c239
return domain after creating success (#7050)
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
2021-11-30 11:50:32 +08:00
zhang
c2585a1170
[BUG] master task log can't output repair (#7029)
* update task_definition_log field typ

update task_definition_log  field task_params type,modify text to longtext to be consistent with the main table

* update t_ds_task_definition_log field task_params

update t_ds_task_definition_log field task_params

* [FIX:211128] master task log Can't output repair

Co-authored-by: crane <zhangbq3306@163.com>
2021-11-30 11:04:32 +08:00
wind
be3bd4c83d
[DS-7004][MasterServer]fix master still work when it lose zk connection (#7045)
Co-authored-by: caishunfeng <534328519@qq.com>
2021-11-30 11:00:17 +08:00
JinYong Li
6e55394783
[Improvement][API][num-9] add ProcessTaskRelationServiceImpl.moveTaskProcessRelation (#7053)
* add processDefinition releaseWorkflowAndSchedule

* add ProcessTaskRelationServiceImpl.moveTaskProcessRelation

* add dependency and subprocess judgement
2021-11-30 10:24:28 +08:00
Kerwin
f0630bc9a0
Fix view task status module on project homepage cannot read property label of undefined (#6956) 2021-11-30 10:00:54 +08:00
Kerwin
631a31b6ac
fix token delete request 404 (#6979) 2021-11-30 10:00:22 +08:00
Hua Jiang
a0955a078a
[Fix-7019][MasterServer] Fix the issue with failing to save and run the process that contains the switch task. (#7046) 2021-11-30 09:59:48 +08:00
wind
8e93939121
[DS-6963][MasterServer]add cache manager for tenant and user (#6974)
* cache manager for tenant and user

* add test

* fix checkstyle

* add dependencies

* fix sonar check

* use spring boot cache configuration

* add license

* check style

* check style

* add license

* change proxy name to processor

* add license header

* check style

* add license file

* add license file

* add license

Co-authored-by: caishunfeng <534328519@qq.com>
2021-11-30 08:29:25 +08:00
EdwardYang
88cd37ff0f
[Improvement][API][num-1] save schedule when workflow is offline in interface 'createEmptyProcessDefinition' (#7047)
* [Improvement] save schedule when workflow is offline

* [Improvement] rollback transactional when creating/updating schedule failed.

* [Improvement] resolve merge conflict

* [Improvement] do not set projectName and processDefinitionName when saving schedule

* [Improvement] do not set projectName and processDefinitionName when saving schedule

Co-authored-by: edward-yang <yangjianh210@gmail.com>
2021-11-29 21:32:23 +08:00
zwZjut
b815da6158
to #7001: delete certain edge in processDefinition (#7038)
* to #7001: delete certain edge in processDefinition

* to #7001: delete certain edge in processDefinition

* to #7001: delete certain edge in processDefinition

* to #7001: delete certain edge in processDefinition

* to #7001: fix checkstyle

* to #7001: delete edge by projectCode,processDefinitionCode,preTaskCode and postTaskCode

* to #7001: add UT

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2021-11-29 20:51:58 +08:00
JinYong Li
1e9973299f
add processDefinition releaseWorkflowAndSchedule (#7044) 2021-11-29 20:13:49 +08:00
zwZjut
f865c26322
to #7000: implement deleteTaskProcessRelation (#7043)
* to #7000: implement deleteTaskProcessRelation

* to #7000: ! CollectionUtils.isEmpty -> CollectionUtils.isNotEmpty

* to #7000: fix bug

* to #7000: add UT

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2021-11-29 20:11:47 +08:00
JinYong Li
c5bde33ac0
[Upgrade][install] upgrade compatibility exception (#7030)
* upgrade compatibility exception

* upgrade compatibility exception
2021-11-29 15:07:47 +08:00
EdwardYang
f30ee5956e
[Improvement][API][num-1 & 2] Implement createEmptyProcessDefinition & updateProcessDefinitionBasicInfo (#6984)
* [feature] finish interface createEmptyProcessDefinition

* [feature] finish interface updateProcessDefinitionBasicInfo

* [feature] use class Schedule replace ScheduleDto and delete it.

* [feature] delete chinese comment.

* [Improvement] change '.*' to single form of import

Co-authored-by: 熠然 <yangjianhua@cai-inc.com>
Co-authored-by: edward-yang <yangjianh210@gmail.com>
2021-11-29 10:30:48 +08:00
Jiajie Zhong
03ee12bccb
[community] Add new release version to issue template (#7021) 2021-11-28 19:04:45 +08:00
Zonglei Dong
4c4ebb8924
Refactor code, add class import. (#7028) 2021-11-28 10:35:13 +08:00
sparklezzz
42e20cbf60
fix(kerboros): set correct classloader for kerboros conf load in plugin tasks (#7027)
Co-authored-by: xudong.zhang <xudong.zhang@nio.com>
2021-11-28 09:25:51 +08:00
zwZjut
a8aed0f5f7
to #7005: transform params to SPRING_DATASOURCE_XXX (#7007)
* to #7005: transform params to SPRING_DATASOURCE_XXX

* to #7005: exclude h2

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2021-11-26 16:57:41 +08:00
lvshaokang
1a88b1863b
[Improvement-5785][common] Fix code format (#6864)
* [DS-5785][style] Fix common module code format

* [DS-5785][style] Fix common module code format
2021-11-26 14:43:23 +08:00
xuhhui
1c6ef50036
[improvement] improve install.sh if then statement (#6782)
* [Fix] Executing install.sh failed when password and others contain @

* Update install.sh

Co-authored-by: Jiajie Zhong <zhongjiajie955@hotmail.com>

Co-authored-by: Kirs <acm_master@163.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@hotmail.com>
2021-11-26 14:42:14 +08:00
kezhenxu94
ef0cb46661
Fix shell tools for database schema cannot run (#7003) 2021-11-26 11:10:38 +08:00
wind
e6fe39ea47
[DS-6961][MasterServer] batch dispatch (#6962)
* [DS-6961][MasterServer] batch dispatch

* fix test

Co-authored-by: caishunfeng <534328519@qq.com>
2021-11-25 12:55:37 +08:00
JinYong Li
5a04b8d49a
update schdule api (#6977) 2021-11-25 10:22:41 +08:00
kezhenxu94
2de4a3cbb5
Add a demo docker-compose for testing the meter module (#6938) 2021-11-24 17:22:30 +08:00
zwZjut
1edd2bd0f6
to #6957 implement interface deleteUpstreamRelation deleteDownstreamRelation (#6966)
* to #6957

* to #6957

* to #6957

* to #6957: group by process definition code

* to #6957: fix sonar

* to #6957: fix sonar

* to #6957: add ut , add preTaskVersion

* to #6957: fix style

* to #6957: use org.apache.dolphinscheduler.spi.utils.StringUtils

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2021-11-24 17:12:47 +08:00
JinYong Li
e51a2a1642
[Improvement][API][num-8] add ProcessTaskRelationServiceImpl.createProcessTaskRelation (#6970)
* add ProcessTaskRelationServiceImpl.createProcessTaskRelation

* code style
2021-11-24 15:06:12 +08:00
lyq
c78fd24776
bug about dolphinscheduler-remote SendAsync (#6972)
* bug about SendAsync
2021-11-24 09:53:22 +08:00