test/DolphinScheduler
1
0
Fork 0
mirror of https://gitee.com/dolphinscheduler/DolphinScheduler.git synced 2024-12-03 12:48:46 +08:00
Code Issues Actions 10 Packages Projects Releases Wiki Activity
7,294 Commits 27 Branches 59 Tags 276 MiB
682829e4ea
Commit Graph

7294 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
caishunfeng
a5a941e079
fix upgrade for 310 (#12137) 2022-09-26 10:16:12 +08:00
Yann Ann
3e899bee06 [fix#12000]Cannot remove the WorkerGroup from the master service (#12050) 
* [Bug] [Master] Cannot remove the WorkerGroup from the master service. #12000

* remove unnecessary locks

* Update dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/registry/ServerNodeManager.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
 2022-09-25 23:18:09 +08:00
Eric Gao
42d8308940 [Doc][Improvement] Add instructions for process execution type and data complement (#12121) 
* Add instructions for process execution type and data complement

* Fix and polish the docs
 2022-09-25 22:58:32 +08:00
Jiajie Zhong
b0b29ed8e1 [fix][python] Task switch branch not show in webui (#12120) 
when create task switch in python api, switch branch not show correctly,
due to we add some unnecessary attribute to switch task, this patch we
add `_task_ignore_attr` in class `Task` to ignore those unnecessary
attribute from `_task_default_attr`

(cherry picked from commit a86f4e2693)
 2022-09-23 19:46:38 +08:00
Jiajie Zhong
71c51c3c3d [Fix] Also auto formatter workflow instance if location is null (#12080) 
* [fix] Also auto formatter workflow instance if location is null

In #11535(096fae77) and #11681(4dca488c), we already formatter
workflow definition, but I find out we forget formatter workflow
instance with definition's location is null, this patch also
formatter workflow instance.

* remove console log

(cherry picked from commit 2531c222de)
 2022-09-23 19:44:20 +08:00
JieguangZhou
f871a4a41f fix python home conflict (#12112) 
(cherry picked from commit 6eb1eb722a)
 2022-09-23 19:43:56 +08:00
Amy0104
c47e088b73
[Fix][UI] Fix workflow name overlaps bug (#11862) (#12125) 
Co-authored-by: Devosend <devosend@gmail.com>
 2022-09-23 17:40:13 +08:00
jackfanwan
1e59250055 [BUG]Delete Setting ID (#12096) 
* Delete Setting ID

* modify id

Co-authored-by: jackfanwan <fanwanlong@kezaihui.com>
 2022-09-22 15:21:24 +08:00
Wenjun Ruan
1a63f8672a
Fix insert command error due to the id is not null (#12092) (#12098) 
(cherry picked from commit fba5a8eaa0)
 2022-09-22 15:21:07 +08:00
Eric Gao
e7b12bf205
[Cherry-Pick][3.1.0-prepare] Cherry-Pick OssOperator for Resource Center to 3.1.0 (#12094) 
* Cherry OssOperator for Resource Center to 3.1.0

* Fix doc dead link
 2022-09-22 15:00:25 +08:00
Eric Gao
0d16d7b323
[Cherry-Pick][3.1.0-Prepare] Cherry pick docs format fix for 3.1.0 (#12095) 
* Cherry pick docs format fix for 3.1.0

* Fix doc dead link

* Fix sphinx dead link
 2022-09-22 14:11:43 +08:00
JieguangZhou
a2b3659fe9 [improve] Optimize MLFlow task plugin for easy of use (#12071) 
optimize code

(cherry picked from commit cf522e2f)
 2022-09-21 13:50:48 +08:00
limaiwang
f0fda2a9aa add(dependent node's add unprivileged project list): dependent node's add unprivileged project list (#12073) 2022-09-21 10:40:12 +08:00
jackfanwan
280b7c8545 [Improvement] Add Set cluster name (#12074) 2022-09-21 10:17:04 +08:00
jackfanwan
cda3110409 [improvement]Add Set cluster name (#12058) 
* Add Set cluster name

* add unit test

Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
 2022-09-21 10:16:39 +08:00
Wenjun Ruan
c286c5567a
Script cannot contains ''' in params (#12068) 
(cherry picked from commit f40a831453b3577249e011bad1fbe4c69fc6e9bc)
 2022-09-21 08:51:44 +08:00
Wenjun Ruan
f4babb773e
Fix update TaskDefinition error (#12064) 
(cherry picked from commit 96c12f95925bde5a137be2eb6241c0d60d4106f0)
 2022-09-20 22:24:11 +08:00
rickchengx
806ad1d98c [Improvement-11291][sql] Improvement the log output while executing multiple sql statements (#11292) 2022-09-20 10:47:18 +08:00
songjianet
23d77f8a2a [Feat][UI] Update package. (#12046) 
* [Feat][UI] Update package.

* [Feat][UI] Update package.
 2022-09-20 10:46:10 +08:00
juzimao
34950d3c09 and task instance date range search (#11963) 2022-09-20 10:45:00 +08:00
caishunfeng
780a509f67 fix workflow keep running when task fail (#11930) 2022-09-19 17:39:18 +08:00
Wenjun Ruan
1513363eed Fix cannot save processDefinition (#11931) 2022-09-19 17:38:46 +08:00
caishunfeng
704043f229 fix import error 2022-09-19 17:07:02 +08:00
Stalary
d7f40b19b5 [Bug](dependent) Dependent downstream trigger error when schedule cycle not day. (#11734) 
* FIX: dependent

* FIX: version

* MOD: for review
 2022-09-19 17:01:14 +08:00
kezhenxu94
775ef98b64 Add validations of possible malicious keys (#11966) 2022-09-19 16:32:15 +08:00
Wenjun Ruan
6f7ba2c634 Add debug logs for properties read from common.properties (#11910) 2022-09-19 16:17:10 +08:00
Stalary
714e258be6 [Bug][Dependent]: Id also clone due to duplicate when use dependent mode. (#11929) 2022-09-19 16:14:23 +08:00
juzimao
8c6658e3f9 Optimize date range condition (#11911) 2022-09-19 16:12:34 +08:00
Daniel Y
2a437607ae [Improvement-11834] Upgrade docker base image to support python3.9 (#11835) 
* use openjdk:8-jre-slim-bullseye instead of buster to support python3.9

* use openjdk:8-jre-slim-bullseye instead of buster across all components
 2022-09-19 15:50:25 +08:00
Wenjun Ruan
7ab4412b5e Fix listing processDefinition the schedulerReleaseState will never be null (#11888) 2022-09-19 15:39:10 +08:00
W.XING
9ad6a049c5 Add chunjun in dolphinscheduler-task-all/pom.xml (#11375) 2022-09-19 15:34:54 +08:00
ouyangyewei
7b58737e22 Add default constructor (#11858) 2022-09-19 15:32:07 +08:00
LiuBodong
0f3b42925f [Fix][Monitor]Monitor UI not show DisakAvailable and MemoryUsage correctly (#11870) 2022-09-19 15:30:49 +08:00
kezhenxu94
89b4192d3d Remove htrace dependencies (#11881) 
* Remove htrace dependencies

* Update pom.xml
 2022-09-19 15:27:41 +08:00
Kengo Seki
216ceea641 [Improve] Upgrade Hadoop to 3.2.4 (#11832) 2022-09-19 15:26:58 +08:00
Yann Ann
c11ec05d61 [Improvement-#11768][Monitor] Support monitor h2 database in monitor page (#11813) 2022-09-19 15:23:11 +08:00
kezhenxu94
fcc75ef1c6 Bump up dependencies to fix cves (#11765) 2022-09-19 15:10:56 +08:00
Wenjun Ruan
1aba077fb8 Remove not use web service comment in alert server (#11819) 2022-09-19 14:50:16 +08:00
Kengo Seki
52b79b017e [Improvement] Replace commons-lang 2 function invocations with commons-lang3 (#11810) 
* [Improvement] Replace commons-lang 2 function invocations with commons-lang3
 2022-09-19 14:48:17 +08:00
Jiajie Zhong
ed33066178 [python] Fix permission error when create related objects (#11783) 
after we add permission to our codebase in dev branch, will got error
when create objects from pydolphinscheduler, because users with user_id
equal to `Integer.MAX_VALUE` is ordinary users which can not have access
to create unless we grant permission to the role manually. this patch
change dummyUser to admin user's user_id == 1 to fix it
 2022-09-19 14:46:26 +08:00
fuchanghai
f1de1707d5 Update dolphinscheduler_ddl.sql fix alert t_ds_user add time_zone is not correct (#11795) 2022-09-19 14:41:50 +08:00
caishunfeng
113dc4b5c5
[Feature-10273][Datasource] Add dataSource for AWS Athena (#11157) (#12039) 
Co-authored-by: ZhaoGuodong <guodongym@163.com>
 2022-09-19 13:45:19 +08:00
JieguangZhou
dde6f63c31 [Feature][PyDolphinScheduler] Support DVC task in pyds #11922 (#11941) 
* add dvc task in pyds

* add BaseDVC class

(cherry picked from commit bbc228e93f)
 2022-09-18 16:49:34 +08:00
JieguangZhou
cb063732d7 [feat][python] Support MLflow task in python api (#11962) 
(cherry picked from commit ad683c3c42)
 2022-09-18 16:46:45 +08:00
JieguangZhou
f66dedc9da [feat][python] Support OpenMLDB task in python api (#11944) 
Using the whole word zookeeper instead of short cut zk
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>

(cherry picked from commit e50a32d9cc)
 2022-09-18 16:43:36 +08:00
JieguangZhou
1ac2e4a8f3 [feat][python] Add sagemaker yaml example (#11925) 
(cherry picked from commit e05f14ba23)
 2022-09-18 16:43:24 +08:00
JieguangZhou
6f3b4c1624 [feat][python] Support Pytorch task in python api (#11975) 
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
(cherry picked from commit 5202e5cfc6)
 2022-09-18 16:43:08 +08:00
JieguangZhou
e462918ac9
[Feat][python] Add parameter environment to task (#11763) (#11989) 
(cherry picked from commit 8988492c43)
 2022-09-17 10:24:07 +08:00
Wenjun Ruan
1ea2e848cd
[Feature][Registry] Support etcd as registry (#10981) (#11997) 
(cherry picked from commit 2eb8b9f7f0)

Co-authored-by: wjf <jffwang@qq.com>
 2022-09-17 09:01:24 +08:00
Wenjun Ruan
8eadf5e5aa
Fix insertOrUpdate plugin may failed due to concurrent operation (#11471) (#11996) 
(cherry picked from commit 864a90820d)
 2022-09-17 08:59:45 +08:00