test/DolphinScheduler
1
0
Fork 0
mirror of https://gitee.com/dolphinscheduler/DolphinScheduler.git synced 2024-12-03 12:48:46 +08:00
Code Issues Actions 10 Packages Projects Releases Wiki Activity
7,166 Commits 27 Branches 59 Tags 276 MiB
cc5f710147
Commit Graph

1110 Commits

Author SHA1 Message Date
ouyangyewei
db46e4786a
Add default constructor (#11858) 2022-09-11 19:12:03 +08:00
Stalary
37325b4c34
[Bug](dependent) Dependent downstream trigger error when schedule cycle not day. (#11734) 
* FIX: dependent

* FIX: version

* MOD: for review
 2022-09-08 15:08:10 +08:00
caishunfeng
2e61c76c22
[Improvement] Add remote task model (#11767) 2022-09-08 13:41:36 +08:00
kezhenxu94
efedc9a53c
Bump up dependencies to fix cves (#11765) 2022-09-08 09:05:05 +08:00
Kengo Seki
444c7e6eb7
[Improvement] Replace commons-lang 2 function invocations with commons-lang3 (#11810) 
* [Improvement] Replace commons-lang 2 function invocations with commons-lang3
 2022-09-07 13:48:09 +08:00
Jiajie Zhong
0e534dd61f
[python] Fix permission error when create related objects (#11783) 
after we add permission to our codebase in dev branch, will got error
when create objects from pydolphinscheduler, because users with user_id
equal to `Integer.MAX_VALUE` is ordinary users which can not have access
to create unless we grant permission to the role manually. this patch
change dummyUser to admin user's user_id == 1 to fix it
 2022-09-06 12:00:08 +08:00
JieguangZhou
8988492c43
[Feat][python] Add parameter environment to task (#11763) 2022-09-06 09:26:30 +08:00
Tq
4283cfd7a1
[fix][API]fix task types sequence (#11775) 
* fix task types sequence

* fix mapper table name t_ds_fav_task

* fix sequence
 2022-09-05 20:29:03 +08:00
Chris
3c86e52075
[Fix-11583][UI] Fix the API usage of gantt graph (#11642) 2022-09-05 14:20:48 +08:00
caishunfeng
f8d46a26c1
[Feature-11530] add state history for process instance (#11757) 
* [Feature] add state history for process instance (#97)

* add state history for process instance

* upsertProcessInstance

* remove unuse method

* fix UT

Co-authored-by: caishunfeng <534328519@qq.com>
 2022-09-03 10:14:05 +08:00
kezhenxu94
277f137358
Add Kubernetes configmap reload to all components (#11730) 2022-09-02 12:03:19 +08:00
Tq
b3cc8a55b9
[feature][API]feature: add task type list and enable user to add task type to fav (#11727) 
* feature: add task type list and enable user to add task type to fav

* make DependentExecute.java variable protected

* add standalone server fileSet
 2022-09-02 11:40:23 +08:00
Wenjun Ruan
67e7f88d8b
Refactor heart beat task, use json to serialize/deserialize (#11702) 
* Refactor heart beat task, use json to serialize/deserialize
 2022-08-31 16:20:23 +08:00
Jiajie Zhong
4dca488cd5
[python] Auto location when create process definition (#11681) 
* Add auto format when submit process definition from python api
* add UPDATING.md

close: #8254
 2022-08-27 23:38:46 +08:00
JiPeng Wang
cf3b4424d7
[Fix-11616] Workflow Definition Name Change Validation Optimization. (#11617) 
* Workflow Definition Name Change Validation Optimization

* [Fix][UI] Add the workflow code entry to the verify name interface.

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/ProcessDefinitionService.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* processDefinitionCode param name change

Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
 2022-08-24 19:59:38 +08:00
JiPeng Wang
961e67f524
[Improvement][User] Query all users filter un enabled. (#11504) 
* user query all filter un enabled
* restore permissions
 2022-08-24 11:55:18 +08:00
longtb
4893bef5a7
[Improvement][TaskInstance] reduce database queries (#11522) 
* [Improvement][TaskInstance] reduce database queries

* Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/TaskInstanceMapper.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* [Improvement][TaskInstance] queryByInstanceIdsAndCodes -> queryByProcessInstanceIdsAndTaskCodes

Co-authored-by: zhangshunmin <zhangshunmin@kezaihui.com>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
 2022-08-23 14:27:26 +08:00
insist777
abfef1a929
[improvement] Add two parameters in workergroup, and support the application of description display and other parameters (#11542) 
* [Improvement] Improvement default worker group

* [Improvement] Improvement default worker group

* [Improvement] Improvement default worker group

* [Improvement] Improvement default worker group

* [Improvement] Improvement default worker group

* [improvement] The default worker grouping supports editing

* [improvement] The default worker grouping supports editing

* Update WorkerGroupServiceImpl.java

* Update WorkerGroupServiceImpl.java

* The default worker grouping supports editing

* update sql file

* update

* update

* update

* update
 2022-08-23 10:54:17 +08:00
Wenjun Ruan
8886d5a126
Fix quartz threadPriority config name error (#11596) 
* Fix quartz threadPriority config name error

* Add batchTriggerAcquisitionMaxCount config
 2022-08-23 09:32:05 +08:00
kezhenxu94
17a9dd25fa
Fix vulnerability in LDAP login (#11586) 2022-08-22 13:49:14 +08:00
kezhenxu94
13e4720aa2
Upgrade spring boot and swagger (#11574) 2022-08-22 10:27:40 +08:00
kezhenxu94
0b82755796
Fix some resource leak (#11576) 2022-08-21 01:19:16 +08:00
Guanhua Li
8b3f60ed88
[Improvement] [LDAP] Bug fix: Config value return "null" instead of real null currently. (#11325) 2022-08-19 10:34:00 +08:00
juzimao
3b72c6efe7
[Improvement]Add a stop function when you are ready to do pause operation (#11543) 
* add can stop for execute state machine

* add execute type check for pause operation
 2022-08-18 21:32:53 +08:00
Wenjun Ruan
2862f5b67c
Set process instance and task priority default value as 2 (#11539) 2022-08-18 16:21:12 +08:00
insist777
ebdf903dcc
[Improvement-11468] Support re running historical version workflow (#11489) 
* Support re running historical version workflow

 Support re running historical version workflow

* Update ExecutorServiceImpl.java

* Update ExecutorServiceImpl.java
 2022-08-18 09:46:54 +08:00
insist777
006d8e21a6
[Improvement] File deletion logic optimization (#11519) 
* [Improvement] File deletion logic optimization
 2022-08-18 09:38:06 +08:00
kezhenxu94
f6ef628030
Support reading application properties from kubernetes config map (#11402) 2022-08-16 20:25:17 +08:00
Wenjun Ruan
7ff34c3947
[Feature-7024] Add waiting strategy to support master/worker can recover from registry lost (#11368) 
* Add waiting strategy to support master/worker can recover from registry lost

* throw exception when zookeeper registry start failed due to interrupted
 2022-08-13 09:52:03 +08:00
insist777
8217784044
[Fix-1360]: Fix Description length check (#11371) 
* [Fix-1360]: Fix Description length check

* Update dolphinscheduler_h2.sql

h2 Increase the length of some fields

* Update dolphinscheduler_ddl.sql
 2022-08-11 13:26:50 +08:00
fuchanghai
6e2bed4d6b
[fix-11378] fix API-Server release response message typo (#11400) 
* [fix-11295] remove duplicate classes

* [fix-11378] fix response message error

Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>
 2022-08-11 09:21:32 +08:00
caishunfeng
0464123c2b
[Feature-11223] support stream task (#11350) 
* add task execute type

* update task definition list paging

* update task instance list paging

* stream task start

* [Feature][UI] Some changes to execute task.
    * Set the connection edge to dashed line.
    * Add FLINK_STREAM task.

* add stream task

* flink savepoint and cancel

* fix query bug

* add stream task definition

* add task instance for stream task

* delete stream task definition state

* update api for stream task definition edit

* modify search for stream task instance

* add language

* delete task type search for stream task definition

* change task type search for stream task instance

* add jump button

* add savepoint

* add down log for stream task instance

* ui test

* stream task start

* run DAG

* [Fix][UI] Fix the stream task edgs not to be dashed when filling back.

* [Feature][UI] Remove some fields for FLINK_STREAM.

* add start modal

* add dryRun column for stream task instance

* fix duration

* fix pon

* fix build error

* Add success tip

* add auto sync for stream task instance

* remove forgien key for task instance

* license header

* UT fix

* modify locales

* recover common config

* fix UT

* add doc

Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: devosend <devosend@gmail.com>
 2022-08-10 21:44:43 +08:00
xuhhui
a50f110d3e
[Feature][Api] Refactor org.apache.dolphinscheduler.api.controller.QueueController (#11154) 
* [Feature][Api] Refactor org.apache.dolphinscheduler.api.controller.QueueController
 2022-08-10 11:34:37 +08:00
Wenjun Ruan
8774415197
Split ExecutionStatus to WorkflowExecutionStatus and TaskExecutionStatus (#11340) 2022-08-10 11:00:23 +08:00
fuchanghai
8ded072f79
[Improvement-11293][dolphinscheduler-api] remove some variables that redundant in subclasses of AbstractAuthenticator (#11305) 
* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors

* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors

* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors

* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors

* [fix-10729]fix the code smell

* [fix-10729]decorate DataSourceControllerTest with public

* [fix-10729]replace import *

* [fix-10729]

* [fix-10729]

* [fix-10729]

* [fix-10729]checkstyle

* [Improvement][ExecutorServiceImpl] remove some unnecessary

* [fix-11181]text check and word spell

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>

* Update ExecutorServiceImpl.java

remove the error logging and update the comment

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>

* [Improvement-10760][dolphinscheduler-api] Some variables are redundant

* [Improvement-10760][dolphinscheduler-api] Some variables are redundant and fix checkstyle

* [Improvement-10760][dolphinscheduler-api] Some variables are redundant and fix checkstyle

* [Improvement-10760][dolphinscheduler-api] add import

* [Improvement-10760][dolphinscheduler-api] remove not use

* [Improvement-11293][dolphinscheduler-api] remove some variables that redundant in subclasses of AbstractAuthenticator

* [Improvement-11293][dolphinscheduler-api] remove some variables that redundant in subclasses of AbstractAuthenticator

Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2022-08-05 14:11:12 +08:00
JiPeng Wang
c9cf8c7774
no-admin user query alert group fix (#11301) 2022-08-04 23:01:15 +08:00
zhuxt2015
c34503e3f6
[fix] Process definition length too long when copy or import (#10621) 2022-08-04 15:04:14 +08:00
陈家名
aef2fbf36c
[Python] Migrate exists method call in PythonGateway to corresponding service (#11188) 
Migrate all exists method call in PythonGateway to corresponding service
 2022-08-04 12:50:21 +08:00
fuchanghai
cb001b581a
[Improvement-10760][dolphinscheduler-api] Some variables are redundant and fix checkstyle (#11213) 
* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors

* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors

* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors

* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors

* [fix-10729]fix the code smell

* [fix-10729]decorate DataSourceControllerTest with public

* [fix-10729]replace import *

* [fix-10729]checkstyle

* [Improvement][ExecutorServiceImpl] remove some unnecessary

* [fix-11181]text check and word spell

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>

* Update ExecutorServiceImpl.java

remove the error logging and update the comment

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>

* [Improvement-10760][dolphinscheduler-api] Some variables are redundant

* [Improvement-10760][dolphinscheduler-api] Some variables are redundant and fix checkstyle

* [Improvement-10760][dolphinscheduler-api] Some variables are redundant and fix checkstyle

* [Improvement-10760][dolphinscheduler-api] add import

* [Improvement-10760][dolphinscheduler-api] remove not use

Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2022-08-01 09:24:02 +08:00
JinYong Li
e5cca0e79b
[Fix-11007] [Master] fix forced_success bug (#11088) 
* fix forced_success bug

* add comments

* add transactional

* refactor code

Co-authored-by: JinyLeeChina <jiny.li@foxmail.com>
 2022-07-30 23:28:31 +08:00
fuchanghai
d73ad2e7d5
[BUG-11181] [Document] text check (#11183) 2022-07-29 23:49:46 +08:00
JiPeng Wang
cd0c50f3f2
[Fix-11140] Added resource parameters for function verification (#11141) 
* Added resource parameters for function verification

* checkstyle fixed

* checkstyle fixed

* check style fixed for env test

* rerun

* rerun
 2022-07-28 14:03:12 +08:00
fuchanghai
81fa09678c
[Improvement][ExecutorServiceImpl] remove some unnecessary (#11122) 2022-07-28 09:57:19 +08:00
Lyle Shaw
181cd2ff79
[Feature] Add CURD to the project/tenant/user section of the API and add its tests. (#10913) 2022-07-27 14:33:33 +08:00
zhuxt2015
cc2f17ddcc
[Enhancement][API] Copy workflow with scheduler info (#10677) 
* support batch copy workflow with scheduler
 2022-07-27 13:45:45 +08:00
xuhhui
8004e97b4b
[Feature][Api] Refactor org.apache.dolphinscheduler.api.controller.ProjectController (#10832) 
* [Feature][Api] Refactor org.apache.dolphinscheduler.api.controller.ProjectController
 2022-07-26 15:24:48 +08:00
zhuxt2015
5ebd53893c
[Feature-10604] Task name in the copied and imported workflow without copy suffix (#10607) 
* fix

* remove imported task suffix
 2022-07-26 15:21:33 +08:00
zhuxt2015
4d9db3451e
[Bug] [API] If the single log length is long, it will causes the View Log page to hang (#10612) 2022-07-26 10:14:45 +08:00
jackfanwan
ccb7641468
修改数据质量查询的权限判断 (#10977) 
Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
 2022-07-25 09:35:53 +08:00
旺阳
28b40da1b1
[Improve] Hide Change Pwd Page When Login With LDAP (#11041) 
* hide-change-pwd-page-when-ldap-login

* add unit test
 2022-07-20 18:48:16 +08:00