* [feat] New restful API for workflow and schedule
CURD for workflow and schedule, different with exists
API, this new restful api only operate single resource
in each request, and return the latest. For example,
previous workflow should also need to post tasks definition
and tasks relation definition, but this patch will allow
you to create workflow without task relate information
* use checkProjectAndAuthThrowException, and fix CI error
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/ScheduleV2Controller.java
* change method name
from createProcessDefinitionV2 to createSingleProcessDefinition
from updateProcessDefinitionV2 to updateSingleProcessDefinition
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
* [improve] support test tasks
* [improve] support test tasks
* [improve] support test tasks
* [improve] support test tasks
* [improve] support test tasks
* Update TaskExecuteThread.java
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* Update DataSource.java
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* Update messages_zh_CN.properties
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* Update messages.properties
* Update messages_en_US.properties
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Resolve conflict.
* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- fix ProcessDefinitionServiceImpl.java dependency
* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Accept proposed change in ResourcePermissionCheckServiceImpl.java
* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Update the UT case in TenantServiceTest.java, UsersServiceTest.java, TaskGroupServiceTest.java.
- Update log printing in TaskGroupServiceImpl.java.
- Fix NPE of log parameter in ExecutorServiceImpl.java when call python api.
* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Fix NPE of log in WorkerGroupServiceImpl.java.
- Fix log parameter missing bug in ResourcesServiceImpl.java.
* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Fix bugs and handle some vulnerability codes.
* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Fix bugs and handle some vulnerability codes.
* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Fix e2e User test.
* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Fix codeQL check & SonarCloud Code Analysis.
* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Resolve import conflict.
* [DS-11773][api] Optimize the log printing of the api module according to the log specification doc.
- Fix codeQL check & SonarCloud Code Analysis.
* [Fix] [Quartz] cron did not work as expected
* [Fix] [Quartz] make the value of batchTriggerAcquisitionMaxCount to 1(default value)
Co-authored-by: hezhao2 <hezhao2@cisco.com>
after we add permission to our codebase in dev branch, will got error
when create objects from pydolphinscheduler, because users with user_id
equal to `Integer.MAX_VALUE` is ordinary users which can not have access
to create unless we grant permission to the role manually. this patch
change dummyUser to admin user's user_id == 1 to fix it
* [Feature] add state history for process instance (#97)
* add state history for process instance
* upsertProcessInstance
* remove unuse method
* fix UT
Co-authored-by: caishunfeng <534328519@qq.com>
* Support re running historical version workflow
Support re running historical version workflow
* Update ExecutorServiceImpl.java
* Update ExecutorServiceImpl.java
* Add waiting strategy to support master/worker can recover from registry lost
* throw exception when zookeeper registry start failed due to interrupted
* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors
* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors
* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors
* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors
* [fix-10729]fix the code smell
* [fix-10729]decorate DataSourceControllerTest with public
* [fix-10729]replace import *
* [fix-10729]
* [fix-10729]
* [fix-10729]
* [fix-10729]checkstyle
* [Improvement][ExecutorServiceImpl] remove some unnecessary
* [fix-11181]text check and word spell
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
* Update ExecutorServiceImpl.java
remove the error logging and update the comment
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
* [Improvement-10760][dolphinscheduler-api] Some variables are redundant
* [Improvement-10760][dolphinscheduler-api] Some variables are redundant and fix checkstyle
* [Improvement-10760][dolphinscheduler-api] Some variables are redundant and fix checkstyle
* [Improvement-10760][dolphinscheduler-api] add import
* [Improvement-10760][dolphinscheduler-api] remove not use
* [Improvement-11293][dolphinscheduler-api] remove some variables that redundant in subclasses of AbstractAuthenticator
* [Improvement-11293][dolphinscheduler-api] remove some variables that redundant in subclasses of AbstractAuthenticator
Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors
* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors
* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors
* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors
* [fix-10729]fix the code smell
* [fix-10729]decorate DataSourceControllerTest with public
* [fix-10729]replace import *
* [fix-10729]checkstyle
* [Improvement][ExecutorServiceImpl] remove some unnecessary
* [fix-11181]text check and word spell
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
* Update ExecutorServiceImpl.java
remove the error logging and update the comment
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
* [Improvement-10760][dolphinscheduler-api] Some variables are redundant
* [Improvement-10760][dolphinscheduler-api] Some variables are redundant and fix checkstyle
* [Improvement-10760][dolphinscheduler-api] Some variables are redundant and fix checkstyle
* [Improvement-10760][dolphinscheduler-api] add import
* [Improvement-10760][dolphinscheduler-api] remove not use
Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
* when task with more than one upstreams, mapper
TaskDefinitionMapper method queryByName will return
more than one record, and failed the mybatis result
type, so we have to add `limit 1` to it to
* add multiple runs of example in integrate test
* Change from subprocess.Popen to subprocess.call_check
in integrating test which will raise an error when failed
currently, users can delete process definitions used
in other sub-process tasks or in other dependent tasks.
but this change will break the dependence of those task
and failed DAG, this patch add validation of those
delete behavior to avoid this error
