test/DolphinScheduler
1
0
Fork 0
mirror of https://gitee.com/dolphinscheduler/DolphinScheduler.git synced 2024-12-04 05:09:48 +08:00
Code Issues Actions 10 Packages Projects Releases Wiki Activity
7,564 Commits 27 Branches 59 Tags 276 MiB
de6bc56aee
Commit Graph

784 Commits

Author SHA1 Message Date
calvin
915bdf481d
fix the issue with throwing the sql exception (#13231) 2022-12-20 17:54:47 +08:00
陈家名
7643d2840a
[Improvement][api-sql] Optimize the sql for paging query project (#13172) 
* Optimizing sql

* add version join condition

Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
 2022-12-19 08:51:21 +08:00
JieguangZhou
66e20271ad
[Feature][Master] Add task caching mechanism to improve the running speed of repetitive tasks (#13194) 
* Supports task instance cache operation

* add task plugin cache

* use SHA-256 to generate key

* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql

Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>

* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgresql.sql

Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>

* Optimizing database Scripts

* Optimize clear cache operation

Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
 2022-12-18 18:17:09 +08:00
insist777
631e3a81d1
[Feature][API] New restful API for taskInstance (#13070) 2022-12-14 14:47:36 +08:00
JieguangZhou
e4b9b67255
Allow execute task in workflow instance (#13103) 2022-12-13 16:43:44 +08:00
Wenjun Ruan
f5801a0e1c
Fix task group might be rob by multiple task (#13115) 2022-12-11 22:58:21 +08:00
Yann Ann
6ef74073cc
[Improve-13001]migrate commons-collections -> commons-collections4 (#13002) 2022-12-10 23:50:19 +08:00
Wenjun Ruan
66b8a81ad8
Revert "Update dolphinscheduler_ddl.sql (#13081)" (#13117) 
This reverts commit fa3e2a5e1a.
 2022-12-07 10:14:28 +08:00
jackfanwan
cb8d125e0f
[Improvement] optimization task definition & fix in the task definition list, if one task have more pre task, the task list can't show all task (#13106) 
* fix in the task definition list, if one task have more pre task, the task list can't show all task

* modify code style

* in the task definition, delete search workflow name filter, and  fix in the task definition list, if one task have more pre task, the task list can't show all task

* modify code style

* modify code style

* delete useless select sql

* add annotation

Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
 2022-12-07 09:52:53 +08:00
Eric Gao
d9f43adafd
Prevent default alert group from binding alert plugin instances with id 1 and 2 automatically (#13114) 2022-12-06 23:10:48 +08:00
Wenjun Ruan
8a152aebc7
Fix task log file might not be clear (#13102) 2022-12-06 11:23:20 +08:00
Wenjun Ruan
fed1e85fb8
Fix the invalidate task instance never be deleted (#13091) 2022-12-04 18:38:54 +08:00
darkz
fa3e2a5e1a
Update dolphinscheduler_ddl.sql (#13081) 
https://github.com/apache/dolphinscheduler/pull/12826
for this pr
 2022-12-03 22:11:08 +08:00
Jay Chung
f5a59982b3
[fix] Python gateway can not upload to resource center (#13042) 
in #12076 we refactor our resource center, remove the resource table,
it is a good refactor but it failed python api upload, this patch try
to fix python api upload function

ref: #12076
 2022-12-02 10:11:57 +08:00
insist777
1064680ded
[feat][API] New restful API for workflow state (#13031) 2022-12-01 14:21:01 +08:00
insist777
a0eb45b9e4
[Feature][API] New restful API for workflowInstance (#12990) 2022-11-28 12:58:46 +08:00
Kerwin
f9a0ecbc81
[Bug-12997][API] Fix that the end time is not reset when the workflow instance reruns. (#12998) 
* Fix that the end time is not reset when the workflow instance reruns.
 2022-11-27 15:08:30 +08:00
rickchengx
43719f7c15
[Improvement-12763][UT] Improve testListAuthorizedProjects() in ProjectMapperTest (#12768) 2022-11-27 13:15:38 +08:00
rickchengx
7336afaa65
[Fix-12916] Add permission check when query or download log (#12917) 2022-11-25 17:59:28 +08:00
Kerwin
31021730ec
The task instance list is sorted by submission time (#12974) 2022-11-24 18:59:53 +08:00
Wenjun Ruan
d99ba29b66
Fix master cluster may loop command unbalanced (#12891) 
(cherry picked from commit 3b2b86661be76b7c1404a910c865d78b7936313d)
 2022-11-16 10:20:22 +08:00
Guanhua Li
83f9588eb0
[Improvement-12856][UT] Refactor duplicated code fragment in UdfFuncMapperTest (#12857) 2022-11-15 22:59:11 +08:00
Kerwin
713046b043
Modify the table t_ds_worker_group to add a description field in the postgresql upgrade script (#12883) 2022-11-15 17:26:41 +08:00
rickchengx
7c711e622f
[Improvement-12850][UT] Improve the ut of DataSourceMapperTest (#12851) 2022-11-12 23:57:40 +08:00
jackfanwan
f249f2b257
[fix-12675]edit workflow related task, workflow's task version change (#12692) 
* edit workflow related task, workflow's task version change

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/enums/Status.java

Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
 2022-11-06 20:49:07 +08:00
jackfanwan
913525343e
modify sql error (#12717) 2022-11-05 21:44:01 +08:00
jackfanwan
7d0e2cbbb9
when delete workflow, delete related task (#12681) 
* when delete workflow, delete related task

Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
 2022-11-04 14:40:15 +08:00
ZhenjiLiu
7cdb926a5f
[Improvement][Batch Query] Batch query ProcessDefinitions belongs to need failover ProcessInstance. (#12506) 2022-11-03 09:15:19 +08:00
Yiming Guo
dc8d18cf87
[Feature-12040][api][ui] Add authorization management of read and write permissions for project center (#12048) 
[Feature-12040][api][ui] Add authorization management of read and write permissions for project center
 2022-10-27 18:01:51 +08:00
Tq
4b4d0b92a3
[FIX][DAO-12277] change t_ds_fav_task column task_name to task_type and related code (#12276) 
* change t_ds_fav_task column task_name to task_type and related code

* change task_name to task_type

* change FavTask taskName to taskType, taskType to taskCategory

Co-authored-by: labbomb <739955946@qq.com>
 2022-10-27 09:36:26 +08:00
HanayoZz
489e7fe4e2
[Feature-10495][Resource Center] Resource Center Refactor (#12076) 
* resource center refactor - S3 services connection

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
 2022-10-26 13:53:44 +08:00
Hengdong Gong
3030419ee1
[fix](dolphinscheduler-dao) fix upgrade to 3.1.0 sql missing field (#12314) (#12315) 2022-10-26 12:32:05 +08:00
Yann Ann
04aa125ba2
[Refactor]migrate some task dao functions from ProcessServiceImpl to dao modules. (#12505) 
* migrate some task DAO to dao modules.

* Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/repository/impl/ProcessInstanceMapDaoImpl.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
 2022-10-26 11:51:58 +08:00
陈家名
97a0771f21
[fix][sql] Add unique key to process_definition_log avoid TooManyResultExpection (#12503) 
* Add unique key to t_ds_process_definition_log
 2022-10-25 14:20:37 +08:00
caishunfeng
dedff70f90
[Improvement] Merge spi.utils into common.utils (#12502) 
* improve JSONUtil

* merge spi.utils into common.utils

* split constants && remove some copy utils method

* remove StringUtils
 2022-10-23 21:23:54 +08:00
Wenjun Ruan
b5193ee4e5
Remove equals in User to fix UT (#12487) 2022-10-22 08:59:10 +08:00
Kerwin
1436ad65fc
[Bug-12410] [API]Fix the worker list result in workflow definition only has default (#12411) 
* Fix the worker list result in workflow definition only has default

* Fix tenant, k8s namespace similar permission issues.

* code clean in the k8s namespace mapper

* delete redundant sql method
 2022-10-21 13:54:28 +08:00
Eric Gao
d46e4659d9
[Improvement][Style] Fix remaining style errors and wildcard imports (#12412) 
* Fix remaining style errors and wildcard imports

* Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link

* Fix spotless matching scope of markdown files
 2022-10-19 11:08:04 +08:00
Kerwin
c02e08bb3d
[BUG-12396][Schedule] Fixed that the workflow definition scheduling that has been online after the version upgrade does not execute (#12397) 
* Fixed that the workflow definition scheduling that has been online after the version upgrade does not execute.
 2022-10-17 19:45:39 +08:00
fuchanghai
22103f975e
[improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module (#12328) 
* [improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module

Co-authored-by: Jackie <‘2875334588@qq.com’>
 2022-10-13 15:26:39 +08:00
kezhenxu94
db1d319159
Reorganize some classes in common module, remove duplicate classes (#12321) 2022-10-13 10:23:27 +08:00
Yann Ann
17cd644506
[Fix-#11669][Workflow Instance Page] Fix the duration in Workflow Instance page. (#12264) 
* fix process duration issue

* use processInstance.getState().isFinished() replace new isFinish function

* add WorkflowUtils
 2022-10-13 09:50:31 +08:00
Jiajie Zhong
0e1c8d8153
[Feature][API] New restful API task and task relation (#12116) 2022-10-13 09:41:03 +08:00
jegger
04e1b88c1c
[fix] Fix error problem on h2 startup data quality rule management page (#12108) 
Co-authored-by: jegger <zhangbq3306@163.com>
 2022-10-11 16:52:35 +08:00
Ivan
98a8b5383e
[ fix: #11590 ][upgrade] Fix the bugs when I upgrade ds from v1.3.9 to v3.0.0 ,such as file cannot be found or column not found etc (#11619) 
* fix the bugs which upgrade ds metabase from v1.3.9 to v3.0.0 with mysql

* [Fix-11590][upgrade] Fix the bugs when I upgrade ds from v1.3.9 to v3.0.0 ,such as file cannot be found or column not found etc

* fix: #11590 add process_instance_code_state_index with table t_ds_process_instance to improve query efficiency for the method of findLastProcessInterval

* Fix the bug  that cannot find the files when upgrade ds version with postgresql

Co-authored-by: fan.wang <fan.wang@jiduauto.com>
 2022-10-11 10:20:05 +08:00
Yann Ann
60c43d5d32
just add WorkerGroupMapper UT (#12242) 2022-10-06 20:10:48 +08:00
Yann Ann
3c4f9380d1
just correct wrong word (#12174) 2022-10-05 17:08:48 +08:00
fuchanghai
e27c79974d
[fix-#11753] send alert error alert data id (#11774) 
* [fix-#11753] send alert error alert data id

Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>
 2022-09-29 15:34:40 +08:00
caishunfeng
151c2d2c70
fix upgrade sql (#12141) 2022-09-26 15:21:52 +08:00
labbomb
64f4cb4f3e
refactor: dag-menu refactor (#11965) 
* refactor: dag-menu refactor

* feat: add i18n support for the dag-menu

* feat: add e2e class

Co-authored-by: devosend <devosend@gmail.com>
Co-authored-by: Tq <tianqitobethefirst@gmail.com>
 2022-09-26 11:06:39 +08:00