Commit Graph

8005 Commits

Author SHA1 Message Date
xuankun zheng
61118d4467
[fix-14123] remove the equals and hashcode in Project pojo (#14167)
* [fix] remove the equals and hashcode in Project pojo

* [fix]fix the Strict Problem in Mockito by using `doReturn()` instead of `when()` functionw

---------

Co-authored-by: xuankun zheng <zhxuankun@gmail.com>
2023-06-13 11:19:04 +08:00
Rick Cheng
1cd5070b5d
[Improvement-14329][common] Remove the duplicate BusinessTimeUtils (#14330) 2023-06-13 08:30:34 +08:00
Kerwin
75f4fa2881
Fix the complement function does not generate the next running instances in parallel mode (#14335) 2023-06-12 19:40:26 +08:00
Rick Cheng
1c935d901e
[Feature-14214][Parameter] Support CRUD of project-level parameters (#14264) 2023-06-12 13:35:38 +08:00
Rick Cheng
4fa0ab4d7e
[feature][Resource] Add support for Azure Blob Storage in the resource center (#14082) 2023-06-12 12:05:49 +08:00
ORuteMa
de2cc0e235
[bug][plugin]Fix: Correct the way to determine the yarn queue in Flink CommandLine and SQL mode (#14237)
* Fix: Correct the way to determine the yarn queue in Flink CommandLine

* fix the yarn queue in sql mode && refine the code

* refine code

* remove unnecessary comment

* fix yarn queue properties

* remove redundant variable
2023-06-12 11:04:39 +08:00
Wenjun Ruan
aa2d9a7f05
Add baseDao (#14316) 2023-06-09 19:02:50 +08:00
Aaron Wang
b7fb393eed
fix: trim node selector requirement value (#14307) 2023-06-09 18:06:52 +08:00
Rick Cheng
66e09dc66e
[Improvement-14295][common] Remove the duplicate FileUtils (#14301) 2023-06-08 08:59:53 +08:00
JieguangZhou
e7cdc7c136
[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters (#14127)
* add dynamic task plugin

* fix ui

* update code

* add DOC

* ADD UT

* fix doc

* fix sanity check

* add upgrade ddl
* fix sql
2023-06-07 16:01:06 +08:00
Rick Cheng
525e441223
[Improvement-14282][Task] Add app_link on the ui of task instance (#14283) 2023-06-07 15:00:12 +08:00
Rick Cheng
2c057d6a8f
[Improvement-14292][Common] Remove the duplicate OSUtils (#14293) 2023-06-07 14:59:25 +08:00
jackfanwan
6b1a952c6b
add if judge (#14290) 2023-06-07 14:57:48 +08:00
Rick Cheng
929811760a
[Fix-14284][DAO] update the check of Integer in equals() (#14285) 2023-06-07 12:08:48 +08:00
Rick Cheng
ed8ae9c0ee
[Improvement-14286][BOM] Bump clickhouse-jdbc from 0.3.2-patch11 to 0.4.6 (#14287) 2023-06-07 12:08:23 +08:00
Rick Cheng
4d798e774e
[Improvement-14280][Task] update the task execution status check (#14281) 2023-06-06 15:25:57 +08:00
HQFGit
d587b5f03d
[Bug][Master][Fixes 14216]workflow state keep READY_STOP when sub_process state … (#14221)
* [Bug] [Master] workflow state keep READY_STOP when sub_process state STOP
Fixes #14216

* [Bug] [Master] workflow state keep READY_STOP when sub_process state STOP
Fixes  mvn spotless:apply#14216

* Update testFile.txt.crc

* Update testFile.txt.crc

* Delete testFile.txt.crc
2023-06-06 11:04:32 +08:00
lgcareer
fdb8fde776
[NOTICE]Update the NOTICE year (#14272)
Co-authored-by: lgcareer <lgcareer@apache.org>
2023-06-06 10:25:33 +08:00
Jay Chung
dd55de4429
chore: Remove EOL issue version and add prepare one (#14270)
* due to we release the last version of 2.0.x and 3.0.x, we do not
  accept bug report for them now.
* Add new version 3.2.0-prepare for testing the incoming verison
  3.2.0-prepare
2023-06-04 17:12:40 +08:00
Devosend
85b581b232
fix resource center upload file timeout bug (#14268) 2023-06-02 21:15:13 +08:00
Zinway
18d176c5f4
feat: Introduce new datasource vertica (#14232)
Co-authored-by: Zinway Liu <zinway.liu@ucloud.cn>
2023-06-02 13:57:37 +08:00
Rick Cheng
767331281a
[Improvement-14255][Project] Remove userName when update project (#14256) 2023-06-02 09:58:22 +08:00
Eric Gao
e86630bb7b
[Improvement][Metrics] Add more worker related metrics and fix some previous ones (#14254)
* Add more worker related metrics and fix some previous ones

* update metrics docs
2023-06-01 16:54:48 +08:00
alexBaiJW
d67fe52c33
Fix the perm setting for the process definition import function (#14239)
* Fix the perm setting for the process definition import function

* fix the style issue
2023-06-01 15:59:02 +08:00
Rick Cheng
8aec3846b4
[Improvement-14243][Metrics] Add user tag of response time of api server (#14248) 2023-06-01 15:13:28 +08:00
Wenjun Ruan
5e9f1de075
Remove state check for dependent/subProcess in StateWheelExecuteThread (#14242) 2023-05-31 16:39:12 +08:00
Jay Chung
7226edd04e
chore: Release version 3.0.6 (#14234) 2023-05-30 10:36:58 +08:00
scorpig
b8748e29ae
Fix TreeView "Task Status" not show bug and compatibility with older versions (#14207)
use WorkflowExecutionStatus.name()
2023-05-29 13:39:38 +08:00
Aaron Wang
9e0991145e
[Improvement-14146][K8S Task] print complete error logs in task log file (#14147) 2023-05-27 17:39:03 +08:00
Rick Cheng
1011852ab2
[Improvement-14195][Parameter] remove misleading comment of combining local and global parameter (#14196) 2023-05-26 09:29:09 +08:00
Aaron Wang
4e78248238
[Feature][K8S Task] support node selector (#14126)
* feat: support K8S node selector

* fix CI
2023-05-26 09:21:23 +08:00
Kerwin
fa4a4f6938
Added 3.1.7 release document (#14206) 2023-05-25 18:08:04 +08:00
Wenjun Ruan
d810c487fd
Fix taskGroupQueue doesn't removed from inQueue where wakeup failed (#14200)
* Fix taskGroupQueue doesn't removed from inQueue where wakeup failed

* Fix avaliable taskGroup is 0 the TaskGroupQueue doesn't out queue
2023-05-25 14:42:32 +08:00
calvin
c6ac356134
[Improvement-14201][UI] Improve the select component to support users to filter options. (#14202) 2023-05-25 13:12:04 +08:00
haibingtown
af7da0630e
[Feature] Add project name/workflow definition name/instance id/task name to the built-in variables (#14099)
* [Feature] Add project name/workflow definition name/instance id/task name to the built-in variables
2023-05-25 11:02:39 +08:00
Aaron Wang
41e3ce35a7
fix: disordered comments in values.yaml (#14197) 2023-05-24 21:06:18 +08:00
Wenjun Ruan
deca0a7ea1
Fix master memory leak due to MasterTaskExecuteRunnableDoesn't be removed (#14162)
* Fix master memory leak due to MasterTaskExecuteRunnableDoesn't be removed

* Update dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/runner/execute/MasterTaskExecuteRunnable.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2023-05-24 13:49:32 +08:00
Zzih
43d7b35977
[fix-14119] The checkBucketNameExists method should not use s3Client. listBuckets() (#14188)
* optimize checkBucketNameExists

* fix code style

---------

Co-authored-by: 詹子恒 <ziheng.zhan@longbridge.sg>
2023-05-24 13:43:44 +08:00
calvin
4c2e57cfb3
[Feature][UI] Support to view and manage all timing settings of a project. (#14178) 2023-05-24 08:50:53 +08:00
Rick Cheng
5c4ba4105d
[Feature-14138][Metrics] Add metrics for api server (#14177) 2023-05-23 12:22:49 +08:00
Rick Cheng
0ab2447d58
[Improvement-14080][script] cleanup dist directory at the beginning of check-LICENSE.sh (#14081) 2023-05-23 10:52:50 +08:00
Aaron Wang
708086c8fe
fix: PULL_REQUEST_TEMPLATE.md dead link (#14163) 2023-05-23 09:44:04 +08:00
Aaron Wang
5e87b2d58a
[Bug][Worker] generate kill command with unknown user: default (#14145) 2023-05-22 20:48:40 +08:00
Rick Cheng
428f1559a3
[Improv-14083][Resource Center] Handle deleteSource in OSS / S3 / GCS (#14084) 2023-05-22 20:44:43 +08:00
秋天
9979ea3467
[fix-11321][ui] fix create workflow contains chunjun node failed (#11979) 2023-05-22 13:52:32 +08:00
Alex Ting
606b56403e
[Fix-13381][plugin] fix error while parsing hive load sql (#13378)
* [fix][task plugin][task sql] fix parsing error while using variables sometimes parsing exception happened if task sql contains a variable followed by \" or \' .

for example:
input sql: load inpath '/tmp/test_table/dt=${dt}'
into table test_table partition(dt=${dt})

after replace: preparing : load inpath '/tmp/test_table/dt=?
into table test_table partition(dt=?)
2023-05-22 11:19:30 +08:00
Wenjun Ruan
05df0269f6
Fix task exception might not exist in task instance log (#14085) 2023-05-21 09:55:35 +08:00
Kerwin
8315279620
[Feature-#14148][Task] Added status check interval and dependent failure policy parameters for dependent task nodes (#14150)
* Added a dependent task failure policy in the dependent task node
2023-05-19 14:49:50 +08:00
Jay Chung
56b0f91f6e
fix: Save task seatunnel error (#14129) 2023-05-19 10:47:16 +08:00
calvin
03ff78fdcb
[Improvement-14112][UI] Add a quick link to visit workflow instances of the current workflow. (#14134) 2023-05-18 19:47:02 +08:00