Commit Graph

7982 Commits

Author SHA1 Message Date
alexBaiJW
d67fe52c33
Fix the perm setting for the process definition import function (#14239)
* Fix the perm setting for the process definition import function

* fix the style issue
2023-06-01 15:59:02 +08:00
Rick Cheng
8aec3846b4
[Improvement-14243][Metrics] Add user tag of response time of api server (#14248) 2023-06-01 15:13:28 +08:00
Wenjun Ruan
5e9f1de075
Remove state check for dependent/subProcess in StateWheelExecuteThread (#14242) 2023-05-31 16:39:12 +08:00
Jay Chung
7226edd04e
chore: Release version 3.0.6 (#14234) 2023-05-30 10:36:58 +08:00
scorpig
b8748e29ae
Fix TreeView "Task Status" not show bug and compatibility with older versions (#14207)
use WorkflowExecutionStatus.name()
2023-05-29 13:39:38 +08:00
Aaron Wang
9e0991145e
[Improvement-14146][K8S Task] print complete error logs in task log file (#14147) 2023-05-27 17:39:03 +08:00
Rick Cheng
1011852ab2
[Improvement-14195][Parameter] remove misleading comment of combining local and global parameter (#14196) 2023-05-26 09:29:09 +08:00
Aaron Wang
4e78248238
[Feature][K8S Task] support node selector (#14126)
* feat: support K8S node selector

* fix CI
2023-05-26 09:21:23 +08:00
Kerwin
fa4a4f6938
Added 3.1.7 release document (#14206) 2023-05-25 18:08:04 +08:00
Wenjun Ruan
d810c487fd
Fix taskGroupQueue doesn't removed from inQueue where wakeup failed (#14200)
* Fix taskGroupQueue doesn't removed from inQueue where wakeup failed

* Fix avaliable taskGroup is 0 the TaskGroupQueue doesn't out queue
2023-05-25 14:42:32 +08:00
calvin
c6ac356134
[Improvement-14201][UI] Improve the select component to support users to filter options. (#14202) 2023-05-25 13:12:04 +08:00
haibingtown
af7da0630e
[Feature] Add project name/workflow definition name/instance id/task name to the built-in variables (#14099)
* [Feature] Add project name/workflow definition name/instance id/task name to the built-in variables
2023-05-25 11:02:39 +08:00
Aaron Wang
41e3ce35a7
fix: disordered comments in values.yaml (#14197) 2023-05-24 21:06:18 +08:00
Wenjun Ruan
deca0a7ea1
Fix master memory leak due to MasterTaskExecuteRunnableDoesn't be removed (#14162)
* Fix master memory leak due to MasterTaskExecuteRunnableDoesn't be removed

* Update dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/runner/execute/MasterTaskExecuteRunnable.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2023-05-24 13:49:32 +08:00
Zzih
43d7b35977
[fix-14119] The checkBucketNameExists method should not use s3Client. listBuckets() (#14188)
* optimize checkBucketNameExists

* fix code style

---------

Co-authored-by: 詹子恒 <ziheng.zhan@longbridge.sg>
2023-05-24 13:43:44 +08:00
calvin
4c2e57cfb3
[Feature][UI] Support to view and manage all timing settings of a project. (#14178) 2023-05-24 08:50:53 +08:00
Rick Cheng
5c4ba4105d
[Feature-14138][Metrics] Add metrics for api server (#14177) 2023-05-23 12:22:49 +08:00
Rick Cheng
0ab2447d58
[Improvement-14080][script] cleanup dist directory at the beginning of check-LICENSE.sh (#14081) 2023-05-23 10:52:50 +08:00
Aaron Wang
708086c8fe
fix: PULL_REQUEST_TEMPLATE.md dead link (#14163) 2023-05-23 09:44:04 +08:00
Aaron Wang
5e87b2d58a
[Bug][Worker] generate kill command with unknown user: default (#14145) 2023-05-22 20:48:40 +08:00
Rick Cheng
428f1559a3
[Improv-14083][Resource Center] Handle deleteSource in OSS / S3 / GCS (#14084) 2023-05-22 20:44:43 +08:00
秋天
9979ea3467
[fix-11321][ui] fix create workflow contains chunjun node failed (#11979) 2023-05-22 13:52:32 +08:00
Alex Ting
606b56403e
[Fix-13381][plugin] fix error while parsing hive load sql (#13378)
* [fix][task plugin][task sql] fix parsing error while using variables sometimes parsing exception happened if task sql contains a variable followed by \" or \' .

for example:
input sql: load inpath '/tmp/test_table/dt=${dt}'
into table test_table partition(dt=${dt})

after replace: preparing : load inpath '/tmp/test_table/dt=?
into table test_table partition(dt=?)
2023-05-22 11:19:30 +08:00
Wenjun Ruan
05df0269f6
Fix task exception might not exist in task instance log (#14085) 2023-05-21 09:55:35 +08:00
Kerwin
8315279620
[Feature-#14148][Task] Added status check interval and dependent failure policy parameters for dependent task nodes (#14150)
* Added a dependent task failure policy in the dependent task node
2023-05-19 14:49:50 +08:00
Jay Chung
56b0f91f6e
fix: Save task seatunnel error (#14129) 2023-05-19 10:47:16 +08:00
calvin
03ff78fdcb
[Improvement-14112][UI] Add a quick link to visit workflow instances of the current workflow. (#14134) 2023-05-18 19:47:02 +08:00
Kerwin
c6512edc3a
revert [fix-#13956] [Master]taskId is null cause NPE #13980 (#14142) 2023-05-18 19:28:27 +08:00
Kerwin
503d54aff9
Fix dependent task nodes in workflow instances cannot display data (#14141) 2023-05-18 19:24:53 +08:00
Kerwin
8583de878b
fix error TS2339: Property '' does not exist on type CreateComponentPublicInstance (#14144) 2023-05-18 18:46:42 +08:00
fuchanghai
67f50e3904
[fix-#13940] add status of `` stop`` in class of TaskExecutionStatus (#14016) 2023-05-18 13:31:02 +08:00
Rick Cheng
db2da822de
Add supported operations of workflow definition (#14122) 2023-05-18 10:27:36 +08:00
calvin
f0881b65a1
fix syntax errors (#14124) 2023-05-17 08:59:24 +08:00
Aaron Wang
74ed7856bc
[Bug-14105][Task] Replace default tenant when downloading resource (#14106) 2023-05-16 18:11:58 +08:00
calvin
f384d71da0
[Improvement-14111][UI] Add a tooltip for the copy button of workflow definition. (#14116) 2023-05-16 16:52:48 +08:00
Aaron Wang
c3809fbecf
[Improvement-13868][K8S Task] Support the custom labels for k8s task (#14067)
* [Improvement-13868] Support the custom labels for k8s task

* fix front-end type mismatched
2023-05-16 12:04:33 +08:00
Jay Chung
2124a95081
chore: roadmap should not label stale (#14103) 2023-05-15 17:45:22 +08:00
Aaron Wang
1e3ae7b942
[improv][Resource Center] Implement getResourceFileName in StorageOperator (#14097) 2023-05-15 14:02:30 +08:00
Kerwin
8944fdc622
Added 3.1.6 release document (#14100) 2023-05-15 11:25:45 +08:00
JieguangZhou
a3b2cc0275
[CI] Try fix api test error (#14094)
* try fix api test error

* add workergroupapitest to ci and fix log output

* fix log output

* skip remote shell UT

---------

Co-authored-by: SbloodyS <460888207@qq.com>
2023-05-12 21:39:00 +08:00
openopen2
fc97118bdc
[Doc] Fix upgrade-schema.sh cannot load driver class (#14072)
* fix upgrade-schema.sh cannot load driver class

When initializing and creating related tables for the first time, the support of related jdbc drivers is required. This article omits placing jdbc drivers in the tools directory.

* Update datasource-setting.md

update english doc
2023-05-10 13:44:23 +08:00
Drake Youngkun Min
801216bd35
RECOVER_TOLERANCE_FAULT_PROCESS CommandType needs the start parameters (#13958) 2023-05-10 13:02:21 +08:00
He Zhao
f1e78627fc
[feature][plugin] Add snowflake datasource in datasource plugin (#13729)
---------

Co-authored-by: weitong <weitong@cisco.com>
2023-05-06 19:30:50 +08:00
Rick Cheng
3eb4c0ed1d
[Improvement-14054][Worker] Kill multiple yarn apps at the same time (#14055)
* [Improvement-14054][Worker] Kill multiple yarn apps at the same time

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/am/YarnApplicationManager.java

Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
2023-05-06 19:13:12 +08:00
imp2002
920e9b80fb
[Fix-13928][UI] Fix repeat CustomParams input box (#14029) 2023-05-06 17:21:56 +08:00
eye-gu
cfbf675737
[Fix-14049][dao] fix init sql and use on conflict do update in pg (#14051) 2023-05-06 17:11:43 +08:00
Rick Cheng
84edea7593
[Improvement-14052][Log] Remove the useless filter in getAppIdsFromLogFile (#14053) 2023-05-06 17:00:53 +08:00
liyou
f269ccbd4a
[Fix-13989] Fix resource center path validation (#14021) 2023-05-06 16:59:29 +08:00
aiwenmo
76f33bea2b
[doc] Change DinkyTask picture to english (#14061) 2023-05-05 22:37:01 +08:00
Stalary
e932f780b6
FIX: default value (#14059) 2023-05-05 21:57:48 +08:00