Commit Graph

7716 Commits

Author SHA1 Message Date
Rick Cheng
0db916473e
[Improvement-13437][UT] Add UT for S3StorageOperator (#13530) 2023-02-22 19:57:18 +08:00
fuchanghai
79d3ed0744
Update DataxUtils.java (#13604) 2023-02-22 19:01:43 +08:00
fuchanghai
7bf3e3cdd6
[improve-#13201] update pid during running (#13206) 2023-02-22 14:22:49 +08:00
fuchanghai
c406f81e9c
[improve-#13597] fix the method name (#13599) 2023-02-22 10:53:51 +08:00
Aaron Wang
047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes (#13550) 2023-02-21 23:26:21 +08:00
旺阳
aea84055fe
Fix webex teams alert plugin null exception error (#13591) 2023-02-21 20:10:48 +08:00
Devosend
eaf2541018
support modal close for datasources (#13586) 2023-02-20 19:10:38 +08:00
fuchanghai
701d67c831
[improve-#13045] after a submit failure, stop the processInstance to avoid an endless loop (#13051)
* [improve-#13045] add max submit number of workflow

* [fix-13405] remove max times

* Update dolphinscheduler-master/src/main/resources/application.yaml

Co-authored-by: Wenjun Ruan <wenjun@apache.org>

---------

Co-authored-by: fuchanghai <‘2875334588@qq.com’>
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
2023-02-20 14:10:59 +08:00
Wenjun Ruan
e8b20def54
Fix task instance will generate multiple times when retry interval is 0/s (#13571) 2023-02-18 23:41:16 +08:00
QuantumXiecao
dd4804ee4c
[fix-13504] Display the current project name on the left corner of the page (#13572)
Co-authored-by: xiecao <haolong.zhl@alibaba-inc.com>
2023-02-17 15:04:38 +08:00
qindongliang
6a0f48e533
[Feature-13354][deploy] Add configurable busybox image in values.yaml (#13354) (#13560) 2023-02-14 12:53:49 +08:00
Rick Cheng
2bd65fb2df
[Feature][Remote Logging] Add support for writing task logs to OSS (#13332) 2023-02-13 16:38:26 +08:00
kezhenxu94
a6550bc4a2
Set init job as a helm hook so that DS can be upgraded using helm upgrade, also remove legacy registryPluginDir˚ (#13547) 2023-02-11 16:35:57 +08:00
Aaron Wang
966201af86
[BUG][Resource Center] NPE caused by uninitialized hdfsProperties (#13540)
* [BUG][Resource Center] NPE caused by uninitialized hdfsProperties

* [BUG][Resource Center] NPE caused by uninitialized hdfsProperties
2023-02-11 13:12:44 +08:00
kezhenxu94
e368bde7ee
Publish Helm Chart snapshot to ghcr.io (#13546) 2023-02-11 12:40:35 +08:00
fuchanghai
37939add0c
[fix-13492]add single quotes (#13534)
* [fix-13492]add single quotes

* [improve-#13201] fix test error

---------

Co-authored-by: fuchanghai <‘2875334588@qq.com’>
2023-02-09 19:02:27 +08:00
caishunfeng
df963f8393
[Improvement] Add call cost time for api (#13518) 2023-02-09 14:29:23 +08:00
Sheldon
75c5915b78
[Feature-11195][UI] Add re-upload feature for resource files and udf files (#11203)
* add re-upload feature for resource files
* add re-upload feature for udf files

Co-authored-by: sheldonliu <sheldonliu>
2023-02-09 13:51:04 +08:00
Bingchang Chen
75544025df
[Improvement] Fix typos in tools for demo (#13538) 2023-02-09 12:13:36 +08:00
Wenjun Ruan
133d1733eb
Alter title in t_ds_alert to 512 (#13535) 2023-02-09 09:41:07 +08:00
JieguangZhou
16b193454b
[Improvement][Task Plugin] Support Task Plugin output response as a parameter (#13529)
* support http output response as param

* add UT

* fix sqoop UT
2023-02-08 23:03:21 +08:00
Aaron Wang
f3134c7ce7
[Feature][Resource Center] One-time migration script for unmanaged resources (#13512) 2023-02-08 10:20:08 +08:00
seedscoder
8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger (#13509) 2023-02-07 20:32:53 +08:00
kezhenxu94
57db06e1b0
Fix the parameter table is messed up (#13526) 2023-02-07 13:45:10 +08:00
Rick Cheng
8a59ab44eb
[Fix-13434][Resource Center] fix the NPE when use OSS as the resource center (#13435) 2023-02-07 11:55:07 +08:00
朱通通
9a6f83383b
[Improvement][task node] #13498 (#13508)
[Improvement][task node] task node includes shell、proceduce、sql、spark、datax、sqoop、flink_stream and so on,those can not select resource file by seraching resources tree #13498
2023-02-07 11:19:02 +08:00
xiaojingXU
3627bf25ef
[Improvement-13472][Api] Removes the overhead of idle Quartz Threadpool of Api (#13475)
* [fix-13472][Api] change Threadpool of Quartz Scheduler to ZeroSizeThreadPool

* update doc about quartz threadpool configuration
2023-02-06 10:55:19 +08:00
shenyun
8fa90c2d8f
feature flinksql support standalone deploy mode (#13495) 2023-02-05 20:37:56 +08:00
旺阳
0ee82c5492
[doc] Update LDAP config doc (#13507) 2023-02-04 11:05:51 +08:00
dddyszy
19ffd64e23
Fix complement data date order will change due to use set (#13487) 2023-02-03 19:44:45 +08:00
Wenjun Ruan
5a9cb7ee64
Fix task log might delay until task finished due to batch flush (#13502) 2023-02-02 21:48:03 +08:00
yangyang zhong
615b1dbb37
[bug][UI]Fixed a bug where the environment name of a task could not be changed when a workflow was created(issue-12457) (#13148) 2023-02-02 14:53:21 +08:00
Stalary
b9ef4a7177
FIX: qrtz table use uppercase (#13494)
* FIX: use uppercase
2023-02-02 11:25:27 +08:00
Wenjun Ruan
6300a9b8de
Fix serial wait will go into block when there is no task need to submit (#13486) 2023-02-02 11:10:37 +08:00
Stalary
5fb6035f0d
fix: 3.1.1_schema mysql ddl sql error (#13485) 2023-02-01 21:11:05 +08:00
Wenjun Ruan
b11431db95
Use single thread to refresh kerberos (#13456) 2023-02-01 20:41:05 +08:00
Wenjun Ruan
af9091a98a
Use convert to set the exist column collate to utf8_bin (#13479) 2023-02-01 18:40:18 +08:00
Wenjun Ruan
12dd60fa46
Fix task wake up failed will block the event (#13466) 2023-02-01 15:31:04 +08:00
Wenjun Ruan
d10eaa8d81
Change mysql COLLATE to utf8_bin (#13469) 2023-02-01 14:08:31 +08:00
Rick Cheng
80da35e39c
[Fix-12828][api] Add permission check when query specific datasource (#12830) 2023-02-01 10:41:05 +08:00
Jay Chung
78e5569afd
[feat] Add type local turn on resource center by default (#13303) 2023-01-31 17:39:20 +08:00
Tq
78ba71bdbd
[Feature][task]add azure datafactory task type (#13417)
* init data factory

* add task-type-config.yaml

* add data factory ui

* submit doc

* submit license

---------

Co-authored-by: devosend <devosend@gmail.com>
2023-01-30 11:15:20 +08:00
imizao
23c7363f64
[Refactor][UI]Add a back button when viewing an error file (#13354)
Co-authored-by: imizao <lai.jinwen@vpclub.cn>
2023-01-30 10:06:56 +08:00
Aaron Wang
802bf4a2e0
[Fix-13418][UI] Remove move-task-definition code (#13441)
* remove move task definition

* remove unused DragOutlined
2023-01-30 10:01:59 +08:00
Eric Gao
385d781ebc
Fix minor spelling and punctuation errors (#13452) 2023-01-29 16:51:03 +08:00
Wenjun Ruan
ce34e21960
Task instance failure when worker group doesn't exist (#13448) 2023-01-29 16:27:56 +08:00
Wenjun Ruan
45694aa697
Fix MessageSender may be null due to class initialize late (#13446) 2023-01-28 20:53:32 +08:00
Wenjun Ruan
ef47e7efeb
Use parallelStream to improve the performance of upgrade (#13442) 2023-01-23 13:59:20 +08:00
Wenjun Ruan
713fdbc444
Split the upgrade code (#13436)
1. Split the upgrade code into different version
2. Log the dml/ddl sql in origin friendly format
3. Fix ddl of 3.0.0 and 3.1.0
4. Fix search resource regular expression injection
2023-01-20 20:48:07 +08:00
jackfanwan
3b54de0c90
fix when the task details are not modified, the predecessor node cannot be modified (#13422)
* fix when the task details are not modified, the predecessor node cannot be modified

* deleted useless code

Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2023-01-18 20:08:28 +08:00