Commit Graph

7747 Commits

Author SHA1 Message Date
Wenjun Ruan
133d1733eb
Alter title in t_ds_alert to 512 (#13535) 2023-02-09 09:41:07 +08:00
JieguangZhou
16b193454b
[Improvement][Task Plugin] Support Task Plugin output response as a parameter (#13529)
* support http output response as param

* add UT

* fix sqoop UT
2023-02-08 23:03:21 +08:00
Aaron Wang
f3134c7ce7
[Feature][Resource Center] One-time migration script for unmanaged resources (#13512) 2023-02-08 10:20:08 +08:00
seedscoder
8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger (#13509) 2023-02-07 20:32:53 +08:00
kezhenxu94
57db06e1b0
Fix the parameter table is messed up (#13526) 2023-02-07 13:45:10 +08:00
Rick Cheng
8a59ab44eb
[Fix-13434][Resource Center] fix the NPE when use OSS as the resource center (#13435) 2023-02-07 11:55:07 +08:00
朱通通
9a6f83383b
[Improvement][task node] #13498 (#13508)
[Improvement][task node] task node includes shell、proceduce、sql、spark、datax、sqoop、flink_stream and so on,those can not select resource file by seraching resources tree #13498
2023-02-07 11:19:02 +08:00
xiaojingXU
3627bf25ef
[Improvement-13472][Api] Removes the overhead of idle Quartz Threadpool of Api (#13475)
* [fix-13472][Api] change Threadpool of Quartz Scheduler to ZeroSizeThreadPool

* update doc about quartz threadpool configuration
2023-02-06 10:55:19 +08:00
shenyun
8fa90c2d8f
feature flinksql support standalone deploy mode (#13495) 2023-02-05 20:37:56 +08:00
旺阳
0ee82c5492
[doc] Update LDAP config doc (#13507) 2023-02-04 11:05:51 +08:00
dddyszy
19ffd64e23
Fix complement data date order will change due to use set (#13487) 2023-02-03 19:44:45 +08:00
Wenjun Ruan
5a9cb7ee64
Fix task log might delay until task finished due to batch flush (#13502) 2023-02-02 21:48:03 +08:00
yangyang zhong
615b1dbb37
[bug][UI]Fixed a bug where the environment name of a task could not be changed when a workflow was created(issue-12457) (#13148) 2023-02-02 14:53:21 +08:00
Stalary
b9ef4a7177
FIX: qrtz table use uppercase (#13494)
* FIX: use uppercase
2023-02-02 11:25:27 +08:00
Wenjun Ruan
6300a9b8de
Fix serial wait will go into block when there is no task need to submit (#13486) 2023-02-02 11:10:37 +08:00
Stalary
5fb6035f0d
fix: 3.1.1_schema mysql ddl sql error (#13485) 2023-02-01 21:11:05 +08:00
Wenjun Ruan
b11431db95
Use single thread to refresh kerberos (#13456) 2023-02-01 20:41:05 +08:00
Wenjun Ruan
af9091a98a
Use convert to set the exist column collate to utf8_bin (#13479) 2023-02-01 18:40:18 +08:00
Wenjun Ruan
12dd60fa46
Fix task wake up failed will block the event (#13466) 2023-02-01 15:31:04 +08:00
Wenjun Ruan
d10eaa8d81
Change mysql COLLATE to utf8_bin (#13469) 2023-02-01 14:08:31 +08:00
Rick Cheng
80da35e39c
[Fix-12828][api] Add permission check when query specific datasource (#12830) 2023-02-01 10:41:05 +08:00
Jay Chung
78e5569afd
[feat] Add type local turn on resource center by default (#13303) 2023-01-31 17:39:20 +08:00
Tq
78ba71bdbd
[Feature][task]add azure datafactory task type (#13417)
* init data factory

* add task-type-config.yaml

* add data factory ui

* submit doc

* submit license

---------

Co-authored-by: devosend <devosend@gmail.com>
2023-01-30 11:15:20 +08:00
imizao
23c7363f64
[Refactor][UI]Add a back button when viewing an error file (#13354)
Co-authored-by: imizao <lai.jinwen@vpclub.cn>
2023-01-30 10:06:56 +08:00
Aaron Wang
802bf4a2e0
[Fix-13418][UI] Remove move-task-definition code (#13441)
* remove move task definition

* remove unused DragOutlined
2023-01-30 10:01:59 +08:00
Eric Gao
385d781ebc
Fix minor spelling and punctuation errors (#13452) 2023-01-29 16:51:03 +08:00
Wenjun Ruan
ce34e21960
Task instance failure when worker group doesn't exist (#13448) 2023-01-29 16:27:56 +08:00
Wenjun Ruan
45694aa697
Fix MessageSender may be null due to class initialize late (#13446) 2023-01-28 20:53:32 +08:00
Wenjun Ruan
ef47e7efeb
Use parallelStream to improve the performance of upgrade (#13442) 2023-01-23 13:59:20 +08:00
Wenjun Ruan
713fdbc444
Split the upgrade code (#13436)
1. Split the upgrade code into different version
2. Log the dml/ddl sql in origin friendly format
3. Fix ddl of 3.0.0 and 3.1.0
4. Fix search resource regular expression injection
2023-01-20 20:48:07 +08:00
jackfanwan
3b54de0c90
fix when the task details are not modified, the predecessor node cannot be modified (#13422)
* fix when the task details are not modified, the predecessor node cannot be modified

* deleted useless code

Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2023-01-18 20:08:28 +08:00
qianli2022
8be32d4145
[Feature][Api] When use api to run a process we want get processInstanceId (#13184)
* add sql

* add mapper

* add dao

* add excutor


Co-authored-by: qianl4 <qianl4@cicso.com>
2023-01-18 17:58:32 +08:00
Tq
3a6e10397f
[feature][api-datasource]add redshift auth mode to get connection by access key (#13379)
* submit redshift auth mode

* add front end

* add doc and fix frontend

Co-authored-by: devosend <devosend@gmail.com>
2023-01-16 16:21:26 +08:00
Wenjun Ruan
01f4fb26f0
Change remove task instance log to async request (#13399) 2023-01-16 15:49:23 +08:00
jackfanwan
8439b5dc69
[fix-12721] Fix cannot modify the upstream task in task definition page. (#12722) 2023-01-15 19:58:47 +08:00
kezhenxu94
a843e0b96d
Add documentation to release Helm Chart (#13385) 2023-01-15 10:10:31 +08:00
Wenjun Ruan
483330273d
Remove entity in QueryWrapper constructor (#13396) 2023-01-14 20:57:03 +08:00
v-wx-v
e39bf59b4b
[fix][data quality] fix when running data quality task with Error "No main class set in JAR" (#13360) 2023-01-14 14:50:50 +08:00
Eric Gao
366f999167
[Feature][Deployment] Add KEDA autoscaler support for worker deployment when deployed in K8S cluster (#13367)
* Add keda autoscaler support for worker deployment when deployed in K8S cluster

* Add mysql scaler for worker autoscaling

* Add docs for worker autoscaler

* Add support for external postgresql db
2023-01-14 13:51:15 +08:00
Wenjun Ruan
e660f7fc2d
Use spotless upToDateChecking (#13394) 2023-01-13 21:59:05 +08:00
Wenjun Ruan
98dfd64444
Clear the task group data when delete a project/workflowInstance (#13383) 2023-01-12 21:51:51 +08:00
LiXuemin
a5c6748202
[doc] Remove excess space (#13388)
Remove excess space,from `127.0. 0.1` to `127.0.0.1`
2023-01-12 18:42:15 +08:00
v-wx-v
3f16776cd7
[improvement][install.sh] fix the install Error "Command not found rmr" & su… (#13163)
* [BUG][install.sh] fix the install Error "Command not found rmr"  & support ZooKeeper (3.4.6+)

* [BUG][install.sh] fix the install Error "Command not found rmr"  & support ZooKeeper (3.4.6+)

* [BUG][install.sh] fix the install Error "Command not found rmr"  & support ZooKeeper (3.4.6+)

* [docs] add documentation for building with different ZK versions
* support both 3.4 and 3.8

* [docs] add documentation for building with different ZK versions
* support both 3.4 and 3.8

* [improvement][install.sh] fix the install Error "Command not found rmr" &  support ZooKeeper (3.4.6+)
* update known-dependencies.txt

* [improvement][install.sh] fix the install Error "Command not found rmr"
* support ZooKeeper (3.4.6+) by activating zk-3.4 profile
* make zk-3.8 as default option in pom.xml
* update defalut ZK version in docs
* update known-dependencies.txt

Co-authored-by: wangxx <wangxx@kcwl.com>
2023-01-12 18:07:58 +08:00
Eric Gao
dd0d73036e
Fix minio version in helm chart (#13368) 2023-01-11 00:40:17 +08:00
Kerwin
22958682c4
add 3.1.3 release (#13357) 2023-01-10 17:17:51 +08:00
Donald Yang
8f7b141fe7
[Fix-13287][doc]Fix Chinese workflow-definition.md duplication description in execution-type (#13361) 2023-01-10 11:33:42 +08:00
calvin
4f73fe1bd8
fix this issue with missing a comma in the TaskInstanceMapper.xml (#13359) 2023-01-09 14:43:34 +08:00
tog
2a44a7f36a
rename: WorkflowDefinitionTree component rename (#13134) 2023-01-08 20:42:21 +08:00
imizao
1edee6224c
[fix][UI]Add render to projects-overview table (#13305)
Co-authored-by: Jinwen Lai <lai.jinwen@vpclub.cn>
2023-01-07 22:56:54 +08:00
fuchanghai
7027d3d768
[improve-#13053] in method of `` execProcessInstance` check `startNodeList`` (#13057)
* [improve-#13053] in method of ``` execProcessInstance``` check ```startNodeList```

* [improve-#13053] format

* [improve-#13053] fix UT

* Update Status.java

update description

* [improve-#13053] add parameter ```version ```

* [improve-#13053] format

* [improve-#13053] version is not necessary

* [improve-#13053] format

* Update use-form.ts

change  ```version``` default vaule to ``` null```

* [improve-#13053] format

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* Update ExecutorServiceImpl.java

Co-authored-by: fuchanghai <‘2875334588@qq.com’>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2023-01-07 20:49:59 +08:00