test/DolphinScheduler
1
0
Fork 0
mirror of https://gitee.com/dolphinscheduler/DolphinScheduler.git synced 2024-12-02 12:17:43 +08:00
Code Issues Actions 10 Packages Projects Releases Wiki Activity
7,747 Commits 27 Branches 59 Tags 276 MiB
51afbfe159
Commit Graph

7747 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Rick Cheng
2dceb6b8ca
[Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center (#13562) 2023-03-15 19:29:27 +08:00
Rick Cheng
aa79c01ce9
[Feature-13419][Remote Logging] Add support for writing task logs to S3 (#13649) 
* [Feature-13419][Remote Logging] Add support for writing task logs to S3

* Update dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/log/remote/S3RemoteLogHandler.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* use try with resource

* remove unnecessary log

---------

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
 2023-03-13 19:36:12 +08:00
Aaron Wang
ceea147e2d
[doc] update kubernetes doc (#13716) 2023-03-10 18:02:36 +08:00
Wenjun Ruan
1f365819a6
Ignore unknown VM options in start.sh (#13719) 2023-03-10 17:34:09 +08:00
Aaron Wang
34d49e0d28
remove WORKER_GROUP conf in values.yaml (#13718) 2023-03-10 15:12:06 +08:00
Wenjun Ruan
aef5524ee7
Clearer task runnable. (#13689) 
* Clean unused method in AbstractTask

* Kill task by process.destroy

* wait 5/s after destroy process
 2023-03-09 20:46:29 +08:00
He Wang
f06af0d972
[Document] Add OceanBase to supported list (#13700) 2023-03-09 18:00:25 +08:00
Eric Gao
394805b2c7
[Feature][Metrics] Tag workflow related metrics with process definition code (workflow id) (#13640) 
* Tag workflow related metrics with process definition code (workflow id)

* Clean up related metrics when deleting workflow definition

* Add license headers

* Update related UT cases

* Add an example in grafana-demo

* Add related docs
 2023-03-09 11:30:21 +08:00
朱通通
76f3076481
[Bug] Fix ResourcesServiceImpl.java pageInfo (#13709) 2023-03-09 11:05:52 +08:00
Jay Chung
30fd43e32b
feat: Python add online_schedule for workflow control schedule state (#13551) 
related: apache/dolphinscheduler-sdk-python#73
 2023-03-07 11:35:01 +08:00
Jay Chung
512899ed14
feat: Python return datasource object and allow filter by type (#13616) 
related: https://github.com/apache/dolphinscheduler-sdk-python/pull/75
 2023-03-07 11:34:28 +08:00
fuchanghai
6218f818c0
[improve-#13665] improve datax parser if sql contain * (#13680) 
* [improve-#13665] improve datax parser if sql contain *

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-datax/src/main/java/org/apache/dolphinscheduler/plugin/task/datax/DataxTask.java

Co-authored-by: fuchanghai <‘2875334588@qq.com’>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
 2023-03-07 11:16:53 +08:00
He Wang
35d8e8ac17
[Feature][DataSource] add oceanbase datasource (#13675) 
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
 2023-03-07 10:12:58 +08:00
Wenjun Ruan
c9066e8de9
Use MDC to filter task instance log (#13673) 
* Use MDC to collect task instance log
* Use MDCAutoClosableContext to remove the MDC key
 2023-03-06 17:44:23 +08:00
陈家名
a8e3deca8b
[Improvement][api] Remove unless code in ResourcesServiceImpl (#13676) 
* remove unless code in ResourcesServiceImpl

---------

Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
 2023-03-06 10:40:17 +08:00
陈家名
c2d5774790
[Improvement] SQL optimization queryTheHighestPriorityTasks (#13671) 
Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
 2023-03-05 22:35:24 +08:00
Aaron Wang
fd720880c7
[Improvement] Add missing placeholder (#13663) 
* Add missing placeholder

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/am/KubernetesApplicationManager.java

Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>

---------

Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
 2023-03-03 18:02:46 +08:00
iuhoay
b48eae8ce7
docs(file-manage): The file in File manage is a relative path, not an absolute path (#13641) 2023-03-03 09:34:44 +08:00
Wenjun Ruan
ca9df868f1
Fix task instance log order might be wrong due to async print (#13660) 2023-03-02 22:37:05 +08:00
Aaron Wang
08ca57e4e8
[BUG][UI] Flink task display right version and deploy mode (#13628) 2023-03-02 19:42:16 +08:00
Rick Cheng
7c97febefb
[Improvement-12697][UT] Improve the ProjectServiceTest (#12698) 2023-03-01 11:37:52 +08:00
Rick Cheng
eb4cba8884
[Improvement-12782][UT] Add UT for the 13 implementations of ResourceAcquisitionAndPermissionCheck (#12784) 2023-03-01 11:37:19 +08:00
旺阳
43d79e45b4
Fix data quality pwd error (#13643) 2023-02-28 18:50:44 +08:00
QuantumXiecao
7586710d49
[fix-13625] Modify systemd-run from MemoryMax to MemoryLimit for more generality (#13627) 
Co-authored-by: xiecao <haolong.zhl@alibaba-inc.com>
 2023-02-28 14:17:54 +08:00
Jay Chung
c1fd1cba1b
[Document]: Add new quick start doc with more details and gifs (#13607) 
* doc: new quick start doc with more detail and gif

copy paste from https://github.com/bitsondatadev/trino-getting-started/pull/22

and the chinese translate by Google Translate

---------

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2023-02-28 11:20:28 +08:00
kezhenxu94
9668c84d30
Fix typo (#13632) 2023-02-27 10:12:14 +08:00
kezhenxu94
f937c511b1
Publish Docker images to docker hub when released (#13631) 2023-02-27 09:24:28 +08:00
Kerwin
9b4605cbdd
[Release][3.1.4] add 3.1.4 release doc (#13621) 2023-02-25 11:24:43 +08:00
Qi Zhang
6516240e0c
[Docs] Update rainbond docs (#13608) 
Signed-off-by: Qi Zhang <smallqi1@163.com>
 2023-02-24 16:52:43 +08:00
Wenjun Ruan
4351a25f2a
Add execute function to handle the workflow instance operation (#13610) 2023-02-24 13:47:41 +08:00
Aaron Wang
938f13b568
[Doc] Spark on K8S (#13605) 2023-02-23 10:31:34 +08:00
Rick Cheng
0db916473e
[Improvement-13437][UT] Add UT for S3StorageOperator (#13530) 2023-02-22 19:57:18 +08:00
fuchanghai
79d3ed0744
Update DataxUtils.java (#13604) 2023-02-22 19:01:43 +08:00
fuchanghai
7bf3e3cdd6
[improve-#13201] update pid during running (#13206) 2023-02-22 14:22:49 +08:00
fuchanghai
c406f81e9c
[improve-#13597] fix the method name (#13599) 2023-02-22 10:53:51 +08:00
Aaron Wang
047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes (#13550) 2023-02-21 23:26:21 +08:00
旺阳
aea84055fe
Fix webex teams alert plugin null exception error (#13591) 2023-02-21 20:10:48 +08:00
Devosend
eaf2541018
support modal close for datasources (#13586) 2023-02-20 19:10:38 +08:00
fuchanghai
701d67c831
[improve-#13045] after a submit failure, stop the processInstance to avoid an endless loop (#13051) 
* [improve-#13045] add max submit number of workflow

* [fix-13405] remove max times

* Update dolphinscheduler-master/src/main/resources/application.yaml

Co-authored-by: Wenjun Ruan <wenjun@apache.org>

---------

Co-authored-by: fuchanghai <‘2875334588@qq.com’>
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
 2023-02-20 14:10:59 +08:00
Wenjun Ruan
e8b20def54
Fix task instance will generate multiple times when retry interval is 0/s (#13571) 2023-02-18 23:41:16 +08:00
QuantumXiecao
dd4804ee4c
[fix-13504] Display the current project name on the left corner of the page (#13572) 
Co-authored-by: xiecao <haolong.zhl@alibaba-inc.com>
 2023-02-17 15:04:38 +08:00
qindongliang
6a0f48e533
[Feature-13354][deploy] Add configurable busybox image in values.yaml (#13354) (#13560) 2023-02-14 12:53:49 +08:00
Rick Cheng
2bd65fb2df
[Feature][Remote Logging] Add support for writing task logs to OSS (#13332) 2023-02-13 16:38:26 +08:00
kezhenxu94
a6550bc4a2
Set init job as a helm hook so that DS can be upgraded using helm upgrade, also remove legacy registryPluginDir˚ (#13547) 2023-02-11 16:35:57 +08:00
Aaron Wang
966201af86
[BUG][Resource Center] NPE caused by uninitialized hdfsProperties (#13540) 
* [BUG][Resource Center] NPE caused by uninitialized hdfsProperties

* [BUG][Resource Center] NPE caused by uninitialized hdfsProperties
 2023-02-11 13:12:44 +08:00
kezhenxu94
e368bde7ee
Publish Helm Chart snapshot to ghcr.io (#13546) 2023-02-11 12:40:35 +08:00
fuchanghai
37939add0c
[fix-13492]add single quotes (#13534) 
* [fix-13492]add single quotes

* [improve-#13201] fix test error

---------

Co-authored-by: fuchanghai <‘2875334588@qq.com’>
 2023-02-09 19:02:27 +08:00
caishunfeng
df963f8393
[Improvement] Add call cost time for api (#13518) 2023-02-09 14:29:23 +08:00
Sheldon
75c5915b78
[Feature-11195][UI] Add re-upload feature for resource files and udf files (#11203) 
* add re-upload feature for resource files
* add re-upload feature for udf files

Co-authored-by: sheldonliu <sheldonliu>
 2023-02-09 13:51:04 +08:00
Bingchang Chen
75544025df
[Improvement] Fix typos in tools for demo (#13538) 2023-02-09 12:13:36 +08:00