test/DolphinScheduler
1
0
Fork 0
mirror of https://gitee.com/dolphinscheduler/DolphinScheduler.git synced 2024-12-04 05:09:48 +08:00
Code Issues Actions 10 Packages Projects Releases Wiki Activity
7,831 Commits 27 Branches 59 Tags 276 MiB
8aec3846b4
Commit Graph

534 Commits

Author SHA1 Message Date
Rick Cheng
8aec3846b4
[Improvement-14243][Metrics] Add user tag of response time of api server (#14248) 2023-06-01 15:13:28 +08:00
Jay Chung
7226edd04e
chore: Release version 3.0.6 (#14234) 2023-05-30 10:36:58 +08:00
Aaron Wang
4e78248238
[Feature][K8S Task] support node selector (#14126) 
* feat: support K8S node selector

* fix CI
 2023-05-26 09:21:23 +08:00
Kerwin
fa4a4f6938
Added 3.1.7 release document (#14206) 2023-05-25 18:08:04 +08:00
haibingtown
af7da0630e
[Feature] Add project name/workflow definition name/instance id/task name to the built-in variables (#14099) 
* [Feature] Add project name/workflow definition name/instance id/task name to the built-in variables
 2023-05-25 11:02:39 +08:00
Rick Cheng
5c4ba4105d
[Feature-14138][Metrics] Add metrics for api server (#14177) 2023-05-23 12:22:49 +08:00
Rick Cheng
428f1559a3
[Improv-14083][Resource Center] Handle deleteSource in OSS / S3 / GCS (#14084) 2023-05-22 20:44:43 +08:00
Alex Ting
606b56403e
[Fix-13381][plugin] fix error while parsing hive load sql (#13378) 
* [fix][task plugin][task sql] fix parsing error while using variables sometimes parsing exception happened if task sql contains a variable followed by \" or \' .

for example:
input sql: load inpath '/tmp/test_table/dt=${dt}'
into table test_table partition(dt=${dt})

after replace: preparing : load inpath '/tmp/test_table/dt=?
into table test_table partition(dt=?)
 2023-05-22 11:19:30 +08:00
Kerwin
8315279620
[Feature-#14148][Task] Added status check interval and dependent failure policy parameters for dependent task nodes (#14150) 
* Added a dependent task failure policy in the dependent task node
 2023-05-19 14:49:50 +08:00
Jay Chung
56b0f91f6e
fix: Save task seatunnel error (#14129) 2023-05-19 10:47:16 +08:00
Rick Cheng
db2da822de
Add supported operations of workflow definition (#14122) 2023-05-18 10:27:36 +08:00
Aaron Wang
c3809fbecf
[Improvement-13868][K8S Task] Support the custom labels for k8s task (#14067) 
* [Improvement-13868] Support the custom labels for k8s task

* fix front-end type mismatched
 2023-05-16 12:04:33 +08:00
Kerwin
8944fdc622
Added 3.1.6 release document (#14100) 2023-05-15 11:25:45 +08:00
openopen2
fc97118bdc
[Doc] Fix upgrade-schema.sh cannot load driver class (#14072) 
* fix upgrade-schema.sh cannot load driver class

When initializing and creating related tables for the first time, the support of related jdbc drivers is required. This article omits placing jdbc drivers in the tools directory.

* Update datasource-setting.md

update english doc
 2023-05-10 13:44:23 +08:00
He Zhao
f1e78627fc
[feature][plugin] Add snowflake datasource in datasource plugin (#13729) 
---------

Co-authored-by: weitong <weitong@cisco.com>
 2023-05-06 19:30:50 +08:00
aiwenmo
76f33bea2b
[doc] Change DinkyTask picture to english (#14061) 2023-05-05 22:37:01 +08:00
Bingchang Chen
77e58ce245
[Feature] Add SSO login by Casdoor (#8706) 2023-05-05 14:43:06 +08:00
Aaron Wang
3bad68a942
[Bug-13929][K8S Task] Set command contains single quote is invalid (#13930) 
* [Fix-13929][K8S Task] Set command contains single quote is invalid

* fix UT
 2023-05-01 11:45:03 +08:00
Jay Chung
8c43e71adf
doc: Change readme and standalone docker quick start (#14002) 2023-04-25 09:35:49 +08:00
Jeremy
db6c061c8b
[Feature][plugin] Add databend datasource in datasource plugin (#13866) 
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
 2023-04-24 21:28:14 +08:00
Aaron Wang
731123cebc
[Bug][Worker] get worker status bug (#13992) 
* get worker status bug

* modify configuration name
 2023-04-24 09:51:47 +08:00
JieguangZhou
5c1edd2912
[Improvement][DOC] Update resource S3 configuration docs (#13985) 
* update resoure s3 docs
 2023-04-21 17:00:14 +08:00
zzm
35bb533a50
[Improvement][Task Plugin] Integrate zeppelin password authentication with DS zeppelin task plugin (#13861) 
---------

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2023-04-18 12:18:51 +08:00
He Zhao
c0126b7f30
[Feature][plugin] Support Kyuubi datasource (#13642) 
---------

Co-authored-by: weitong <weitong@cisco.com>
Co-authored-by: Rick Cheng <38122586+rickchengx@users.noreply.github.com>
 2023-04-18 11:12:39 +08:00
Wenjun Ruan
61a689aa5a
Use percentage to represent memory/cpu usage (#13896) 2023-04-13 15:48:20 +08:00
Jay Chung
f9f88cb505
doc: Add hyperlink for pydolphinscheduler doc (#13907) 
* doc: Add hyperlink for pydolphinscheduler doc

* style

* remove Tianqi-Dotes for docs code owner
 2023-04-11 14:42:09 +08:00
Assert
4439c1ec90
[Feature-13052][Task Plugin] Support Apache Seatunnel Connector-V2 (#13086) 2023-04-08 22:02:19 +08:00
Kerwin
7e3ecfa68f
add 3.1.5 release (#13877) 2023-04-07 16:19:13 +08:00
Rick Cheng
7ee66f2d02
[Feature-13429][Remote Logging] Add support for writing task logs to Google Cloud Storage (#13777) 2023-04-06 17:49:33 +08:00
Jay Chung
22786351b2
doc: Announce link error (#13855) 2023-04-03 14:23:44 +08:00
Jay Chung
406fef1988
doc: Release version 305 (#13854) 2023-04-03 11:41:49 +08:00
Kerwin
490ead614e
Improve svn commit section in release docs (#13843) 2023-04-03 08:48:32 +08:00
Wenjun Ruan
a1861bc2df
Use DATAX_PYTHON to specify a datax python version (#13849) 
(cherry picked from commit 752452ecbd2f8094b819eae219f3eec0f6a6427b)
 2023-04-03 08:47:32 +08:00
JieguangZhou
273a5e78eb
[FEATURE][Task Plugin]Add remote-shell task plugin (#13801) 2023-03-30 20:17:28 +08:00
Wenjun Ruan
9df89cf0cf
Use bootstrap user as the default tenant (#13825) 2023-03-30 14:11:23 +08:00
Rick Cheng
2dceb6b8ca
[Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center (#13562) 2023-03-15 19:29:27 +08:00
Rick Cheng
aa79c01ce9
[Feature-13419][Remote Logging] Add support for writing task logs to S3 (#13649) 
* [Feature-13419][Remote Logging] Add support for writing task logs to S3

* Update dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/log/remote/S3RemoteLogHandler.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* use try with resource

* remove unnecessary log

---------

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
 2023-03-13 19:36:12 +08:00
Aaron Wang
ceea147e2d
[doc] update kubernetes doc (#13716) 2023-03-10 18:02:36 +08:00
Eric Gao
394805b2c7
[Feature][Metrics] Tag workflow related metrics with process definition code (workflow id) (#13640) 
* Tag workflow related metrics with process definition code (workflow id)

* Clean up related metrics when deleting workflow definition

* Add license headers

* Update related UT cases

* Add an example in grafana-demo

* Add related docs
 2023-03-09 11:30:21 +08:00
He Wang
35d8e8ac17
[Feature][DataSource] add oceanbase datasource (#13675) 
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
 2023-03-07 10:12:58 +08:00
iuhoay
b48eae8ce7
docs(file-manage): The file in File manage is a relative path, not an absolute path (#13641) 2023-03-03 09:34:44 +08:00
Jay Chung
c1fd1cba1b
[Document]: Add new quick start doc with more details and gifs (#13607) 
* doc: new quick start doc with more detail and gif

copy paste from https://github.com/bitsondatadev/trino-getting-started/pull/22

and the chinese translate by Google Translate

---------

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2023-02-28 11:20:28 +08:00
kezhenxu94
f937c511b1
Publish Docker images to docker hub when released (#13631) 2023-02-27 09:24:28 +08:00
Kerwin
9b4605cbdd
[Release][3.1.4] add 3.1.4 release doc (#13621) 2023-02-25 11:24:43 +08:00
Qi Zhang
6516240e0c
[Docs] Update rainbond docs (#13608) 
Signed-off-by: Qi Zhang <smallqi1@163.com>
 2023-02-24 16:52:43 +08:00
Aaron Wang
938f13b568
[Doc] Spark on K8S (#13605) 2023-02-23 10:31:34 +08:00
Aaron Wang
047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes (#13550) 2023-02-21 23:26:21 +08:00
Rick Cheng
2bd65fb2df
[Feature][Remote Logging] Add support for writing task logs to OSS (#13332) 2023-02-13 16:38:26 +08:00
kezhenxu94
a6550bc4a2
Set init job as a helm hook so that DS can be upgraded using helm upgrade, also remove legacy registryPluginDir˚ (#13547) 2023-02-11 16:35:57 +08:00
JieguangZhou
16b193454b
[Improvement][Task Plugin] Support Task Plugin output response as a parameter (#13529) 
* support http output response as param

* add UT

* fix sqoop UT
 2023-02-08 23:03:21 +08:00