test/DolphinScheduler
1
0
Fork 0
mirror of https://gitee.com/dolphinscheduler/DolphinScheduler.git synced 2024-12-04 05:09:48 +08:00
Code Issues Actions 10 Packages Projects Releases Wiki Activity
7,890 Commits 27 Branches 59 Tags 276 MiB
d38d504332
Commit Graph

103 Commits

Author SHA1 Message Date
IT-Kwj
7a24be0672
[Feature-14404][datasource-plugin] add HANA datasource (#14404) 
---------

Co-authored-by: WeiJian Kong <>
Co-authored-by: xujiaqiang <Xjq634828243>
 2023-06-28 10:56:41 +08:00
JieguangZhou
e7cdc7c136
[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters (#14127) 
* add dynamic task plugin

* fix ui

* update code

* add DOC

* ADD UT

* fix doc

* fix sanity check

* add upgrade ddl
* fix sql
 2023-06-07 16:01:06 +08:00
Zinway
18d176c5f4
feat: Introduce new datasource vertica (#14232) 
Co-authored-by: Zinway Liu <zinway.liu@ucloud.cn>
 2023-06-02 13:57:37 +08:00
He Zhao
f1e78627fc
[feature][plugin] Add snowflake datasource in datasource plugin (#13729) 
---------

Co-authored-by: weitong <weitong@cisco.com>
 2023-05-06 19:30:50 +08:00
aiwenmo
76f33bea2b
[doc] Change DinkyTask picture to english (#14061) 2023-05-05 22:37:01 +08:00
Bingchang Chen
77e58ce245
[Feature] Add SSO login by Casdoor (#8706) 2023-05-05 14:43:06 +08:00
Jeremy
db6c061c8b
[Feature][plugin] Add databend datasource in datasource plugin (#13866) 
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
 2023-04-24 21:28:14 +08:00
He Zhao
c0126b7f30
[Feature][plugin] Support Kyuubi datasource (#13642) 
---------

Co-authored-by: weitong <weitong@cisco.com>
Co-authored-by: Rick Cheng <38122586+rickchengx@users.noreply.github.com>
 2023-04-18 11:12:39 +08:00
JieguangZhou
273a5e78eb
[FEATURE][Task Plugin]Add remote-shell task plugin (#13801) 2023-03-30 20:17:28 +08:00
He Wang
35d8e8ac17
[Feature][DataSource] add oceanbase datasource (#13675) 
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
 2023-03-07 10:12:58 +08:00
Jay Chung
c1fd1cba1b
[Document]: Add new quick start doc with more details and gifs (#13607) 
* doc: new quick start doc with more detail and gif

copy paste from https://github.com/bitsondatadev/trino-getting-started/pull/22

and the chinese translate by Google Translate

---------

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2023-02-28 11:20:28 +08:00
Qi Zhang
6516240e0c
[Docs] Update rainbond docs (#13608) 
Signed-off-by: Qi Zhang <smallqi1@163.com>
 2023-02-24 16:52:43 +08:00
Tq
78ba71bdbd
[Feature][task]add azure datafactory task type (#13417) 
* init data factory

* add task-type-config.yaml

* add data factory ui

* submit doc

* submit license

---------

Co-authored-by: devosend <devosend@gmail.com>
 2023-01-30 11:15:20 +08:00
Tq
3a6e10397f
[feature][api-datasource]add redshift auth mode to get connection by access key (#13379) 
* submit redshift auth mode

* add front end

* add doc and fix frontend

Co-authored-by: devosend <devosend@gmail.com>
 2023-01-16 16:21:26 +08:00
lenian
bcf03ad4d1
[Feature-9467] add DAMENG DataSource (#12860) 
* [Feature-9467][DataSource] add DAMENG （达梦） data source

* [Feature-9467] add DM datasource doc (Issue #9467)

* [Feature-9467] add DM IDataBaseOptionKeys

* [Feature-9467] add DM DataSource: DmDataSourceChannelFactoryTest remove testGetDmConnection method

* [Feature-9467] modification package dm to dameng;

* [Feature-9467] add Dameng DmJdbcDriver18 License

* [Feature-9467] add DM DataSource: remove DruidDataSourceClient

Co-authored-by: lenian <yuenian@mananacare.com>
 2023-01-04 15:00:24 +08:00
Aaron Wang
8503ee0eed
[Improvement][Worker] Startup parameter should have the highest priority (#13274) 2022-12-29 11:05:00 +08:00
Tq
06b77b34c7
[doc][datasource-12820] add azure sql database doc (#13254) 2022-12-22 16:04:19 +08:00
Wenjun Ruan
5c75d312fa
Add StarRocks datasource (#13204) 2022-12-17 08:44:39 +08:00
insist777
b40c63f02d
[Feature][DataSource]Add trino datasource plugin (#12911) 2022-11-23 10:09:02 +08:00
JieguangZhou
6e224d08a2
[fix] Python task can not pass the parameters to downstream task. (#12961) 2022-11-22 16:11:45 +08:00
Assert
2dbc79693e
[feature][task plugin] Add new task plugin for apache linkis (#12693) 2022-11-17 10:14:36 +08:00
xuhhui
9e6f4d2bc1
[Improvement][Document]Update architecture and process-start-flow pic (#12912) 
Co-authored-by: xuhaihui <xuhaihui@cmss.chinamobile.com>
 2022-11-16 16:03:00 +08:00
baihongbin
0373e06615
[Feature-8030][docs] Add sqoop task doc (#12855) 
* [Feature-8030][docs] Add sqoop task doc

* Update docs/docs/zh/guide/task/sqoop.md

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>

* Update docs/docs/en/guide/task/sqoop.md

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>

* [Feature-8030][docs] Add sqoop task doc

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2022-11-13 00:09:05 +08:00
JieguangZhou
229c554912
[feature][task] Add Kubeflow task plugin for MLOps scenario (#12843) 2022-11-11 16:08:38 +08:00
Tq
9bba4b105c
[fix][doc] Fix sql-hive and hive-cli doc (#12765) 2022-11-07 17:39:02 +08:00
JieguangZhou
a47b4d0672
[Feature][Task] Transfer files between tasks (#12552) 
* add data transfer between tasks

* add delete DATA_TRANSFER API

* convert Result to DeleteDataTransferResponse

* add api UT

* fix final

* fix doc
 2022-11-03 16:33:39 +08:00
Tq
4e2701b57e
[doc][fix] Add new alert doc Slack (#12567) 2022-11-01 09:49:05 +08:00
Yiming Guo
064fec88b0
[Feature-12040][docs] Update Granted Permissions Guide for PR#12048 (#12587) 
* Upload new ui screenshots.

* Update document of Granted Permissions.

* Delete unused images.
 2022-10-30 17:28:30 +08:00
Chris-Arith
b953cdc559
update english oracle.md (#12332) 2022-10-14 11:39:06 +08:00
Chris-Arith
c8bd106604
create oracle help.md (#12218) 
* create oracle help.md

* Add files via upload

allow Oracle to choose schema

* move pic under img and add title for oracle.md
 2022-10-10 13:53:20 +08:00
Tq
c7435a51ac
[Feature][task-plugins] aws datasync task plugins (#11865) 
* submit datasync task

* add aws software package license
 2022-10-09 10:47:01 +08:00
JieguangZhou
308f632fcc
[Feature][TASK-PLUGIN] AWS Database Migration Service (DMS) (#11868) 
* add aws dms
 2022-09-30 10:16:16 +08:00
Eric Gao
064224696f
[Doc][Improvement] Add instructions for process execution type and data complement (#12121) 
* Add instructions for process execution type and data complement

* Fix and polish the docs
 2022-09-24 09:59:02 +08:00
JieguangZhou
cf522e2fc0
[improve] Optimize MLFlow task plugin for easy of use (#12071) 
optimize code
 2022-09-21 10:45:05 +08:00
ZhaoGuodong
86291bb5e6
[Feature-10273][Datasource] Add dataSource for AWS Athena (#11157) 2022-09-16 09:59:20 +08:00
caishunfeng
0deafba12c
fix procedure task param pass (#11919) 2022-09-14 13:44:01 +08:00
juzimao
5d9331f4ee
[Feature-10683][Task Plugin] Add Java Task Plugin. (#10689) 2022-09-09 10:37:24 +08:00
xiangzihao
f0db90f71d
[Doc] Remove re-upload file function in the 3.0.0's doc (#11804) 2022-09-07 09:45:51 +08:00
Eric Gao
4a37345436
[Feature][Task Plugin] Support hive cli task plugin (#11651) 
* Add hive cli task plugin

* Add docs for hive-cli task plugin

* Fix hive-cli task related front-end nits and checkstyle

* Fix exception handling logic
 2022-08-30 10:45:51 +08:00
Eric Gao
ff4d2c9460
[Doc][Bug] Fix resource center docs for standalone mode (#11600) 
* Fix resource center docs for standalone mode

* Remove useless images
 2022-08-23 09:46:01 +08:00
monster
3e360a8ecb
[Improvement-11550] [Doc]Document content update (#11577) 
* [Improvement-11550] [Doc]Document content update

* Update pictures

* fix

* Update Process word to Workflow

Co-authored-by: David <davidzollo365@gmail.com>
 2022-08-22 00:00:42 +08:00
JieguangZhou
a974ba74ab
[Feature] New task plugin Pytorch (#11498) 
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2022-08-18 10:20:37 +08:00
Qi Zhang
a4bdadbb84
[doc] Use Rainbond deployment DolphinScheduler Cluster (#10951) 
* [doc] Use Rainbond deployment DolphinScheduler Cluster

Signed-off-by: Qi Zhang <smallqi1@163.com>

* Update docs/docs/en/guide/installation/rainbond.md

* Update docs/docs/en/guide/installation/rainbond.md

* Update docs/docs/zh/guide/installation/rainbond.md

* Update docs/docs/zh/guide/installation/rainbond.md

* [doc] modify rainbond doc and add image

Signed-off-by: Qi Zhang <smallqi1@163.com>

* fix: img link

Signed-off-by: Qi Zhang <smallqi1@163.com>

* fix: modify proposal

Signed-off-by: Qi Zhang <smallqi1@163.com>

* docs: move rainbond docs to integration

Signed-off-by: Qi Zhang <smallqi1@163.com>

Signed-off-by: Qi Zhang <smallqi1@163.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
 2022-08-15 14:33:37 +08:00
caishunfeng
0464123c2b
[Feature-11223] support stream task (#11350) 
* add task execute type

* update task definition list paging

* update task instance list paging

* stream task start

* [Feature][UI] Some changes to execute task.
    * Set the connection edge to dashed line.
    * Add FLINK_STREAM task.

* add stream task

* flink savepoint and cancel

* fix query bug

* add stream task definition

* add task instance for stream task

* delete stream task definition state

* update api for stream task definition edit

* modify search for stream task instance

* add language

* delete task type search for stream task definition

* change task type search for stream task instance

* add jump button

* add savepoint

* add down log for stream task instance

* ui test

* stream task start

* run DAG

* [Fix][UI] Fix the stream task edgs not to be dashed when filling back.

* [Feature][UI] Remove some fields for FLINK_STREAM.

* add start modal

* add dryRun column for stream task instance

* fix duration

* fix pon

* fix build error

* Add success tip

* add auto sync for stream task instance

* remove forgien key for task instance

* license header

* UT fix

* modify locales

* recover common config

* fix UT

* add doc

Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: devosend <devosend@gmail.com>
 2022-08-10 21:44:43 +08:00
insist777
8ad6e10da5
[doc] Improve the document introduction of complement (#11275) 2022-08-09 19:35:25 +08:00
Eric Gao
3aa9f2ea25
[Bug][Doc] Fix typos in docs which causes links to upgrade section to fail (#11333) 
* [Bug][Doc] Fix typo in docs

* Remove dead links and update related docs
 2022-08-06 20:50:48 +08:00
Jiajie Zhong
bf5f7a88c5
[doc] migrate community and development docs into main repo (#11313) 2022-08-05 17:58:39 +08:00
xuhhui
513f336015
[Feature] Add new task type chunjun (#10937) 2022-07-28 19:25:29 +08:00
Tq
9859b5da1f
add Feishu alert doc and configure email alert doc to the docsdev.js (#11173) 
add Feishu alert doc and configure email alert doc to the docsdev.js
 2022-07-28 17:21:32 +08:00
JieguangZhou
af7b359333
[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario (#10826) (#10935) 
* add sagemaker pipeline task plugin

[DOC] add Sagemaker task plugin document

change license and fix dependencies

* [fix] Optimize the code

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java

Optimization parameter judgment

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* [fix] nips

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
 2022-07-21 18:16:58 +08:00