Commit Graph

89 Commits

Author SHA1 Message Date
lenian
bcf03ad4d1
[Feature-9467] add DAMENG DataSource (#12860)
* [Feature-9467][DataSource] add DAMENG (达梦) data source

* [Feature-9467] add DM datasource doc (Issue #9467)

* [Feature-9467] add DM IDataBaseOptionKeys

* [Feature-9467] add DM DataSource: DmDataSourceChannelFactoryTest remove testGetDmConnection method

* [Feature-9467] modification package dm to dameng;

* [Feature-9467] add Dameng DmJdbcDriver18 License

* [Feature-9467] add DM DataSource: remove DruidDataSourceClient

Co-authored-by: lenian <yuenian@mananacare.com>
2023-01-04 15:00:24 +08:00
Aaron Wang
8503ee0eed
[Improvement][Worker] Startup parameter should have the highest priority (#13274) 2022-12-29 11:05:00 +08:00
Tq
06b77b34c7
[doc][datasource-12820] add azure sql database doc (#13254) 2022-12-22 16:04:19 +08:00
Wenjun Ruan
5c75d312fa
Add StarRocks datasource (#13204) 2022-12-17 08:44:39 +08:00
insist777
b40c63f02d
[Feature][DataSource]Add trino datasource plugin (#12911) 2022-11-23 10:09:02 +08:00
JieguangZhou
6e224d08a2
[fix] Python task can not pass the parameters to downstream task. (#12961) 2022-11-22 16:11:45 +08:00
Assert
2dbc79693e
[feature][task plugin] Add new task plugin for apache linkis (#12693) 2022-11-17 10:14:36 +08:00
xuhhui
9e6f4d2bc1
[Improvement][Document]Update architecture and process-start-flow pic (#12912)
Co-authored-by: xuhaihui <xuhaihui@cmss.chinamobile.com>
2022-11-16 16:03:00 +08:00
baihongbin
0373e06615
[Feature-8030][docs] Add sqoop task doc (#12855)
* [Feature-8030][docs] Add sqoop task doc

* Update docs/docs/zh/guide/task/sqoop.md

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>

* Update docs/docs/en/guide/task/sqoop.md

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>

* [Feature-8030][docs] Add sqoop task doc

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-11-13 00:09:05 +08:00
JieguangZhou
229c554912
[feature][task] Add Kubeflow task plugin for MLOps scenario (#12843) 2022-11-11 16:08:38 +08:00
Tq
9bba4b105c
[fix][doc] Fix sql-hive and hive-cli doc (#12765) 2022-11-07 17:39:02 +08:00
JieguangZhou
a47b4d0672
[Feature][Task] Transfer files between tasks (#12552)
* add data transfer between tasks

* add delete DATA_TRANSFER API

* convert Result to DeleteDataTransferResponse

* add api UT

* fix final

* fix doc
2022-11-03 16:33:39 +08:00
Tq
4e2701b57e
[doc][fix] Add new alert doc Slack (#12567) 2022-11-01 09:49:05 +08:00
Yiming Guo
064fec88b0
[Feature-12040][docs] Update Granted Permissions Guide for PR#12048 (#12587)
* Upload new ui screenshots.

* Update document of Granted Permissions.

* Delete unused images.
2022-10-30 17:28:30 +08:00
Chris-Arith
b953cdc559
update english oracle.md (#12332) 2022-10-14 11:39:06 +08:00
Chris-Arith
c8bd106604
create oracle help.md (#12218)
* create oracle help.md

* Add files via upload

allow Oracle to choose schema

* move pic under img and add title for oracle.md
2022-10-10 13:53:20 +08:00
Tq
c7435a51ac
[Feature][task-plugins] aws datasync task plugins (#11865)
* submit datasync task

* add aws software package license
2022-10-09 10:47:01 +08:00
JieguangZhou
308f632fcc
[Feature][TASK-PLUGIN] AWS Database Migration Service (DMS) (#11868)
* add aws dms
2022-09-30 10:16:16 +08:00
Eric Gao
064224696f
[Doc][Improvement] Add instructions for process execution type and data complement (#12121)
* Add instructions for process execution type and data complement

* Fix and polish the docs
2022-09-24 09:59:02 +08:00
JieguangZhou
cf522e2fc0
[improve] Optimize MLFlow task plugin for easy of use (#12071)
optimize code
2022-09-21 10:45:05 +08:00
ZhaoGuodong
86291bb5e6
[Feature-10273][Datasource] Add dataSource for AWS Athena (#11157) 2022-09-16 09:59:20 +08:00
caishunfeng
0deafba12c
fix procedure task param pass (#11919) 2022-09-14 13:44:01 +08:00
juzimao
5d9331f4ee
[Feature-10683][Task Plugin] Add Java Task Plugin. (#10689) 2022-09-09 10:37:24 +08:00
xiangzihao
f0db90f71d
[Doc] Remove re-upload file function in the 3.0.0's doc (#11804) 2022-09-07 09:45:51 +08:00
Eric Gao
4a37345436
[Feature][Task Plugin] Support hive cli task plugin (#11651)
* Add hive cli task plugin

* Add docs for hive-cli task plugin

* Fix hive-cli task related front-end nits and checkstyle

* Fix exception handling logic
2022-08-30 10:45:51 +08:00
Eric Gao
ff4d2c9460
[Doc][Bug] Fix resource center docs for standalone mode (#11600)
* Fix resource center docs for standalone mode

* Remove useless images
2022-08-23 09:46:01 +08:00
monster
3e360a8ecb
[Improvement-11550] [Doc]Document content update (#11577)
* [Improvement-11550] [Doc]Document content update

* Update pictures

* fix

* Update Process word to Workflow

Co-authored-by: David <davidzollo365@gmail.com>
2022-08-22 00:00:42 +08:00
JieguangZhou
a974ba74ab
[Feature] New task plugin Pytorch (#11498)
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-08-18 10:20:37 +08:00
Qi Zhang
a4bdadbb84
[doc] Use Rainbond deployment DolphinScheduler Cluster (#10951)
* [doc] Use Rainbond deployment DolphinScheduler Cluster

Signed-off-by: Qi Zhang <smallqi1@163.com>

* Update docs/docs/en/guide/installation/rainbond.md

* Update docs/docs/en/guide/installation/rainbond.md

* Update docs/docs/zh/guide/installation/rainbond.md

* Update docs/docs/zh/guide/installation/rainbond.md

* [doc] modify rainbond doc and add image

Signed-off-by: Qi Zhang <smallqi1@163.com>

* fix: img link

Signed-off-by: Qi Zhang <smallqi1@163.com>

* fix: modify proposal

Signed-off-by: Qi Zhang <smallqi1@163.com>

* docs: move rainbond docs to integration

Signed-off-by: Qi Zhang <smallqi1@163.com>

Signed-off-by: Qi Zhang <smallqi1@163.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-08-15 14:33:37 +08:00
caishunfeng
0464123c2b
[Feature-11223] support stream task (#11350)
* add task execute type

* update task definition list paging

* update task instance list paging

* stream task start

* [Feature][UI] Some changes to execute task.
    * Set the connection edge to dashed line.
    * Add FLINK_STREAM task.

* add stream task

* flink savepoint and cancel

* fix query bug

* add stream task definition

* add task instance for stream task

* delete stream task definition state

* update api for stream task definition edit

* modify search for stream task instance

* add language

* delete task type search for stream task definition

* change task type search for stream task instance

* add jump button

* add savepoint

* add down log for stream task instance

* ui test

* stream task start

* run DAG

* [Fix][UI] Fix the stream task edgs not to be dashed when filling back.

* [Feature][UI] Remove some fields for FLINK_STREAM.

* add start modal

* add dryRun column for stream task instance

* fix duration

* fix pon

* fix build error

* Add success tip

* add auto sync for stream task instance

* remove forgien key for task instance

* license header

* UT fix

* modify locales

* recover common config

* fix UT

* add doc

Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: devosend <devosend@gmail.com>
2022-08-10 21:44:43 +08:00
insist777
8ad6e10da5
[doc] Improve the document introduction of complement (#11275) 2022-08-09 19:35:25 +08:00
Eric Gao
3aa9f2ea25
[Bug][Doc] Fix typos in docs which causes links to upgrade section to fail (#11333)
* [Bug][Doc] Fix typo in docs

* Remove dead links and update related docs
2022-08-06 20:50:48 +08:00
Jiajie Zhong
bf5f7a88c5
[doc] migrate community and development docs into main repo (#11313) 2022-08-05 17:58:39 +08:00
xuhhui
513f336015
[Feature] Add new task type chunjun (#10937) 2022-07-28 19:25:29 +08:00
Tq
9859b5da1f
add Feishu alert doc and configure email alert doc to the docsdev.js (#11173)
add Feishu alert doc and configure email alert doc to the docsdev.js
2022-07-28 17:21:32 +08:00
JieguangZhou
af7b359333
[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario (#10826) (#10935)
* add sagemaker pipeline task plugin

[DOC] add Sagemaker task plugin document

change license and fix dependencies

* [fix] Optimize the code

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java

Optimization parameter judgment

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* [fix] nips

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-07-21 18:16:58 +08:00
Jiajie Zhong
08cfbc73e0
[doc] Add missing doc change by snehal (#10892) 2022-07-12 14:16:00 +08:00
ZhaoGuodong
8eaf5a2309
[Feature-10219][EMR] EMR supports use <add-Steps> to add steps to an existing cluster (#10657)
* Add the ProgramType parameter to distinguish task types
* EmrAddStepsTask supports Add-Steps
* UI supports Add-Steps
* EmrTask modify the name of the class to EmrJobFlowTask
* add ERM Task abstract base class AbstractEmrTask
* add testcase for EmrAddStepsTask
* Modifying help Documents
2022-07-10 10:15:25 +08:00
qianli2022
1e48bbc5c6
[Feature-10629][Improvement] Support multi cluster environments - namespace use cluster (#10650)
* server code

* namespace ui

* fix dao test

* fix test

* fix

* docs and image update

Co-authored-by: qianl4 <qianl4@cicso.com>
2022-07-07 16:05:52 +08:00
sneh-wha
fa1458b3e0
[doc] Modify features, hw, intro and homepage docs. (#10713) 2022-07-05 21:58:05 +08:00
Kerwin
bd1be6cf36
[Task] Added Apache SeaTunnel 2.x task node (#10480) 2022-07-05 19:21:30 +08:00
aiwenmo
5b0347e8da
[Task] Add Dinky task to better support the development and execution of FlinkSQL (#10640) 2022-07-05 10:07:24 +08:00
sneh-wha
423cc5b9be
[doc] Modified project doc. (#10711) 2022-07-04 10:23:25 +08:00
sneh-wha
7898f41dc0
[doc] Change datasource doc (#10660) 2022-06-30 23:33:59 +08:00
Stalary
a45fc5b032
[doc] Add doc for pre-sql and post-sql (#10685) 2022-06-30 20:01:23 +08:00
caishunfeng
c2f1886306
[doc] Update metadata and design doc (#10600) 2022-06-30 17:48:17 +08:00
Stalary
b2df357814
[doc] Add run the task alone doc. (#10581) 2022-06-24 16:59:22 +08:00
houshitao
1b1a567fec
[doc] Correct the complement add docs (#10521) 2022-06-23 12:02:28 +08:00
JieguangZhou
36e20cdfc8
[Feature][Task Plugin] Add DVC task plugin for MLops scenario (#10372) (#10407) 2022-06-21 13:13:46 +08:00
liubo1990
b8d5e78994
[Doc] Add how to set the alarm mailbox in faq (#10401) 2022-06-17 21:16:38 +08:00