Commit Graph

325 Commits

Author SHA1 Message Date
Eric Gao
0e15ce3389
[Improvement][Metrics] Switch to use tags to indicate task / workflow execution status for metrics (#11128)
* [Improvement][Metrics] Switch to use tags to indicate task / workflow execution status for metrics (#10867)

* Update docs and grafana demo dashboards
2022-07-26 13:44:02 +08:00
JieguangZhou
952aee80e7
[fix] py sagemaker doc (#11109) 2022-07-22 22:57:50 +08:00
xiangzihao
5b429d29b8
add oracle dependency (#11095) 2022-07-22 09:49:20 +08:00
JieguangZhou
af7b359333
[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario (#10826) (#10935)
* add sagemaker pipeline task plugin

[DOC] add Sagemaker task plugin document

change license and fix dependencies

* [fix] Optimize the code

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java

Optimization parameter judgment

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* [fix] nips

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-07-21 18:16:58 +08:00
Eric Gao
f689220290
[Feature][Task Plugin] Increase zeppelin task stability in production (#11010)
* [Feature][Task Plugin] Increase zeppelin task stability in production (#10584)

* Add front-end and update docs for the production mode of zeppelin task

* Fix minor front-end bug of zeppelin task plugin

* Refactor ZeppelinParameters with lombok

* Fix formatting

* Replace @Data with @Getter, @Setter, @ToString to avoid decrease in test coverage
2022-07-20 14:16:47 +08:00
Eric Gao
a38fa34d43
[Feature][Task Plugin] Enable users to switch endpoints in zeppelin tasks (#10925)
* [Feature][Task Plugin] Enable users to switch endpoints in zeppelin tasks (#9814)
2022-07-15 09:26:28 +08:00
Jiajie Zhong
08cfbc73e0
[doc] Add missing doc change by snehal (#10892) 2022-07-12 14:16:00 +08:00
Eric Gao
2f7281c2d2
[Feature][Metrics] Add resource download related metrics for workers (#10749)
* [Feature][Metrics] Add resource download related metrics for workers (#9324)

* [Feature][Metrics] Fix bugs and add grafana demos for worker resource download metrics (#9324)

* [Feature][Metrics] Add docs to resource related metrics (#9324)

* [Feature][Metrics] Use tags to indicate status in metrics (#9324)

* [Feature][Metrics] Fix demos, docs and remove redundant code (#9324)

* [Feature][Metrics] Remove .pnpm-debug.log (#9324)

* [Feature][Metrics] Fix style check (#9324)

* [Feature][Metrics] Replace KB with bytes for the unit of resource file size in metrics (#9324)

* [Feature][Metrics] Make code neat (#9324)
2022-07-12 11:44:34 +08:00
ZhaoGuodong
8eaf5a2309
[Feature-10219][EMR] EMR supports use <add-Steps> to add steps to an existing cluster (#10657)
* Add the ProgramType parameter to distinguish task types
* EmrAddStepsTask supports Add-Steps
* UI supports Add-Steps
* EmrTask modify the name of the class to EmrJobFlowTask
* add ERM Task abstract base class AbstractEmrTask
* add testcase for EmrAddStepsTask
* Modifying help Documents
2022-07-10 10:15:25 +08:00
Luke Yan
057a9f6b24
[Fix-10830][Doc] Change the start or install script command sh in the document to bash (#10831)
* Change sh to bash

Change the script execution command sh to bash

* Change sh to bash

Change the script execution command sh to bash

* Change sh to bash

Change the script execution command sh to bash

* Change sh to bash

Change the script execution command sh to bash

* Change sh to bash

Co-authored-by: luke <luke.yan@china-entercom.net>
2022-07-09 15:41:56 +08:00
Eric Gao
1387fb3ccf
[Doc][Upgrade] Fix tiny error in upgrade docs (#10847)
* [Doc][Upgrade] Fix tiny error in upgrade docs (#10846)

* [Doc][Upgrade] Add useSSL=false and fix typo in upgrade docs (#10846)
2022-07-09 14:53:05 +08:00
Jiajie Zhong
503cf179eb
[doc] 206 drop down doc not work (#10855) 2022-07-08 23:24:34 +08:00
Jiajie Zhong
d29592da1d
New version release 2.0.6 (#10851)
* New version release 2.0.6

* remove verison 1.3.8 and 1.3.9
2022-07-08 20:34:14 +08:00
qianli2022
1e48bbc5c6
[Feature-10629][Improvement] Support multi cluster environments - namespace use cluster (#10650)
* server code

* namespace ui

* fix dao test

* fix test

* fix

* docs and image update

Co-authored-by: qianl4 <qianl4@cicso.com>
2022-07-07 16:05:52 +08:00
Eric Gao
71f0168510
[Feature] Enable users to create python env from requirements.txt (#10658) 2022-07-06 15:56:39 +08:00
旺阳
2d8b4932b3
[doc] Correct custom jdbc driver for K8s Doc (#10768) 2022-07-06 10:57:14 +08:00
sneh-wha
fa1458b3e0
[doc] Modify features, hw, intro and homepage docs. (#10713) 2022-07-05 21:58:05 +08:00
sneh-wha
91b59dee54
[doc] Modified dq, monitor, security, resources (#10715) 2022-07-05 20:50:37 +08:00
Kerwin
bd1be6cf36
[Task] Added Apache SeaTunnel 2.x task node (#10480) 2022-07-05 19:21:30 +08:00
aiwenmo
5b0347e8da
[Task] Add Dinky task to better support the development and execution of FlinkSQL (#10640) 2022-07-05 10:07:24 +08:00
xiangzihao
7aad6a6515
[doc] Unify data source switching of the docs during installation (#10688) 2022-07-04 16:28:14 +08:00
sneh-wha
6cf9d088ff
[doc] Change tasks docs (#10751) 2022-07-04 11:29:59 +08:00
sneh-wha
423cc5b9be
[doc] Modified project doc. (#10711) 2022-07-04 10:23:25 +08:00
Devosend
4f0a02eb43
[chore] update by release version (#10742)
* update 3.0.0-beta-2 doc

* update history-versions doc
2022-07-04 10:05:29 +08:00
sneh-wha
fb8d0c858b
Merging general settings to faq (#10716)
* Merging general settings to faq

* also change the zh position

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-07-01 17:18:02 +08:00
sneh-wha
fb90a0e558
[doc] Modify quick start. (#10712) 2022-07-01 16:51:07 +08:00
sneh-wha
0cdae777ab
[doc] Modified alert doc files (#10714) 2022-07-01 16:29:00 +08:00
Paul Zhang
4a3c3e7797
[feature][task-flink] Support Flink application mode (#9577) 2022-07-01 12:20:38 +08:00
sneh-wha
65ebdbef98
[doc] Change tasks doc (#10639) 2022-07-01 01:46:04 +08:00
sneh-wha
7898f41dc0
[doc] Change datasource doc (#10660) 2022-06-30 23:33:59 +08:00
Stalary
a45fc5b032
[doc] Add doc for pre-sql and post-sql (#10685) 2022-06-30 20:01:23 +08:00
caishunfeng
c2f1886306
[doc] Update metadata and design doc (#10600) 2022-06-30 17:48:17 +08:00
sneh-wha
1cdbbc1ba5
[doc] Modified parameter doc files. (#10659) 2022-06-29 14:42:37 +08:00
sneh-wha
1f46078ab8
[doc] Change subprocess dependent (#10637) 2022-06-27 19:30:35 +08:00
sneh-wha
a14b96b091
[doc] Modify Shell task file (#10634) 2022-06-27 17:22:09 +08:00
Jiajie Zhong
cd51a22940
[doc] Correct installPath when using related path (#10597)
correct the doc and add hint to setting

ref: #10511
2022-06-27 11:02:19 +08:00
Eric Gao
16144a8858
[docs] Add links to metrics docs (#10583) 2022-06-24 17:27:40 +08:00
Stalary
b2df357814
[doc] Add run the task alone doc. (#10581) 2022-06-24 16:59:22 +08:00
xiangzihao
33cc68ed4a
[doc] Add doc about how to use healthcheck endpoints (#10592) 2022-06-24 16:56:26 +08:00
xiangzihao
b21e211d2c
[doc] Add docs about complement dependent mode (#10587) 2022-06-24 16:33:10 +08:00
xiangzihao
773ebc9e52
fix 10513 (#10564) 2022-06-23 13:44:22 +08:00
houshitao
1b1a567fec
[doc] Correct the complement add docs (#10521) 2022-06-23 12:02:28 +08:00
JieguangZhou
3918140e7e
[fix][doc] Add DVC task plugin doc link (#10529) 2022-06-23 10:01:49 +08:00
Eric Gao
0aba68f335
[Improvement][Metrics] Update some metrics names in grafana-demo dashboards (#10432) (#10552) 2022-06-22 23:05:54 +08:00
Eric Gao
cc06eaaf54
[Improvement][Metrics] Apply micrometer naming convention to metrics (#10477)
* Apply micrometer naming convention to worker metrics
* Apply micrometer naming convention all current metrics
* Fix remaining metrics names, update English docs and add Chinese docs
* Fix metrics names in grafana-demo dashboards
2022-06-21 14:27:06 +08:00
JieguangZhou
36e20cdfc8
[Feature][Task Plugin] Add DVC task plugin for MLops scenario (#10372) (#10407) 2022-06-21 13:13:46 +08:00
旺阳
6e4b2e6992
[Fix]Recovery Traffic Control Config (#10505)
* recovery traffic config

* run ci

* update
2022-06-20 18:43:48 +08:00
Eric Gao
64cee03fed
[Feature] Enable users to switch and install conda env in jupyter task (#10337) 2022-06-20 14:47:44 +08:00
xiangzihao
704e633659
[Doc] Add api test doc (#10499) 2022-06-19 13:55:23 +08:00
Eric Gao
4be3b877c3
[feature][task] Enable zeppelin schedule a whole zeppelin note (#10434) 2022-06-18 13:34:24 +08:00