Eric Gao
064224696f
[Doc][Improvement] Add instructions for process execution type and data complement ( #12121 )
...
* Add instructions for process execution type and data complement
* Fix and polish the docs
2022-09-24 09:59:02 +08:00
JieguangZhou
cf522e2fc0
[improve] Optimize MLFlow task plugin for easy of use ( #12071 )
...
optimize code
2022-09-21 10:45:05 +08:00
ZhaoGuodong
86291bb5e6
[Feature-10273][Datasource] Add dataSource for AWS Athena ( #11157 )
2022-09-16 09:59:20 +08:00
caishunfeng
0deafba12c
fix procedure task param pass ( #11919 )
2022-09-14 13:44:01 +08:00
juzimao
5d9331f4ee
[Feature-10683][Task Plugin] Add Java Task Plugin. ( #10689 )
2022-09-09 10:37:24 +08:00
xiangzihao
f0db90f71d
[Doc] Remove re-upload file function in the 3.0.0's doc ( #11804 )
2022-09-07 09:45:51 +08:00
Eric Gao
4a37345436
[Feature][Task Plugin] Support hive cli task plugin ( #11651 )
...
* Add hive cli task plugin
* Add docs for hive-cli task plugin
* Fix hive-cli task related front-end nits and checkstyle
* Fix exception handling logic
2022-08-30 10:45:51 +08:00
Eric Gao
ff4d2c9460
[Doc][Bug] Fix resource center docs for standalone mode ( #11600 )
...
* Fix resource center docs for standalone mode
* Remove useless images
2022-08-23 09:46:01 +08:00
monster
3e360a8ecb
[Improvement-11550] [Doc]Document content update ( #11577 )
...
* [Improvement-11550] [Doc]Document content update
* Update pictures
* fix
* Update Process word to Workflow
Co-authored-by: David <davidzollo365@gmail.com>
2022-08-22 00:00:42 +08:00
JieguangZhou
a974ba74ab
[Feature] New task plugin Pytorch ( #11498 )
...
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-08-18 10:20:37 +08:00
Qi Zhang
a4bdadbb84
[doc] Use Rainbond deployment DolphinScheduler Cluster ( #10951 )
...
* [doc] Use Rainbond deployment DolphinScheduler Cluster
Signed-off-by: Qi Zhang <smallqi1@163.com>
* Update docs/docs/en/guide/installation/rainbond.md
* Update docs/docs/en/guide/installation/rainbond.md
* Update docs/docs/zh/guide/installation/rainbond.md
* Update docs/docs/zh/guide/installation/rainbond.md
* [doc] modify rainbond doc and add image
Signed-off-by: Qi Zhang <smallqi1@163.com>
* fix: img link
Signed-off-by: Qi Zhang <smallqi1@163.com>
* fix: modify proposal
Signed-off-by: Qi Zhang <smallqi1@163.com>
* docs: move rainbond docs to integration
Signed-off-by: Qi Zhang <smallqi1@163.com>
Signed-off-by: Qi Zhang <smallqi1@163.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-08-15 14:33:37 +08:00
caishunfeng
0464123c2b
[Feature-11223] support stream task ( #11350 )
...
* add task execute type
* update task definition list paging
* update task instance list paging
* stream task start
* [Feature][UI] Some changes to execute task.
* Set the connection edge to dashed line.
* Add FLINK_STREAM task.
* add stream task
* flink savepoint and cancel
* fix query bug
* add stream task definition
* add task instance for stream task
* delete stream task definition state
* update api for stream task definition edit
* modify search for stream task instance
* add language
* delete task type search for stream task definition
* change task type search for stream task instance
* add jump button
* add savepoint
* add down log for stream task instance
* ui test
* stream task start
* run DAG
* [Fix][UI] Fix the stream task edgs not to be dashed when filling back.
* [Feature][UI] Remove some fields for FLINK_STREAM.
* add start modal
* add dryRun column for stream task instance
* fix duration
* fix pon
* fix build error
* Add success tip
* add auto sync for stream task instance
* remove forgien key for task instance
* license header
* UT fix
* modify locales
* recover common config
* fix UT
* add doc
Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: devosend <devosend@gmail.com>
2022-08-10 21:44:43 +08:00
insist777
8ad6e10da5
[doc] Improve the document introduction of complement ( #11275 )
2022-08-09 19:35:25 +08:00
Eric Gao
3aa9f2ea25
[Bug][Doc] Fix typos in docs which causes links to upgrade section to fail ( #11333 )
...
* [Bug][Doc] Fix typo in docs
* Remove dead links and update related docs
2022-08-06 20:50:48 +08:00
Jiajie Zhong
bf5f7a88c5
[doc] migrate community and development docs into main repo ( #11313 )
2022-08-05 17:58:39 +08:00
xuhhui
513f336015
[Feature] Add new task type chunjun ( #10937 )
2022-07-28 19:25:29 +08:00
Tq
9859b5da1f
add Feishu alert doc and configure email alert doc to the docsdev.js ( #11173 )
...
add Feishu alert doc and configure email alert doc to the docsdev.js
2022-07-28 17:21:32 +08:00
JieguangZhou
af7b359333
[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario ( #10826 ) ( #10935 )
...
* add sagemaker pipeline task plugin
[DOC] add Sagemaker task plugin document
change license and fix dependencies
* [fix] Optimize the code
* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java
Optimization parameter judgment
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
* [fix] nips
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-07-21 18:16:58 +08:00
Jiajie Zhong
08cfbc73e0
[doc] Add missing doc change by snehal ( #10892 )
2022-07-12 14:16:00 +08:00
ZhaoGuodong
8eaf5a2309
[Feature-10219][EMR] EMR supports use <add-Steps> to add steps to an existing cluster ( #10657 )
...
* Add the ProgramType parameter to distinguish task types
* EmrAddStepsTask supports Add-Steps
* UI supports Add-Steps
* EmrTask modify the name of the class to EmrJobFlowTask
* add ERM Task abstract base class AbstractEmrTask
* add testcase for EmrAddStepsTask
* Modifying help Documents
2022-07-10 10:15:25 +08:00
qianli2022
1e48bbc5c6
[Feature-10629][Improvement] Support multi cluster environments - namespace use cluster ( #10650 )
...
* server code
* namespace ui
* fix dao test
* fix test
* fix
* docs and image update
Co-authored-by: qianl4 <qianl4@cicso.com>
2022-07-07 16:05:52 +08:00
sneh-wha
fa1458b3e0
[doc] Modify features, hw, intro and homepage docs. ( #10713 )
2022-07-05 21:58:05 +08:00
Kerwin
bd1be6cf36
[Task] Added Apache SeaTunnel 2.x task node ( #10480 )
2022-07-05 19:21:30 +08:00
aiwenmo
5b0347e8da
[Task] Add Dinky task to better support the development and execution of FlinkSQL ( #10640 )
2022-07-05 10:07:24 +08:00
sneh-wha
423cc5b9be
[doc] Modified project doc. ( #10711 )
2022-07-04 10:23:25 +08:00
sneh-wha
7898f41dc0
[doc] Change datasource doc ( #10660 )
2022-06-30 23:33:59 +08:00
Stalary
a45fc5b032
[doc] Add doc for pre-sql and post-sql ( #10685 )
2022-06-30 20:01:23 +08:00
caishunfeng
c2f1886306
[doc] Update metadata and design doc ( #10600 )
2022-06-30 17:48:17 +08:00
Stalary
b2df357814
[doc] Add run the task alone doc. ( #10581 )
2022-06-24 16:59:22 +08:00
houshitao
1b1a567fec
[doc] Correct the complement add docs ( #10521 )
2022-06-23 12:02:28 +08:00
JieguangZhou
36e20cdfc8
[Feature][Task Plugin] Add DVC task plugin for MLops scenario ( #10372 ) ( #10407 )
2022-06-21 13:13:46 +08:00
liubo1990
b8d5e78994
[Doc] Add how to set the alarm mailbox in faq ( #10401 )
2022-06-17 21:16:38 +08:00
qianli2022
ff065d8e5b
[Feature][Improvement] Support multi cluster environments - k8s type ( #10096 )
...
* service code
* [Feature][UI] Add front-end for cluster manage
* fix e2e
* remove comment on cluster controller
* doc
* img
* setting e2e.yaml
* test
* rerun e2e
* fix bug from comment
* Update index.tsx
use Nspace instead of css.
* Update index.tsx
Remove the style.
* Delete index.module.scss
Remove the useless file.
Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
2022-06-15 13:39:20 +08:00
JieguangZhou
3258438f6e
[Feature] [MLOps] support mlflow deploy with docker compose ( #10217 )
...
* [Feature] [MLOps] support mlflow deploy with docker compose
fix doc
Update docs/docs/en/guide/task/mlflow.md
fix doc
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
revert cancel modification
fix ENV name and docker compose command
* fix doc image link
* fix testModelsDeployDockerCompose
* add docker compose container health check and fix mlflow bug
* update docker compose healthcheck timeout
2022-06-10 10:20:50 +08:00
Wenjun Ruan
e21d7b1551
[Feature][metrics] Add master, worker metrics ( #10326 )
...
* Add mater metrics
* fix UT
* Add url to mysql profile
* Add worker metrics
* Update grafana config
* Add system metrics doc
* Add process failover counter
* Add metrics image
* Change jpg to png
* Add command insert metrics
* Fix UT
* Revert UT
2022-06-09 10:55:39 +08:00
chuxing
7e39e0d48d
[doc] Add switch task demo ( #10247 )
...
Co-authored-by: QuakeWang <45645138+QuakeWang@users.noreply.github.com>
2022-06-08 14:17:05 +08:00
HuangWei
c5961aed25
[feat][task] Add OpenMLDB task plugin ( #10198 )
2022-05-31 11:00:21 +08:00
QuakeWang
cd36401a6a
[doc] Refactor context parameter docment ( #10227 )
2022-05-30 11:44:10 +08:00
QuakeWang
58b1e1da1e
[doc] Upgrade screenshot to latest version in dev document ( #10242 )
...
* fix issue-9898
* delete no use pictures
2022-05-30 11:04:42 +08:00
Jiajie Zhong
6d9bc0743b
[doc] Add setValue syntax in local param ( #10245 )
...
ref: #9576
same as： #9671
2022-05-25 21:53:41 +08:00
QuakeWang
5998c73aac
[doc] Refactor local parameter docment ( #10119 )
2022-05-24 17:16:08 +08:00
Jiajie Zhong
f4b7754952
[doc] Update task DataX document ( #10218 )
2022-05-24 13:45:26 +08:00
JieguangZhou
54ab2651bd
[Feature][MLops] Add MLflow Projects (custom project) component ( #10175 )
...
* Add MLflow Projects (custom project) component
* fix something
* update document
* update document
* Supplementary test cases
2022-05-24 09:42:46 +08:00
QuakeWang
0abfb5e744
[doc] Refactor global parameter docment ( #10045 )
2022-05-23 10:46:11 +08:00
JieguangZhou
e11373b963
[Feature][MLops] Support MLflow Models to deploy model service (MLflow models serve and Docker) ( #10150 )
...
* Add backend of MLflow Moldes component
* Add front end of MLflow Moldes component
* [DOC] update mlflow document
* revert unnecessary
* fix doc image url
* Update docs/docs/en/guide/task/mlflow.md
Discard the lr abbreviation
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-20 19:41:22 +08:00
Mr.An
7d5af7e7ec
[doc] Update editorial workflow content and images ( #10130 )
2022-05-20 16:44:56 +08:00
Jiajie Zhong
94c515555e
[doc] Remove flink call docs ( #10122 )
...
Flink call docs is only teld users
how to use flink task in dolphinscheduler
and it should be including in task/flink
2022-05-19 16:41:33 +08:00
Mr.An
73f13a9c9c
[doc] Show all the functions of the home page through screenshots ( #10118 )
2022-05-19 14:45:44 +08:00
QuakeWang
243ee8ba70
[Bug][doc] Fix the open-api docs request error ( #10100 )
2022-05-19 11:28:33 +08:00
JieguangZhou
9ab3bebc90
[Feature][Task Plugin] Add mlflow task plugin for MLops scenario. ( #10036 )
...
* [Feature][Task Plugin] Add mlflow task plugin (#9725 )
* [Feature][Task Plugin] Add mlflow task plugin UI (#9725 )
* [Feature][Task Plugin] fix license header (#9725 )
* [Feature][Task Plugin] fix license header (#9725 )
* [Feature][Task Plugin] revert unnecessary
* [Feature][Task Plugin] add auto ml to mlflow task plugin
* [DOC] add mlflow document
* [DOC] fix mlflow docs imgs
* [DOC] fix dead link localhost:5000
* [DOC] fix dead link localhost:5000
* [DOC] remove dead link localhost:5000
* Update docs/docs/en/guide/task/mlflow.md
* Update docs/docs/zh/guide/task/mlflow.md
* [DOC] format ui code
* [DOC] remove dead link localhost:5000
* [Feature][Task Plugin] revert unnecessary
* fix some nits
* Move the personal repository to the public repository.
* Run the command directly instead of saving the file
* fix paramsMap initialize
* revert unnecessary
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-19 09:40:31 +08:00
