Commit Graph

312 Commits

Author SHA1 Message Date
qianli2022
1e48bbc5c6
[Feature-10629][Improvement] Support multi cluster environments - namespace use cluster (#10650)
* server code

* namespace ui

* fix dao test

* fix test

* fix

* docs and image update

Co-authored-by: qianl4 <qianl4@cicso.com>
2022-07-07 16:05:52 +08:00
Eric Gao
71f0168510
[Feature] Enable users to create python env from requirements.txt (#10658) 2022-07-06 15:56:39 +08:00
旺阳
2d8b4932b3
[doc] Correct custom jdbc driver for K8s Doc (#10768) 2022-07-06 10:57:14 +08:00
sneh-wha
fa1458b3e0
[doc] Modify features, hw, intro and homepage docs. (#10713) 2022-07-05 21:58:05 +08:00
sneh-wha
91b59dee54
[doc] Modified dq, monitor, security, resources (#10715) 2022-07-05 20:50:37 +08:00
Kerwin
bd1be6cf36
[Task] Added Apache SeaTunnel 2.x task node (#10480) 2022-07-05 19:21:30 +08:00
aiwenmo
5b0347e8da
[Task] Add Dinky task to better support the development and execution of FlinkSQL (#10640) 2022-07-05 10:07:24 +08:00
xiangzihao
7aad6a6515
[doc] Unify data source switching of the docs during installation (#10688) 2022-07-04 16:28:14 +08:00
sneh-wha
6cf9d088ff
[doc] Change tasks docs (#10751) 2022-07-04 11:29:59 +08:00
sneh-wha
423cc5b9be
[doc] Modified project doc. (#10711) 2022-07-04 10:23:25 +08:00
Devosend
4f0a02eb43
[chore] update by release version (#10742)
* update 3.0.0-beta-2 doc

* update history-versions doc
2022-07-04 10:05:29 +08:00
sneh-wha
fb8d0c858b
Merging general settings to faq (#10716)
* Merging general settings to faq

* also change the zh position

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-07-01 17:18:02 +08:00
sneh-wha
fb90a0e558
[doc] Modify quick start. (#10712) 2022-07-01 16:51:07 +08:00
sneh-wha
0cdae777ab
[doc] Modified alert doc files (#10714) 2022-07-01 16:29:00 +08:00
Paul Zhang
4a3c3e7797
[feature][task-flink] Support Flink application mode (#9577) 2022-07-01 12:20:38 +08:00
sneh-wha
65ebdbef98
[doc] Change tasks doc (#10639) 2022-07-01 01:46:04 +08:00
sneh-wha
7898f41dc0
[doc] Change datasource doc (#10660) 2022-06-30 23:33:59 +08:00
Stalary
a45fc5b032
[doc] Add doc for pre-sql and post-sql (#10685) 2022-06-30 20:01:23 +08:00
caishunfeng
c2f1886306
[doc] Update metadata and design doc (#10600) 2022-06-30 17:48:17 +08:00
sneh-wha
1cdbbc1ba5
[doc] Modified parameter doc files. (#10659) 2022-06-29 14:42:37 +08:00
sneh-wha
1f46078ab8
[doc] Change subprocess dependent (#10637) 2022-06-27 19:30:35 +08:00
sneh-wha
a14b96b091
[doc] Modify Shell task file (#10634) 2022-06-27 17:22:09 +08:00
Jiajie Zhong
cd51a22940
[doc] Correct installPath when using related path (#10597)
correct the doc and add hint to setting

ref: #10511
2022-06-27 11:02:19 +08:00
Eric Gao
16144a8858
[docs] Add links to metrics docs (#10583) 2022-06-24 17:27:40 +08:00
Stalary
b2df357814
[doc] Add run the task alone doc. (#10581) 2022-06-24 16:59:22 +08:00
xiangzihao
33cc68ed4a
[doc] Add doc about how to use healthcheck endpoints (#10592) 2022-06-24 16:56:26 +08:00
xiangzihao
b21e211d2c
[doc] Add docs about complement dependent mode (#10587) 2022-06-24 16:33:10 +08:00
xiangzihao
773ebc9e52
fix 10513 (#10564) 2022-06-23 13:44:22 +08:00
houshitao
1b1a567fec
[doc] Correct the complement add docs (#10521) 2022-06-23 12:02:28 +08:00
JieguangZhou
3918140e7e
[fix][doc] Add DVC task plugin doc link (#10529) 2022-06-23 10:01:49 +08:00
Eric Gao
0aba68f335
[Improvement][Metrics] Update some metrics names in grafana-demo dashboards (#10432) (#10552) 2022-06-22 23:05:54 +08:00
Eric Gao
cc06eaaf54
[Improvement][Metrics] Apply micrometer naming convention to metrics (#10477)
* Apply micrometer naming convention to worker metrics
* Apply micrometer naming convention all current metrics
* Fix remaining metrics names, update English docs and add Chinese docs
* Fix metrics names in grafana-demo dashboards
2022-06-21 14:27:06 +08:00
JieguangZhou
36e20cdfc8
[Feature][Task Plugin] Add DVC task plugin for MLops scenario (#10372) (#10407) 2022-06-21 13:13:46 +08:00
旺阳
6e4b2e6992
[Fix]Recovery Traffic Control Config (#10505)
* recovery traffic config

* run ci

* update
2022-06-20 18:43:48 +08:00
Eric Gao
64cee03fed
[Feature] Enable users to switch and install conda env in jupyter task (#10337) 2022-06-20 14:47:44 +08:00
xiangzihao
704e633659
[Doc] Add api test doc (#10499) 2022-06-19 13:55:23 +08:00
Eric Gao
4be3b877c3
[feature][task] Enable zeppelin schedule a whole zeppelin note (#10434) 2022-06-18 13:34:24 +08:00
guodong
2c227ab384
[Feature-10363][server] S3 Resource center supports bucket customization (#10433)
* [Feature-10363][server] S3 Resource center supports bucket customization

* Modify the configuration. Sort out HDFS and S3 configurations to distinguish them
* Modify the configuration comment to clarify the configuration meaning
* Modify official documents to add missing configuration descriptions and clarify configuration meanings and usage
* Modify the configuration file in e2E to the correct definition, dolphinscheduler-e2e/dolphinscheduler-e2e-case/src/test/resources/docker/file-manage/common.properties
* Modified code to support bucket customization
* Check that the bucket on personal permission, Otherwise, the startup fails
* S3 increase support resource. Storage. Upload. Base. The base path path
* Change S3Utils implementation style to be consistent with HadoopUtils

* [Feature-10363][server] S3 Resource center supports bucket customization

* Modify code review comments
2022-06-18 10:20:01 +08:00
liubo1990
b8d5e78994
[Doc] Add how to set the alarm mailbox in faq (#10401) 2022-06-17 21:16:38 +08:00
旺阳
6515c66208
[Improve] Add LDAP user not exsitst action config (#10451) 2022-06-17 14:18:05 +08:00
qianli2022
ff065d8e5b
[Feature][Improvement] Support multi cluster environments - k8s type (#10096)
* service code

* [Feature][UI] Add front-end for cluster manage

* fix e2e

* remove comment on cluster controller

* doc

* img

* setting e2e.yaml

* test

* rerun e2e

* fix bug from comment

* Update index.tsx

use Nspace instead of css.

* Update index.tsx

Remove the style.

* Delete index.module.scss

Remove the useless file.

Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
2022-06-15 13:39:20 +08:00
Jiajie Zhong
b655aa9b1f
[doc] Correct resource in HDFS HA cluster (#10445) 2022-06-15 11:08:18 +08:00
旺阳
0efcd5c631
[Fix-10425]Recovery LDAP Config (#10429)
* recovery ladp code

* add ldap config in doc
2022-06-15 09:52:37 +08:00
阿福Chris
8205444e0a
[DolphinScheduler] Fix wrong class name in doc (#10438) 2022-06-14 19:53:33 +08:00
hstdream
f6fea06f10
[Improve] Enhance complement function transformation (#10376) 2022-06-12 12:35:08 +08:00
JieguangZhou
3258438f6e
[Feature] [MLOps] support mlflow deploy with docker compose (#10217)
* [Feature] [MLOps] support mlflow deploy with docker compose

fix doc

Update docs/docs/en/guide/task/mlflow.md

fix doc

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>

revert cancel modification

fix ENV name and docker compose command

* fix doc image link

* fix testModelsDeployDockerCompose

* add docker compose container health check and fix mlflow bug

* update docker compose healthcheck timeout
2022-06-10 10:20:50 +08:00
Wenjun Ruan
e21d7b1551
[Feature][metrics] Add master, worker metrics (#10326)
* Add mater metrics

* fix UT

* Add url to mysql profile

* Add worker metrics

* Update grafana config

* Add system metrics doc

* Add process failover counter

* Add metrics image

* Change jpg to png

* Add command insert metrics

* Fix UT

* Revert UT
2022-06-09 10:55:39 +08:00
xiangzihao
b1fb17119b
[Feature-6758][Task] Add limit resource usage for tasks base on cgroup (#10373) 2022-06-08 19:42:05 +08:00
chuxing
7e39e0d48d
[doc] Add switch task demo (#10247)
Co-authored-by: QuakeWang <45645138+QuakeWang@users.noreply.github.com>
2022-06-08 14:17:05 +08:00
He Zhao
da3c25dc67
[improve] Using create or replace function in sql task (#10170) 2022-06-06 10:33:24 +08:00