test/DolphinScheduler
1
0
Fork 0
mirror of https://gitee.com/dolphinscheduler/DolphinScheduler.git synced 2024-12-12 12:25:16 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
7,186 Commits 27 Branches 59 Tags 275 MiB
b73a9511a7
Commit Graph

380 Commits

Author SHA1 Message Date
JieguangZhou
36e20cdfc8
[Feature][Task Plugin] Add DVC task plugin for MLops scenario (#10372) (#10407) 2022-06-21 13:13:46 +08:00
旺阳
6e4b2e6992
[Fix]Recovery Traffic Control Config (#10505) 
* recovery traffic config

* run ci

* update
 2022-06-20 18:43:48 +08:00
Eric Gao
64cee03fed
[Feature] Enable users to switch and install conda env in jupyter task (#10337) 2022-06-20 14:47:44 +08:00
xiangzihao
704e633659
[Doc] Add api test doc (#10499) 2022-06-19 13:55:23 +08:00
Eric Gao
4be3b877c3
[feature][task] Enable zeppelin schedule a whole zeppelin note (#10434) 2022-06-18 13:34:24 +08:00
guodong
2c227ab384
[Feature-10363][server] S3 Resource center supports bucket customization (#10433) 
* [Feature-10363][server] S3 Resource center supports bucket customization

* Modify the configuration. Sort out HDFS and S3 configurations to distinguish them
* Modify the configuration comment to clarify the configuration meaning
* Modify official documents to add missing configuration descriptions and clarify configuration meanings and usage
* Modify the configuration file in e2E to the correct definition, dolphinscheduler-e2e/dolphinscheduler-e2e-case/src/test/resources/docker/file-manage/common.properties
* Modified code to support bucket customization
* Check that the bucket on personal permission, Otherwise, the startup fails
* S3 increase support resource. Storage. Upload. Base. The base path path
* Change S3Utils implementation style to be consistent with HadoopUtils

* [Feature-10363][server] S3 Resource center supports bucket customization

* Modify code review comments
 2022-06-18 10:20:01 +08:00
liubo1990
b8d5e78994
[Doc] Add how to set the alarm mailbox in faq (#10401) 2022-06-17 21:16:38 +08:00
旺阳
6515c66208
[Improve] Add LDAP user not exsitst action config (#10451) 2022-06-17 14:18:05 +08:00
qianli2022
ff065d8e5b
[Feature][Improvement] Support multi cluster environments - k8s type (#10096) 
* service code

* [Feature][UI] Add front-end for cluster manage

* fix e2e

* remove comment on cluster controller

* doc

* img

* setting e2e.yaml

* test

* rerun e2e

* fix bug from comment

* Update index.tsx

use Nspace instead of css.

* Update index.tsx

Remove the style.

* Delete index.module.scss

Remove the useless file.

Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
 2022-06-15 13:39:20 +08:00
Jiajie Zhong
b655aa9b1f
[doc] Correct resource in HDFS HA cluster (#10445) 2022-06-15 11:08:18 +08:00
旺阳
0efcd5c631
[Fix-10425]Recovery LDAP Config (#10429) 
* recovery ladp code

* add ldap config in doc
 2022-06-15 09:52:37 +08:00
阿福Chris
8205444e0a
[DolphinScheduler] Fix wrong class name in doc (#10438) 2022-06-14 19:53:33 +08:00
hstdream
f6fea06f10
[Improve] Enhance complement function transformation (#10376) 2022-06-12 12:35:08 +08:00
JieguangZhou
3258438f6e
[Feature] [MLOps] support mlflow deploy with docker compose (#10217) 
* [Feature] [MLOps] support mlflow deploy with docker compose

fix doc

Update docs/docs/en/guide/task/mlflow.md

fix doc

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>

revert cancel modification

fix ENV name and docker compose command

* fix doc image link

* fix testModelsDeployDockerCompose

* add docker compose container health check and fix mlflow bug

* update docker compose healthcheck timeout
 2022-06-10 10:20:50 +08:00
Wenjun Ruan
e21d7b1551
[Feature][metrics] Add master, worker metrics (#10326) 
* Add mater metrics

* fix UT

* Add url to mysql profile

* Add worker metrics

* Update grafana config

* Add system metrics doc

* Add process failover counter

* Add metrics image

* Change jpg to png

* Add command insert metrics

* Fix UT

* Revert UT
 2022-06-09 10:55:39 +08:00
xiangzihao
b1fb17119b
[Feature-6758][Task] Add limit resource usage for tasks base on cgroup (#10373) 2022-06-08 19:42:05 +08:00
chuxing
7e39e0d48d
[doc] Add switch task demo (#10247) 
Co-authored-by: QuakeWang <45645138+QuakeWang@users.noreply.github.com>
 2022-06-08 14:17:05 +08:00
He Zhao
da3c25dc67
[improve] Using create or replace function in sql task (#10170) 2022-06-06 10:33:24 +08:00
Kirs
0c25d4a3ce
[Docs]Update Slack Invite Link (#10362) 2022-06-04 23:55:23 +08:00
Jiajie Zhong
12fdd9bbd9
[doc] Use related path for img (#10325) 
Use related path in our docs for imgs, previous
can not use because website need the absolute path
from root directory, and after we merged
apache/dolphinscheduler-website#789 we have covert
function to do that

close: #9426
 2022-06-02 23:28:53 +08:00
xiangzihao
d1c47c99ad
fix bug_10343 (#10344) 2022-06-02 16:13:51 +08:00
QuakeWang
6828c9e015
[doc] Add how to use resource in shell task (#10308) 2022-06-01 17:28:27 +08:00
Eric Gao
442f93544e
[Bug][Api-Server]Fix bug when user without tenant uploads file in resource center (#10303) 2022-06-01 17:22:36 +08:00
Eric Gao
a8a5da367a
[Feature][Task Plugin] Add support for dynamic form for zeppelin task plugin (#9977) (#10269) 2022-05-31 11:19:41 +08:00
HuangWei
c5961aed25
[feat][task] Add OpenMLDB task plugin (#10198) 2022-05-31 11:00:21 +08:00
Jiajie Zhong
a241135cbc
[chore] update by release version (#10299) 2022-05-30 23:09:01 +08:00
xiangzihao
12a09f6d5d
[doc] Fix api standard error (#10292) 
* fix api standard error
* add patch method
 2022-05-30 16:07:25 +08:00
Mr.An
8d26d4fe72
[doc] Update the development environment to build the software version (#10246) 2022-05-30 14:46:12 +08:00
Yiming Guo
2294160cdb
[docs] Added local file configuration guide for resource center (#10264) 
* Added Local File Resource Configuration Guide to the document.
* Removed contents with windows features in the documents and improved expression.
* Specify `the user who deploy dolphinscheduler have read and write permissions` in en and zh docs.

Co-authored-by: xiangzihao <460888207@qq.com>
 2022-05-30 12:07:29 +08:00
QuakeWang
cd36401a6a
[doc] Refactor context parameter docment (#10227) 2022-05-30 11:44:10 +08:00
QuakeWang
58b1e1da1e
[doc] Upgrade screenshot to latest version in dev document (#10242) 
* fix issue-9898
* delete no use pictures
 2022-05-30 11:04:42 +08:00
lugela
a0771541e5
[Fix-10181] Fix the logic of judging that the tenant does not exist (#10185) 
* [Fix-10181] Fix the logic of judging that the tenant does not exist

Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap :  uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist  in /etc/passwd file and ldap: id: test: no such user

Temporarily unable to test the system for windows and mac

* [Fix-10181] Fix the logic of judging that the tenant does not exist

Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap :  uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist  in /etc/passwd file and ldap: id: test: no such user

Temporarily unable to test the system for windows and mac

* [Fix-10181] Fix the logic of judging that the tenant does not exist

Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap :  uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist  in /etc/passwd file and ldap: id: test: no such user

Temporarily unable to test the system for windows and mac

* [Fix-10181] Fix the logic of judging that the tenant does not exist

The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged.

At present, considering that it is a distributed user, it should not be allowed to create users in linux

Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap :  uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist  in /etc/passwd file and ldap: id: test: no such user

Temporarily unable to test the system for windows and mac

* [Fix-10181] Fix the logic of judging that the tenant does not exist

Add test method

The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged.

At present, considering that it is a distributed user, it should not be allowed to create users in linux

Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap :  uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist  in /etc/passwd file and ldap: id: test: no such user

Temporarily unable to test the system for windows and mac

* [Fix-10181] Fix the logic of judging that the tenant does not exist

Add parameter description to configuration.md

Add test method

The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged.

At present, considering that it is a distributed user, it should not be allowed to create users in linux

Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap :  uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist  in /etc/passwd file and ldap: id: test: no such user

Temporarily unable to test the system for windows and mac

* [Fix-10181] Fix the logic of judging that the tenant does not exist

Add parameter description to configuration.md

Add test method

The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged.

At present, considering that it is a distributed user, it should not be allowed to create users in linux

Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap :  uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist  in /etc/passwd file and ldap: id: test: no such user

Temporarily unable to test the system for windows and mac

* [Fix-10181] Fix the logic of judging that the tenant does not exist

Add parameter description to configuration.md

Add test method

The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged.

At present, considering that it is a distributed user, it should not be allowed to create users in linux

Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap :  uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist  in /etc/passwd file and ldap: id: test: no such user

Temporarily unable to test the system for windows and mac

Co-authored-by: ouyangl <ouyangl@tebon.com.cn>
 2022-05-26 14:58:07 +08:00
Jiajie Zhong
e3579dd13d
[doc] Correct all setup documents (#10074) 
* Correct the login page URL
* change version and database configuration
* change setup and upgrade
 2022-05-26 14:53:47 +08:00
Jiajie Zhong
6d9bc0743b
[doc] Add setValue syntax in local param (#10245) 
ref: #9576
same as： #9671
 2022-05-25 21:53:41 +08:00
旺阳
aba5f8a40e
[improve] Change Mysql Driver (#10220) 2022-05-25 14:09:15 +08:00
旺阳
87d9ec1dee
[doc] Delete SPRING_DATASOURCE_DRIVER_CLASS_NAME in doc (#10228) 2022-05-25 11:45:16 +08:00
QuakeWang
5998c73aac
[doc] Refactor local parameter docment (#10119) 2022-05-24 17:16:08 +08:00
旺阳
c12848a4ff
[doc] Update kubernetes' FAQ (#10221) 2022-05-24 17:00:57 +08:00
Jiajie Zhong
f4b7754952
[doc] Update task DataX document (#10218) 2022-05-24 13:45:26 +08:00
JieguangZhou
54ab2651bd
[Feature][MLops] Add MLflow Projects (custom project) component (#10175) 
* Add MLflow Projects (custom project) component

* fix something

* update document

* update document

* Supplementary test cases
 2022-05-24 09:42:46 +08:00
Mr.An
31cb485312
[doc] Update delete workflow description (#10203) 2022-05-23 20:59:19 +08:00
xiangzihao
41a3183810
[Doc] Add complie supporting system (#10188) 2022-05-23 15:17:37 +08:00
Eric Gao
7a8f3f1810
[doc] Update project directory structure in docs (#10107) 2022-05-23 11:11:45 +08:00
QuakeWang
0abfb5e744
[doc] Refactor global parameter docment (#10045) 2022-05-23 10:46:11 +08:00
JieguangZhou
e11373b963
[Feature][MLops] Support MLflow Models to deploy model service (MLflow models serve and Docker) (#10150) 
* Add backend of MLflow Moldes component

* Add front end of MLflow Moldes component

* [DOC] update mlflow document

* revert unnecessary

* fix doc image url

* Update docs/docs/en/guide/task/mlflow.md

Discard the lr abbreviation

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
 2022-05-20 19:41:22 +08:00
Mr.An
e2fac21399
[doc] Update website docs link (#10161) 2022-05-20 16:47:41 +08:00
Mr.An
7d5af7e7ec
[doc] Update editorial workflow content and images (#10130) 2022-05-20 16:44:56 +08:00
Jiajie Zhong
94c515555e
[doc] Remove flink call docs (#10122) 
Flink call docs is only teld users
how to use flink task in dolphinscheduler
and it should be including in task/flink
 2022-05-19 16:41:33 +08:00
Jiajie Zhong
2eff5ee10c
[doc] change document structure (#10124) 
This patch change the structure and make it more sense

* Remove dev doc in tab Docs, and for now you could only see it in
  history-version page
* Move PyDolphinScheduler from tab DOCS to sidebar and combine with open
  API
* Move installation after Functions
* Move data quality after HOW-TOS
 2022-05-19 16:30:53 +08:00
Mr.An
73f13a9c9c
[doc] Show all the functions of the home page through screenshots (#10118) 2022-05-19 14:45:44 +08:00
QuakeWang
243ee8ba70
[Bug][doc] Fix the open-api docs request error (#10100) 2022-05-19 11:28:33 +08:00
JieguangZhou
9ab3bebc90
[Feature][Task Plugin] Add mlflow task plugin for MLops scenario. (#10036) 
* [Feature][Task Plugin] Add mlflow task plugin (#9725)

* [Feature][Task Plugin] Add mlflow task plugin UI (#9725)

* [Feature][Task Plugin] fix license header (#9725)

* [Feature][Task Plugin] fix license header (#9725)

* [Feature][Task Plugin] revert unnecessary

* [Feature][Task Plugin] add auto ml to mlflow task plugin

* [DOC] add mlflow document

* [DOC] fix mlflow docs imgs

* [DOC] fix dead link localhost:5000

* [DOC] fix dead link localhost:5000

* [DOC] remove dead link localhost:5000

* Update docs/docs/en/guide/task/mlflow.md

* Update docs/docs/zh/guide/task/mlflow.md

* [DOC] format ui code

* [DOC] remove dead link localhost:5000

* [Feature][Task Plugin] revert unnecessary

* fix some nits

* Move the personal repository to the public repository.

* Run the command directly instead of saving the file

* fix paramsMap initialize

* revert unnecessary

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
 2022-05-19 09:40:31 +08:00
Jiajie Zhong
63f835715f
[fix] Enhance name pre checker in resource center (#10094) 
* [fix] Enhance name pre checker in resource center

Add file name and directory checker to avoid directory traversal

* add some missing change and change docs

* change var name in directoryTraversal

* Fix ci
 2022-05-18 18:40:17 +08:00
He Zhao
5bb1eb04fc
[Feature][plugin] Add k8s task in task plugin (#9425) 
* [Feature][plugin] Add k8s task in task plugin

* [Feature][plugin] fix dos and code problems

* [Feature][plugin] refactor some code based on sonar

* [Feature][UI] front-end for k8s task plugin

* [Feature][plugin] delete some front files

* [Feature][plugin] update document

* Update docs/docs/zh/guide/task/k8s.md

* Update docs/docs/en/guide/task/k8s.md

* Update docs/docs/en/guide/task/k8s.md

* Update docs/docs/en/guide/task/k8s.md

* [Feature][UI] front-end change from review comments

* [Feature][UI] replace get namespace list api

* [Feature][plugin] change file name

* Add kubernetes to zh task list

Co-authored-by: hezhao2 <hezhao2@cisco.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
 2022-05-18 17:23:42 +08:00
旺阳
cab46e6be5
[Fix-10083][Doc]Change Docker cmd && Change WebexTeams Chinese Translation (#10084) 
* Change Docker cmd && Change WebexTeams Chinese Translation

* run ci

Co-authored-by: qingwli <qingwli@cisco.com>
 2022-05-18 13:53:44 +08:00
QuakeWang
3bca240446
fix issue-10061 (#10062) 2022-05-18 12:21:35 +08:00
xiangzihao
225cb332d1
[Fix-10049] Conditions Task branch flow failed (#10077) 2022-05-18 11:40:32 +08:00
旺阳
537c206c2d
[Fix][Docker] Support Multi-Architecture Docker Images (#10052) 
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
 2022-05-18 10:20:24 +08:00
caishunfeng
b1885c7a26
[Bug] fix run on docker and k8s (#10026) 
* fix docker-compose init schema

* recovery depend on zk

* update doc and dockerfile

* fix run on k8s

* udpate doc

* add DOCKER flag & update doc

* remove repeat DOCKER env
 2022-05-16 15:41:45 +08:00
chuxing
f666c64946
[doc] Correct docs of development-environment-setup (#9995) 2022-05-16 09:53:45 +08:00
xiangzihao
baf654cb47
[Feature-9474] [CI] Add cluster test script verify on shell script (#9997) 
* cluster test

* fix init db failed

* fix init db failed

* fix init db failed

* fix init db failed

* fix init db failed

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add sudo

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* remove cluster-test workflows

* add github actions

* add github actions

* refactor test to docker mode

* refactor test to docker mode

* refactor test to docker mode

* refactor test to docker mode

* remove create schema logic

* remove create schema logic

* remove create schema logic

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* add github actions

* add github actions

* add github actions

* add cluster test timeout

* add cluster start test loop check

* add cluster start test loop check

* optimize cluster start test loop check
 2022-05-14 12:30:57 +08:00
旺阳
ee2c516813
[doc] Correct kubernetes (#9985) 
Co-authored-by: qingwli <qingwli@cisco.com>
 2022-05-13 10:39:05 +08:00
Eric Gao
80369363c9
[feat][task plugin] Add Jupyter task plugin (#9872) 
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
 2022-05-12 19:55:49 +08:00
QuakeWang
0fe75482a2
[doc] Add example and notice about task type Dependent (#10001) 
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
 2022-05-12 18:23:43 +08:00
Kerwin
bce5a28440
[doc] Add the description about execute type in SQL task (#9987) 2022-05-12 14:42:39 +08:00
qianli2022
bc1c15b142
[Feature-8252][doc] K8s and namespace manager docs and web page update (#9881) 
* test

* test

* doc

* fix image error

* fix

* Update docs/docs/en/guide/security.md

* Update docs/docs/en/guide/security.md

* Update docs/docs/en/guide/security.md

* Update docs/docs/zh/guide/security.md

* fix doc

Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
 2022-05-11 16:40:30 +08:00
QuakeWang
12a4b01268
[Doc] Add example and notice about task type Conditions (#9945) 2022-05-11 11:43:11 +08:00
QuakeWang
f790bc25fd
[doc] Update the document picture to new UI (#9953) 2022-05-11 11:38:15 +08:00
Dannila
2d36449444
[Feature- 9837][plugin/ui] support FlinkSQL Task (#9840) 
* flink_sql

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* '[refactor]flinksql'

* [refactor] flinksql

* '[refactor]flinksql'

* [refactor] dolphinscheduler flinksql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* [refactor] flink sql

* Update docs/docs/en/guide/task/flink.md

* Update docs/docs/zh/guide/task/flink.md

* prettier front-end code

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
Co-authored-by: devosend <devosend@gmail.com>
 2022-05-09 18:51:55 +08:00
QuakeWang
691e8ab538
[Feature][doc] Refactor and separate the Resource Center Document (#9658) 
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
 2022-05-07 18:07:35 +08:00
Jiajie Zhong
bb78ccb08e
[docs] Correct custom docker image in faq (#9939) 
* [docs] Correct custom docker image in faq

* Correct the build command
* Correct English version of document

* remove Chinese document in En version
 2022-05-07 18:04:21 +08:00
Eric Gao
1f7884609a
[Feature][Doc] Add docs for zeppelin task plugin (#9866) 2022-05-06 15:04:52 +08:00
songjianet
7a7807e520
[Feature] Remove old ui. (#9909) 
* [Feature] Remove old ui.

* [Docs] Add license file for screenfull.
 2022-05-06 14:04:35 +08:00
陈爽
15a15de927
[bug] [doc] fix the data quality link error about the navigation of dolphinscheduler 3.0.0-alpha zh docs (#9887) 2022-05-06 08:55:00 +08:00
Jiajie Zhong
136a183018
[doc] Separate and correct getting start by docker (#9862) 
* [doc] Separate and correct getting start by docker

* Correct content of starting docker
* Remove all FAQ in docker.md and only keep
  build image by users themself in faq.md
* Separate how to use incompatible incompatible
  datasource from docker.md to directory datasource

* correct disable flag

* fix download link

* fix wrong anchor

* remove not support anchor for zh docs
 2022-05-05 10:57:46 +08:00
sq-q
b1bb69c959
[Improve][docs] Add spark sql docs to task spark (#9851) 2022-05-05 10:48:17 +08:00
Kerwin
4f2b9ac886
[Improve][common] code clean in the common module (#9435) 2022-04-29 10:34:03 +08:00
Jiajie Zhong
4f596f362a
[doc] Fix syntax error cause website not work correctly (#9826) 2022-04-28 15:33:03 +08:00
Jiajie Zhong
d188f49b0e
[doc] Dir development should not ref other dirs content (#9812) 
For now, development dir deploy in other place instead
of docs dir https://dolphinscheduler.apache.org/en-us/development/development-environment-setup.html
so could not ref markdown doc from other docs dir
 2022-04-27 20:02:34 +08:00
Tq
7b0b4c126e
[Bug] [Website-9764]add http alert doc and change body param to unnecessary (#9792) 
* add http alert doc and change body param to unnecessary

* submit http en doc and fix doc

* fix http doc
 2022-04-27 17:26:58 +08:00
Eric Gao
515c363148
[Feature][Deploy] Add missing default values in dolphinscheduler_env.sh (#9733) 
* [Feature][Deploy] Add missing default values in dolphinscheduler_env.sh (#9675)

* [Feature][Deploy] Restore dolphinscheduler_env.sh to avoid e2e failure (#9675)

* [Feature][Deploy] Change mysql driver class name to com.mysql.cj.jdbc.Driver (#9675)

* [Feature][Deploy] Remove redundant config file (#9675)
 2022-04-27 13:44:37 +08:00
xiangzihao
71c1a31e63
[Feature-9566][Docs] Missing shell script application_id listening logic (#9778) 2022-04-27 09:51:25 +08:00
Tq
e3070d9fa3
[Bug] [Website-9764]add script doc to the alert function (#9765) 
* add script doc to the alert function

* add script doc to the alert function modify docsdev.js
 2022-04-26 17:43:46 +08:00
Eric Gao
3a66f05baf
[doc] Add how to change standalone database type (#9376) (#9736) 2022-04-26 09:47:22 +08:00
Jiajie Zhong
de50f43de6
[common] Make dolphinscheduler_env.sh work when start server (#9726) 
* [common] Make dolphinscheduler_env.sh work

* Change dist tarball `dolphinscheduler_env.sh` location
  from `bin/` to `conf/`, which users could finish their
  change configuration operation in one single directory.
  and we only need to add `$DOLPHINSCHEDULER_HOME/conf`
  when we start our sever instead of adding both
  `$DOLPHINSCHEDULER_HOME/conf` and `$DOLPHINSCHEDULER_HOME/bin`
* Change the `start.sh`'s path of `dolphinscheduler_env.sh`
* Change the setting order of `dolphinscheduler_env.sh`
* `bin/env/dolphinscheduler_env.sh` will overwrite the `<server>/conf/dolphinscheduler_env.sh`
when start the server using `bin/dolphinsceduler_daemon.sh` or `bin/install.sh`
* Change the related docs
 2022-04-25 15:35:43 +08:00
mans2singh
4799b27e33
[hotfix][docker] Removed extra equals in mail user (#9677) 2022-04-23 12:32:31 +08:00
Eric Gao
072ba731a2
[Bug][Doc]Update database init instruction docs (#9659) 2022-04-22 23:56:00 +08:00
Jiajie Zhong
dde6d1f448
[doc] Add data quality to sidebar and correct docker resource path (#9662) 2022-04-22 14:45:07 +08:00
zixi0825
337696e258
[Docs][DataQuality]: Add DataQuality Docs (#9512) 
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
 2022-04-21 14:54:38 +08:00
wangyang
6155dc3dab
[Docs] enhance alert doc (#9534) 
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
 2022-04-20 13:02:28 +08:00
mans2singh
930d12031a
[task-flink][docs] Corrected name (#9600) 2022-04-20 09:26:42 +08:00
Jiajie Zhong
000e96baec
[doc] Fix dead link after 3.0.0 release (#9562) 2022-04-18 18:30:34 +08:00
Jiajie Zhong
5529a23e5c
[doc] Add new release for 3.0.0-alpha (#9519) 2022-04-18 16:07:43 +08:00
caishunfeng
7b907b854d
[Improvement][doc] update time zone doc (#9503) 
* update time zone doc

* update time zone doc

* update time zone doc
 2022-04-14 21:32:00 +08:00
Tq
df791a374e
[FIX][WEBSITE-9224]fix wechat doc and wechat form display (#9439) 
Co-authored-by: Jiajie Zhong <zhongjiajie955@hotmail.com>
 2022-04-13 23:35:05 +08:00
Eric Gao
eb21b6cc52
[Feature][Doc] Switch shell task instruction screenshots to latest (#9434) 2022-04-13 14:13:42 +08:00
Jiajie Zhong
51c1d8f2aa
[doc] Migrate develop docs from website (#9457) 
* [doc] Migrate develop docs from website

developer should also into main repo, because
development setup should follow with the latest
code

* Add missing change from website
 2022-04-12 17:23:56 +08:00
Lyle Shaw
9d7223b038
[doc] fix url wrong in zh doc (#9421) 
Co-authored-by: xiaoliangyu <xiaoliangyu@bytedance.com>
 2022-04-12 09:45:25 +08:00
Jiajie Zhong
62284ae689
[doc] Add some dev missing doc (#9427) 
* [doc] Add some dev missing doc

Including general-setting, task-definition, audit-log
and they related img

* Change base on suggestion

Co-authored-by: Tq <tianqitobethefirst@gmail.com>
 2022-04-11 21:46:40 +08:00
Jiajie Zhong
2c49c248f3
[doc] Remove observability (#9402) 
SkyWalking v9 is coming soon and there are without
DolphinScheduler menus anymore, So we should remove
the SW agent to avoid confusion.

close: #9242
 2022-04-08 15:52:57 +08:00
Eric Gao
d23616fcbc
[CI] Enable CI to remove unexpected files in /docs/img dir (#9393) 2022-04-08 13:46:35 +08:00
Jiajie Zhong
c828809b46
[doc] Change get help from dev mail list to slack (#9377) 
* Change all get help from dev mailing list to slack, because
  we find out mailing list have many users ask for subscribe
  and they maybe subscribe by accident.
* remove join dev mailing list in faq.md because we already
  have it in https://dolphinscheduler.apache.org/en-us/community/development/subscribe.html
 2022-04-08 10:56:35 +08:00
Jiajie Zhong
3457cee960
[python] Migrate pythonGatewayServer into api server (#9372) 
Currently the size of our distribute package is up to
800MB, this patch is migrate python gateway server into
api server

The distribute package size before and after this patch is:

```sh
# before
796M   apache-dolphinscheduler-2.0.4-SNAPSHOT-bin.tar.gz

# after
647M   apache-dolphinscheduler-2.0.4-SNAPSHOT-bin.tar.gz
```
 2022-04-07 14:41:15 +08:00
mans2singh
950f32e1d6
[task-spark][docs] Corrected notice section (#9375) 2022-04-07 14:03:21 +08:00
labbomb
ee0e3beb9d
[docs] Modifying site Configurations (#9341) 2022-04-03 21:48:22 +08:00
xiangzihao
3c5568c16c
[Doc] There are some version errors in the 2.0.1-release (#9335) 2022-04-03 12:55:25 +08:00
Jiajie Zhong
9f84dbbda0
[doc] Migrate dev doc from website repository (#9291) 
* [doc] Migrate dev doc from website repository

* Correct release language

* Fix license issue

* Add all images from website

* Delete unused images

* Add CI

* Fix ci

* fix ci

* Remove no need file

* Add latest commit from website

* correct img_utils.py script

* Remove unused imgs
 2022-04-02 10:43:34 +08:00
qiaozhanwei
96713ec0e3 remove docs (#1191) 
* add ConnectionFactoryTest and ConnectionFactory read datasource from appliction.yml

* .escheduler_env.sh to dolphinscheduler_env.sh

* dao yml assembly to conf directory

* table name modify

* entity title table  name modify

* logback log name modify

* running through the big process

* running through the big process error modify

* logback log name modify

* data_source.properties rename

* logback log name modify

* install.sh optimization

* install.sh optimization

* command count modify

* command state update

* countCommandState sql update

* countCommandState sql update

* remove application.yml file

* master.properties modify

* install.sh modify

* install.sh modify

* api server startup modify

* the current user quits and the session is completely emptied. bug fix

* remove pom package resources

* checkQueueNameExist method update

* checkQueueExist

* install.sh error output update

* signOut error update

* ProcessDao is null bug fix

* install.sh add mail.user

* request url variables replace

* process define import bug fix

* process define import export bug fix

* processdefine import export bug fix

* down log suffix format modify

* import export process define contains crontab error bug fix

* add Flink local mode

* ProcessDao is null bug fix

* loadAverage display problem bug fix

* MasterServer rename Server

* rollback .env

* rollback .env

* MasterServer rename Server

* the task is abnormal and task is running bug fix

* owners and administrators can delete

* dockerfile optimization

* dockerfile optimization

* dockerfile optimization

* remove application-alert.properties

* task log print worker log bug fix

* remove .escheduler_env.sh

* change dockerfile email address

* dockerfile dao application.properties and install.sh modify

* application.properties modify

* application.properties modify

* dockerfile startup.sh modify

* remove docs

* nginx conf modify

* dockerfile application.properties modify
 2019-11-09 12:06:26 +08:00
qiaozhanwei
d09a2d07c9 rename project and doc 2019-09-29 15:14:10 +08:00
0xflotus
0392dad785 (Docs): Fixed some typo errors (#811) 
* Update EasyScheduler Proposal.md

* Update frontend-deployment.md

* Update frontend-development.md

* Update 前端开发文档.md

* Update system-manual.md

* Update HttpClientTest.java

* Update 系统使用手册.md
 2019-09-19 11:36:11 +08:00
samz406
701495116f misspell words (#817) 2019-09-19 11:31:19 +08:00
qiaozhanwei
bbe7a256a8 scripts name standardization (#813) 
* service start exception modify

* master，worker start modify

* .env update

* install-escheduler-ui.sh,monitor_server.py and install.sh scripts comment change to english and install-escheduler-ui.sh use escheduler change to dolphinscheduler

* scripts name standardization
 2019-09-18 18:21:47 +08:00
fancyChuan
642f3093a4 update markdown docs which can not display images normally (#806) 2019-09-18 14:59:30 +08:00
bao liang
b99c7a66b3 update documents (#740) 
* update english documents

* refactor zk client

* update documents

* update zkclient

* update zkclient

* update documents

* add architecture-design

* change i18n

* update i18n

* update english documents

* add architecture-design

* update english documents

* update en-US documents

* add architecture-design

* update demo site
 2019-08-27 15:29:29 +08:00
easyscheduler
08ce9640c2
only write core dependency in Proposal doc (#710) 
* Update EasyScheduler Proposal.md

* update proposal

* only write core dependency
 2019-08-17 21:57:46 +08:00
easyscheduler
8d1e46ec43
use Jenkins (#706) 
* Update EasyScheduler Proposal.md

* update proposal
 2019-08-15 16:35:58 +08:00
吴晟 Wu Sheng
522f9efe69 Update EasyScheduler Proposal.md (#705) 2019-08-15 16:11:00 +08:00
easyscheduler
1b76bb019c
update proposal (#704) 
* Update EasyScheduler Proposal.md

* update proposal
 2019-08-15 14:59:02 +08:00
easyscheduler
5ed6ee0c2b
Update EasyScheduler Proposal.md 
fix mail style
 2019-08-13 19:32:10 +08:00
easyscheduler
875ac15bdd
Update EasyScheduler Proposal.md 
remove GVP description
 2019-08-13 16:36:33 +08:00
easyscheduler
d5a2a6414c
Update EasyScheduler Proposal.md 2019-08-13 16:32:17 +08:00
easyscheduler
7bdf414a56
Update EasyScheduler Proposal.md 2019-08-13 11:20:20 +08:00
Guo Wei (William)
a4860dbd5f
Update EasyScheduler Proposal.md 2019-08-12 22:07:29 +08:00
Guo Wei (William)
22c13bc404
Update EasyScheduler Proposal.md 2019-08-12 22:01:19 +08:00
easyscheduler
5d3e730afa
Update EasyScheduler Proposal.md 
add chinese docs address
 2019-08-12 17:40:05 +08:00
easyscheduler
6a8611605d
Update EasyScheduler Proposal.md 
add chinese doc address
 2019-08-12 15:16:19 +08:00
bao liang
002a120d44 refactor zk client (#687) 
* update english documents

* refactor zk client

* update documents

* update zkclient

* update zkclient

* update documents

* add architecture-design

* change i18n

* update i18n
 2019-08-12 14:46:59 +08:00
Guo Wei (William)
8cf5911fd6
EasyScheduler Proposal 
Draft of EasyScheduler Proposal, I give it a polish.
 2019-08-12 14:08:12 +08:00
bao liang
bc80ef5444 refactor zkClient; update documents (#683) 
* update english documents

* refactor zk client

* update documents

* update zkclient
 2019-08-08 19:42:50 +08:00
bao liang
7e8b5c693c
add en-us documents (#672) 
* add quick start document

* update test

* add backend deployment document

* add frontend deployment document

* add system manual

* Supplementary translation

Translated untranslated places

* 1.0.1-release.md

add 1.0.1-release document

* 1.0.2-release.md

add 1.0.2-release document

* 1.0.3-release.md

add 1.0.3-release document

* 1.1.0-release.md

add 1.1.0-release document

* EasyScheduler-FAQ.md

add FAQ document

* Backend development documentation.md

add backend development documentation

* Upgrade documentation.md

add Upgrade documentation

* Frontend development documentation.md

add frontend development documentation
 2019-08-06 11:14:27 +08:00
lenboo
4116f4def4 update 1.1.0 release note 2019-08-05 10:27:31 +08:00
lenboo
67b3b5ad0f update 1.1.0 release note. 2019-08-05 09:54:59 +08:00
lenboo
8b35dde214 Merge remote-tracking branch 'upstream/dev' into dev 
# Conflicts:
#	escheduler-common/src/main/java/cn/escheduler/common/zk/AbstractZKClient.java
#	escheduler-server/src/main/java/cn/escheduler/server/worker/runner/FetchTaskThread.java
 2019-07-31 20:08:08 +08:00
lenboo
73bb6d5f48 add readme.md 2019-07-25 18:10:46 +08:00
lenboo
f57961472c fix bug: close zk links . 2019-07-25 14:49:01 +08:00
lenboo
a259753bfd update documents. 2019-07-23 19:22:31 +08:00
easyscheduler
81d57c5f3b
Update 1.1.0-release.md 2019-07-18 17:39:43 +08:00
lenboo
99e586260e Merge remote-tracking branch 'upstream/branch-1.0.2' into dev-up 
# Conflicts:
#	docs/zh_CN/1.0.4-release.md
#	docs/zh_CN/SUMMARY.md
#	escheduler-alert/pom.xml
#	escheduler-api/pom.xml
#	escheduler-common/pom.xml
#	escheduler-dao/pom.xml
#	escheduler-rpc/pom.xml
#	escheduler-server/pom.xml
#	pom.xml
 2019-07-18 16:26:27 +08:00
lenboo
892901e3a9 update documents 2019-07-18 16:07:57 +08:00
lenboo
7cdca7bf74 merge from upstream 2019-07-18 16:04:15 +08:00
easyscheduler
e768539543
Update 1.1.0-release.md 2019-07-16 17:12:13 +08:00
lidongdai
c2e6352e80 merge from 1.1.0 upstream 2019-07-16 16:21:12 +08:00
lidongdai
a62ba2b457 update docs 2019-07-16 14:31:08 +08:00
qiaozhanwei
bd2a35ab45 update doc 2019-07-16 14:22:24 +08:00
lenboo
a386de8f1b Merge remote-tracking branch 'upstream/dev-1.1.0' into dev-1.1.0 2019-07-16 13:53:02 +08:00
lenboo
6ad22dab53 update 1.1.0 documents 2019-07-16 11:36:36 +08:00
qiaozhanwei
8c13e7a7f2 sql kerberos task update doc 2019-07-16 11:07:32 +08:00
lenboo
98252e990d add 1.1.0 documents 2019-07-15 18:51:07 +08:00
qiaozhanwei
1f9719578e sql task add kerberos doc update 2019-07-15 18:09:39 +08:00
lidongdai
c3a0dcc4a8 update api i18n and docs 2019-07-04 15:44:17 +08:00