Commit Graph

6743 Commits

Author SHA1 Message Date
songjianet
c07339b07d
[Fix][UI] Limit task group resource capacity to only positive integers. (#10158) 2022-05-20 15:19:43 +08:00
Amy0104
3dd007ca59
[Fix][UI] Add the task status of pending. (#10129) 2022-05-20 10:06:43 +08:00
Jiajie Zhong
bf4b8ff0d9
[python] Change distribute name avoid confusion with main pkg (#10134)
rename them and add `python` suffix in the end
close: #9121
2022-05-19 20:27:38 +08:00
xiangzihao
8fab224e0d
add_alert_server_cluster_test (#10125) 2022-05-19 18:14:11 +08:00
Jiajie Zhong
94c515555e
[doc] Remove flink call docs (#10122)
Flink call docs is only teld users
how to use flink task in dolphinscheduler
and it should be including in task/flink
2022-05-19 16:41:33 +08:00
Jiajie Zhong
2eff5ee10c
[doc] change document structure (#10124)
This patch change the structure and make it more sense

* Remove dev doc in tab Docs, and for now you could only see it in
  history-version page
* Move PyDolphinScheduler from tab DOCS to sidebar and combine with open
  API
* Move installation after Functions
* Move data quality after HOW-TOS
2022-05-19 16:30:53 +08:00
Mr.An
73f13a9c9c
[doc] Show all the functions of the home page through screenshots (#10118) 2022-05-19 14:45:44 +08:00
QuakeWang
243ee8ba70
[Bug][doc] Fix the open-api docs request error (#10100) 2022-05-19 11:28:33 +08:00
旺阳
fa2f20577a
Fix unit test and remove unused import (#10113) 2022-05-19 11:25:12 +08:00
旺阳
844ae42ee4
Fix alert server curator health check not work (#10111) 2022-05-19 10:51:37 +08:00
JieguangZhou
9ab3bebc90
[Feature][Task Plugin] Add mlflow task plugin for MLops scenario. (#10036)
* [Feature][Task Plugin] Add mlflow task plugin (#9725)

* [Feature][Task Plugin] Add mlflow task plugin UI (#9725)

* [Feature][Task Plugin] fix license header (#9725)

* [Feature][Task Plugin] fix license header (#9725)

* [Feature][Task Plugin] revert unnecessary

* [Feature][Task Plugin] add auto ml to mlflow task plugin

* [DOC] add mlflow document

* [DOC] fix mlflow docs imgs

* [DOC] fix dead link localhost:5000

* [DOC] fix dead link localhost:5000

* [DOC] remove dead link localhost:5000

* Update docs/docs/en/guide/task/mlflow.md

* Update docs/docs/zh/guide/task/mlflow.md

* [DOC] format ui code

* [DOC] remove dead link localhost:5000

* [Feature][Task Plugin] revert unnecessary

* fix some nits

* Move the personal repository to the public repository.

* Run the command directly instead of saving the file

* fix paramsMap initialize

* revert unnecessary

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-19 09:40:31 +08:00
songjianet
bc71c3b0a0
[Build][UI] Solve vite config throws terser warning. (#10105) 2022-05-18 22:12:52 +08:00
BaoLiang
ee2b855ced
[BUG][TaskGroup] Task group does not take effect (#10093)
* fix 10092: Task group does not take effect

* fix 10092: Task group does not take effect

* fix 10092: Task group does not take effect
2022-05-18 18:40:36 +08:00
Jiajie Zhong
63f835715f
[fix] Enhance name pre checker in resource center (#10094)
* [fix] Enhance name pre checker in resource center

Add file name and directory checker to avoid directory traversal

* add some missing change and change docs

* change var name in directoryTraversal

* Fix ci
2022-05-18 18:40:17 +08:00
rockfang
7a4a21d0b1
[Fix][UI] fulfill missing fields in DataQuality (#10098) 2022-05-18 18:28:24 +08:00
He Zhao
5bb1eb04fc
[Feature][plugin] Add k8s task in task plugin (#9425)
* [Feature][plugin] Add k8s task in task plugin

* [Feature][plugin] fix dos and code problems

* [Feature][plugin] refactor some code based on sonar

* [Feature][UI] front-end for k8s task plugin

* [Feature][plugin] delete some front files

* [Feature][plugin] update document

* Update docs/docs/zh/guide/task/k8s.md

* Update docs/docs/en/guide/task/k8s.md

* Update docs/docs/en/guide/task/k8s.md

* Update docs/docs/en/guide/task/k8s.md

* [Feature][UI] front-end change from review comments

* [Feature][UI] replace get namespace list api

* [Feature][plugin] change file name

* Add kubernetes to zh task list

Co-authored-by: hezhao2 <hezhao2@cisco.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-18 17:23:42 +08:00
旺阳
cab46e6be5
[Fix-10083][Doc]Change Docker cmd && Change WebexTeams Chinese Translation (#10084)
* Change Docker cmd && Change WebexTeams Chinese Translation

* run ci

Co-authored-by: qingwli <qingwli@cisco.com>
2022-05-18 13:53:44 +08:00
QuakeWang
3bca240446
fix issue-10061 (#10062) 2022-05-18 12:21:35 +08:00
Devosend
91f1d45948
[Feat][UI] Add resource username for function and resource manage (#10086) 2022-05-18 12:00:51 +08:00
xiangzihao
225cb332d1
[Fix-10049] Conditions Task branch flow failed (#10077) 2022-05-18 11:40:32 +08:00
hstdream
701b535ae6
[Fix-10082]Resource userName is null and udf function manager add a username (#10064)
* Resource userName is null

* [Fix-10082]Resource userName is null and udf function manager add a username

* [Fix-10082]Resource userName is null and udf function manager add a username

* [Fix-10082]Resource userName is null and udf function manager add a username

Co-authored-by: houshitao <shitaohou@163.com>
2022-05-18 11:33:08 +08:00
旺阳
537c206c2d
[Fix][Docker] Support Multi-Architecture Docker Images (#10052)
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2022-05-18 10:20:24 +08:00
hstdream
cd70ad584a
Create process definition with task group and task group priority cannot be save into db (#10078)
Co-authored-by: houshitao <shitaohou@163.com>
2022-05-18 09:41:03 +08:00
hstdream
67cf7b2800
[Fix-10080]When the created tenant name is too long, an error message will be prompted (#10081)
* [Fix-10080]When the created tenant name is too long, an error message will be prompted

* [Fix-10080]When the created tenant name is too long, an error message will be prompted

* [Fix-10080]When the created tenant name is too long, an error message will be prompted

Co-authored-by: houshitao <shitaohou@163.com>
2022-05-18 01:36:40 +08:00
caishunfeng
0cc0ee77fa
[Bug][Master] fix master task failover (#10065)
* fix master task failover

* ui
2022-05-17 16:36:24 +08:00
Devosend
c16424027e
[Fix][UI] Fix bug where username is empty in file manage (#10070) 2022-05-17 15:17:46 +08:00
songjianet
359300380b
[Fix][UI] Fix in the Chinese state, there is a problem with the multi-language support of the form. (#10066) 2022-05-17 14:57:04 +08:00
xiangzihao
718e786c24
Fix flaky filemanage_e2e_test (#10068) 2022-05-17 14:51:43 +08:00
songjianet
514d26e03f
Revert "[Fix][UI] Fix in the Chinese state, there is a problem with the multi-language support of the form. (#10056)" (#10060)
This reverts commit d8b56b8e9b.
2022-05-17 14:04:55 +08:00
songjianet
d8b56b8e9b
[Fix][UI] Fix in the Chinese state, there is a problem with the multi-language support of the form. (#10056) 2022-05-17 11:32:41 +08:00
labbomb
a088ca1048
[Fix][UI]Modify error message (#10054) 2022-05-17 11:11:56 +08:00
陈家名
a2cd2a99e6
[python] Fix pre_submit_check error when local params in tasks (#10032) 2022-05-16 19:51:41 +08:00
caishunfeng
b1885c7a26
[Bug] fix run on docker and k8s (#10026)
* fix docker-compose init schema

* recovery depend on zk

* update doc and dockerfile

* fix run on k8s

* udpate doc

* add DOCKER flag & update doc

* remove repeat DOCKER env
2022-05-16 15:41:45 +08:00
Dannila
d643e1c1cf
[Fix-10039] Flink run command when perfecting Python jobs (#10042)
* [fix] flink task

* [fix] flink task
2022-05-16 15:06:21 +08:00
Jiajie Zhong
3e471f8b4c
[feat] Add batch rerun and stop for process instance (#10013)
* [feat] Add batch rerun and stop for process instance

* fix execute type pass

* error message changed

* correct error message

* add note to i18n ignore

* enhance the note of process instance ids
2022-05-16 11:01:32 +08:00
chuxing
f666c64946
[doc] Correct docs of development-environment-setup (#9995) 2022-05-16 09:53:45 +08:00
zixi0825
359cbe2a1e
[dataquality] Fix task commnd null bug (#9974) 2022-05-15 17:46:31 +08:00
xiangzihao
2423fa50f7
[Feature-10034][CI] Add postgresql cluster test in CI (#10035)
* add postgresql cluster test

* add postgresql cluster test

* add postgresql cluster test

* add postgresql cluster test
2022-05-15 13:04:48 +08:00
chuxing
df04c4aef0
[fix-9991][worker]fix statement is closed before resultSet.getMetaData() (#10014) 2022-05-15 10:24:31 +08:00
xiangzihao
baf654cb47
[Feature-9474] [CI] Add cluster test script verify on shell script (#9997)
* cluster test

* fix init db failed

* fix init db failed

* fix init db failed

* fix init db failed

* fix init db failed

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add sudo

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* add github actions

* remove cluster-test workflows

* add github actions

* add github actions

* refactor test to docker mode

* refactor test to docker mode

* refactor test to docker mode

* refactor test to docker mode

* remove create schema logic

* remove create schema logic

* remove create schema logic

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* fix runnint cluster test error

* add github actions

* add github actions

* add github actions

* add cluster test timeout

* add cluster start test loop check

* add cluster start test loop check

* optimize cluster start test loop check
2022-05-14 12:30:57 +08:00
旺阳
ee2c516813
[doc] Correct kubernetes (#9985)
Co-authored-by: qingwli <qingwli@cisco.com>
2022-05-13 10:39:05 +08:00
rockfang
d17379da1f
[Fix][UI] Fix errorOutputPath column in dataquality page (#10015) 2022-05-13 10:16:54 +08:00
Eric Gao
80369363c9
[feat][task plugin] Add Jupyter task plugin (#9872)
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
2022-05-12 19:55:49 +08:00
QuakeWang
0fe75482a2
[doc] Add example and notice about task type Dependent (#10001)
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-05-12 18:23:43 +08:00
Amy0104
18bfe6399d
[Fix][UI] Support only one file upload on the file manage page. (#10007) 2022-05-12 16:54:03 +08:00
WangJPLeo
dbdbfeaeee
[Fix-9975] The selected task instance was recreated when the Master service fail… (#9976)
* The selected task instance was recreated when the Master service failed over.

* Returns the expression result directly.

* Use Recovery to determine whether to use the old task instance.
2022-05-12 16:31:53 +08:00
Amy0104
00f102959b
[Fix][UI] Fix the task name validator error. (#10008) 2022-05-12 15:27:55 +08:00
Kerwin
bce5a28440
[doc] Add the description about execute type in SQL task (#9987) 2022-05-12 14:42:39 +08:00
rockfang
53cd7009de
[Fix-10002] Fix some bugs in datasource list (#10005)
* fix: fix ellipsis bug in table column

* fix ellipsis bug in table column

* fix: json-highlight component support nested jsonstring

* fix: make datasource description show
2022-05-12 14:11:52 +08:00
Jiajie Zhong
8d17fd20f9
[ci] Dead link check all markdown file (#10004)
there are 162 markdown files in dir `docs`
and all file in project is 175 files, so I
think check all file will not add too much
load for our ci, but it could discovered
the dead link in time to avoid some thing
like #9998
2022-05-12 11:30:01 +08:00