Commit Graph

7005 Commits

Author SHA1 Message Date
Eric Gao
6a02870926
[Feature][style] Add spotless maven plugin for automatic style fix. (#11272)
* [Feature][style] Add spotless maven plugin for automatic style fix (#10963)

* Fix spotless ratchet configuration

* Remove license-check and decrease line length threshold value

* Update related docs

* Remove checkstyle and add pre-commit hook

* Test updated pre-commit hook

* Replace checkstyle with spotless in CI

* Remove reviewdog
2022-08-06 19:29:23 +08:00
Jiajie Zhong
bf5f7a88c5
[doc] migrate community and development docs into main repo (#11313) 2022-08-05 17:58:39 +08:00
Amy0104
348edb16f9
[Fix][UI] Fix the taskPriority options not showing when hover. (#11294) 2022-08-05 17:45:07 +08:00
fuchanghai
8ded072f79
[Improvement-11293][dolphinscheduler-api] remove some variables that redundant in subclasses of AbstractAuthenticator (#11305)
* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors

* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors

* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors

* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors

* [fix-10729]fix the code smell

* [fix-10729]decorate DataSourceControllerTest with public

* [fix-10729]replace import *

* [fix-10729]

* [fix-10729]

* [fix-10729]

* [fix-10729]checkstyle

* [Improvement][ExecutorServiceImpl] remove some unnecessary

* [fix-11181]text check and word spell

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>

* Update ExecutorServiceImpl.java

remove the error logging and update the comment

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>

* [Improvement-10760][dolphinscheduler-api] Some variables are redundant

* [Improvement-10760][dolphinscheduler-api] Some variables are redundant and fix checkstyle

* [Improvement-10760][dolphinscheduler-api] Some variables are redundant and fix checkstyle

* [Improvement-10760][dolphinscheduler-api] add import

* [Improvement-10760][dolphinscheduler-api] remove not use

* [Improvement-11293][dolphinscheduler-api] remove some variables that redundant in subclasses of AbstractAuthenticator

* [Improvement-11293][dolphinscheduler-api] remove some variables that redundant in subclasses of AbstractAuthenticator

Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-08-05 14:11:12 +08:00
JiPeng Wang
c9cf8c7774
no-admin user query alert group fix (#11301) 2022-08-04 23:01:15 +08:00
zhuxt2015
c34503e3f6
[fix] Process definition length too long when copy or import (#10621) 2022-08-04 15:04:14 +08:00
Wenjun Ruan
acd3d3fab1
Fix TaskGroup cannot work and will cause master dead loop (#11254)
* Fix TaskGroup cannot work and will cause master dead loop

* Remove acquireTaskGroupAgain in ProcessServiceImpl
2022-08-04 14:43:45 +08:00
陈家名
aef2fbf36c
[Python] Migrate exists method call in PythonGateway to corresponding service (#11188)
Migrate all exists method call in PythonGateway to corresponding service
2022-08-04 12:50:21 +08:00
rickchengx
39186b1a6d
[Doc] update the configuration doc (#11113) 2022-08-04 11:55:05 +08:00
Jiajie Zhong
dc3ab6af11
[doc] Add notice when environment can not select (#11276)
ref: #11249

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-08-04 11:08:11 +08:00
秋天
2adfc52e55
[fix-11233][ui] Remove custom template switch button in chunjun component module (#11234)
- delete obsolete switch button

This closes #11233
2022-08-03 16:44:01 +08:00
Eric Gao
9ca1eb96c4
[Improvement][Metrics] Add metrics for alert server (#11240)
* [Improvement][Metrics] Add metrics for alert server (#11131)

* Update related docs of metrics

* Add grafana demo dashboards for alert server metrics

* Refactor metric classes with UtilityClass annotation

* Refactor meter names in camelCase for checkstyle
2022-08-03 15:42:06 +08:00
Amy0104
adfec41986
[Improvement][UI] Improve monaco-editor component in ts. (#11274) 2022-08-03 15:17:56 +08:00
Devosend
9ba9a0ff82
[Fix][UI] fix bug where log modal display object (#11271) 2022-08-03 13:54:32 +08:00
Devosend
78e9122573
fix bug where confirm disable error (#11251) 2022-08-02 17:38:05 +08:00
rickchengx
d9516e2236
add lombok config (#11212)
Co-authored-by: rick <rick@B-V6XRMD6M-1956.local>
2022-08-02 11:46:58 +08:00
Wenjun Ruan
04f3aa9713
Fix recovery from failed task will dead loop (#11239) 2022-08-02 09:30:18 +08:00
Wenjun Ruan
caa6287d7f
Add alertPluginInstanceId in AlertInfo (#11231) 2022-08-01 17:32:26 +08:00
microeastcowboy
9a53c6ac34
fix work oom when task logs's size is very large (#11224) 2022-08-01 15:28:06 +08:00
Amy0104
0141aa511b
[Fix][UI] Fix datax task data instance replay error. (#11222) 2022-08-01 14:56:19 +08:00
Wenjun Ruan
8e21c38c00
Write alert result into db (#11221) 2022-08-01 13:04:27 +08:00
阿福Chris
01fc6c8a3a
[doc] Fix installation typo (#11220)
Co-authored-by: xiangzihao <460888207@qq.com>
2022-08-01 10:03:53 +08:00
fuchanghai
cb001b581a
[Improvement-10760][dolphinscheduler-api] Some variables are redundant and fix checkstyle (#11213)
* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors

* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors

* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors

* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors

* [fix-10729]fix the code smell

* [fix-10729]decorate DataSourceControllerTest with public

* [fix-10729]replace import *

* [fix-10729]checkstyle

* [Improvement][ExecutorServiceImpl] remove some unnecessary

* [fix-11181]text check and word spell

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>

* Update ExecutorServiceImpl.java

remove the error logging and update the comment

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ExecutorServiceImpl.java

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>

* [Improvement-10760][dolphinscheduler-api] Some variables are redundant

* [Improvement-10760][dolphinscheduler-api] Some variables are redundant and fix checkstyle

* [Improvement-10760][dolphinscheduler-api] Some variables are redundant and fix checkstyle

* [Improvement-10760][dolphinscheduler-api] add import

* [Improvement-10760][dolphinscheduler-api] remove not use

Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-08-01 09:24:02 +08:00
songjianet
163df5f1a3
[Refactor][UI] Refactor task group option using NSpace component. (#11209) 2022-07-31 14:54:18 +08:00
JinYong Li
e5cca0e79b
[Fix-11007] [Master] fix forced_success bug (#11088)
* fix forced_success bug

* add comments

* add transactional

* refactor code

Co-authored-by: JinyLeeChina <jiny.li@foxmail.com>
2022-07-30 23:28:31 +08:00
xuhhui
bfff3a7c5d
fix error (#11206) 2022-07-30 18:20:20 +08:00
fuchanghai
d73ad2e7d5
[BUG-11181] [Document] text check (#11183) 2022-07-29 23:49:46 +08:00
Chris Ho
d85ea8f62f
[Improvement][UI] Unified local parameters UI (#11190) 2022-07-29 17:49:33 +08:00
Devosend
91a944f967
fix nodeSize is not a function bug (#11200) 2022-07-29 17:39:45 +08:00
Jiajie Zhong
93a73b1292
[ci] Make cluster test work on release branch (#11199)
When I try to release the 3.0.0 on branch `3.0.0-prepare`,
I find out cluster-test error due to version change of
tarball, I think we should make cluster test work on both
dev and prepare release branch, so I add this patch
2022-07-29 14:49:00 +08:00
Eric Gao
4b43d62356
[Improvement][Metrics] Upgrade plugin versions in grafana demo dashboards (#11192) (#11193) 2022-07-29 07:04:04 +08:00
Jiajie Zhong
9e692f919a
[python] Add directly install without clone source code (#11179)
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2022-07-28 21:40:20 +08:00
xuhhui
513f336015
[Feature] Add new task type chunjun (#10937) 2022-07-28 19:25:29 +08:00
Jiajie Zhong
7a766cbcf2
[python] Refactor structure to avoid cycle import (#11167)
Currently, our core and side module dependent on each others. and will cause
cycle import in our codebase, especially in issue #10905, we try to refactor
to solve this problem.

This patch do the following change:

* Rename module `side` to `models`
* Move `core/base` and `core/sidebase` to dir `modules`
* Move `configuration` and `default_config.yaml` to the root of pydolphinscheduler
2022-07-28 19:02:13 +08:00
Tq
9859b5da1f
add Feishu alert doc and configure email alert doc to the docsdev.js (#11173)
add Feishu alert doc and configure email alert doc to the docsdev.js
2022-07-28 17:21:32 +08:00
caishunfeng
818648df7d
[Bug-11071] fix local params (#11184)
* fix local params

* add CI case
2022-07-28 15:07:04 +08:00
pinkhello
2e81f30298
[Fix] Parameter values disappear when editing Zeppelin task (#11115) 2022-07-28 15:03:26 +08:00
JiPeng Wang
cd0c50f3f2
[Fix-11140] Added resource parameters for function verification (#11141)
* Added resource parameters for function verification

* checkstyle fixed

* checkstyle fixed

* check style fixed for env test

* rerun

* rerun
2022-07-28 14:03:12 +08:00
Wenjun Ruan
052ceaacd0
Add is success in loop task status (#11169) 2022-07-28 12:12:01 +08:00
fuchanghai
81fa09678c
[Improvement][ExecutorServiceImpl] remove some unnecessary (#11122) 2022-07-28 09:57:19 +08:00
SongTao Zhuang
a52d1b4acd
[11130] Refactor alert-api with lombok (#11133) 2022-07-28 08:31:44 +08:00
Sheldon
efd68f4805
[Fix-10665] [S3] Fix s3 download method (#10675)
when overwrite param is true and dest file is exist, throw exception
make dirs for ancestor directories of the source file path if it is not exists
To describe the error more clearly, change "the file isn`t exists" to specific error message

Co-authored-by: sheldonliu <sheldonliu>
2022-07-27 21:25:13 +08:00
caishunfeng
6c7e00c4aa
[Bug-11101] fix task failover NPE (#11168) 2022-07-27 19:21:21 +08:00
Lyle Shaw
181cd2ff79
[Feature] Add CURD to the project/tenant/user section of the API and add its tests. (#10913) 2022-07-27 14:33:33 +08:00
zhuxt2015
cc2f17ddcc
[Enhancement][API] Copy workflow with scheduler info (#10677)
* support batch copy workflow with scheduler
2022-07-27 13:45:45 +08:00
Jiajie Zhong
de5c22b276
[doc] Add new page incompatible change (#11153)
Add incompatibles and give some hint to user when then
want to upgrade to specific version.

ref: #10607
2022-07-27 11:15:09 +08:00
caishunfeng
b03f2e22cd
fix k8s master and worker start error (#11156) 2022-07-27 09:23:17 +08:00
xuhhui
8b50578bdb
[doc] Fix bugs in doc installation, design and glossary (#11084) 2022-07-26 18:08:19 +08:00
Assert
cdfe115247
[Feature-10837][Task Plugin] Sqoop Task Add --split-by Parameter (#10960)
* [Feature-10837][Task Plugin] Sqoop Task Add --split-by Parameter

* checkstyle
2022-07-26 17:41:13 +08:00
xuhhui
8004e97b4b
[Feature][Api] Refactor org.apache.dolphinscheduler.api.controller.ProjectController (#10832)
* [Feature][Api] Refactor org.apache.dolphinscheduler.api.controller.ProjectController
2022-07-26 15:24:48 +08:00