Commit Graph

6952 Commits

Author SHA1 Message Date
Eric Gao
0e15ce3389
[Improvement][Metrics] Switch to use tags to indicate task / workflow execution status for metrics (#11128)
* [Improvement][Metrics] Switch to use tags to indicate task / workflow execution status for metrics (#10867)

* Update docs and grafana demo dashboards
2022-07-26 13:44:02 +08:00
Devosend
d76d6da734
[Fix][UI] Add duplicate of file suffix (#11136) 2022-07-26 11:25:33 +08:00
zhuxt2015
4d9db3451e
[Bug] [API] If the single log length is long, it will causes the View Log page to hang (#10612) 2022-07-26 10:14:45 +08:00
songjianet
fbfaca3dbd
[Refactor][UI] Refactor resource manage using NSpace component. (#11098)
* [Refactor][UI] Refactor resource manage using NSpace component.

* [Refactor][UI] Refactor resource manage using NSpace component.
2022-07-26 10:07:00 +08:00
liyangyang
6f0a609793
[Improvement 11072][common] Added HTTPS request support in kerberos environment (#11127)
* [Improvement-11072][dolphinscheduler-common] Added HTTPS request support in kerberos environment

* [Improvement-11072][dolphinscheduler-common] supplement

Co-authored-by: liyangyang <liyangyang@bizseer.com>
2022-07-25 23:21:42 +08:00
songjianet
7ed1e7cd74
[Refactor][UI] Refactor function manage using NSpace component. (#11124) 2022-07-25 22:22:04 +08:00
Devosend
011040f90e
[Fix][UI] fix bug where The Gantt chart does not show the execution status (#11135)
* fix bug where The Gantt chart does not show the execution status of all components

* modify round method
2022-07-25 15:53:57 +08:00
JieguangZhou
764a24384f
[python] add import SageMaker task (#11121) 2022-07-25 15:46:36 +08:00
liyangyang
f13e7a95ae
[Improvement-11013][dolphinscheduler-common] YarnHAAdminUtils#getActiveRMName function Add HTTPS Hadoop environment support (#11017)
* [Improvement-11013][dolphinscheduler-common] YarnHAAdminUtils#getActiveRMName function Add HTTPS Hadoop environment support

* [Improvement-11013][dolphinscheduler-common] add test code

* [Improvement-11013][dolphinscheduler-common] code format

* [Improvement-11013][dolphinscheduler-common] add hadooputils test code

* [Improvement-11013][dolphinscheduler-common] remove extra blank lines

* [Improvement-11013][dolphinscheduler-common] adjusts test code

* [Improvement-11013][dolphinscheduler-common] remove useless import

* [Improvement-11013][dolphinscheduler-common] add test code

* [Improvement-11013][dolphinscheduler-common] shortened string

* [Improvement-11013][dolphinscheduler-common]  format test code style

Co-authored-by: liyangyang <liyangyang@bizseer.com>
2022-07-25 11:07:40 +08:00
jackfanwan
ccb7641468
修改数据质量查询的权限判断 (#10977)
Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2022-07-25 09:35:53 +08:00
Wenjun Ruan
71cf7e1baa
[Fix-10918] Close datasource when expire from guava cache (#11120)
* Close datasource when expire from guava cache
* Remove duplicate datasource in HiveDataSourceClient
2022-07-23 20:43:37 +08:00
JieguangZhou
952aee80e7
[fix] py sagemaker doc (#11109) 2022-07-22 22:57:50 +08:00
Devosend
2f2de7f90e
fix space validate for create folder bug (#11106) 2022-07-22 17:08:12 +08:00
zhuxt2015
3701a24d15
[Improvement][Task Log] Task status log print description instead of code (#11009)
* use execution status instead of status code
2022-07-22 13:34:31 +08:00
songjianet
de6e58ec1b
[Fix][UI] Fix the problem of too large spacing in operation. (#11090)
* [Fix][UI] Fix the problem of too large spacing in operation.

* [Fix][UI] Fix the problem of too large spacing in operation.
2022-07-22 11:52:41 +08:00
Devosend
7227acd653
fix view variable display bug (#11100) 2022-07-22 11:52:25 +08:00
Amy0104
79cec27423
[Fix][UI] Widen the segment separator input box. (#11096) 2022-07-22 11:02:25 +08:00
JieguangZhou
cc088e0f54
[python] Support SageMaker task type (#11002) 2022-07-22 10:47:08 +08:00
xiangzihao
5b429d29b8
add oracle dependency (#11095) 2022-07-22 09:49:20 +08:00
xiangzihao
c34fe4f9b3
Try to fix filemanage e2e flaky test (#11097) 2022-07-22 05:51:26 +08:00
songjianet
445e830a84
[Refactor][UI] Refactor file manage using NSpace component. (#11073) 2022-07-21 21:19:23 +08:00
JieguangZhou
af7b359333
[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario (#10826) (#10935)
* add sagemaker pipeline task plugin

[DOC] add Sagemaker task plugin document

change license and fix dependencies

* [fix] Optimize the code

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java

Optimization parameter judgment

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* [fix] nips

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-07-21 18:16:58 +08:00
Devosend
594f00512b
[Refactor][UI] Refactor time display use datatable render function (#11078) 2022-07-21 15:57:08 +08:00
xiangzihao
72d29971bf
[E2E] [CI] Fix flaky e2e test (#11077)
* fix flaky e2e test

* fix flaky e2e test

* fix flaky e2e test
2022-07-21 15:43:24 +08:00
songjianet
25ded1e81b
[Refactor][UI] Refactor rule manage using NSpace component. (#11069) 2022-07-20 19:39:00 +08:00
旺阳
28b40da1b1
[Improve] Hide Change Pwd Page When Login With LDAP (#11041)
* hide-change-pwd-page-when-ldap-login

* add unit test
2022-07-20 18:48:16 +08:00
WangJPLeo
fd59f0bb32
[Fix-11031] AccessToken can only be used by the creator. (#11032)
* AccessToken can only be used by the creator.

* supplement ut

* checkstyle fix
2022-07-20 16:32:03 +08:00
fuchanghai
1a08f3970d
[fix-10729]The request's url given by the test case looks different f… (#10734)
* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors
2022-07-20 15:42:45 +08:00
Eric Gao
f689220290
[Feature][Task Plugin] Increase zeppelin task stability in production (#11010)
* [Feature][Task Plugin] Increase zeppelin task stability in production (#10584)

* Add front-end and update docs for the production mode of zeppelin task

* Fix minor front-end bug of zeppelin task plugin

* Refactor ZeppelinParameters with lombok

* Fix formatting

* Replace @Data with @Getter, @Setter, @ToString to avoid decrease in test coverage
2022-07-20 14:16:47 +08:00
xuhhui
35f32cd16e
[Improvement][Task]Improve seatunnel task command log (#11027) 2022-07-20 11:06:10 +08:00
Eric Gao
2f0d907bcb
[Improvement][Task Plugin]Refactor JupyterParameters.java with lombok (#11045)
* [Improvement][Task Plugin]Refactor JupyterParameters.java with lombok (#11040)
2022-07-20 11:02:47 +08:00
Wenjun Ruan
5e9c7dad23
Add dolphinscheduler-bom to manage the dependency version (#11025) 2022-07-20 10:37:31 +08:00
caishunfeng
65d2b8f14e
[Bug] fix task params pass (#11053) 2022-07-20 10:14:51 +08:00
songjianet
878cbbc159
[Refactor][UI] Refactor task result using NSpace component. (#11054) 2022-07-19 23:04:54 +08:00
Mr.An
d7df899909
[Fix-11003]Task group queue is not updated to final state (#11004)
* fix after the task group is forced to start the task. Task group status has not changed
2022-07-19 17:48:16 +08:00
Eric Gao
a5b3144e53
Add EricGao888 to help review docs, tools, etc. (#11047) 2022-07-19 17:08:53 +08:00
songjianet
ff34393333
[Feat][UI] Added LDAP function. (#11029) 2022-07-18 22:12:45 +08:00
songjianet
6bf80f7a06
[Refactor][UI] Refactor datasource using NSpace component. (#11022)
* [Refactor][UI] Refactor datasource using NSpace component.

* [Refactor][UI] Refactor datasource using NSpace component.
2022-07-18 13:19:41 +08:00
Jiajie Zhong
502fbb0f1c
impv: not mark issue stale with security label (#10982) 2022-07-18 12:00:20 +08:00
zhuxt2015
a74d7ef665
[hotfix][Worker] Remove service dependency from worker module (#11008)
* worker remove service dependency
2022-07-17 22:16:35 +08:00
Wenjun Ruan
e1c78d1a49
Move utils, builder under master (#11000) 2022-07-16 23:18:00 +08:00
Wenjun Ruan
083ab2b5c9
Remove dao in worker (#10994) 2022-07-15 20:07:18 +08:00
Wenjun Ruan
2be1d4bf0a
Fix worker cannot shutdown due to resource close failed or heart beat check failed (#10979)
* Use try-with-resource to close resource, and add heart error threshold to avoid worker cannot close due to heart beat check failed

* Move heartbeat error threshold to applicaiton.yml
2022-07-15 20:06:53 +08:00
SongTao Zhuang
dad8981cfe
fix: typo executor service (#10980) 2022-07-15 18:58:39 +08:00
Wenjun Ruan
998e4d74dd
Kill task when we do master failover to avoid task lost (#10997) 2022-07-15 18:44:42 +08:00
labbomb
d41dac0602
feat: Add trim method to all input (#10984) 2022-07-15 17:14:47 +08:00
JieguangZhou
11a354927d
[fix] [MLflow Task plugin] Sometimes errors are reported using preset algorithms (#10986) (#10987)
* Optimize the download method of preset project

* fix checkstyle
2022-07-15 15:38:13 +08:00
songjianet
fd5fb85858
[Refactor][UI] Refactor audio log using NSpace component. (#10991) 2022-07-15 15:10:48 +08:00
zhuxt2015
7196b125d9
[Feature][Datax Task]Datax task plugin support custom parameters (#10950)
* datax task plugin support custom parameters
2022-07-15 09:27:23 +08:00
Eric Gao
a38fa34d43
[Feature][Task Plugin] Enable users to switch endpoints in zeppelin tasks (#10925)
* [Feature][Task Plugin] Enable users to switch endpoints in zeppelin tasks (#9814)
2022-07-15 09:26:28 +08:00