Commit Graph

7294 Commits

Author SHA1 Message Date
liyangyang
f13e7a95ae
[Improvement-11013][dolphinscheduler-common] YarnHAAdminUtils#getActiveRMName function Add HTTPS Hadoop environment support (#11017)
* [Improvement-11013][dolphinscheduler-common] YarnHAAdminUtils#getActiveRMName function Add HTTPS Hadoop environment support

* [Improvement-11013][dolphinscheduler-common] add test code

* [Improvement-11013][dolphinscheduler-common] code format

* [Improvement-11013][dolphinscheduler-common] add hadooputils test code

* [Improvement-11013][dolphinscheduler-common] remove extra blank lines

* [Improvement-11013][dolphinscheduler-common] adjusts test code

* [Improvement-11013][dolphinscheduler-common] remove useless import

* [Improvement-11013][dolphinscheduler-common] add test code

* [Improvement-11013][dolphinscheduler-common] shortened string

* [Improvement-11013][dolphinscheduler-common]  format test code style

Co-authored-by: liyangyang <liyangyang@bizseer.com>
2022-07-25 11:07:40 +08:00
jackfanwan
ccb7641468
修改数据质量查询的权限判断 (#10977)
Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2022-07-25 09:35:53 +08:00
Wenjun Ruan
71cf7e1baa
[Fix-10918] Close datasource when expire from guava cache (#11120)
* Close datasource when expire from guava cache
* Remove duplicate datasource in HiveDataSourceClient
2022-07-23 20:43:37 +08:00
JieguangZhou
952aee80e7
[fix] py sagemaker doc (#11109) 2022-07-22 22:57:50 +08:00
Devosend
2f2de7f90e
fix space validate for create folder bug (#11106) 2022-07-22 17:08:12 +08:00
zhuxt2015
3701a24d15
[Improvement][Task Log] Task status log print description instead of code (#11009)
* use execution status instead of status code
2022-07-22 13:34:31 +08:00
songjianet
de6e58ec1b
[Fix][UI] Fix the problem of too large spacing in operation. (#11090)
* [Fix][UI] Fix the problem of too large spacing in operation.

* [Fix][UI] Fix the problem of too large spacing in operation.
2022-07-22 11:52:41 +08:00
Devosend
7227acd653
fix view variable display bug (#11100) 2022-07-22 11:52:25 +08:00
Amy0104
79cec27423
[Fix][UI] Widen the segment separator input box. (#11096) 2022-07-22 11:02:25 +08:00
JieguangZhou
cc088e0f54
[python] Support SageMaker task type (#11002) 2022-07-22 10:47:08 +08:00
xiangzihao
5b429d29b8
add oracle dependency (#11095) 2022-07-22 09:49:20 +08:00
xiangzihao
c34fe4f9b3
Try to fix filemanage e2e flaky test (#11097) 2022-07-22 05:51:26 +08:00
songjianet
445e830a84
[Refactor][UI] Refactor file manage using NSpace component. (#11073) 2022-07-21 21:19:23 +08:00
JieguangZhou
af7b359333
[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario (#10826) (#10935)
* add sagemaker pipeline task plugin

[DOC] add Sagemaker task plugin document

change license and fix dependencies

* [fix] Optimize the code

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java

Optimization parameter judgment

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* [fix] nips

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-07-21 18:16:58 +08:00
Devosend
594f00512b
[Refactor][UI] Refactor time display use datatable render function (#11078) 2022-07-21 15:57:08 +08:00
xiangzihao
72d29971bf
[E2E] [CI] Fix flaky e2e test (#11077)
* fix flaky e2e test

* fix flaky e2e test

* fix flaky e2e test
2022-07-21 15:43:24 +08:00
songjianet
25ded1e81b
[Refactor][UI] Refactor rule manage using NSpace component. (#11069) 2022-07-20 19:39:00 +08:00
旺阳
28b40da1b1
[Improve] Hide Change Pwd Page When Login With LDAP (#11041)
* hide-change-pwd-page-when-ldap-login

* add unit test
2022-07-20 18:48:16 +08:00
WangJPLeo
fd59f0bb32
[Fix-11031] AccessToken can only be used by the creator. (#11032)
* AccessToken can only be used by the creator.

* supplement ut

* checkstyle fix
2022-07-20 16:32:03 +08:00
fuchanghai
1a08f3970d
[fix-10729]The request's url given by the test case looks different f… (#10734)
* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors
2022-07-20 15:42:45 +08:00
Eric Gao
f689220290
[Feature][Task Plugin] Increase zeppelin task stability in production (#11010)
* [Feature][Task Plugin] Increase zeppelin task stability in production (#10584)

* Add front-end and update docs for the production mode of zeppelin task

* Fix minor front-end bug of zeppelin task plugin

* Refactor ZeppelinParameters with lombok

* Fix formatting

* Replace @Data with @Getter, @Setter, @ToString to avoid decrease in test coverage
2022-07-20 14:16:47 +08:00
xuhhui
35f32cd16e
[Improvement][Task]Improve seatunnel task command log (#11027) 2022-07-20 11:06:10 +08:00
Eric Gao
2f0d907bcb
[Improvement][Task Plugin]Refactor JupyterParameters.java with lombok (#11045)
* [Improvement][Task Plugin]Refactor JupyterParameters.java with lombok (#11040)
2022-07-20 11:02:47 +08:00
Wenjun Ruan
5e9c7dad23
Add dolphinscheduler-bom to manage the dependency version (#11025) 2022-07-20 10:37:31 +08:00
caishunfeng
65d2b8f14e
[Bug] fix task params pass (#11053) 2022-07-20 10:14:51 +08:00
songjianet
878cbbc159
[Refactor][UI] Refactor task result using NSpace component. (#11054) 2022-07-19 23:04:54 +08:00
Mr.An
d7df899909
[Fix-11003]Task group queue is not updated to final state (#11004)
* fix after the task group is forced to start the task. Task group status has not changed
2022-07-19 17:48:16 +08:00
Eric Gao
a5b3144e53
Add EricGao888 to help review docs, tools, etc. (#11047) 2022-07-19 17:08:53 +08:00
songjianet
ff34393333
[Feat][UI] Added LDAP function. (#11029) 2022-07-18 22:12:45 +08:00
songjianet
6bf80f7a06
[Refactor][UI] Refactor datasource using NSpace component. (#11022)
* [Refactor][UI] Refactor datasource using NSpace component.

* [Refactor][UI] Refactor datasource using NSpace component.
2022-07-18 13:19:41 +08:00
Jiajie Zhong
502fbb0f1c
impv: not mark issue stale with security label (#10982) 2022-07-18 12:00:20 +08:00
zhuxt2015
a74d7ef665
[hotfix][Worker] Remove service dependency from worker module (#11008)
* worker remove service dependency
2022-07-17 22:16:35 +08:00
Wenjun Ruan
e1c78d1a49
Move utils, builder under master (#11000) 2022-07-16 23:18:00 +08:00
Wenjun Ruan
083ab2b5c9
Remove dao in worker (#10994) 2022-07-15 20:07:18 +08:00
Wenjun Ruan
2be1d4bf0a
Fix worker cannot shutdown due to resource close failed or heart beat check failed (#10979)
* Use try-with-resource to close resource, and add heart error threshold to avoid worker cannot close due to heart beat check failed

* Move heartbeat error threshold to applicaiton.yml
2022-07-15 20:06:53 +08:00
SongTao Zhuang
dad8981cfe
fix: typo executor service (#10980) 2022-07-15 18:58:39 +08:00
Wenjun Ruan
998e4d74dd
Kill task when we do master failover to avoid task lost (#10997) 2022-07-15 18:44:42 +08:00
labbomb
d41dac0602
feat: Add trim method to all input (#10984) 2022-07-15 17:14:47 +08:00
JieguangZhou
11a354927d
[fix] [MLflow Task plugin] Sometimes errors are reported using preset algorithms (#10986) (#10987)
* Optimize the download method of preset project

* fix checkstyle
2022-07-15 15:38:13 +08:00
songjianet
fd5fb85858
[Refactor][UI] Refactor audio log using NSpace component. (#10991) 2022-07-15 15:10:48 +08:00
zhuxt2015
7196b125d9
[Feature][Datax Task]Datax task plugin support custom parameters (#10950)
* datax task plugin support custom parameters
2022-07-15 09:27:23 +08:00
Eric Gao
a38fa34d43
[Feature][Task Plugin] Enable users to switch endpoints in zeppelin tasks (#10925)
* [Feature][Task Plugin] Enable users to switch endpoints in zeppelin tasks (#9814)
2022-07-15 09:26:28 +08:00
Jiajie Zhong
81930e5420
[python] Fix tasks with multiple upstream and workflow query error (#10941)
* when task with more than one upstreams, mapper
   TaskDefinitionMapper method queryByName will return
   more than one record, and failed the mybatis result
   type, so we have to add `limit 1` to it to
* add multiple runs of example in integrate test
* Change from subprocess.Popen to subprocess.call_check
  in integrating test which will raise an error when failed
2022-07-14 22:06:07 +08:00
labbomb
05308ccfe6
feat: Added global trim method (#10975) 2022-07-14 20:44:41 +08:00
Assert
4ff8eaa996
[Fix-10595][api] Fix Dependent Node Only View Projects Created By Self (#10834)
* [Fix-10595][api] Fix Dependent Node Only View Projects Created By Self
2022-07-14 19:03:34 +08:00
songjianet
89780e296d
[Feat][UI] Add title display to the table in the security center. (#10969) 2022-07-14 18:02:29 +08:00
rockfang
895dca3e93
[Fix-10890] fix some bugs in the Resource page (#10907)
* [Fix-10890] fix some bugs in the Resource page

* fix: cancel the unnecessary verifications and reset the form when canceling FileUploadModal

* fix: use se `resetForm` method to reset the form
2022-07-14 16:17:06 +08:00
SongTao Zhuang
99a134febb
fix: typo task definition. (#10958) 2022-07-14 11:40:46 +08:00
Mr.An
ed7ec8ac10
[fix-10954]Querying the task group list returns empty data (#10955)
* fix task group query page retrun is null
2022-07-14 11:16:28 +08:00
Amy0104
c2dfda80f6
[Fix][UI] Set the next node to not required. (#10932)
* [Fix][UI] Set the next node to not required.

* [Fix][UI] Remove the unuse i
2022-07-14 10:15:25 +08:00