test/DolphinScheduler
1
0
Fork 0
mirror of https://gitee.com/dolphinscheduler/DolphinScheduler.git synced 2024-12-02 20:28:03 +08:00
Code Issues Actions 10 Packages Projects Releases Wiki Activity
6,935 Commits 27 Branches 59 Tags 276 MiB
cc088e0f54
Commit Graph

6935 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
JieguangZhou
cc088e0f54
[python] Support SageMaker task type (#11002) 2022-07-22 10:47:08 +08:00
xiangzihao
5b429d29b8
add oracle dependency (#11095) 2022-07-22 09:49:20 +08:00
xiangzihao
c34fe4f9b3
Try to fix filemanage e2e flaky test (#11097) 2022-07-22 05:51:26 +08:00
songjianet
445e830a84
[Refactor][UI] Refactor file manage using NSpace component. (#11073) 2022-07-21 21:19:23 +08:00
JieguangZhou
af7b359333
[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario (#10826) (#10935) 
* add sagemaker pipeline task plugin

[DOC] add Sagemaker task plugin document

change license and fix dependencies

* [fix] Optimize the code

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java

Optimization parameter judgment

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* [fix] nips

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
 2022-07-21 18:16:58 +08:00
Devosend
594f00512b
[Refactor][UI] Refactor time display use datatable render function (#11078) 2022-07-21 15:57:08 +08:00
xiangzihao
72d29971bf
[E2E] [CI] Fix flaky e2e test (#11077) 
* fix flaky e2e test

* fix flaky e2e test

* fix flaky e2e test
 2022-07-21 15:43:24 +08:00
songjianet
25ded1e81b
[Refactor][UI] Refactor rule manage using NSpace component. (#11069) 2022-07-20 19:39:00 +08:00
旺阳
28b40da1b1
[Improve] Hide Change Pwd Page When Login With LDAP (#11041) 
* hide-change-pwd-page-when-ldap-login

* add unit test
 2022-07-20 18:48:16 +08:00
WangJPLeo
fd59f0bb32
[Fix-11031] AccessToken can only be used by the creator. (#11032) 
* AccessToken can only be used by the creator.

* supplement ut

* checkstyle fix
 2022-07-20 16:32:03 +08:00
fuchanghai
1a08f3970d
[fix-10729]The request's url given by the test case looks different f… (#10734) 
* [fix-10729]The request's url given by the test case looks different from the controller layer. Some usages and parameter format errors
 2022-07-20 15:42:45 +08:00
Eric Gao
f689220290
[Feature][Task Plugin] Increase zeppelin task stability in production (#11010) 
* [Feature][Task Plugin] Increase zeppelin task stability in production (#10584)

* Add front-end and update docs for the production mode of zeppelin task

* Fix minor front-end bug of zeppelin task plugin

* Refactor ZeppelinParameters with lombok

* Fix formatting

* Replace @Data with @Getter, @Setter, @ToString to avoid decrease in test coverage
 2022-07-20 14:16:47 +08:00
xuhhui
35f32cd16e
[Improvement][Task]Improve seatunnel task command log (#11027) 2022-07-20 11:06:10 +08:00
Eric Gao
2f0d907bcb
[Improvement][Task Plugin]Refactor JupyterParameters.java with lombok (#11045) 
* [Improvement][Task Plugin]Refactor JupyterParameters.java with lombok (#11040)
 2022-07-20 11:02:47 +08:00
Wenjun Ruan
5e9c7dad23
Add dolphinscheduler-bom to manage the dependency version (#11025) 2022-07-20 10:37:31 +08:00
caishunfeng
65d2b8f14e
[Bug] fix task params pass (#11053) 2022-07-20 10:14:51 +08:00
songjianet
878cbbc159
[Refactor][UI] Refactor task result using NSpace component. (#11054) 2022-07-19 23:04:54 +08:00
Mr.An
d7df899909
[Fix-11003]Task group queue is not updated to final state (#11004) 
* fix after the task group is forced to start the task. Task group status has not changed
 2022-07-19 17:48:16 +08:00
Eric Gao
a5b3144e53
Add EricGao888 to help review docs, tools, etc. (#11047) 2022-07-19 17:08:53 +08:00
songjianet
ff34393333
[Feat][UI] Added LDAP function. (#11029) 2022-07-18 22:12:45 +08:00
songjianet
6bf80f7a06
[Refactor][UI] Refactor datasource using NSpace component. (#11022) 
* [Refactor][UI] Refactor datasource using NSpace component.

* [Refactor][UI] Refactor datasource using NSpace component.
 2022-07-18 13:19:41 +08:00
Jiajie Zhong
502fbb0f1c
impv: not mark issue stale with security label (#10982) 2022-07-18 12:00:20 +08:00
zhuxt2015
a74d7ef665
[hotfix][Worker] Remove service dependency from worker module (#11008) 
* worker remove service dependency
 2022-07-17 22:16:35 +08:00
Wenjun Ruan
e1c78d1a49
Move utils, builder under master (#11000) 2022-07-16 23:18:00 +08:00
Wenjun Ruan
083ab2b5c9
Remove dao in worker (#10994) 2022-07-15 20:07:18 +08:00
Wenjun Ruan
2be1d4bf0a
Fix worker cannot shutdown due to resource close failed or heart beat check failed (#10979) 
* Use try-with-resource to close resource, and add heart error threshold to avoid worker cannot close due to heart beat check failed

* Move heartbeat error threshold to applicaiton.yml
 2022-07-15 20:06:53 +08:00
SongTao Zhuang
dad8981cfe
fix: typo executor service (#10980) 2022-07-15 18:58:39 +08:00
Wenjun Ruan
998e4d74dd
Kill task when we do master failover to avoid task lost (#10997) 2022-07-15 18:44:42 +08:00
labbomb
d41dac0602
feat: Add trim method to all input (#10984) 2022-07-15 17:14:47 +08:00
JieguangZhou
11a354927d
[fix] [MLflow Task plugin] Sometimes errors are reported using preset algorithms (#10986) (#10987) 
* Optimize the download method of preset project

* fix checkstyle
 2022-07-15 15:38:13 +08:00
songjianet
fd5fb85858
[Refactor][UI] Refactor audio log using NSpace component. (#10991) 2022-07-15 15:10:48 +08:00
zhuxt2015
7196b125d9
[Feature][Datax Task]Datax task plugin support custom parameters (#10950) 
* datax task plugin support custom parameters
 2022-07-15 09:27:23 +08:00
Eric Gao
a38fa34d43
[Feature][Task Plugin] Enable users to switch endpoints in zeppelin tasks (#10925) 
* [Feature][Task Plugin] Enable users to switch endpoints in zeppelin tasks (#9814)
 2022-07-15 09:26:28 +08:00
Jiajie Zhong
81930e5420
[python] Fix tasks with multiple upstream and workflow query error (#10941) 
* when task with more than one upstreams, mapper
   TaskDefinitionMapper method queryByName will return
   more than one record, and failed the mybatis result
   type, so we have to add `limit 1` to it to
* add multiple runs of example in integrate test
* Change from subprocess.Popen to subprocess.call_check
  in integrating test which will raise an error when failed
 2022-07-14 22:06:07 +08:00
labbomb
05308ccfe6
feat: Added global trim method (#10975) 2022-07-14 20:44:41 +08:00
Assert
4ff8eaa996
[Fix-10595][api] Fix Dependent Node Only View Projects Created By Self (#10834) 
* [Fix-10595][api] Fix Dependent Node Only View Projects Created By Self
 2022-07-14 19:03:34 +08:00
songjianet
89780e296d
[Feat][UI] Add title display to the table in the security center. (#10969) 2022-07-14 18:02:29 +08:00
rockfang
895dca3e93
[Fix-10890] fix some bugs in the Resource page (#10907) 
* [Fix-10890] fix some bugs in the Resource page

* fix: cancel the unnecessary verifications and reset the form when canceling FileUploadModal

* fix: use se `resetForm` method to reset the form
 2022-07-14 16:17:06 +08:00
SongTao Zhuang
99a134febb
fix: typo task definition. (#10958) 2022-07-14 11:40:46 +08:00
Mr.An
ed7ec8ac10
[fix-10954]Querying the task group list returns empty data (#10955) 
* fix task group query page retrun is null
 2022-07-14 11:16:28 +08:00
Amy0104
c2dfda80f6
[Fix][UI] Set the next node to not required. (#10932) 
* [Fix][UI] Set the next node to not required.

* [Fix][UI] Remove the unuse i
 2022-07-14 10:15:25 +08:00
Wenjun Ruan
b245e7c973
Fix kill yarn job error when failover caused by doesn't set ProcessDefinition (#10948) 2022-07-13 22:32:30 +08:00
Wenjun Ruan
df0416c193
Fix taskInstance's host is not worker nettyServer address (#10926) 
* Fix taskInstance's host is not worker nettyServer address

* Remove unnecessary mock
 2022-07-13 20:46:33 +08:00
WangJPLeo
9f34a837b8
[Fix-10909] Returns executionStatus for each process instance status and access token module support. (#10922) 
* Returns executionStatus for each process instance status and access token module support
 2022-07-13 20:45:52 +08:00
Jiajie Zhong
2d7a48b0f0
[fix] Can not query exists environments (#10884) 
always return empty set
 2022-07-13 17:21:29 +08:00
pinkhello
7a15877fa4
[FIX-10784][Bug] [ALERT-SERVER] FEISHU Plugin might block the whole alert process loop (#10888) 
* closed 10784 [Bug] [ALERT-SERVER] FEISHU Plugin might block the whole alert process loop
 2022-07-13 14:27:44 +08:00
chuxing
427c58546c
[fix][plugin]: fix spark sql use custom parma. (#10821) 
* [fix][plugin]: fix spark sql use custom parma.

* [fix][plugin] roll back part of the code

Co-authored-by: huaangcg <huangcg@getui.com>
 2022-07-13 11:44:13 +08:00
WangJPLeo
2397423eb6
Solve transaction problems under multi-threading (#10917) 2022-07-13 11:23:47 +08:00
Wenjun Ruan
2a67866718
Catch exception when check state in StateWheelExecuteThread (#10908) 
* Catch exception when check state
 2022-07-13 10:51:20 +08:00
Amy0104
51d6eae7f4
[Fix][UI] Add validator to the next node field of the switch task. (#10898) 2022-07-13 10:21:18 +08:00