test/DolphinScheduler
1
0
Fork 0
mirror of https://gitee.com/dolphinscheduler/DolphinScheduler.git synced 2024-12-02 12:17:43 +08:00
Code Issues Actions 10 Packages Projects Releases Wiki Activity
7,965 Commits 27 Branches 59 Tags 276 MiB
512f4c7021
Commit Graph

7965 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
KingsleyY
512f4c7021
[Fix-10795][plugin] sqoop task query columns bug (#10776) 
* [Improvement][Api] add @Override on the Override method

* [FIX]sqoop task query columns bug

* merge two if

* update checkstyle problem

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sqoop/src/main/java/org/apache/dolphinscheduler/plugin/task/sqoop/SqoopColumnType.java

Co-authored-by: Wenjun Ruan <wenjun@apache.org>

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sqoop/src/main/java/org/apache/dolphinscheduler/plugin/task/sqoop/generator/sources/MySQLSourceGenerator.java

Co-authored-by: Wenjun Ruan <wenjun@apache.org>

* code format

* code format

---------

Co-authored-by: Wenjun Ruan <wenjun@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
 2023-07-26 10:42:29 +08:00
Wenjun Ruan
4aab0b234f
Use AdHoc datasource client in sqlTask (#14631) 
* Use AdHoc datasource client in sqlTask

* Add method in DataSourceChannel to create PooledDataSourceClient and AdHocDataSourceClient
 2023-07-26 08:58:50 +08:00
xiangzihao
c6696683e5
[CI][E2E] Upgrade e2e dependency version (#14634) 
* upgrade e2e dependency version

* upgrade e2e dependency version

* optimize imports

* remove duplicated awaitility

* remove duplicated awaitility
 2023-07-25 18:04:18 +08:00
KingsleyY
4a80e3a021
[DS-14566][master] fix serial_wait command_param does not replace global_params (#14606) 
This closes #14566

Co-authored-by: yangxin3 <yangxin3@newhope.cn>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
Co-authored-by: xiangzihao <460888207@qq.com>
 2023-07-25 13:36:35 +08:00
xiangzihao
164154488a
add e2e optional for ci (#14633) 2023-07-25 11:10:50 +08:00
Wenjun Ruan
6617e3fb72
Revert "datasource test and sql task Remove connection pool issues is #14179 (#14193)" (#14626) 
This reverts commit e4fb5b30a4.
 2023-07-24 17:33:43 +08:00
xiangzihao
930d2f05b7
[CI] [E2E] Increase e2e containers timeout (#14628) 
* increase e2e containers timeout
 2023-07-24 16:26:41 +08:00
Gallardot
0188f40b84
[Improvement][HELM] add driver-class-name (#14614) 
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2023-07-24 11:58:33 +08:00
Aaron Wang
759756ae80
[Improvement-14269][API] Bind task group with project (#14392) 
* [Improvement-14269][API] Bind task group with project

* remove comment

* add project permission check for task group operation

* add doc
 2023-07-23 12:11:37 +08:00
Aaron Wang
ca760aabd4
[Fix-14512][BOM] kubernetes-client version conflict (#14561) 2023-07-21 18:17:53 +08:00
xuhui1231
e4fb5b30a4
datasource test and sql task Remove connection pool issues is #14179 (#14193) 
* datasource test and sql task Remove connection pool issues is #14179

* datasource test and sql task Remove connection pool issues is #14179 uniform style

* datasource test and sql task Remove connection pool issues is #14179 uniform style by 20230720

* datasource test and sql task Remove connection pool issues is #14179 uniform style by 20230720

---------

Co-authored-by: xuhui <xuhui@3h1china.com>
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
 2023-07-21 16:14:21 +08:00
Jay Chung
d92e2b360e
ci: Mergeable must have ready-to-merge and not require version (#14600) 
you can see our init discuss in https://lists.apache.org/thread/xgcd3wndfst88ornvdknd64nol76k89n
 2023-07-21 15:18:41 +08:00
Eric Gao
d6a4e99e19
fix process utils comment typo (#14613) 2023-07-21 13:18:10 +08:00
eye-gu
50cc65b118
[Fix-13976][dao] task complete contain force success state (#14611) 
Co-authored-by: eye <eye.gu@aloudata.com>
Co-authored-by: xiangzihao <460888207@qq.com>
 2023-07-21 11:50:29 +08:00
Gallardot
1e31327418
[Improvement][K8S] Disable delete namespaces in the K8S cluster (#14597) 
* [Improvement][K8S] Disable all namespaces operations in the K8S cluster

Signed-off-by: Gallardot <gallardot@apache.org>

---------

Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2023-07-21 10:28:20 +08:00
calvin
fc65c185dc
[Fix-14601][UI] Ironed out the issue with choosing an environment on the task form of both types of DMS and DATASYNC. (#14605) 
* worked out this issue
 2023-07-20 22:27:28 +08:00
Wenjun Ruan
cbd354d134
Add host/port in heartbeat (#14591) 2023-07-20 21:26:35 +08:00
pppppjcc
cbfb1cbffb
[Fix-14603] phone Number validate (#14604) 2023-07-20 20:39:54 +08:00
旺阳
3d033da55d
[Improvement] Dataquality code style enhance (#14592) 
* code style enhance

* update

---------

Co-authored-by: xiangzihao <460888207@qq.com>
 2023-07-20 20:02:51 +08:00
xiangzihao
149ff49f11
increase browser container timeout (#14608) 2023-07-20 19:17:47 +08:00
Aaron Wang
04800a48d1
[Feature-13763][K8S Task] collect real-time log (#14379) 
* [Improvement-13763][K8S Task] collect real-time log

* fix codesmell

* get pod watcher until pod is ready

* fix codesmell

* specify container name & loop waiting pod creation

* sleep when pod is not initialized

---------

Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
 2023-07-20 18:38:25 +08:00
Xinxing
1d0d85b988
[Feature] doris add datasource (#14391) 
* Added doris data source plug-in

* Update DbType.java

* XML configuration

* doc and ui

* Missing catch of NumberFormatException

* code format

---------

Co-authored-by: xiangzihao <460888207@qq.com>
 2023-07-20 17:15:22 +08:00
xiangzihao
311a715123
increase container healthcheck timeout (#14599) 2023-07-20 15:42:04 +08:00
kezhenxu94
68e8b352d3
Disable dependabot pull requests (#14596) 2023-07-20 14:00:09 +08:00
Kerwin
9664bef933
Fix wrong judgment condition when building parameters of seatunnel task node. (#14594) 2023-07-20 12:26:10 +08:00
Jay Chung
de2d215aee
impv: Correct datax execute and python execute script name (#14523) 
* impv: Correct datax execute and python execute script name

we use PYTHON_LAUNCHER for python script execute and
DATAX_LAUNCHER for datax script name

* Add pr number

* fix ut

* style

---------

Co-authored-by: xiangzihao <460888207@qq.com>
 2023-07-20 09:13:55 +08:00
Wenjun Ruan
8505f1878d
Expose swagger.properties to release (#14590) 2023-07-19 22:24:42 +08:00
calvin
50386d622c
worked out the issue (#14588) 2023-07-19 18:46:46 +08:00
Orange Summer
af2986eca1
[Feature-14545][Master][UI]Cross workflow parameter passing (#14552) 
* feat: cross-workflow parameter passing

* refactor: remove useless parameters

* refactor: remove useless code

* refactor: code format

* docs: update docs

* docs: docs format

* more effective information

Co-authored-by: xiangzihao <zihaoxiang@apache.org>

* more effective information

Co-authored-by: xiangzihao <zihaoxiang@apache.org>

* fix: wrong writing of log code

* fix: perfect error log

---------

Co-authored-by: xiangzihao <zihaoxiang@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
 2023-07-19 18:00:44 +08:00
Wenjun Ruan
93c3871925
Support parse ipv6 (#14584) 2023-07-19 17:25:58 +08:00
calvin
20cf4ad4e6
[Feature-14505][UI] Support to set project-level preferences (#14573) 
* add a few codes about the project preferences
 2023-07-19 15:35:54 +08:00
Wenjun Ruan
c30cca9d9a
Support execute shell in different interceptor (#14582) 2023-07-19 14:50:04 +08:00
Gallardot
804b715643
[Bug][dolphinscheduler-api]validated for duplicate username when creating or registering a user (#14577) 
* [Bug][dolphinscheduler-api]validated for duplicate username when creating or registering a user

Signed-off-by: Gallardot <gallardot@apache.org>

* [Bug][dolphinscheduler-api]validated for duplicate username when creating or registering a user

Signed-off-by: Gallardot <gallardot@apache.org>

---------

Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2023-07-19 12:58:00 +08:00
Rick Cheng
9778652f17
[Improvement-14136][task] Support submitting spark-sql task with the sql file in resource center (#14527) 
Co-authored-by: xiangzihao <460888207@qq.com>
 2023-07-19 10:09:30 +08:00
xiangzihao
758d5af023
[Dependency] Bump h2, snowflake-jdbc, snappy-java version (#14575) 
* bump some dependency version
 2023-07-19 09:31:50 +08:00
Wenjun Ruan
399d0d0ce9
Add log for NetUtils (#14578) 2023-07-18 21:17:17 +08:00
arlendp
c0d776381c
[Fix-14531][UI] Tooltip of Chart not show text in light theme mode (#14532) 
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2023-07-18 17:56:36 +08:00
hoey
1ba0aecc71
[Bug][api] An error occurred while trying to access the Postgres database (#14574) 
Signed-off-by: hoey94 <cnnqjban521@gmail.com>
 2023-07-18 17:22:27 +08:00
Gallardot
9d10de6efa
[Improvement][Task] Mask configYaml in task log (#14571) 
* [Improvement][Task] Mask configYaml in task log

Signed-off-by: Gallardot <gallardot@apache.org>
---------

Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
 2023-07-18 15:02:20 +08:00
Rick Cheng
5a6f1c88a3
[Fix-14503][Worker] Fix the problem of subprocess cannot be killed (#14504) 
Co-authored-by: xiangzihao <460888207@qq.com>
 2023-07-17 21:43:34 +08:00
xiangzihao
6af361a7d6
[CI] Try to fix flaky CI (#14568) 
* increase zk timeout in ci

* increase await timeout in WorkflowE2ETest
 2023-07-17 19:02:55 +08:00
Gallardot
f5be784044
[Feature][K8S] add prometheus serviceMonitor (#14539) 
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2023-07-17 16:01:05 +08:00
FlechazoW
027d66d200
[Typo] standardized license header. (#14548) 
Co-authored-by: wentz <wentz@getui.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2023-07-17 13:56:23 +08:00
Wenjun Ruan
e6d94632b9
Add WorkflowExecuteContext (#14544) 2023-07-14 18:40:01 +08:00
旺阳
c812bf9d49
[Bug] [Mater] Not got latest task intance by task code (#14529) 
* add task code->instance map

---------

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2023-07-14 14:51:39 +08:00
Eric Gao
8020c1539c
[Improvement][API Test] Add api tests for process instance (#14514) 
* Add test cases for process instance apis

---------

Co-authored-by: xiangzihao <460888207@qq.com>
 2023-07-14 11:07:41 +08:00
Jay Chung
b5d88f2a6f
fix terrafrom config bug (#14362) 2023-07-14 09:52:16 +08:00
Eric Gao
06b6ea81cf
[Bug][Core] Fix query process instances by trigger code bug (#14528) 
* Fix query process instances by trigger code bug

* Add comment
 2023-07-13 16:56:04 +08:00
lutongzero
484f8419c4
[FIX-14299][api]: check schedule exists (#14430) 
* fix: check schedule exists

* put error message in result

---------

Co-authored-by: lutong <lutongtong211027@credithc.com>
 2023-07-13 16:21:07 +08:00
Rick Cheng
09afa75a3d
[Improvement][Worker] No need to kill remote app when appid is empty (#14534) 2023-07-13 15:40:58 +08:00