Commit Graph

8005 Commits

Author SHA1 Message Date
Wenjun Ruan
55cc77226f
[RPC] Refactor the remote module. (#14776)
* Add dolphinscheduler-extract-base
* Add dolphinscheduler-extract-master
* Add dolphinscheduler-extract-worker
* Add dolphinscheduler-extract-alert
2023-08-23 09:43:17 +08:00
yangyang zhong
70731a1617
[Feature][Authentication] support oauth2 login (#14743)
* support oauth2 login

---------

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-08-21 15:57:30 +08:00
Chenshuai
502bd36fde
fix: filter (#14770)
Co-authored-by: Jim Chen <chenshuai19950725@gmail.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-08-20 14:30:47 +08:00
Aaron Wang
a491e3a849
fix: null app-info-path cause NPE (#14752) 2023-08-19 13:28:45 +08:00
caishunfeng
59998f4c75
[Improvement] add dispatch fail times when compare (#14761)
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
2023-08-18 15:26:01 +08:00
wangzheyuan
34d2f67052
Fix a typo in development-environment-setup.md (#14767) 2023-08-18 14:18:41 +08:00
KingsleyY
b3af374fe6
[Fix-14646][Worker] Fix match wrong pid on linux server (#14652)
* [DS-14646][Worker] Fix match wrong pid on linux server
This closes #14646

---------

Co-authored-by: yangxin3 <yangxin3@newhope.cn>
2023-08-17 19:17:16 +08:00
Gallardot
f7ba26f030
fix: kubectl version update (#14762)
Signed-off-by: Gallardot <gallardot@apache.org>
2023-08-17 17:13:18 +08:00
calvin
e2b97c026e
[Improvement][UI] Support to disable or enable the project preferences. (#14756) 2023-08-16 20:20:48 +08:00
Gallardot
a826ed2c1a
[Improvement][security] get-user-info API endpoint should not return the user's password in MD5 format (#14680)
* [Improvement][security] get-user-info API endpoint should not return the user's password in MD5 format

Signed-off-by: Gallardot <gallardot@apache.org>

* [Improvement][security] list-paging API endpoint should not return the user's password in MD5 format

Signed-off-by: Gallardot <gallardot@apache.org>

---------

Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
2023-08-14 18:28:11 +08:00
Edison Catto
25480ae9e7
[Feature][Resource Center] Add support for Huawei Cloud OBS (#14643)
* [Feature][Resource Center] Add support for Huawei Cloud OBS as storage of resource center

* add license and add doc

* add 3-party dependency license

* Update LICENSE

* fix

* Update pom.xml

* fix

* fix

---------

Co-authored-by: sunkang <sunkang@hjfruit.com>
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
2023-08-14 13:25:48 +08:00
eye-gu
dde45dbdfb
[Fix-13972][dao] set default value for command (#14612) 2023-08-14 09:53:26 +08:00
Aaron Wang
cb55476235
[Fix-14721] [K8S Task] Handle job delete event when user manually delete the job in k8s cluster (#14722)
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2023-08-11 17:15:07 +08:00
JieguangZhou
8e64026e93
fix fault tolerant enviroment missing (#14735) 2023-08-11 14:35:31 +08:00
Wenjun Ruan
93b0283dfe
Set tenant as the the resource file owner (#13832) 2023-08-11 00:57:47 +08:00
Aaron Wang
2314b67870
[Fix-14715] [Resource Center] Modify default fs of local storage plugin (#14716)
Co-authored-by: xiangzihao <460888207@qq.com>
2023-08-10 19:15:09 +08:00
Wenjun Ruan
27745a8a84
Upgrade JDK17 for Sonar (#14726) 2023-08-10 11:29:11 +08:00
Wenjun Ruan
3efcf0c5ac
Fix message in MessageRetryRunner might disorder (#14725) 2023-08-09 20:19:02 +08:00
eye-gu
7c37a7f9fe
[Fix-14714][master] package task instance before put into cache (#14718)
Co-authored-by: eye <eye.gu@aloudata.com>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-08-09 13:41:28 +08:00
Gallardot
11d1df2f32
[Improvement][helm] configmap changes automatically trigger restart (#14657)
* [Improvement][helm] configmap changes automatically trigger restarts

Signed-off-by: Gallardot <gallardot@apache.org>

* feat: add an optional parameter

Signed-off-by: Gallardot <gallardot@apache.org>

---------

Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-08-09 10:30:20 +08:00
Kerwin
420bcd69a6
Add 3.1.8 release document (#14707) 2023-08-07 13:39:14 +08:00
Wenjun Ruan
db62ce0e47
Fix serial mode will cause NPE in Workflow bootstrap (#14703) 2023-08-04 23:43:57 +08:00
eye-gu
4bae7b1ae2
[Fix-14683][pom] upgrade mysql driver version (#14684) 2023-08-04 10:51:15 +08:00
Gallardot
57b9da145e
[Doc]fix typo (#14691)
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-08-04 10:14:04 +08:00
xiangzihao
85f6a6e73c
use wildcard import (#14697) 2023-08-03 19:04:00 +08:00
Gallardot
a5f5aacb5d
[Bug][Alert]batchInsert execption #14686 (#14687)
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-08-03 18:15:09 +08:00
xiangzihao
dec5228d62
[CI][E2E] Try to fix e2e timeout error (#14690)
* try to fix e2e timeout error

* remove use file
2023-08-03 17:08:37 +08:00
Aaron Wang
5ec9085113
fix: do not override k8sConfigYaml in ShShellInterceptorBuilder (#14682)
Co-authored-by: xiangzihao <460888207@qq.com>
2023-08-02 18:01:34 +08:00
sleo
139f23040a
[Fix-14668][dolphinscheduler-tools] Modify the imported jar package. Use org.apache.commons.lang3.StringUtils. (#14669) 2023-08-02 11:03:49 +08:00
Tengting Xu
9963bfc612
[Workflow] Print WorkflowInstance detail/ TaskInstance detail when finished (#14677)
* [Workflow] Print WorkflowInstance detail/ TaskInstance detail when finished

* [Workflow] minor fix

* [Workflow] add ut

* [Workflow] add header

---------

Co-authored-by: tengting.xu <xtt@dipeak.com>
2023-08-01 20:50:00 +08:00
Gallardot
37ecd262ee
[Bug][Alert]batchInsert execption #14675 (#14676)
Signed-off-by: Gallardot <gallardot@apache.org>
2023-08-01 13:54:00 +08:00
fuchanghai
b391b74df4
[fix-#14537] the branch that needs to be executed overlaps with another branch, it may not be able to complete the normal execution (#14563) 2023-08-01 11:04:31 +08:00
Gallardot
2f3ab18b29
[Doc] fix built-in typo (#14667)
Signed-off-by: Gallardot <gallardot@apache.org>
2023-08-01 08:56:08 +08:00
Gallardot
150d9e04b0
[Improvement][UI] Image pull policy in the K8S task provides default values (#14650)
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
2023-07-29 19:56:19 +08:00
eye-gu
d87a0d831c
[Fix-14008][registry] Fix etcd memory leak due to leaseId (#14034) 2023-07-28 22:07:37 +08:00
Wenjun Ruan
9ce8871158
Support get property from env/jvm/common.properties (#14645) 2023-07-28 14:41:58 +08:00
Rick Cheng
79cf785eca
[Improvement][Parameter] Improve the order of project parameter (#14581) 2023-07-27 18:20:36 +08:00
Wenjun Ruan
2b99451ccd
Support filter restrict network interface (#14638) 2023-07-26 23:03:58 +08:00
Gallardot
5a550dd628
[Improvement][CI] deploy to k8s (#14555)
* [Improvement][CI] deploy to k8s

Signed-off-by: Gallardot <gallardot@apache.org>

---------

Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
2023-07-26 17:18:04 +08:00
amao
5ccc4cc889
[Improvement-4375][api] cannot delete yarn queue (#13046)
* [Bug-12833][api]
delete api

* [Bug-12833][api]
delete yarn queue

* [Bug-12833][api]
add Unit Test

* Repair the failed CI

* Repair the failed UT

* Repair the failed Docs

* Repair the failed Doc

---------

Co-authored-by: amao <Guoqing.Mao@Yumchina.com>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-26 11:52:57 +08:00
KingsleyY
512f4c7021
[Fix-10795][plugin] sqoop task query columns bug (#10776)
* [Improvement][Api] add @Override on the Override method

* [FIX]sqoop task query columns bug

* merge two if

* update checkstyle problem

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sqoop/src/main/java/org/apache/dolphinscheduler/plugin/task/sqoop/SqoopColumnType.java

Co-authored-by: Wenjun Ruan <wenjun@apache.org>

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-sqoop/src/main/java/org/apache/dolphinscheduler/plugin/task/sqoop/generator/sources/MySQLSourceGenerator.java

Co-authored-by: Wenjun Ruan <wenjun@apache.org>

* code format

* code format

---------

Co-authored-by: Wenjun Ruan <wenjun@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-26 10:42:29 +08:00
Wenjun Ruan
4aab0b234f
Use AdHoc datasource client in sqlTask (#14631)
* Use AdHoc datasource client in sqlTask

* Add method in DataSourceChannel to create PooledDataSourceClient and AdHocDataSourceClient
2023-07-26 08:58:50 +08:00
xiangzihao
c6696683e5
[CI][E2E] Upgrade e2e dependency version (#14634)
* upgrade e2e dependency version

* upgrade e2e dependency version

* optimize imports

* remove duplicated awaitility

* remove duplicated awaitility
2023-07-25 18:04:18 +08:00
KingsleyY
4a80e3a021
[DS-14566][master] fix serial_wait command_param does not replace global_params (#14606)
This closes #14566

Co-authored-by: yangxin3 <yangxin3@newhope.cn>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-25 13:36:35 +08:00
xiangzihao
164154488a
add e2e optional for ci (#14633) 2023-07-25 11:10:50 +08:00
Wenjun Ruan
6617e3fb72
Revert "datasource test and sql task Remove connection pool issues is #14179 (#14193)" (#14626)
This reverts commit e4fb5b30a4.
2023-07-24 17:33:43 +08:00
xiangzihao
930d2f05b7
[CI] [E2E] Increase e2e containers timeout (#14628)
* increase e2e containers timeout
2023-07-24 16:26:41 +08:00
Gallardot
0188f40b84
[Improvement][HELM] add driver-class-name (#14614)
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-07-24 11:58:33 +08:00
Aaron Wang
759756ae80
[Improvement-14269][API] Bind task group with project (#14392)
* [Improvement-14269][API] Bind task group with project

* remove comment

* add project permission check for task group operation

* add doc
2023-07-23 12:11:37 +08:00
Aaron Wang
ca760aabd4
[Fix-14512][BOM] kubernetes-client version conflict (#14561) 2023-07-21 18:17:53 +08:00