Commit Graph

7736 Commits

Author SHA1 Message Date
Assert
4439c1ec90
[Feature-13052][Task Plugin] Support Apache Seatunnel Connector-V2 (#13086) 2023-04-08 22:02:19 +08:00
huangxinan1990
d772f2492b
fix: when sudo enable is false, execute command will failed (#13860) 2023-04-07 17:13:22 +08:00
Kerwin
7e3ecfa68f
add 3.1.5 release (#13877) 2023-04-07 16:19:13 +08:00
Rick Cheng
7ee66f2d02
[Feature-13429][Remote Logging] Add support for writing task logs to Google Cloud Storage (#13777) 2023-04-06 17:49:33 +08:00
Wenjun Ruan
41a8ba9aab
Support alert server HA (#13865)
* Support alert server cluster

* Remove WORKER_ALERT_LISTEN_HOST in statefulset-dolphinscheduler-worker.yaml
2023-04-05 17:31:50 +08:00
Aaron Wang
d6fcf60534
[Improvement-13751][Worker] Support real-time pod log collection (#13752)
* Support real-time pod log collection

* datax task test have to mock ShellCommandExecutor with whole dependencies

* replace \n with EMPTY_STRING

* modify error log msg

* Update dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/AbstractCommandExecutor.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* throw exception in pod log collection thread

---------

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2023-04-05 16:13:45 +08:00
Wenjun Ruan
64833952fc
Remove the extra default tenant in workflow save page (#13867) 2023-04-04 17:14:40 +08:00
Wenjun Ruan
69fc217ab2
Fix trim might cause NPE in PropertyUtils (#13853) 2023-04-04 12:22:34 +08:00
Jay Chung
e61b8a3dce
fix: docker auto push tag name (#13858) 2023-04-03 18:28:26 +08:00
Jay Chung
22786351b2
doc: Announce link error (#13855) 2023-04-03 14:23:44 +08:00
Jay Chung
406fef1988
doc: Release version 305 (#13854) 2023-04-03 11:41:49 +08:00
SYSU-Coder
aec1366732
[Improvement]Update spelling mistake for the name of WorkflowSubmitStatue (#13850)
* Correct the spelling of an enum
2023-04-03 11:10:57 +08:00
Kerwin
490ead614e
Improve svn commit section in release docs (#13843) 2023-04-03 08:48:32 +08:00
Wenjun Ruan
a1861bc2df
Use DATAX_PYTHON to specify a datax python version (#13849)
(cherry picked from commit 752452ecbd2f8094b819eae219f3eec0f6a6427b)
2023-04-03 08:47:32 +08:00
Wenjun Ruan
9b269b3c53
Use common response for sync request (#13847) 2023-04-01 10:45:21 +08:00
ralphgj
8f3a23dae5
[Fix-13828][api] Fix the problem of work groups have two defult records (#13829) 2023-03-31 11:18:17 +08:00
JieguangZhou
273a5e78eb
[FEATURE][Task Plugin]Add remote-shell task plugin (#13801) 2023-03-30 20:17:28 +08:00
AliceXiaoLu
ad7ce2db56
fix: DB2 username can not be save (#13764)
db2's jdbcUrl should be like this "jdbc:db2://localhost:50000/sample:currentSchema=DB2INST1;characterEncoding=UTF-8;".should be ":"
2023-03-30 18:59:21 +08:00
Jay Chung
6a33d2bec0
fix: Alarm instance port verification (#13827)
close: #13532
2023-03-30 18:57:47 +08:00
Jrebel-i
3630b00c9f
Fix Bug [Athena Datasource] datasource other params illegal (#13032) 2023-03-30 16:15:29 +08:00
ititdog
d64004abea
Update WorkflowExecuteRunnable.java (#13155) 2023-03-30 15:12:40 +08:00
Wenjun Ruan
9df89cf0cf
Use bootstrap user as the default tenant (#13825) 2023-03-30 14:11:23 +08:00
Rick Cheng
85605bbef9
[Improvement-13653][Remote Logging] Support api-server to get task log from remote target (#13654) 2023-03-30 12:07:58 +08:00
HomminLee
fba59981d4
[Fix-13657][Master]NPE caused by the execution of workflow with startNode and forbidden task (#13668)
Co-authored-by: HomminLee <lihongmin@ysstech.com>
2023-03-30 09:56:57 +08:00
caishunfeng
9d9ae9ad54
[improvement] support self-dependent (#13818) 2023-03-29 18:18:03 +08:00
Wenjun Ruan
68660ec96b
Refactor remote command (#13809)
* Refactor remote command

* Rename Command to Message
2023-03-29 17:54:57 +08:00
Wenjun Ruan
e074d7a8bf
Add jdbc registry module (#13812)
* Add jdbc registry module

* Update dolphinscheduler-registry/dolphinscheduler-registry-plugins/dolphinscheduler-registry-jdbc/README.md

Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>

---------

Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2023-03-29 17:33:12 +08:00
calvin
1e8d09e955
improve the select component on the page of workflow relation (#13805) 2023-03-28 18:20:42 +08:00
lxorc
4e2c22061a
[Fix-11583][UI] Fix the API usage of gantt graph (#13778) 2023-03-28 17:17:10 +08:00
Wenjun Ruan
d1b6e6f02c
Take over task instance in master failover (#13798) 2023-03-28 16:02:57 +08:00
sandiegoe
21ca8ddf03
[fix-13734] Fix taskExecuteType field of task definition was not set correctly (#13735)
Co-authored-by: shenzhaoquan <shenzhaoquan@shenqingtech.com>
2023-03-27 10:50:01 +08:00
Wenjun Ruan
d91bdeff37
Fix retry task instance will loss varpool (#13791) 2023-03-25 12:26:59 +08:00
Wenjun Ruan
0bfd7d66d9
db: Modify name len to 255 (#13788) 2023-03-24 09:40:09 +08:00
Aaron Wang
b98566e070
[Bug-13782] match ')' in setValue regular expression (#13787) 2023-03-23 22:56:22 +08:00
Aaron Wang
8895921d87
[Improvement-13651] Remove useless resources_task (#13721) 2023-03-23 22:52:23 +08:00
NoSuchField
41801663fd
[Improvement] Remove duplicate dependencies (#13773) 2023-03-22 15:09:31 +08:00
旺阳
69e744961b
[Fix][Alert] Fix when auth is false and user || pwd null can't send email excection (#13761)
* fix send email error

* fix spotless

* fix-sonar
2023-03-21 13:59:01 +08:00
xuhhui
1075be6e62
[Improvement] Test DataSource connection return msg may not internationalization (#13767)
Co-authored-by: xuhaihui <xuhaihui@cmss.chinamobile.com>
2023-03-21 09:58:24 +08:00
xuhhui
1ac76e1cbb
[Improvement]update spelling mistake for Constants (#13738)
* [Improvement][Document]Update architecture and process-start-flow pic

* [Improvement]update spelling mistake for Constants

---------

Co-authored-by: xuhaihui <xuhaihui@cmss.chinamobile.com>
2023-03-16 16:52:17 +08:00
Rick Cheng
2dceb6b8ca
[Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center (#13562) 2023-03-15 19:29:27 +08:00
Rick Cheng
aa79c01ce9
[Feature-13419][Remote Logging] Add support for writing task logs to S3 (#13649)
* [Feature-13419][Remote Logging] Add support for writing task logs to S3

* Update dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/log/remote/S3RemoteLogHandler.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* use try with resource

* remove unnecessary log

---------

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2023-03-13 19:36:12 +08:00
Aaron Wang
ceea147e2d
[doc] update kubernetes doc (#13716) 2023-03-10 18:02:36 +08:00
Wenjun Ruan
1f365819a6
Ignore unknown VM options in start.sh (#13719) 2023-03-10 17:34:09 +08:00
Aaron Wang
34d49e0d28
remove WORKER_GROUP conf in values.yaml (#13718) 2023-03-10 15:12:06 +08:00
Wenjun Ruan
aef5524ee7
Clearer task runnable. (#13689)
* Clean unused method in AbstractTask

* Kill task by process.destroy

* wait 5/s after destroy process
2023-03-09 20:46:29 +08:00
He Wang
f06af0d972
[Document] Add OceanBase to supported list (#13700) 2023-03-09 18:00:25 +08:00
Eric Gao
394805b2c7
[Feature][Metrics] Tag workflow related metrics with process definition code (workflow id) (#13640)
* Tag workflow related metrics with process definition code (workflow id)

* Clean up related metrics when deleting workflow definition

* Add license headers

* Update related UT cases

* Add an example in grafana-demo

* Add related docs
2023-03-09 11:30:21 +08:00
朱通通
76f3076481
[Bug] Fix ResourcesServiceImpl.java pageInfo (#13709) 2023-03-09 11:05:52 +08:00
Jay Chung
30fd43e32b
feat: Python add online_schedule for workflow control schedule state (#13551)
related: apache/dolphinscheduler-sdk-python#73
2023-03-07 11:35:01 +08:00
Jay Chung
512899ed14
feat: Python return datasource object and allow filter by type (#13616)
related: https://github.com/apache/dolphinscheduler-sdk-python/pull/75
2023-03-07 11:34:28 +08:00