wangxj3
|
3ad53c5200
|
3.2.2 release add task-pure delete some task module to reduce the size of the deployment package (#16094)
* add task-pure delete some task module to reduce the size of the deployment package
* add version of 3.2.2
* Update Chart.yaml Rollback APPversion
* remove task pure plugin
* fix ci
* add pure datasource plugin
* remove ck，sr from datasource pure
* remove task plugin chunjun ，dms ，datafactory from pure
* add api pom dependency
* spotless:apply
* add dependency license
* [maven-release-plugin] prepare release 3.2.2
* [maven-release-plugin] prepare for next development iteration
* remove datasource-pure：
dolphinscheduler-datasource-sqlserver
dolphinscheduler-datasource-oracle
remove task-pure：
dolphinscheduler-task-dinky
dolphinscheduler-task-pytorch
dolphinscheduler-task-datasync
dolphinscheduler-task-kubeflow
dolphinscheduler-task-emr
dolphinscheduler-task-pigeon
dolphinscheduler-task-flink-stream
* add register pure remove jdbc and etcd
* add dolphinscheduler-storage-pure remove task of
dolphinscheduler-storage-obs
dolphinscheduler-storage-abs
dolphinscheduler-storage-gcs
dolphinscheduler-storage-oss
* mvn spotless:apply
---------
Co-authored-by: wangxj959 <wangxj959@chinaunicom.cn>
Co-authored-by: wangxj <wangxj31>
Co-authored-by: wangxj3 <wangxj@apache.org>
|
2024-06-08 17:05:20 +08:00 |
|
xiangzihao
|
fd864bf351
|
Revert "3.2.2 release cherry-pick cp: Reduce the size of tarball to continue …" (#16068)
This reverts commit 646bbf4881.
|
2024-05-25 10:50:37 +08:00 |
|
wangxj3
|
646bbf4881
|
3.2.2 release cherry-pick cp: Reduce the size of tarball to continue ASF release (#16042)
* add version of 3.2.2
* Fix rpc channel leak due to concurrent operation (#16021)
* Fix rpc channel leak due to concurrent operation
* Throw channel create failed exception
---------
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
* Fix WorkerTaskExecutorThreadPool#isOverload is incorrect (#16027)
* cp: Reduce the size of tarball to continue ASF release (#15004) (#15540)
* Reduce the size of tarball to continue ASF release
for more detail you can see https://lists.apache.org/thread/rmp7fghlj0n7h9y2v3p8gkw9f9qbo6qt
# Conflicts:
# tools/dependencies/known-dependencies.txt
* Increase block-until-connected in ZookeeperRegistryTestCase (#16041)
* [Fix][CI] fix the ci error of Values.datasource.profile (#16031)
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
* Correction of Typos in the Chinese Document Appendix for Task Parameters (#16033)
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
* [DSIP-39][parameter] Improvement startup parameters/global parameters/project parameters data type (#15967)
* [Improvement][parameter] New data types and type filtering
* [Improvement][parameter] Improvement startup parameters/global parameters data type
* fix api interfaces compatible
* add project parameter data type default value
* [Improvement][parameter] New data types and type filtering
* [Improvement][parameter] Improvement startup parameters/global parameters data type
* fix api interfaces compatible
* add project parameter data type default value
* improvement project code
* remove useless imports
* remove method onClearSearchTaskType
* add parameter doc
* optimisation logic
* code conflict resolution
* code conflict resolution
* [Improvement][Monitor] Show master && worker Busy Or Normal Status and Show Commands table list (#15978)
* update
* test
* add monitor enhance ui
* update
* update
* update doc
* fix spotless
* update
* update
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/DataAnalysisController.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/DataAnalysisController.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/ErrorCommandMapper.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/ErrorCommandMapper.xml
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/CommandMapper.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/ErrorCommandMapper.xml
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* update
* fix spotless
* update
---------
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* [Improvement][Monitor] Add UT for montor (#15998)
* formatting Code
* add pom
* Fix NettyRemotingClient might throw IllegalMonitorStateException (#16038)
* Removed unused StateEventHandleFailure (#16052)
* Remove OmitStackTraceInFastThrow in start.sh (#16054)
* Update Chart.yaml Rollback APPversion
* modify log msg (#16062)
Co-authored-by: xiangzihao <460888207@qq.com>
* [DS-16046][fix] Set PreparedStatement parameter type (#16050)
Fix the PreparedStatement parameter is TIME, set it to java.sql.Time
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
* Update pom.xml
* [DSIP-42] Add dolphinscheduler-aws-authentication module (#16043)
---------
Co-authored-by: wangxj <wangxj31>
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
Co-authored-by: TianXinCoord <tianxincoord@163.com>
Co-authored-by: 小可耐 <46134044+sdhzwc@users.noreply.github.com>
Co-authored-by: sleo <97011595+alei1206@users.noreply.github.com>
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: yinxiaolog <43245392+yinxiaolog@users.noreply.github.com>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
|
2024-05-25 10:16:18 +08:00 |
|
Wenjun Ruan
|
61915a2d5d
|
Fix workflow instance restart failed due to duplicate key in varpool (#16001)
|
2024-05-16 11:32:27 +08:00 |
|
Wenjun Ruan
|
99d8276be7
|
Optimizing the scope of RPC base classes (#15946)
* Optimizing the scope of RPC base classes
* Fix UT
|
2024-05-08 11:46:09 +08:00 |
|
JohnHuang
|
d218b021e7
|
[DSIP-25][Remote Logging] Split remote logging configuration (#15826)
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
|
2024-05-06 11:33:16 +08:00 |
|
Wenjun Ruan
|
0a11cd21bd
|
Fix jar path is not correct in java task (#15906)
|
2024-04-29 18:07:05 +08:00 |
|
Wenjun Ruan
|
446f6ba72b
|
Fix auto create tennat concurrently will cause the task failed (#15909)
|
2024-04-25 18:14:48 +08:00 |
|
Wenjun Ruan
|
285c5a8eb5
|
[DSIP-28] Donnot scan whole bean under classpath (#15874)
|
2024-04-19 18:12:40 +08:00 |
|
Wenjun Ruan
|
163f8f01f0
|
Fix jdbc registry cannot work (#15861)
|
2024-04-18 15:43:28 +08:00 |
|
Wenjun Ruan
|
66df5d4b90
|
Split cpuUsage to systemCpuUsage and jvmCpuUsage (#15803)
|
2024-04-09 14:04:24 +08:00 |
|
Gallardot
|
5466117838
|
[Bug][Worker] Replace jre with jdk (#15764)
Signed-off-by: Gallardot <gallardot@apache.org>
|
2024-03-26 11:39:28 +08:00 |
|
John Huang
|
e3bd26322f
|
[Improvement][UT] Improve Worker runner coverage (#15428)
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
|
2024-03-05 18:32:32 +08:00 |
|
Wenjun Ruan
|
3526b42df6
|
Add Server HealthIndicator (#15274)
|
2024-02-07 14:07:30 +08:00 |
|
seckiller
|
89da67ddeb
|
[fix][worker]:Fix the issue of missing disk usage reporting information in the worker (#15565)
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
|
2024-02-06 16:43:29 +08:00 |
|
John Huang
|
69676b445c
|
[Improvement][UT] Improve Worker registry coverage (#15380)
Co-authored-by: fuchanghai <changhaifu@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
|
2024-02-06 10:45:53 +08:00 |
|
Wenjun Ruan
|
4d15932ede
|
Fix createFile with permission will not work (#15556)
|
2024-02-03 18:00:33 +08:00 |
|
Wenjun Ruan
|
25810a81dc
|
Exit JVM when OOM (#15538)
|
2024-01-31 13:59:30 +08:00 |
|
Wenjun Ruan
|
64e1e67581
|
Use DefaultUncaughtExceptionHandler to log the uncached exception (#15496)
Co-authored-by: fuchanghai <changhaifu@apache.org>
|
2024-01-18 14:59:17 +08:00 |
|
Wenjun Ruan
|
0b873e6870
|
[HotFix] Fix createTaskInstanceWorkingDirectory failed if the old path exist (#15377)
|
2024-01-15 11:53:55 +08:00 |
|
Wenjun Ruan
|
7b9c9e0eb2
|
Enable set ServerLoadProtection fot Master/Worker (#15439)
|
2024-01-14 22:17:58 +08:00 |
|
Wenjun Ruan
|
6c1e001edf
|
Add config for defaultTenantEnabled (#15391)
|
2024-01-06 18:26:22 +08:00 |
|
Gallardot
|
575b89e2f9
|
[Bug][Registry] Optimizing waiting strategy (#15223)
* [Improvement][Registry] Optimizing waiting strategy
Signed-off-by: Gallardot <gallardot@apache.org>
|
2024-01-02 22:41:50 +09:00 |
|
Wenjun Ruan
|
d6dea4633c
|
Optimize server startup log (#15362)
|
2023-12-27 20:20:21 +08:00 |
|
Wenjun Ruan
|
5523a62825
|
Remove taskQueue and looper in worker (#15292)
|
2023-12-27 19:51:45 +08:00 |
|
Wenjun Ruan
|
0e88ea3ac8
|
Recreate new TaskInstance Working Directory when exist in worker (#15358)
|
2023-12-25 16:00:41 +08:00 |
|
Wenjun Ruan
|
5b6b0ceb31
|
Fix resource file usage(Delete Resource/ResourceUser which is deprecated) (#15355)
|
2023-12-23 22:47:59 +08:00 |
|
Wenjun Ruan
|
2119e41800
|
[Improvement] Move delay calculation to Master (#15278)
|
2023-12-06 09:37:14 +08:00 |
|
Wenjun Ruan
|
43f5f24529
|
Add dolphinscheduler-extract-common module (#15266)
|
2023-12-05 21:06:39 +08:00 |
|
Wenjun Ruan
|
ef2e9c9b67
|
Set the tenant as the owner in final stage (#15256)
|
2023-12-01 21:49:28 +08:00 |
|
Wenjun Ruan
|
f2d146665c
|
Use chown to set the file owner (#15240)
|
2023-11-29 16:28:39 +08:00 |
|
Wenjun Ruan
|
d6175f3bbf
|
Exclude DataSourceAutoConfiguration in worker server (#15169)
|
2023-11-16 19:17:39 +08:00 |
|
dbac
|
d683553324
|
[Improvement][Master] Calculate the remainTime then we set the delay execution. (#15012)
* [#15007][fix][worker-server] fix bug task delay execution
* [#15007][fix][worker-server] fix bug task delay execution
mvn spotless:apply
* [#15007][fix][worker-server] fix bug task delay execution
worker fix task delay logic
---------
Co-authored-by: 旺阳 <wang@lqwang.net>
|
2023-10-11 02:32:07 -05:00 |
|
Wenjun Ruan
|
ab29ae77c1
|
Exclude DataSourceAutoConfiguration in WorkerServer (#14957)
|
2023-09-23 22:01:54 +08:00 |
|
Aaron Wang
|
73e846d03e
|
[Improvement-14884][Master] Add overload state in master heartbeat to trigger slot change (#14887)
|
2023-09-14 10:36:42 +08:00 |
|
Aaron Wang
|
b12df72a0c
|
[Fix][Resource Center] Remove NONE storage type and set LOCAL type as default (#14661)
|
2023-09-07 14:09:15 +08:00 |
|
Wenjun Ruan
|
742f0c3e60
|
Add workflowInstanceHost and taskInstanceHost in ITaskInstanceExecutionEvent (#14827)
|
2023-08-29 13:32:17 +08:00 |
|
Wenjun Ruan
|
d223d654cc
|
Add rpc benchmark test (#14797)
|
2023-08-27 20:59:55 +08:00 |
|
Wenjun Ruan
|
55cc77226f
|
[RPC] Refactor the remote module. (#14776)
* Add dolphinscheduler-extract-base
* Add dolphinscheduler-extract-master
* Add dolphinscheduler-extract-worker
* Add dolphinscheduler-extract-alert
|
2023-08-23 09:43:17 +08:00 |
|
Wenjun Ruan
|
93b0283dfe
|
Set tenant as the the resource file owner (#13832)
|
2023-08-11 00:57:47 +08:00 |
|
Wenjun Ruan
|
3efcf0c5ac
|
Fix message in MessageRetryRunner might disorder (#14725)
|
2023-08-09 20:19:02 +08:00 |
|
Wenjun Ruan
|
9ce8871158
|
Support get property from env/jvm/common.properties (#14645)
|
2023-07-28 14:41:58 +08:00 |
|
Aaron Wang
|
ca760aabd4
|
[Fix-14512][BOM] kubernetes-client version conflict (#14561)
|
2023-07-21 18:17:53 +08:00 |
|
Wenjun Ruan
|
cbd354d134
|
Add host/port in heartbeat (#14591)
|
2023-07-20 21:26:35 +08:00 |
|
Wenjun Ruan
|
399d0d0ce9
|
Add log for NetUtils (#14578)
|
2023-07-18 21:17:17 +08:00 |
|
Gallardot
|
9d10de6efa
|
[Improvement][Task] Mask configYaml in task log (#14571)
* [Improvement][Task] Mask configYaml in task log
Signed-off-by: Gallardot <gallardot@apache.org>
---------
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
|
2023-07-18 15:02:20 +08:00 |
|
Rick Cheng
|
5a6f1c88a3
|
[Fix-14503][Worker] Fix the problem of subprocess cannot be killed (#14504)
Co-authored-by: xiangzihao <460888207@qq.com>
|
2023-07-17 21:43:34 +08:00 |
|
Wenjun Ruan
|
0246327083
|
Polish config, expose rpc config in application.yml (#14501)
|
2023-07-11 09:29:31 +08:00 |
|
Wenjun Ruan
|
406aeaf659
|
Use jvm_args_env.sh to set JVM args (#14487)
|
2023-07-10 17:39:57 +08:00 |
|
Eric Gao
|
e86630bb7b
|
[Improvement][Metrics] Add more worker related metrics and fix some previous ones (#14254)
* Add more worker related metrics and fix some previous ones
* update metrics docs
|
2023-06-01 16:54:48 +08:00 |
|