Commit Graph

123 Commits

Author SHA1 Message Date
Wenjun Ruan
f754611509
[DSIP-42] Add dolphinscheduler-aws-authentication module (#16043) 2024-05-24 14:15:03 +08:00
Wenjun Ruan
5037f0a5e3
Remove OmitStackTraceInFastThrow in start.sh (#16054) 2024-05-24 10:34:10 +08:00
Wenjun Ruan
8d336def61
[DSIP-35][Alert] Refactor the alert thread model (#15932) 2024-05-09 12:23:01 +08:00
Wenjun Ruan
647cbae400
[DSIP-32][Master] Add command fetcher strategy for master fetch command (#15900) 2024-04-29 16:14:23 +08:00
Wenjun Ruan
285c5a8eb5
[DSIP-28] Donnot scan whole bean under classpath (#15874) 2024-04-19 18:12:40 +08:00
Wenjun Ruan
883848f6ee
Remove unused caffeine cache (#15830) 2024-04-11 19:28:00 +08:00
Wenjun Ruan
66df5d4b90
Split cpuUsage to systemCpuUsage and jvmCpuUsage (#15803) 2024-04-09 14:04:24 +08:00
Jay Chung
91d56f4860
fix: data quality may fail in docker mode (#15563) 2024-02-05 17:14:59 +08:00
Wenjun Ruan
25810a81dc
Exit JVM when OOM (#15538) 2024-01-31 13:59:30 +08:00
Wenjun Ruan
7b9c9e0eb2
Enable set ServerLoadProtection fot Master/Worker (#15439) 2024-01-14 22:17:58 +08:00
lizhenglei
3c7a77c90e
[Improvement][E2E] add e2e javatask case (#15469)
* add java task

* fix

* support jdk

* fix java

* fix  java_home

* add ut

* recover

---------

Co-authored-by: 80597928 <673421862@qq.com>
Co-authored-by: xiangzihao <460888207@qq.com>
2024-01-12 17:20:40 +08:00
Wenjun Ruan
6c1e001edf
Add config for defaultTenantEnabled (#15391) 2024-01-06 18:26:22 +08:00
Wenjun Ruan
d6dea4633c
Optimize server startup log (#15362) 2023-12-27 20:20:21 +08:00
Wenjun Ruan
df656a7671
Fix home page workflow instance miss status (#15193) 2023-11-22 10:33:24 +08:00
Wenjun Ruan
9be81be328
Remove API Result in Service (#15181) 2023-11-20 17:04:03 +08:00
Wei Xiaonan
c0ed68121d
[Feature-14832][Listener]Implementation of Listener Mechanism (#14981)
* first commit

* 1. sql: sync ddl
2. front-end: change to ternary expression
3. back-end: correct license header in ListenerEvent.java

* test case

* frontend: remove unnecessary console

* fix unit test

* remove log depends on user-provided value

* fix dolphinscheduler_postgresql.sql

* sync database schema

* fix unit test

* fix unit test

* fix some NIT.

* extract GLOBAL_ALERT_GROUP_ID into variable

* fix ddl bug

* add column task_type in t_ds_fav_task in upgrade/3.2.0_schema

* add unit test
2023-10-29 20:28:05 +08:00
Wenjun Ruan
a5284e4024
Remove mapper usage in tools (#15073) 2023-10-25 22:58:47 +08:00
Wenjun Ruan
33084d281f
Add dolphinscheduler-dao-plugin module (#15019) 2023-10-14 17:58:40 +08:00
gaopeng
adf49fd23f
[Feature-14802][api] Use Casdoor SSO to log in, add admin user configuration (#14814)
* [Feature-14802][feat] Use Casdoor SSO to log in, add admin user configuration

    Use Casdoor SSO to log in, add admin user configuration

This closes #14802

* [Feature-14802][feat] Use Casdoor SSO to log in, add admin user configuration

    Use Casdoor SSO to log in, add admin user configuration

This closes #14802

* update doc

* [Feature-14802][feat] Use Casdoor SSO to log in, add admin user configuration

    Use Casdoor SSO to log in, add admin user configuration

This closes #14802

---------

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
Co-authored-by: 旺阳 <qingwli@cisco.com>
2023-09-04 13:25:40 +08:00
kezhenxu94
d62ce25a01
Remove @AccessLogAnnotation annotation, replace with built-in access log (#14803) 2023-08-24 15:19:01 +08:00
yangyang zhong
70731a1617
[Feature][Authentication] support oauth2 login (#14743)
* support oauth2 login

---------

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-08-21 15:57:30 +08:00
xiangzihao
85f6a6e73c
use wildcard import (#14697) 2023-08-03 19:04:00 +08:00
Aaron Wang
ca760aabd4
[Fix-14512][BOM] kubernetes-client version conflict (#14561) 2023-07-21 18:17:53 +08:00
Wenjun Ruan
8505f1878d
Expose swagger.properties to release (#14590) 2023-07-19 22:24:42 +08:00
Wenjun Ruan
0246327083
Polish config, expose rpc config in application.yml (#14501) 2023-07-11 09:29:31 +08:00
Wenjun Ruan
406aeaf659
Use jvm_args_env.sh to set JVM args (#14487) 2023-07-10 17:39:57 +08:00
旺阳
f186cd5dab
[Feature][Api] LDAP SSL supports&& Add LDAP K8s configuration (#14349) 2023-06-29 16:14:37 +08:00
Bingchang Chen
77e58ce245
[Feature] Add SSO login by Casdoor (#8706) 2023-05-05 14:43:06 +08:00
Wenjun Ruan
cf91544b99
Refactor logic task (#13948) 2023-04-26 10:01:51 +08:00
Wenjun Ruan
61a689aa5a
Use percentage to represent memory/cpu usage (#13896) 2023-04-13 15:48:20 +08:00
Rick Cheng
7ee66f2d02
[Feature-13429][Remote Logging] Add support for writing task logs to Google Cloud Storage (#13777) 2023-04-06 17:49:33 +08:00
Wenjun Ruan
41a8ba9aab
Support alert server HA (#13865)
* Support alert server cluster

* Remove WORKER_ALERT_LISTEN_HOST in statefulset-dolphinscheduler-worker.yaml
2023-04-05 17:31:50 +08:00
Wenjun Ruan
c9066e8de9
Use MDC to filter task instance log (#13673)
* Use MDC to collect task instance log
* Use MDCAutoClosableContext to remove the MDC key
2023-03-06 17:44:23 +08:00
Aaron Wang
047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes (#13550) 2023-02-21 23:26:21 +08:00
seedscoder
8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger (#13509) 2023-02-07 20:32:53 +08:00
Wenjun Ruan
14ec4a2398
Remove dao module in worker (#13242) 2022-12-22 12:25:29 +08:00
Wenjun Ruan
70ccffeee2
Format task parameter as pretty json (#13173) 2022-12-13 16:30:21 +08:00
rickchengx
38b876733c
[Feature-10498] Mask the password in the log of sqoop task (#11589) 2022-11-24 14:54:54 +08:00
John Bampton
27c37b8828
Fix grammar and spelling (#12937) 2022-11-18 23:03:34 +08:00
Jay Chung
6d8befa075
[fix] Add token as authentication for python gateway (#12893)
separate from #6407. Authentication, add secret to ensure only trusted people could connect to gateway.

fix: #8255
2022-11-14 18:43:08 +08:00
Tq
d324cce6f1
[Feature-12526][Api] add dynamic task function: shell task (#12840)
* submit dynamic task code

* submit shell.json

* add dynamic-task-type-config.yaml to standalone server
2022-11-14 13:52:44 +08:00
Eric Gao
6d79414491
Add instructions on how to configure logging level for debugging purpose (#12699) 2022-11-07 10:30:56 +08:00
Wenjun Ruan
e6da1ccf81
Add worker-group-refresh-interval in master config (#12601)
* Add worker-group-refresh-interval in master config

* Set interval cannot smaller than 10s

* Update dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/config/MasterConfig.java

Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2022-10-31 09:37:26 +08:00
kezhenxu94
065d5caccc
Only expose necessary actuator endpoints (#12571) 2022-10-28 07:40:32 +08:00
Wenjun Ruan
76a9e6d8a6
Add task executor threads full policy config in worker (#12510) 2022-10-26 10:29:22 +08:00
Eric Gao
d46e4659d9
[Improvement][Style] Fix remaining style errors and wildcard imports (#12412)
* Fix remaining style errors and wildcard imports

* Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link

* Fix spotless matching scope of markdown files
2022-10-19 11:08:04 +08:00
kezhenxu94
4ea7eec750
Use temurin Java docker images instead of deprecated ones (#12334) 2022-10-17 15:46:21 +08:00
caishunfeng
40090d459e
[Improvement] remove log-server and server module (#12206)
* remove log-server module

* remove dolphinscheduler-server module
2022-09-30 16:41:41 +08:00
Daniel Y
009cb68011
[Improvement-11834] Upgrade docker base image to support python3.9 (#11835)
* use openjdk:8-jre-slim-bullseye instead of buster to support python3.9

* use openjdk:8-jre-slim-bullseye instead of buster across all components
2022-09-14 09:29:45 +08:00
He Zhao
ca22c083b3
[Fix] [Quartz] cron did not work as expected (#11851)
* [Fix] [Quartz] cron did not work as expected

* [Fix] [Quartz] make the value of batchTriggerAcquisitionMaxCount to 1(default value)

Co-authored-by: hezhao2 <hezhao2@cisco.com>
2022-09-13 16:05:40 +08:00