Eric Gao
d675d32771
Fix confusing constant string for unit convertor ( #15126 )
2023-11-06 21:32:36 +08:00
Gallardot
8c01fcf14b
[Improvement][K8S] Remove ResourceQuota ( #14991 )
...
* [Improvement][K8S] Remove ResourceQuota
Signed-off-by: Gallardot <gallardot@apache.org>
* chore: fix pg
Signed-off-by: Gallardot <gallardot@apache.org>
* chore: Clean up unused code
Signed-off-by: Gallardot <gallardot@apache.org>
* chore: naming conventions
Signed-off-by: Gallardot <gallardot@apache.org>
---------
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-11-03 15:18:50 +08:00
Wei Xiaonan
c0ed68121d
[Feature-14832][Listener]Implementation of Listener Mechanism ( #14981 )
...
* first commit
* 1. sql: sync ddl
2. front-end: change to ternary expression
3. back-end: correct license header in ListenerEvent.java
* test case
* frontend: remove unnecessary console
* fix unit test
* remove log depends on user-provided value
* fix dolphinscheduler_postgresql.sql
* sync database schema
* fix unit test
* fix unit test
* fix some NIT.
* extract GLOBAL_ALERT_GROUP_ID into variable
* fix ddl bug
* add column task_type in t_ds_fav_task in upgrade/3.2.0_schema
* add unit test
2023-10-29 20:28:05 +08:00
Wenjun Ruan
b750db3c37
Add IT for dolphinscheduler-tools module ( #15043 )
2023-10-20 15:39:42 +08:00
Wenjun Ruan
33084d281f
Add dolphinscheduler-dao-plugin module ( #15019 )
2023-10-14 17:58:40 +08:00
Wenjun Ruan
312c339722
Delete File generated by UT ( #15022 )
2023-10-13 16:43:54 +08:00
Kerwin
1f67e68400
Revert "[Bug] [Resource] fix resource delete bug ( #15003 )" ( #15020 )
...
This reverts commit d6a900667a
2023-10-12 04:28:11 -05:00
liyou
d6a900667a
[Bug] [Resource] fix resource delete bug ( #15003 )
2023-10-12 03:28:23 -05:00
Gallardot
2a65590117
[Improvement][Task] Mask password in task log ( #14988 )
...
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-10-08 01:54:45 -05:00
winghv
c5bc535b85
[Improvement][Common] Obtain resource information in the k8s environm… ( #14968 )
...
* [Improvement][Common] Obtain resource information in the k8s environment.
* [Improvement][Common] Change the comment
---------
Co-authored-by: 旺阳 <qingwli@cisco.com>
2023-09-28 16:40:17 +08:00
Wenjun Ruan
020092ed1e
Set charset in upgrading tools to solve read upgrade sql mojibake ( #14955 )
2023-09-26 09:46:25 +08:00
Aaron Wang
73e846d03e
[Improvement-14884][Master] Add overload state in master heartbeat to trigger slot change ( #14887 )
2023-09-14 10:36:42 +08:00
JueLance
e7c579d8f1
Fix java.sql.Date serialize error by convert it to java.util.Date ( #13050 )
2023-09-13 09:54:55 +08:00
sgw
76bbcbeb30
[Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent ( #14824 )
...
* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970 )
* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970 )
- delete useless output
* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970 )
- add log
- run spotless check
---------
Co-authored-by: 旺阳 <qingwli@cisco.com>
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
2023-09-09 17:23:34 +08:00
Aaron Wang
b12df72a0c
[Fix][Resource Center] Remove NONE storage type and set LOCAL type as default ( #14661 )
2023-09-07 14:09:15 +08:00
Wenjun Ruan
55cc77226f
[RPC] Refactor the remote module. ( #14776 )
...
* Add dolphinscheduler-extract-base
* Add dolphinscheduler-extract-master
* Add dolphinscheduler-extract-worker
* Add dolphinscheduler-extract-alert
2023-08-23 09:43:17 +08:00
yangyang zhong
70731a1617
[Feature][Authentication] support oauth2 login ( #14743 )
...
* support oauth2 login
---------
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2023-08-21 15:57:30 +08:00
Edison Catto
25480ae9e7
[Feature][Resource Center] Add support for Huawei Cloud OBS ( #14643 )
...
* [Feature][Resource Center] Add support for Huawei Cloud OBS as storage of resource center
* add license and add doc
* add 3-party dependency license
* Update LICENSE
* fix
* Update pom.xml
* fix
* fix
---------
Co-authored-by: sunkang <sunkang@hjfruit.com>
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
2023-08-14 13:25:48 +08:00
Wenjun Ruan
93b0283dfe
Set tenant as the the resource file owner ( #13832 )
2023-08-11 00:57:47 +08:00
Wenjun Ruan
9ce8871158
Support get property from env/jvm/common.properties ( #14645 )
2023-07-28 14:41:58 +08:00
Wenjun Ruan
2b99451ccd
Support filter restrict network interface ( #14638 )
2023-07-26 23:03:58 +08:00
Wenjun Ruan
cbd354d134
Add host/port in heartbeat ( #14591 )
2023-07-20 21:26:35 +08:00
Xinxing
1d0d85b988
[Feature] doris add datasource ( #14391 )
...
* Added doris data source plug-in
* Update DbType.java
* XML configuration
* doc and ui
* Missing catch of NumberFormatException
* code format
---------
Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-20 17:15:22 +08:00
Wenjun Ruan
c30cca9d9a
Support execute shell in different interceptor ( #14582 )
2023-07-19 14:50:04 +08:00
Wenjun Ruan
399d0d0ce9
Add log for NetUtils ( #14578 )
2023-07-18 21:17:17 +08:00
Gallardot
9d10de6efa
[Improvement][Task] Mask configYaml in task log ( #14571 )
...
* [Improvement][Task] Mask configYaml in task log
Signed-off-by: Gallardot <gallardot@apache.org>
---------
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
2023-07-18 15:02:20 +08:00
Wenjun Ruan
e6d94632b9
Add WorkflowExecuteContext ( #14544 )
2023-07-14 18:40:01 +08:00
旺阳
175d976cd2
[Feature][Data Quality] Data Quality Support Choose Database ( #14406 )
...
* add dataquality database api
* change ui
* api change
* update
* fix spotless
* fix h2
* fix pg
* fix-dead-line
* update
* fix-spotless
* update pg sql
* add ut
* fix ut
2023-07-12 09:00:28 +08:00
calvin
76b1eefb68
[Feature-14321][API] Support to complement data in descending or ascending order of date ( #14450 )
2023-07-05 14:35:18 +08:00
zhangkuantian
6f90156577
oss avoid listBuckets permission in bucket check ( #14414 )
...
---------
Co-authored-by: kuantian.zhang <kuantian.zhang@inceptio.ai>
2023-06-28 14:21:17 +08:00
IT-Kwj
7a24be0672
[Feature-14404][datasource-plugin] add HANA datasource ( #14404 )
...
---------
Co-authored-by: WeiJian Kong <>
Co-authored-by: xujiaqiang <Xjq634828243>
2023-06-28 10:56:41 +08:00
Rick Cheng
4fa0ab4d7e
[feature][Resource] Add support for Azure Blob Storage in the resource center ( #14082 )
2023-06-12 12:05:49 +08:00
Rick Cheng
66e09dc66e
[Improvement-14295][common] Remove the duplicate FileUtils ( #14301 )
2023-06-08 08:59:53 +08:00
JieguangZhou
e7cdc7c136
[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters ( #14127 )
...
* add dynamic task plugin
* fix ui
* update code
* add DOC
* ADD UT
* fix doc
* fix sanity check
* add upgrade ddl
* fix sql
2023-06-07 16:01:06 +08:00
Rick Cheng
2c057d6a8f
[Improvement-14292][Common] Remove the duplicate OSUtils ( #14293 )
2023-06-07 14:59:25 +08:00
Zinway
18d176c5f4
feat: Introduce new datasource vertica ( #14232 )
...
Co-authored-by: Zinway Liu <zinway.liu@ucloud.cn>
2023-06-02 13:57:37 +08:00
Zzih
43d7b35977
[fix-14119] The checkBucketNameExists method should not use s3Client. listBuckets() ( #14188 )
...
* optimize checkBucketNameExists
* fix code style
---------
Co-authored-by: 詹子恒 <ziheng.zhan@longbridge.sg>
2023-05-24 13:43:44 +08:00
Aaron Wang
5e87b2d58a
[Bug][Worker] generate kill command with unknown user: default ( #14145 )
2023-05-22 20:48:40 +08:00
He Zhao
f1e78627fc
[feature][plugin] Add snowflake datasource in datasource plugin ( #13729 )
...
---------
Co-authored-by: weitong <weitong@cisco.com>
2023-05-06 19:30:50 +08:00
Bingchang Chen
77e58ce245
[Feature] Add SSO login by Casdoor ( #8706 )
2023-05-05 14:43:06 +08:00
Wenjun Ruan
cf91544b99
Refactor logic task ( #13948 )
2023-04-26 10:01:51 +08:00
Jeremy
db6c061c8b
[Feature][plugin] Add databend datasource in datasource plugin ( #13866 )
...
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2023-04-24 21:28:14 +08:00
fuchanghai
ec29220977
[improve-#13966] mask datax log ( #13969 )
...
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
2023-04-21 14:51:37 +08:00
He Zhao
c0126b7f30
[Feature][plugin] Support Kyuubi datasource ( #13642 )
...
---------
Co-authored-by: weitong <weitong@cisco.com>
Co-authored-by: Rick Cheng <38122586+rickchengx@users.noreply.github.com>
2023-04-18 11:12:39 +08:00
Wenjun Ruan
61a689aa5a
Use percentage to represent memory/cpu usage ( #13896 )
2023-04-13 15:48:20 +08:00
Rick Cheng
7ee66f2d02
[Feature-13429][Remote Logging] Add support for writing task logs to Google Cloud Storage ( #13777 )
2023-04-06 17:49:33 +08:00
Wenjun Ruan
41a8ba9aab
Support alert server HA ( #13865 )
...
* Support alert server cluster
* Remove WORKER_ALERT_LISTEN_HOST in statefulset-dolphinscheduler-worker.yaml
2023-04-05 17:31:50 +08:00
Wenjun Ruan
69fc217ab2
Fix trim might cause NPE in PropertyUtils ( #13853 )
2023-04-04 12:22:34 +08:00
Wenjun Ruan
9df89cf0cf
Use bootstrap user as the default tenant ( #13825 )
2023-03-30 14:11:23 +08:00
Rick Cheng
85605bbef9
[Improvement-13653][Remote Logging] Support api-server to get task log from remote target ( #13654 )
2023-03-30 12:07:58 +08:00
