Commit Graph

853 Commits

Author SHA1 Message Date
Jay Chung
25e841a228
chore: Correct db upgrade and add ci avoid regression (#14620)
add atlasgo to ci
https://atlasgo.io/declarative/diff
related: https://github.com/apache/dolphinscheduler/issues/11286

BTW, it seems some ddl change only exist in 3.1.3、3.1.5、3.1.6 but do not exist in dev which will also cause an error when updating from those version
2023-08-30 11:55:05 +08:00
calvin
e2b97c026e
[Improvement][UI] Support to disable or enable the project preferences. (#14756) 2023-08-16 20:20:48 +08:00
Gallardot
a826ed2c1a
[Improvement][security] get-user-info API endpoint should not return the user's password in MD5 format (#14680)
* [Improvement][security] get-user-info API endpoint should not return the user's password in MD5 format

Signed-off-by: Gallardot <gallardot@apache.org>

* [Improvement][security] list-paging API endpoint should not return the user's password in MD5 format

Signed-off-by: Gallardot <gallardot@apache.org>

---------

Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
2023-08-14 18:28:11 +08:00
eye-gu
dde45dbdfb
[Fix-13972][dao] set default value for command (#14612) 2023-08-14 09:53:26 +08:00
Gallardot
a5f5aacb5d
[Bug][Alert]batchInsert execption #14686 (#14687)
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-08-03 18:15:09 +08:00
Gallardot
37ecd262ee
[Bug][Alert]batchInsert execption #14675 (#14676)
Signed-off-by: Gallardot <gallardot@apache.org>
2023-08-01 13:54:00 +08:00
Rick Cheng
79cf785eca
[Improvement][Parameter] Improve the order of project parameter (#14581) 2023-07-27 18:20:36 +08:00
amao
5ccc4cc889
[Improvement-4375][api] cannot delete yarn queue (#13046)
* [Bug-12833][api]
delete api

* [Bug-12833][api]
delete yarn queue

* [Bug-12833][api]
add Unit Test

* Repair the failed CI

* Repair the failed UT

* Repair the failed Docs

* Repair the failed Doc

---------

Co-authored-by: amao <Guoqing.Mao@Yumchina.com>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-26 11:52:57 +08:00
Aaron Wang
759756ae80
[Improvement-14269][API] Bind task group with project (#14392)
* [Improvement-14269][API] Bind task group with project

* remove comment

* add project permission check for task group operation

* add doc
2023-07-23 12:11:37 +08:00
eye-gu
50cc65b118
[Fix-13976][dao] task complete contain force success state (#14611)
Co-authored-by: eye <eye.gu@aloudata.com>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-21 11:50:29 +08:00
Jay Chung
de2d215aee
impv: Correct datax execute and python execute script name (#14523)
* impv: Correct datax execute and python execute script name

we use PYTHON_LAUNCHER for python script execute and
DATAX_LAUNCHER for datax script name

* Add pr number

* fix ut

* style

---------

Co-authored-by: xiangzihao <460888207@qq.com>
2023-07-20 09:13:55 +08:00
Wenjun Ruan
8505f1878d
Expose swagger.properties to release (#14590) 2023-07-19 22:24:42 +08:00
calvin
20cf4ad4e6
[Feature-14505][UI] Support to set project-level preferences (#14573)
* add a few codes about the project preferences
2023-07-19 15:35:54 +08:00
Eric Gao
06b6ea81cf
[Bug][Core] Fix query process instances by trigger code bug (#14528)
* Fix query process instances by trigger code bug

* Add comment
2023-07-13 16:56:04 +08:00
旺阳
175d976cd2
[Feature][Data Quality] Data Quality Support Choose Database (#14406)
* add dataquality database api

* change ui

* api change

* update

* fix spotless

* fix h2

* fix pg

* fix-dead-line

* update

* fix-spotless

* update pg sql

* add ut

* fix ut
2023-07-12 09:00:28 +08:00
Rick Cheng
29a9888167
[Improvement-12700][Project]Improve the sql of listAuthorizedProjects (#12702) 2023-07-11 20:12:16 +08:00
Rick Cheng
3de0b5a38c
[Feature-14339][Parameter] Add parameter combining of project-level parameters (#14452) 2023-07-10 10:17:46 +08:00
He Wang
107643dba8
Support to use OceanBase like MySQL as metadata database (#13662)
* modify the order of creating tables

* use temp variable to set 'sql_mode'

* Revert "modify the order of creating tables"

This reverts commit 6f3534e92824ac0c94cbef8f79a4d8cd8e17142a.
2023-07-07 10:36:44 +08:00
Rick Cheng
68a3a75211
[Improvement-14457][UT] Improve the expected and actual value of Assertions (#14459) 2023-07-06 13:12:48 +08:00
Gavin Hawk
dec066f8ce
修复Issue-14397:由于导入的工作流没有设置taskExecuteType导致在任务定义页面中无法展示出来,地址:https://github.com/apache/dolphinscheduler/issues/14397 (#14398)
Co-authored-by: huangjp@zetyun.com <huangjp@zetyun.com>
2023-07-04 10:47:15 +08:00
Jay Chung
221df4a278
revert: Datasource need test binding to create prod (#14381)
We should keep our step as less as possible, for now, we have to
test datasource and binding it to the prod datasource, I think it will
make our users do not thing to use datasource, so I do like to revert
it and keep step as less as possible

related to https://github.com/apache/dolphinscheduler/pull/11670
2023-06-27 10:59:17 +08:00
calvin
d4921fa2dd
[Feature][UI] Support CRUD of project-level parameters. (#14344) 2023-06-13 18:54:41 +08:00
xuankun zheng
61118d4467
[fix-14123] remove the equals and hashcode in Project pojo (#14167)
* [fix] remove the equals and hashcode in Project pojo

* [fix]fix the Strict Problem in Mockito by using `doReturn()` instead of `when()` functionw

---------

Co-authored-by: xuankun zheng <zhxuankun@gmail.com>
2023-06-13 11:19:04 +08:00
Rick Cheng
1c935d901e
[Feature-14214][Parameter] Support CRUD of project-level parameters (#14264) 2023-06-12 13:35:38 +08:00
Wenjun Ruan
aa2d9a7f05
Add baseDao (#14316) 2023-06-09 19:02:50 +08:00
JieguangZhou
e7cdc7c136
[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters (#14127)
* add dynamic task plugin

* fix ui

* update code

* add DOC

* ADD UT

* fix doc

* fix sanity check

* add upgrade ddl
* fix sql
2023-06-07 16:01:06 +08:00
Rick Cheng
929811760a
[Fix-14284][DAO] update the check of Integer in equals() (#14285) 2023-06-07 12:08:48 +08:00
calvin
4c2e57cfb3
[Feature][UI] Support to view and manage all timing settings of a project. (#14178) 2023-05-24 08:50:53 +08:00
Rick Cheng
428f1559a3
[Improv-14083][Resource Center] Handle deleteSource in OSS / S3 / GCS (#14084) 2023-05-22 20:44:43 +08:00
calvin
f0881b65a1
fix syntax errors (#14124) 2023-05-17 08:59:24 +08:00
Aaron Wang
1e3ae7b942
[improv][Resource Center] Implement getResourceFileName in StorageOperator (#14097) 2023-05-15 14:02:30 +08:00
eye-gu
cfbf675737
[Fix-14049][dao] fix init sql and use on conflict do update in pg (#14051) 2023-05-06 17:11:43 +08:00
liyou
71bbd00ef1
alarm instance add sort (#14058) 2023-05-05 20:53:11 +08:00
Wenjun Ruan
cf91544b99
Refactor logic task (#13948) 2023-04-26 10:01:51 +08:00
破晓
fba47b337e
[BUG][Data Quality] Fixing the incorrect DML statements in upgrade SQL. (#13960) 2023-04-24 12:08:10 +08:00
Aaron Wang
c2711f501f
[Fix-13977][SQL] 3.2.0_schema mysql ddl sql error (#13979) 2023-04-21 15:14:44 +08:00
Kerwin
79cb707b57
[Improvement-13932][API] Tenant parameters and Worker group parameters are put together in the task startup parameters (#13935)
* [Improvement][API] Tenant parameters and Worker group parameters are put together in the task startup parameters
2023-04-18 14:56:38 +08:00
Wenjun Ruan
9df89cf0cf
Use bootstrap user as the default tenant (#13825) 2023-03-30 14:11:23 +08:00
caishunfeng
9d9ae9ad54
[improvement] support self-dependent (#13818) 2023-03-29 18:18:03 +08:00
sandiegoe
21ca8ddf03
[fix-13734] Fix taskExecuteType field of task definition was not set correctly (#13735)
Co-authored-by: shenzhaoquan <shenzhaoquan@shenqingtech.com>
2023-03-27 10:50:01 +08:00
Wenjun Ruan
0bfd7d66d9
db: Modify name len to 255 (#13788) 2023-03-24 09:40:09 +08:00
Aaron Wang
8895921d87
[Improvement-13651] Remove useless resources_task (#13721) 2023-03-23 22:52:23 +08:00
陈家名
c2d5774790
[Improvement] SQL optimization queryTheHighestPriorityTasks (#13671)
Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
2023-03-05 22:35:24 +08:00
Wenjun Ruan
4351a25f2a
Add execute function to handle the workflow instance operation (#13610) 2023-02-24 13:47:41 +08:00
fuchanghai
c406f81e9c
[improve-#13597] fix the method name (#13599) 2023-02-22 10:53:51 +08:00
Wenjun Ruan
133d1733eb
Alter title in t_ds_alert to 512 (#13535) 2023-02-09 09:41:07 +08:00
seedscoder
8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger (#13509) 2023-02-07 20:32:53 +08:00
Stalary
b9ef4a7177
FIX: qrtz table use uppercase (#13494)
* FIX: use uppercase
2023-02-02 11:25:27 +08:00
Stalary
5fb6035f0d
fix: 3.1.1_schema mysql ddl sql error (#13485) 2023-02-01 21:11:05 +08:00
Wenjun Ruan
af9091a98a
Use convert to set the exist column collate to utf8_bin (#13479) 2023-02-01 18:40:18 +08:00