Commit Graph

905 Commits

Author SHA1 Message Date
Amy0104
f5711e4fcd
[Feature][UI Next][V1.0.0-Alpha] Unify clickable text in tables. (#8813) 2022-03-10 18:48:40 +08:00
calvin
41b66b6adb
[Fix-8746][UI] Rectify the issue with affecting the original node's data when editing the form of the copied node. (#8791) 2022-03-10 11:36:01 +08:00
wangqiang
0bce1a96a1
[Fix-8786] [ui] Fixed the "RESOURCE_NOT_EXIST" error message when clicking udF resource list file navigation prompt #8786 (#8788)
* [fix] [ui] Fixed the re-upload function of the Resource Management menu
* Modify resource file list and sub-file front-end code
* Modify udF resource file list and subfile front-end code
* Fix modified page does not dynamically update content, added V-if judgment

* [fix] [ui] Fixed the re-upload function of the Resource Management menu
* Modify resource file list and sub-file front-end code
* Modify udF resource file list and subfile front-end code
* Fix modified page does not dynamically update content, added V-if judgment
* Fix duplicate ID problem

* [Fix] [ui] Fixed the "RESOURCE_NOT_EXIST" error message when clicking udF resource list file navigation prompt

Co-authored-by: wangqiang <wangqiang@coocaa.com>
2022-03-10 11:31:37 +08:00
王强
a4b34e63d0
[Fix] [ui] Fixed the re-upload function of the Resource Management menu #8764 (#8763)
* [fix] [ui] Fixed the re-upload function of the Resource Management menu
* Modify resource file list and sub-file front-end code
* Modify udF resource file list and subfile front-end code
* Fix modified page does not dynamically update content, added V-if judgment

* [fix] [ui] Fixed the re-upload function of the Resource Management menu
* Modify resource file list and sub-file front-end code
* Modify udF resource file list and subfile front-end code
* Fix modified page does not dynamically update content, added V-if judgment
* Fix duplicate ID problem

Co-authored-by: wangqiang <wangqiang@coocaa.com>
2022-03-09 14:35:43 +08:00
ronyang1985
7b66b66e8f
[Feature-8527][Datasource] Add dataSource for Amazon Redshift (#8564)
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
2022-03-01 19:29:52 +08:00
caishunfeng
84f2cfec39
[Feature][Server] Custom timezone - Add timezone handler unified (#8477)
* date convert of timezone

* remove @JsonFormat

* add unit test

* fix time preview in scheduler

* optimization & add env config

Co-authored-by: caishunfeng <534328519@qq.com>
2022-02-24 18:20:34 +08:00
zixi0825
df6eef84cd
fix(dq) change comparison_type from fluctuation to avg (#8382) 2022-02-20 20:59:08 +08:00
Devosend
d2f8d96fa0
[Fix-8412] [UI] Fix workflow definition timing edit bug. 2022-02-17 19:44:47 +08:00
mazhong
6334a8221a
[Bug-8170][UI] SUB_PROCESS Clicking into the child node does not react (#8371)
* Fix-8170 SUB_PROCESS Clicking into the child node does not react

* Fix-8170 SUB_PROCESS Clicking into the child node does not react
2022-02-17 15:44:19 +08:00
qianli2022
151100562f
[Feature][api] Task can run on kubernetes - k8s client and namespace #8247 (#8252)
* add db operator for namespace

* add k8s client

* add k8s controller

* add namespace ui

* add licenses

* add kubernetes model known-dependencies

* add new licenses

* fix SonarCloud Code Analysis bug

* remove license for standard protocol

* fix variable MemoryStr to memoryStr

Co-authored-by: qianl4 <qianl4@cicso.com>
2022-02-15 10:21:15 +08:00
calvin
b2108486ba
[Fix][UI] Rectify this issue with missing the re-uploading file button when the file is under the root directory. 2022-02-14 20:14:24 +08:00
calvin
3f6caef08f
[Fix-8187][UI] Add the function to the module of resource that you can re-upload the file on the page of the file management. (#8359)
* add reupload file

* develop reupload file

* fix this issue
2022-02-13 11:47:10 +08:00
wangyizhi
d9df8319a2
[Fix-8172][UI] Fix coordinate calculation error (#8346)
* [Fix-8172][UI] Fix coordinate calculation error

* [Fix-8172][UI] Code format
2022-02-11 20:24:07 +08:00
wangyizhi
0f04b3cfaa
[Fix-8335][UI] Sqoop node change data source type to hive error (#8348) 2022-02-11 16:49:51 +08:00
calvin
42aab0f47a
fix this issue (#8332) 2022-02-10 18:39:04 +08:00
wind
fc9a31f813
[E2E] add switch task case (#8180)
* fix switch bug

* add switch e2e test

* add switch workflow

* pre task option

* selectPreTask id

* update

* switch task e2e

* naming optimization

Co-authored-by: caishunfeng <534328519@qq.com>
2022-02-10 10:00:50 +08:00
QuakeWang
fd38ef129b
[E2E] Add the update test for tenant (#8282) 2022-02-08 09:25:00 +08:00
Kerwin
36d526d3a8
[Improvement-8284][Alert] Dingtalk alert plugin supports markdown message type (#8285)
* add msgtype in the dingtalk alert plugin

* update markdown msgtype 'at persion'
2022-02-07 22:07:37 +08:00
calvin
41efe305bb
fix this issue (#8280) 2022-02-04 16:41:16 +08:00
calvin
83d08e013a
fix this issue (#8272) 2022-01-31 17:39:18 +08:00
QuakeWang
63f7efa993
[E2E] Add new test of token management (#8161) 2022-01-30 12:34:50 +08:00
xiangzihao
4b58df9aa8
[E2E] add function manage test case (#8250) 2022-01-30 09:01:19 +08:00
springmonster
baf0c95add
[Bug-8169] [dolphinscheduler-ui] Fix `After you save the workflow, it… (#8198) 2022-01-28 18:42:36 +08:00
Devosend
3c10bbe157
[FIX-7514] press Enter key get "true" not new line (#7596) 2022-01-28 18:25:25 +08:00
xiangzihao
d6690fa89c
[E2E] add udf manage test (#8203) 2022-01-27 16:17:32 +08:00
zixi0825
4ba6d667fc
[Feature][DataQuality] Add Data quality Module #4283 (#6718)
* add data quality module

* add license

* add package configuration in dist pom

* fix license and jar import bug

* replace apache/skywalking-eyes@9bd5feb SHA

* refacotr jbdc-connector and writer

* modify parameter name in HiveConnector

* fix checkstyle error

* fix checkstyle error in dolphinschesuler-dist

* fix checkstyle error in dolphinschesuler-dist

* fix checkstyle error in dolphinschesuler-dist

* fix duplicate code bug

* fix code style bug

* fix code smells

* add dq relevant enums and parameter

* replace apache/skywalking-eyes@9bd5feb SHA

* fix Constants bug

* remove the unused class

* add unit test

* fix code style error

* add unit test

* refactor data quality common entity

* fix code style error

* add unit test

* close e2e test

* fix code smell bug

* modify dataquality enum value to 14 in TaskType

* add data qualtiy task

* update

* add getDatasourceOptions interface

* fix checkstyle

* close e2e test

* add data quality task ui

* update skywalking-eyes SHA

* fix style

* fix eslint error

* fix eslint error

* test e2e

* add unit test and alter dataquality task result

* fix checkstyle

* fix process service test error

* add unit test and fix code smells

* fix checkstyle error

* fix unit test error

* fix checkstyle error

* change execute sql type name

* revert ui pom.xml

* fix data quality task error

* fix checkstyle error

* fix dq task src_connector_type ui select bug

* fix spark rw postgresql bug

* change mysql driver scope

* fix form-create json bug

* fix code smell

* fix DolphinException Bug

* fix ui validate rule and Alert title

* fix target connection param bug

* fix threshold validate change

* add rule input entry index

* change statistic_comparison_check logic

* remove check type change

* add DateExpressionReplaceUtil

* fix null point expetion

* fix null point expetion

* fix test error

* add more sql driver

* fix test error and remove DateExprReplaceUtil

* add get datasource tables and columns

* add get datasource tables and columns

* remove hive-jdbc in pom.xml

* fix code smells

* update sql

* change the pom.xml

* optimize multi_table_accuracy ui

* fix v-show error

* fix code smells

* update sql

* [Feature][DataQuality] Add data quality task ui (#5054)

* add data quality task ui

* update skywalking-eyes SHA

* fix style

* fix eslint error

* fix eslint error

* test e2e

* fix dq task src_connector_type ui select bug

* fix threshold validate change

* remove check type change

* add get datasource tables and columns

* optimize multi_table_accuracy ui

* fix v-show error

* fix code smells

Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>

* [Feature][DataQuality] Add data quality module  (#4830)

* add data quality module

* add license

* add package configuration in dist pom

* fix license and jar import bug

* replace apache/skywalking-eyes@9bd5feb SHA

* refacotr jbdc-connector and writer

* modify parameter name in HiveConnector

* fix checkstyle error

* fix checkstyle error in dolphinschesuler-dist

* fix checkstyle error in dolphinschesuler-dist

* fix checkstyle error in dolphinschesuler-dist

* fix duplicate code bug

* fix code style bug

* fix code smells

* update

* close e2e test

* fix spark rw postgresql bug

* change mysql driver scope

* add more sql driver

* remove hive-jdbc in pom.xml

* change the pom.xml

Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>

* [Feature][DataQuality] Add data quality task backend (#4883)

* add dq relevant enums and parameter

* replace apache/skywalking-eyes@9bd5feb SHA


Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>

* refactor data_quality_module

* add header license

* data quality module refactor

* fix unit test error

* fix checkstyle error

* fix unit test error

* fix checkstyle error

* fix unit test error

* fix code smell

* fix check style

* fix unit test error

* task statistics value add unique code

* fix unit test error

* fix checkstyle error

* fix checkstyle

* fix security hotspot

* fix unit test error

* fix security hotspot

* fix check

* add data quality task error handling

* fix unit test error

* add unit test

* add unit test

* optimize data quality result alert

* fix unit test

* fix sql script error

* fix bug

* update sql script

* fix checkstyle

* add license

* fix checkstyle

* fix checkstyle

* fix unit test

* add jacoco dependencies

* fix unit test

* fix unit test

* add jacoco dependencies

* add unit test

* add unit test

* add license

* fix checkstyle

* fix pom

* fix checkstyle

* fix checkstyle

* merge dev

* fix ui error

* fix pom error

* fix pom error

* fix test error

* fix test error

* mssql-jdbc exclude azure-keyvault

* fix test error

* merge dev and add unit test

* add notes

* rollback the CollectionUtils

* fix

* update sql

* fix

* fix

* fix query rule page error

* change dq.jar path

* fix sql error

* fix ui error

* fix(dq): jar path&task enum description

* add notes on DataQualityApplication

* fix dq result jump error

* fix(ui): page condition

* feat(ui): add show error output path

* change version

* remove all chinese word in sql

* merge

Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>
2022-01-27 15:55:45 +08:00
xiangzihao
7b22c16a85
[E2E]Fix file manage e2e error (#8214) 2022-01-27 14:59:22 +08:00
yc322
fb9f4a1339
[Feature-5822][api] Add audit log (#6322)
* rebase

* update audit log type name

* fix the quoted property error

* fix bug

* update audit global switch default value

* fix wrong ddl comment

* fix wrong code style

* update audit log search sql

* add licenses

* add unit test

* fix wrong code style

* fix bugs

* fix wrong code style

* add test case

* add test case

* add license

* Add unit test in pom.xml

* resolve code smell problem

* mysql and postgresql ddl update

* update audit log path and audit page query

* update audit configuration

* update audit log schema, add resource type and resource id

* update audit query and list page

* resolve audit log front page bugs and log query error

* update audit configuration

* resolve wrong configuration

* update AuditLogControllerTest

* update application.yaml

* resolve code smell

* update standalone configuration

* resolve bugs

Co-authored-by: yc322 <1393242780@qq.com>
2022-01-26 09:53:18 +08:00
xiangzihao
30b8b4a93e
[E2E][CI] Add renaming file management E2E tests (#8160) 2022-01-26 09:45:21 +08:00
Kerwin
103ccb01da
change version to 2.0.4-SNAPSHOT (#8188) 2022-01-25 15:17:17 +08:00
Kerwin
1fd748f376
[Feature-8138][Task] add at@ msg in the dingtalk task plugin (#8139) 2022-01-21 17:09:39 +08:00
Devosend
a77b0ef93b
[Fix-8098] [UI] Fix resource manage bug (#8107) 2022-01-20 10:19:02 +08:00
xiangzihao
e7f480bdca
[E2E][CI] Add DataSource E2E test (#8085) 2022-01-19 17:29:02 +08:00
songjianet
c201c156f3
[Feature][Dag] Number of failed retries and failed retry interval use input component. (#8104) 2022-01-18 19:09:56 +08:00
songjianet
9faeef5877
[Feature][Workflow Instance] Add Workflow instalce batch delete reload table list. (#8082) 2022-01-17 15:10:00 +08:00
Jiajie Zhong
a061cf136c
[e2e] Add new test of security environment (#8048)
* [e2e] Add new test of security environment

ref: #7281

* Fix frontend bug

* Fix order of UT

* Fix delete and edit bottom class

* Try to fix

* Try to fix
2022-01-15 09:13:04 +08:00
songjianet
0c353d69e2
[Fix][Dag] Timeout alert. (#8049) 2022-01-14 18:34:21 +08:00
xiangzihao
e45e78d803
[Fix-7513] Fix identical numbers and add positive integer judgment (#8032)
* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* fix bug_7513

* test

* test

* test

* test

* test

* chinese change
2022-01-14 15:45:53 +08:00
calvin
677482795c
fix a little issue (#8039) 2022-01-14 14:33:57 +08:00
Kerwin
b9b0722b4b
Fix query workflow history version information error (#7988) 2022-01-13 14:04:36 +08:00
Kerwin
cb8c875fa8
[Feature-7804][Task] DingTalk alert plugin adds signature. (#7805)
* DingTalk alarm component adds signature.

* fix code style.

* fix code style.

* add dingtalk document link

* fix DingTalkAlertChannelFactoryTest

* update NAME_DING_TALK_SECRET
2022-01-12 15:24:25 +08:00
Kerwin
64efc65edf
Create or update users to add tenants cannot be empty verification. (#7594) 2022-01-12 14:38:41 +08:00
xiangzihao
5be8e0531c
[E2E] [Resource] add file manage case (#7906) 2022-01-12 14:29:03 +08:00
calvin
8cac0d8f94
[Fix-7288] Not allow to delete the default alarm group. (#7932) 2022-01-12 14:12:30 +08:00
wind
3edc58cbdd
[E2E] Add queue e2e test (#7941) 2022-01-12 10:31:17 +08:00
calvin
24eb40c2b2
[Fix-7857] The user won't be allowed to disable their own account. (#7891) 2022-01-08 18:01:22 +08:00
janeHe13
0b38d0e826
[E2E]add worker group manage e2e case (#7879)
* add worker group manage e2e case

* add worker group manage e2e case

* Update dolphinscheduler-e2e/dolphinscheduler-e2e-case/src/test/java/org/apache/dolphinscheduler/e2e/cases/WorkerGroupE2ETest.java

Co-authored-by: janeHe13 <438044805@qq.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-01-07 21:24:03 +08:00
Jiajie Zhong
9b6b381b93
[deploy] Split Ambari plugin to independent repo (#7880)
fix: #7036
2022-01-07 21:10:48 +08:00
Kerwin
5172862a0a
Add seatunnel task plugin (#7131) 2022-01-07 20:51:11 +08:00
wangyizhi
984665a5ef
[Feature-7018][UI] Add list edit view from task definition (#7852)
* Performance optimization of DEPENDENT task

* fix eslint

* [Feature] Improve task definition list

* feat: Task definition list

* change update interface
2022-01-07 10:38:56 +08:00