Commit Graph

5866 Commits

Author SHA1 Message Date
wangyang
49d581d72e
[DS-8215][feat] Support WebexTeams Plugin (#8217)
Co-authored-by: qingwli <qingwli@cisco.com>
2022-01-29 11:36:38 +08:00
Jiajie Zhong
7f4d26ee9c
Change bug-report add 2.0.4 and rm 2.0.0 and 1.3.6 (#8234) 2022-01-29 09:57:09 +08:00
songjianet
303845b78d
[Feature][UI Next] Default open task group manage and project task menu. (#8244) 2022-01-28 21:21:57 +08:00
calvin
7c5a53f70f
[Feature][UI Next] Add the page of task group queue. (#8243) 2022-01-28 20:29:37 +08:00
springmonster
baf0c95add
[Bug-8169] [dolphinscheduler-ui] Fix `After you save the workflow, it… (#8198) 2022-01-28 18:42:36 +08:00
Devosend
3c10bbe157
[FIX-7514] press Enter key get "true" not new line (#7596) 2022-01-28 18:25:25 +08:00
Amy0104
832f7352c9
[Feature][UI Next] Add monaco editor to form (#8241) 2022-01-28 18:03:07 +08:00
songjianet
a778146ec6
[Fix][UI Next] Fix the problem that the switch language options are not updated. (#8239) 2022-01-28 15:56:03 +08:00
songjianet
c64c66e7cf
[Feature][UI Next] Add monitor statistics audit log. (#8238) 2022-01-28 15:30:10 +08:00
labbomb
e094f625d4
Fix the routing problem of project management module (#8236) 2022-01-28 14:52:49 +08:00
xiangzihao
1ce5b5d82d
fix_flaky_worker_group_e2e_test (#8237) 2022-01-28 14:15:33 +08:00
JinYong Li
65744d4624
[Cherry-pick-dev][API] fix relation api bug (#8207)
* pick 8111

* fix relation delete (#8190)

* pick 8190
2022-01-28 13:32:22 +08:00
xiangzihao
6094927dda
[E2E] Fix flaky udf manage e2e test (#8232)
* fix_file_manage_e2e_error

* fix error

* fix error

* fix error
2022-01-28 11:49:55 +08:00
Jiajie Zhong
f3d663a7ea
[python] Clean deps and prepare release (#8210)
* Change package name
* Migrate requirement*.txt to setup.py
* Add extra required for dev
* Add doc RELEASE and DEVELOP
* Correct description
2022-01-28 10:12:00 +08:00
songjianet
07a15b7040
[Fix][UI Next] Fix env. (#8229) 2022-01-27 21:43:53 +08:00
songjianet
d1f65053a8
[Feature][UI Next] Add project task instance. (#8220) 2022-01-27 20:18:41 +08:00
wind
756ea1181e
[Improvement][E2E] use testcontainers host (#8224) 2022-01-27 19:15:05 +08:00
songjianet
a11fbf8352
[Feature][UI Next] Change how env is used. (#8221) 2022-01-27 17:54:46 +08:00
xiangzihao
d6690fa89c
[E2E] add udf manage test (#8203) 2022-01-27 16:17:32 +08:00
zixi0825
4ba6d667fc
[Feature][DataQuality] Add Data quality Module #4283 (#6718)
* add data quality module

* add license

* add package configuration in dist pom

* fix license and jar import bug

* replace apache/skywalking-eyes@9bd5feb SHA

* refacotr jbdc-connector and writer

* modify parameter name in HiveConnector

* fix checkstyle error

* fix checkstyle error in dolphinschesuler-dist

* fix checkstyle error in dolphinschesuler-dist

* fix checkstyle error in dolphinschesuler-dist

* fix duplicate code bug

* fix code style bug

* fix code smells

* add dq relevant enums and parameter

* replace apache/skywalking-eyes@9bd5feb SHA

* fix Constants bug

* remove the unused class

* add unit test

* fix code style error

* add unit test

* refactor data quality common entity

* fix code style error

* add unit test

* close e2e test

* fix code smell bug

* modify dataquality enum value to 14 in TaskType

* add data qualtiy task

* update

* add getDatasourceOptions interface

* fix checkstyle

* close e2e test

* add data quality task ui

* update skywalking-eyes SHA

* fix style

* fix eslint error

* fix eslint error

* test e2e

* add unit test and alter dataquality task result

* fix checkstyle

* fix process service test error

* add unit test and fix code smells

* fix checkstyle error

* fix unit test error

* fix checkstyle error

* change execute sql type name

* revert ui pom.xml

* fix data quality task error

* fix checkstyle error

* fix dq task src_connector_type ui select bug

* fix spark rw postgresql bug

* change mysql driver scope

* fix form-create json bug

* fix code smell

* fix DolphinException Bug

* fix ui validate rule and Alert title

* fix target connection param bug

* fix threshold validate change

* add rule input entry index

* change statistic_comparison_check logic

* remove check type change

* add DateExpressionReplaceUtil

* fix null point expetion

* fix null point expetion

* fix test error

* add more sql driver

* fix test error and remove DateExprReplaceUtil

* add get datasource tables and columns

* add get datasource tables and columns

* remove hive-jdbc in pom.xml

* fix code smells

* update sql

* change the pom.xml

* optimize multi_table_accuracy ui

* fix v-show error

* fix code smells

* update sql

* [Feature][DataQuality] Add data quality task ui (#5054)

* add data quality task ui

* update skywalking-eyes SHA

* fix style

* fix eslint error

* fix eslint error

* test e2e

* fix dq task src_connector_type ui select bug

* fix threshold validate change

* remove check type change

* add get datasource tables and columns

* optimize multi_table_accuracy ui

* fix v-show error

* fix code smells

Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>

* [Feature][DataQuality] Add data quality module  (#4830)

* add data quality module

* add license

* add package configuration in dist pom

* fix license and jar import bug

* replace apache/skywalking-eyes@9bd5feb SHA

* refacotr jbdc-connector and writer

* modify parameter name in HiveConnector

* fix checkstyle error

* fix checkstyle error in dolphinschesuler-dist

* fix checkstyle error in dolphinschesuler-dist

* fix checkstyle error in dolphinschesuler-dist

* fix duplicate code bug

* fix code style bug

* fix code smells

* update

* close e2e test

* fix spark rw postgresql bug

* change mysql driver scope

* add more sql driver

* remove hive-jdbc in pom.xml

* change the pom.xml

Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>

* [Feature][DataQuality] Add data quality task backend (#4883)

* add dq relevant enums and parameter

* replace apache/skywalking-eyes@9bd5feb SHA


Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>

* refactor data_quality_module

* add header license

* data quality module refactor

* fix unit test error

* fix checkstyle error

* fix unit test error

* fix checkstyle error

* fix unit test error

* fix code smell

* fix check style

* fix unit test error

* task statistics value add unique code

* fix unit test error

* fix checkstyle error

* fix checkstyle

* fix security hotspot

* fix unit test error

* fix security hotspot

* fix check

* add data quality task error handling

* fix unit test error

* add unit test

* add unit test

* optimize data quality result alert

* fix unit test

* fix sql script error

* fix bug

* update sql script

* fix checkstyle

* add license

* fix checkstyle

* fix checkstyle

* fix unit test

* add jacoco dependencies

* fix unit test

* fix unit test

* add jacoco dependencies

* add unit test

* add unit test

* add license

* fix checkstyle

* fix pom

* fix checkstyle

* fix checkstyle

* merge dev

* fix ui error

* fix pom error

* fix pom error

* fix test error

* fix test error

* mssql-jdbc exclude azure-keyvault

* fix test error

* merge dev and add unit test

* add notes

* rollback the CollectionUtils

* fix

* update sql

* fix

* fix

* fix query rule page error

* change dq.jar path

* fix sql error

* fix ui error

* fix(dq): jar path&task enum description

* add notes on DataQualityApplication

* fix dq result jump error

* fix(ui): page condition

* feat(ui): add show error output path

* change version

* remove all chinese word in sql

* merge

Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>
2022-01-27 15:55:45 +08:00
xiangzihao
7b22c16a85
[E2E]Fix file manage e2e error (#8214) 2022-01-27 14:59:22 +08:00
songjianet
6f74241100
[Fix][UI Next] Fix alert plugin api. (#8211) 2022-01-27 10:29:53 +08:00
Amy0104
767c03551b
[Feature][UI Next] Add alarm instance manage (#8208) 2022-01-26 19:24:59 +08:00
wind
b05ba4d1b9
fix host update processor init (#8205)
Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-26 17:51:20 +08:00
labbomb
7945a2f3aa
[Feature][UI Next] Remove sidekey, resolve the sidebar route jump issue (#8200) 2022-01-26 15:15:07 +08:00
kezhenxu94
db953a229c
[E2E] Clean up the E2E with Java API to avoid platform sensitive (#8197) 2022-01-26 14:33:11 +08:00
ouyangyewei
aeb7d89c50
to improvement #8192 (#8193)
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
2022-01-26 13:32:17 +08:00
Jiajie Zhong
35578efd08
[python] Initiate document for pydolphinscheduler (#8005) 2022-01-26 12:37:57 +08:00
Wenjun Ruan
a1cc2fd11a
[task] Python task support PYTHON_HOME (#8196) 2022-01-26 11:09:57 +08:00
yc322
fb9f4a1339
[Feature-5822][api] Add audit log (#6322)
* rebase

* update audit log type name

* fix the quoted property error

* fix bug

* update audit global switch default value

* fix wrong ddl comment

* fix wrong code style

* update audit log search sql

* add licenses

* add unit test

* fix wrong code style

* fix bugs

* fix wrong code style

* add test case

* add test case

* add license

* Add unit test in pom.xml

* resolve code smell problem

* mysql and postgresql ddl update

* update audit log path and audit page query

* update audit configuration

* update audit log schema, add resource type and resource id

* update audit query and list page

* resolve audit log front page bugs and log query error

* update audit configuration

* resolve wrong configuration

* update AuditLogControllerTest

* update application.yaml

* resolve code smell

* update standalone configuration

* resolve bugs

Co-authored-by: yc322 <1393242780@qq.com>
2022-01-26 09:53:18 +08:00
xiangzihao
30b8b4a93e
[E2E][CI] Add renaming file management E2E tests (#8160) 2022-01-26 09:45:21 +08:00
Wenjun Ruan
f88def8ef7
[IMPROVEMENT-8178] Add Netty processor in Spring container (#8179)
* Add Netty processor in Spring container
2022-01-25 21:33:09 +08:00
wind
128ede3ee9
Fix start standalone fail because db not init yet (#8191) 2022-01-25 18:10:02 +08:00
Kerwin
103ccb01da
change version to 2.0.4-SNAPSHOT (#8188) 2022-01-25 15:17:17 +08:00
wangyang
14908a25e8
[Feature-7992][Alert] Support PagerDuty Plugin (#8120)
Co-authored-by: qingwli <qingwli@cisco.com>
2022-01-25 10:04:21 +08:00
wind
b5fa54b6be
[Bug-7865][MasterServer] retry logic optimization (#8156)
* submit task optimization

* cloneAndReset

* update

* tolerant task restart when init

* fix snoar check

* fix test

* delete unuse file

* taskInstance key

* code style

* skip complete when retry

Co-authored-by: caishunfeng <534328519@qq.com>
2022-01-25 09:37:57 +08:00
labbomb
435d37899f
Improve the routing (#8176) 2022-01-24 17:38:10 +08:00
Shiwen Cheng
0057cf3fe7
[Improvement][task-plugin] Remove unreasonable log (#8115) 2022-01-24 13:44:43 +08:00
calvin
d379137908
[Fix-8158][UI Next] improve the structure of directories (#8159) 2022-01-22 09:34:05 +08:00
songjianet
8c65b194c7
[Feature][UI Next] Add project workflow relation. (#8155)
* [Feature][UI Next] Add project workflow relation.

* [Feature][UI Next] Add tooltip component.
2022-01-21 19:25:55 +08:00
lilyzhou
a9ecaf0b81
[Fix][UI Next] Fix Security User Manage route was outdated (#8153) 2022-01-21 18:18:26 +08:00
Kerwin
1fd748f376
[Feature-8138][Task] add at@ msg in the dingtalk task plugin (#8139) 2022-01-21 17:09:39 +08:00
lilyzhou
e0dbf3edc6
[Feature][UI Next] Security User Manage (#8133) 2022-01-21 16:04:05 +08:00
Devosend
7aeac75860
[Feature-7348] [Python] Add workflow as code task type mr (#8140) 2022-01-21 09:54:36 +08:00
kezhenxu94
df26be89ed
Fix wrong Python gateway docker image name (#8143) 2022-01-21 09:43:28 +08:00
xiangzihao
b5631d5281
[Fix-8119][API] Update ProcessInstance error and without reason output (#8122)
* fix bug_8119

* fix bug_8119

* fix bug_8119

* fix bug_8119

* fix bug_8119
2022-01-21 09:32:38 +08:00
labbomb
38b40e7ac4
[Feature][UI Next]Improve menu bar function (#8141)
* Improve menu bar function

* Improve menu bar function
2022-01-20 22:25:16 +08:00
wangyizhi
32ed6e281c
[Feature][UI Next] Modify route registration rules (#8137)
* [Feature][UI Next] Modify route registration rules

* [Feature][UI Next] Delete logs
2022-01-20 21:24:52 +08:00
wangyizhi
a87ddca98c
[Feature][UI Next] Adjust the projects directory (#8128) 2022-01-20 10:29:50 +08:00
Devosend
a77b0ef93b
[Fix-8098] [UI] Fix resource manage bug (#8107) 2022-01-20 10:19:02 +08:00