Commit Graph

5065 Commits

Author SHA1 Message Date
JinyLeeChina
515fa4912e
[Feature][JsonSplit] Fix ProcessService ut (#5435)
* Fix ProcessService ut

* codeStyle

* Fix AlertPlugin ut

* Fix AlertPlugin ut

* Fix server module ut

* Fix server module ut

* Fix api ut

* codeStyle

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-05-10 23:17:56 +08:00
ruanwenjun
25727d2d95
[Improvement][Alert] Replace HSSFWorkbook (#5400)
* [Improvement][Alert] Replace HSSFWorkbook

* add license
2021-05-10 09:57:49 +08:00
zhuangchong
9c77faa8ac
[Improvement-5058][Master] The master-server creates the DB data source twice (#5139)
* reduce the number of data sources created twice by master server.

* update ProcessAlertManagerTest test class to increase coverage.

* add DolphinSchedulerPluginLoaderTest test ignore.

Co-authored-by: zhuang chong
2021-05-10 09:56:17 +08:00
zhuangchong
0d8011f9c1
Cleanup of useless files in the binary package lib directory. (#5430) 2021-05-10 09:44:17 +08:00
JinyLeeChina
847865fba6
[Feature][JsonSplit] Fix dao ut (#5433)
* update taskParams/add task delayTime/fix conditionType bug

* update codeStyle for merge to dev

* fix process lineage bug

* fix codeStyle for json_split

* Fix dao ut

* Fix dao ut

* codeStyle

* modify postgreSQL

* fix TaskInstanceMapper ut

* fix ProjectMapper ut

* fix ProcessDefinitionDao ut

* datasource

* fix postgreSQL

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-05-09 13:53:14 +08:00
JinyLeeChina
f7b71fb9ca
[Feature][JsonSplit] Fix codeStyle for json_split (#5432)
* update taskParams/add task delayTime/fix conditionType bug

* update codeStyle for merge to dev

* fix process lineage bug

* fix codeStyle for json_split

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-05-09 00:01:09 +08:00
QuakeWang
f88bbbd637
[Improvement] Create RollViewLogRequestCommandTest.java (#5417)
* Create RollViewLogRequestCommandTest.java

Add a test case about RollViewLogRequestCommand

* Update pom.xml

add the test files in the parent pom
2021-05-07 20:58:23 +08:00
JinyLeeChina
363426de71
[Feature][JsonSplit] fix process lineage bug (#5418)
* update taskParams/add task delayTime/fix conditionType bug

* update codeStyle for merge to dev

* fix process lineage bug

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-05-07 16:37:49 +08:00
baoliang
c850b85484 Merge remote-tracking branch 'upstream/dev' into json_split
# Conflicts:
#	dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/ProcessDefinitionController.java
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/procedure/ProcedureTask.java
2021-05-07 01:38:53 +08:00
baoliang
b594afc94c Merge remote-tracking branch 'upstream/dev' into json_split
# Conflicts:
#	dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/ProcessDefinitionController.java
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/procedure/ProcedureTask.java
2021-05-07 01:38:31 +08:00
ruanwenjun
71f39fa875
[Improvement][Dao] Database add connection check (#5408) (#5409) 2021-05-06 09:41:44 +08:00
ruanwenjun
0bdf15efb9
[Improvement][DAO] Add Unique key in t_ds_alertgroup and t_ds_datasource (#5373)
* [Improvement][DAO] Add Unique key to t_ds_worker_group t_ds_datasource

* Add exception catch

* add ddl

* fix ut
2021-05-06 09:32:28 +08:00
ruanwenjun
97f08429f4
[Improvement] Change the status box text (#5421) 2021-05-06 09:22:51 +08:00
Hayden Zhou
2114b63216
replace access log by AccessLogAnnotation (#5315)
* replace access log by AccessLogAnnotaion

* fix codesytle error

* fix RequestContextHolder.getRequestAttributes may be null

* fix code style

* accessLogAnnotation addd ignore params

* fix style

* reduce code smells

* fix code style

* fix logtext if request is ignore

* add trance id

* fix code style

* add comment

* optimize

* fix code style

* fix code

Co-authored-by: hayden <hayden@haydendeMacBook-Pro.local>
2021-05-04 22:40:46 +08:00
QuakeWang
22c62372a6
Create GetLogBytesResponseCommandTest.java (#5413)
Create a test case
2021-05-01 23:47:43 +08:00
ruanwenjun
ee95d07a90
[Feature][Alert plugin] Support slack alert (#5382) (#5384)
* [Feature][Alert plugin] Support slack alert (#5382)

* fix code smell

* add markdown table
2021-04-30 10:11:32 +08:00
zhuangchong
88a07f7b55
[Feature-4093][server] Support for stored procedures and stored function calls and data source supports DB2 (#4094)
* Support for stored procedures and stored function calls and data source supports DB2.


Co-authored-by: zhuangchong <zhuangchong8@163.com>
2021-04-29 18:29:44 +08:00
BoYiZhang
2a59ed092c
[Improvement-#3476][UI]Resource files support copy path operations (#5348)
* Improvement-5346 :  Resource files support copy path operations

* Improvement-5346 :  Resource files support copy path operations

* this close #5346

The current resource file does not support copying paths

When using the path is very easy to output errors. Add copy button. Support copy operation

* fix code smell
2021-04-29 16:29:29 +08:00
Shiwen Cheng
0f3eed9d00
[Fix-5386][Alert] Fix ERROR: relation t_ds_plugin_define does not exist (#5387) 2021-04-29 16:17:01 +08:00
QuakeWang
d45b27ce2e
[Improvement] Create GetLogBytesRequestCommandTest.java (#5356)
* Create GetLogBytesRequestCommandTest.java

Add a test case about GetLogBytesRequestCommand

* Update GetLogBytesRequestCommandTest.java

* modify the code format

* Update GetLogBytesRequestCommandTest.java

Submitting the test again

* Update GetLogBytesRequestCommandTest.java

Code changes based on comments
2021-04-29 15:18:00 +08:00
ruanwenjun
cbbe9c333c
[Improvement][api-server] Update the project owner (#5394)
* [Bug][api-server] delete the user ,when query the project by join the table of t_ds_user will return null. (#5326)

* when delete a user, do project ownership check

* fix ut

* fix vulnerability
2021-04-29 14:50:05 +08:00
baoliang
1646188027 fix code style 2021-04-27 14:21:30 +08:00
bao liang
86dcddb32b
[Feature-4417]fix code style (#5395)
* fix code style

* fix ut

* remove unused ut

* remove unused ut

Co-authored-by: baoliang <baoliang@analysys.com.cn>
2021-04-27 14:04:13 +08:00
JinyLeeChina
2a44cb9de6
[Feature][JsonSplit] update codeStyle for merge to dev (#5392)
* update taskParams/add task delayTime/fix conditionType bug

* update codeStyle for merge to dev

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-26 22:30:35 +08:00
baoliang
746d9eca1d Merge remote-tracking branch 'upstream/dev' into json_split
# Conflicts:
#	dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/ProcessDefinitionController.java
#	dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ProcessDefinitionVersionServiceImpl.java
#	dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ProjectServiceImpl.java
#	dolphinscheduler-api/src/test/java/org/apache/dolphinscheduler/api/controller/ProcessDefinitionControllerTest.java
#	dolphinscheduler-api/src/test/java/org/apache/dolphinscheduler/api/service/ProcessDefinitionVersionServiceTest.java
#	dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/model/TaskNode.java
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/MasterBaseTaskExecThread.java
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/processdure/ProcedureTask.java
#	dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/process/ProcessService.java
2021-04-26 14:14:05 +08:00
JinyLeeChina
c3558965c1
update taskParams/add task delayTime/fix conditionType bug (#5385)
Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-26 11:28:35 +08:00
Shiwen Cheng
6b8461e901
Revert "[Improvement][DAO] CreateDolphinScheduler (#5357) (#5358)" (#5383)
This reverts commit b108ac43b8.
2021-04-25 23:29:00 +08:00
wen-hemin
7b2f33426b
fix: process definition version delete bug (#5380)
Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-04-25 21:11:09 +08:00
wen-hemin
fd54dc0ce2
[FixBug][JsonSplit] depend task, the field "process definition id" modify to "process definition code" (#5377)
* fix: depend task, the field "process definition id" modify to "process definition code"

* fix: depend task, the field "process definition id" modify to "process definition code"

Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-04-25 19:36:36 +08:00
ruanwenjun
e6d8da484f
[Improvement][API] Create Datasource #5083 (#5116)
* [Improvement][API] Create Datasource #5083

  * Refact create/ update datasource API

* fix Code Smells

* fix code smell

* resolve code smell

* use ConnectionParam to replace BaseDatasource

* solve license

* add ut

* code check

* add ut

* fix ut coverage

* fix ut
2021-04-25 13:51:59 +08:00
Shiwen Cheng
2e1d6975fd
[Improvement][Build] Optimize long release name and remove unused nginx release and upgrade spring boot version (#5308)
* [Build] Optimize long release name and remove unused nginx release

* [Build] Upgrade spring boot version

* [Improvement] Improve code style
2021-04-25 09:55:38 +08:00
JinyLeeChina
db96bf2dfe
[Feature][JsonSplit] Fix batchMove of processDefinition bug (#5371)
* update SnowFlake

* update processDefinite from processInstance

* update processDefinite from processInstance

* Fix task logger path

* Fix dependTask bug

* Fix batchMove of processDefinition bug

* codeStyle

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-24 15:33:23 +08:00
ruanwenjun
b108ac43b8
[Improvement][DAO] CreateDolphinScheduler (#5357) (#5358)
* [Improvement][DAO] Create CreateDolphinScheduler (#5357)

* add ut

* fix code smell
2021-04-23 22:03:47 +08:00
bao liang
75d1ad645c
fix bug: 5349, work flow would running if task is killed by manual. (#5362)
Co-authored-by: baoliang <baoliang@analysys.com.cn>
2021-04-23 14:29:26 +08:00
JinyLeeChina
862565a7c7
[Feature][JsonSplit] Fix dependTask bug (#5360)
* update SnowFlake

* update processDefinite from processInstance

* update processDefinite from processInstance

* Fix task logger path

* Fix dependTask bug

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-23 14:23:04 +08:00
Shiwen Cheng
3a7006a796
[Fix-5351][K8s] Fix quartz cron task cannot take effect in K8s (#5353) 2021-04-22 19:07:19 +08:00
Wenjun
abdd2337b1
[Bug][worker] Fix sql task query result is empty (#5322) (#5324)
* [Bug][worker] Fix sql task query result is empty (#5322)

* add ut

* remove duplicate

* add ut
2021-04-22 12:02:32 +08:00
luoyuan
e57ee658e8
[Improvement] Optimized close of IO (#5336)
* [improvement]modify all methods that refer to LogClientService in the code.

* delete unused code

* [Improvement] Optimized close of IO
2021-04-21 22:47:16 +08:00
wanghong1314
e12a26289b
【BUG-5328】 modify process contain depend task is always running (#5344)
Co-authored-by: wanghong1314 <wanghong1@onething.net>
2021-04-21 22:29:53 +08:00
JinyLeeChina
feffd972b5
[Feature][JsonSplit] Fix task logger path (#5331)
* update SnowFlake

* update processDefinite from processInstance

* update processDefinite from processInstance

* Fix task logger path

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-21 17:19:09 +08:00
Simon
37b149da39
fix circular dependence bug (#5330) 2021-04-21 09:40:21 +08:00
JinyLeeChina
d60f31bcf3
[Feature][JsonSplit] update processDefinite from processInstance (#5325)
* update SnowFlake

* update processDefinite from processInstance

* update processDefinite from processInstance

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-20 15:33:37 +08:00
Wenjun
5f1fc462c9
[Bug][server-api] copy the node ,the preTasks is error #5261 (#5264) 2021-04-20 15:17:17 +08:00
didiaode18
f82da57277
There is a vulnerability in postgresql 42.1.4 ,upgrade recommended #5292 (#5318)
* There is a vulnerability in postgresql 42.1.4 ,upgrade recommended #5292
2021-04-20 15:04:29 +08:00
JinyLeeChina
49b234609a
update SnowFlake (#5321)
Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-19 23:12:09 +08:00
roi
837c9ba2cc
fix bug:when shell task raw script has $[${day} - 1],throw java.lang.IllegalArgumentException::Pattern includes reserved character:'{' (#5313) 2021-04-19 17:50:29 +08:00
luoyuan
513eb76919
[Improvement-5147][Service]This judgment always returns true (#5156)
* this expression which always evaluates "true"

* delete unused variables

* LogClientService add AutoCloseable

* reformat code

* reformat code

* reformat code

* add log in ProcessService

* reformat code

* Optimize the code

* Optimize the code

* [improvement]modify all methods that refer to LogClientService in the code.

* delete unused code
2021-04-19 17:48:09 +08:00
wen-hemin
2a81b29b8f
fix: process instance version page bug (#5319)
Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-04-19 16:22:17 +08:00
zhuangchong
fe144e46a3
[Improvement-4898][API] the paging query interface validates page params (#4899)
* fix api list-paging method check page params.

* update process definition version class check page params.

* add ProcessInstanceControllerTest in the pom xml file.

* solve sonar exception.

* add project controller test class.

* update create project return result

* update project controller test class code style.

* update sonar problem.

* update QueueController test class.
2021-04-19 11:01:52 +08:00
Shiwen Cheng
83519bdfc3
[Improvement][Server] Optimize log display (#5311) 2021-04-19 10:29:32 +08:00