Commit Graph

5089 Commits

Author SHA1 Message Date
Shiwen Cheng
6b8461e901
Revert "[Improvement][DAO] CreateDolphinScheduler (#5357) (#5358)" (#5383)
This reverts commit b108ac43b8.
2021-04-25 23:29:00 +08:00
wen-hemin
7b2f33426b
fix: process definition version delete bug (#5380)
Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-04-25 21:11:09 +08:00
wen-hemin
fd54dc0ce2
[FixBug][JsonSplit] depend task, the field "process definition id" modify to "process definition code" (#5377)
* fix: depend task, the field "process definition id" modify to "process definition code"

* fix: depend task, the field "process definition id" modify to "process definition code"

Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-04-25 19:36:36 +08:00
ruanwenjun
e6d8da484f
[Improvement][API] Create Datasource #5083 (#5116)
* [Improvement][API] Create Datasource #5083

  * Refact create/ update datasource API

* fix Code Smells

* fix code smell

* resolve code smell

* use ConnectionParam to replace BaseDatasource

* solve license

* add ut

* code check

* add ut

* fix ut coverage

* fix ut
2021-04-25 13:51:59 +08:00
Shiwen Cheng
2e1d6975fd
[Improvement][Build] Optimize long release name and remove unused nginx release and upgrade spring boot version (#5308)
* [Build] Optimize long release name and remove unused nginx release

* [Build] Upgrade spring boot version

* [Improvement] Improve code style
2021-04-25 09:55:38 +08:00
JinyLeeChina
db96bf2dfe
[Feature][JsonSplit] Fix batchMove of processDefinition bug (#5371)
* update SnowFlake

* update processDefinite from processInstance

* update processDefinite from processInstance

* Fix task logger path

* Fix dependTask bug

* Fix batchMove of processDefinition bug

* codeStyle

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-24 15:33:23 +08:00
ruanwenjun
b108ac43b8
[Improvement][DAO] CreateDolphinScheduler (#5357) (#5358)
* [Improvement][DAO] Create CreateDolphinScheduler (#5357)

* add ut

* fix code smell
2021-04-23 22:03:47 +08:00
bao liang
75d1ad645c
fix bug: 5349, work flow would running if task is killed by manual. (#5362)
Co-authored-by: baoliang <baoliang@analysys.com.cn>
2021-04-23 14:29:26 +08:00
JinyLeeChina
862565a7c7
[Feature][JsonSplit] Fix dependTask bug (#5360)
* update SnowFlake

* update processDefinite from processInstance

* update processDefinite from processInstance

* Fix task logger path

* Fix dependTask bug

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-23 14:23:04 +08:00
Shiwen Cheng
3a7006a796
[Fix-5351][K8s] Fix quartz cron task cannot take effect in K8s (#5353) 2021-04-22 19:07:19 +08:00
Wenjun
abdd2337b1
[Bug][worker] Fix sql task query result is empty (#5322) (#5324)
* [Bug][worker] Fix sql task query result is empty (#5322)

* add ut

* remove duplicate

* add ut
2021-04-22 12:02:32 +08:00
luoyuan
e57ee658e8
[Improvement] Optimized close of IO (#5336)
* [improvement]modify all methods that refer to LogClientService in the code.

* delete unused code

* [Improvement] Optimized close of IO
2021-04-21 22:47:16 +08:00
wanghong1314
e12a26289b
【BUG-5328】 modify process contain depend task is always running (#5344)
Co-authored-by: wanghong1314 <wanghong1@onething.net>
2021-04-21 22:29:53 +08:00
JinyLeeChina
feffd972b5
[Feature][JsonSplit] Fix task logger path (#5331)
* update SnowFlake

* update processDefinite from processInstance

* update processDefinite from processInstance

* Fix task logger path

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-21 17:19:09 +08:00
Simon
37b149da39
fix circular dependence bug (#5330) 2021-04-21 09:40:21 +08:00
JinyLeeChina
d60f31bcf3
[Feature][JsonSplit] update processDefinite from processInstance (#5325)
* update SnowFlake

* update processDefinite from processInstance

* update processDefinite from processInstance

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-20 15:33:37 +08:00
Wenjun
5f1fc462c9
[Bug][server-api] copy the node ,the preTasks is error #5261 (#5264) 2021-04-20 15:17:17 +08:00
didiaode18
f82da57277
There is a vulnerability in postgresql 42.1.4 ,upgrade recommended #5292 (#5318)
* There is a vulnerability in postgresql 42.1.4 ,upgrade recommended #5292
2021-04-20 15:04:29 +08:00
JinyLeeChina
49b234609a
update SnowFlake (#5321)
Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-19 23:12:09 +08:00
roi
837c9ba2cc
fix bug:when shell task raw script has $[${day} - 1],throw java.lang.IllegalArgumentException::Pattern includes reserved character:'{' (#5313) 2021-04-19 17:50:29 +08:00
luoyuan
513eb76919
[Improvement-5147][Service]This judgment always returns true (#5156)
* this expression which always evaluates "true"

* delete unused variables

* LogClientService add AutoCloseable

* reformat code

* reformat code

* reformat code

* add log in ProcessService

* reformat code

* Optimize the code

* Optimize the code

* [improvement]modify all methods that refer to LogClientService in the code.

* delete unused code
2021-04-19 17:48:09 +08:00
wen-hemin
2a81b29b8f
fix: process instance version page bug (#5319)
Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-04-19 16:22:17 +08:00
zhuangchong
fe144e46a3
[Improvement-4898][API] the paging query interface validates page params (#4899)
* fix api list-paging method check page params.

* update process definition version class check page params.

* add ProcessInstanceControllerTest in the pom xml file.

* solve sonar exception.

* add project controller test class.

* update create project return result

* update project controller test class code style.

* update sonar problem.

* update QueueController test class.
2021-04-19 11:01:52 +08:00
Shiwen Cheng
83519bdfc3
[Improvement][Server] Optimize log display (#5311) 2021-04-19 10:29:32 +08:00
Shiwen Cheng
e92e29ef9a
[Fix-5309][Common] Fix the wrong memory (#5312)
* [Fix-5309][Common] Fix the wrong memory

* [Fix-5309][Common] Fix unit test and remove unused code
2021-04-19 10:24:54 +08:00
QuakeWang
5ef1f731b7
Update PeerTaskInstancePriorityQueueTest.java (#5314)
change `TaskInstance taskInstanceMediumPriority = createTaskInstance("high", Priority.MEDIUM);` to `TaskInstance taskInstanceMediumPriority = createTaskInstance("medium", Priority.MEDIUM);`
2021-04-19 09:48:43 +08:00
JinyLeeChina
f7a06a033d
[Feature][JsonSplit] Fix master/worker about shellTask (#5300)
* Fix quoted bug about processDefineId of processInstance

* Fix master/worker about shellTask

* codeStyle

* codeStyle

* update taskType

* codeStyle

* update timeoutNotifyStrategy

* codeStyle

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-18 12:45:30 +08:00
wen-hemin
784b3550b2
fix: The instance page DAG does not display bug (#5298)
Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-04-18 12:43:47 +08:00
fanwq
87588ca9f7
fix bug:delete the user ,the project list of admin will lost the projects of this user #5301 (#5302) 2021-04-16 23:26:31 +08:00
wangxj3
6dbbf6d55d
fix bug of If start a process instance form fail node or stop node ,the param will be init. (#5267)
Co-authored-by: wangxj <wangxj31>
2021-04-16 23:14:22 +08:00
Shiwen Cheng
94a08c8f32
[Improvement] Remove incubating (#5305) 2021-04-16 22:56:51 +08:00
wenjun
7843ed4087
[Improvement][ApiServer] Traffic limit #5235 (#5307)
* [Improvement][ApiServer] Traffic limit #5235

* code style check
2021-04-16 22:41:02 +08:00
Kirs
07e612c877
Update the NOTICE (#5303) 2021-04-16 16:43:40 +08:00
Zhenxu Ke
6650dd9b33
Delete DISCLAIMER (#5296) 2021-04-16 16:29:36 +08:00
xingchun-chen
7c358690fb
Issue robot removes translation content (#5297)
Co-authored-by: chenxingchun <438044805@qq.com>
2021-04-16 16:00:10 +08:00
Kirs
ac15f45b0b
Update the main repository link (#5286) 2021-04-16 10:56:48 +08:00
Shiwen Cheng
e39409a412
[Improvement-5275][Server] Fix wrong excludeFilters and move zk/ZKMasterClient and registry/ServerNodeManager into master (#5278)
* [Improvement-5275][Server] Move zk/ZKMasterClient and registry/ServerNodeManager into master

* [Improvement-5275][Server] Fix code smells

* [Improvement-5275][Server] Add ZKMasterClientTest
2021-04-16 00:17:21 +08:00
wenjun
f3dfaacca2
[Improvement][Service] Optimize query log (#5205)
* [Improvement][Service] Optimize query log

* remove IPUtils
2021-04-15 20:25:01 +08:00
mrproliu
b6453da298
Remove useless table fields (#5284)
Co-authored-by: dalekliuhan <dalekliuhan@didiglobal.com>
2021-04-15 20:15:20 +08:00
xingchun-chen
029d3eb814
git actions add submodule (#5280)
* Add issue robot automatic reply and Translation

* add license

* git actions add submodule


Co-authored-by: chenxingchun <438044805@qq.com>
2021-04-15 14:13:58 +08:00
Shiwen Cheng
1c1f6663a6
[Improvement][WorkerGroup] Optimize and reduce database and zookeeper queries and replace worker address input with multiple-select (#5182)
* [Improvement][Server] Optimize and reduce database and ZooKeeper query

* [Improvement][WorkerGroup] Replace worker address input with multiple-select

* [Improvement][WorkerGroup] Fix unit test

* [Improvement][API&UI] Optimize long host to short host and long host display in k8s
2021-04-14 21:39:39 +08:00
wenjun
cc7a4446f5
[Improvement][Task] DataX Node doesn't Support Clickhouse as datasource (#5180) (#5243)
* [Improvement][Module Name] DataX Node doesn't Support Clickhouse as the datasource (#5180)

* add ut

* add ut

* resolve code smell
2021-04-14 11:31:40 +08:00
baoliang
0166aebf71 Merge remote-tracking branch 'upstream/dev' into json_split
# Conflicts:
#	dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/enums/Status.java
#	dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/utils/StringUtils.java
#	dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/ProjectMapper.java
#	dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/ProjectMapper.xml
#	dolphinscheduler-service/src/test/java/org/apache/dolphinscheduler/service/process/ProcessServiceTest.java
2021-04-13 23:10:19 +08:00
JinyLeeChina
645847c096
Fix quoted bug about processDefineId of processInstance (#5263)
Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-13 22:47:36 +08:00
xingchun-chen
faa111674f
Add issue robot automatic reply and Translation (#5258)
* Add issue robot automatic reply and Translation

* add license

Co-authored-by: chenxingchun <438044805@qq.com>
2021-04-12 21:41:30 +08:00
didiaode18
0eb8c0c234
[Improvement][common]Task status error 2021-04-12 19:32:57 +08:00
Bruce Lau
3e64f43138
[Test-4124][service] Add the testCreateCommand test of ProcessService Class (#5257)
* [uint test] Improve code test coverage of ProcessService class

* [Test-4124][service] Add the testCreateCommand test of ProcessService Class

Co-authored-by: liuziying <liuziying@longfor.com>
2021-04-12 18:55:00 +08:00
JinyLeeChina
73f5a8e0a7
[Feature][JsonSplit] Fix master/worker server (#5253)
* Fix dependency failure

* Fix taskInstance

* task instance list page

* code review

* fix logger path

* Fix master/worker server

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-12 10:53:22 +08:00
JinyLeeChina
31188ffca0
[Feature][JsonSplit] Fix taskInstance (#5246)
* Fix dependency failure

* Fix taskInstance

* task instance list page

* code review

* fix logger path

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-11 16:52:19 +08:00
wenjun
039d517c13
[Improvement][API] the QueryAuthorizedProject interface adds permission judgment (#5170) (#5184) 2021-04-11 14:44:20 +08:00