Commit Graph

5070 Commits

Author SHA1 Message Date
roi
837c9ba2cc
fix bug:when shell task raw script has $[${day} - 1],throw java.lang.IllegalArgumentException::Pattern includes reserved character:'{' (#5313) 2021-04-19 17:50:29 +08:00
luoyuan
513eb76919
[Improvement-5147][Service]This judgment always returns true (#5156)
* this expression which always evaluates "true"

* delete unused variables

* LogClientService add AutoCloseable

* reformat code

* reformat code

* reformat code

* add log in ProcessService

* reformat code

* Optimize the code

* Optimize the code

* [improvement]modify all methods that refer to LogClientService in the code.

* delete unused code
2021-04-19 17:48:09 +08:00
wen-hemin
2a81b29b8f
fix: process instance version page bug (#5319)
Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-04-19 16:22:17 +08:00
zhuangchong
fe144e46a3
[Improvement-4898][API] the paging query interface validates page params (#4899)
* fix api list-paging method check page params.

* update process definition version class check page params.

* add ProcessInstanceControllerTest in the pom xml file.

* solve sonar exception.

* add project controller test class.

* update create project return result

* update project controller test class code style.

* update sonar problem.

* update QueueController test class.
2021-04-19 11:01:52 +08:00
Shiwen Cheng
83519bdfc3
[Improvement][Server] Optimize log display (#5311) 2021-04-19 10:29:32 +08:00
Shiwen Cheng
e92e29ef9a
[Fix-5309][Common] Fix the wrong memory (#5312)
* [Fix-5309][Common] Fix the wrong memory

* [Fix-5309][Common] Fix unit test and remove unused code
2021-04-19 10:24:54 +08:00
QuakeWang
5ef1f731b7
Update PeerTaskInstancePriorityQueueTest.java (#5314)
change `TaskInstance taskInstanceMediumPriority = createTaskInstance("high", Priority.MEDIUM);` to `TaskInstance taskInstanceMediumPriority = createTaskInstance("medium", Priority.MEDIUM);`
2021-04-19 09:48:43 +08:00
JinyLeeChina
f7a06a033d
[Feature][JsonSplit] Fix master/worker about shellTask (#5300)
* Fix quoted bug about processDefineId of processInstance

* Fix master/worker about shellTask

* codeStyle

* codeStyle

* update taskType

* codeStyle

* update timeoutNotifyStrategy

* codeStyle

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-18 12:45:30 +08:00
wen-hemin
784b3550b2
fix: The instance page DAG does not display bug (#5298)
Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-04-18 12:43:47 +08:00
fanwq
87588ca9f7
fix bug:delete the user ,the project list of admin will lost the projects of this user #5301 (#5302) 2021-04-16 23:26:31 +08:00
wangxj3
6dbbf6d55d
fix bug of If start a process instance form fail node or stop node ,the param will be init. (#5267)
Co-authored-by: wangxj <wangxj31>
2021-04-16 23:14:22 +08:00
Shiwen Cheng
94a08c8f32
[Improvement] Remove incubating (#5305) 2021-04-16 22:56:51 +08:00
wenjun
7843ed4087
[Improvement][ApiServer] Traffic limit #5235 (#5307)
* [Improvement][ApiServer] Traffic limit #5235

* code style check
2021-04-16 22:41:02 +08:00
Kirs
07e612c877
Update the NOTICE (#5303) 2021-04-16 16:43:40 +08:00
Zhenxu Ke
6650dd9b33
Delete DISCLAIMER (#5296) 2021-04-16 16:29:36 +08:00
xingchun-chen
7c358690fb
Issue robot removes translation content (#5297)
Co-authored-by: chenxingchun <438044805@qq.com>
2021-04-16 16:00:10 +08:00
Kirs
ac15f45b0b
Update the main repository link (#5286) 2021-04-16 10:56:48 +08:00
Shiwen Cheng
e39409a412
[Improvement-5275][Server] Fix wrong excludeFilters and move zk/ZKMasterClient and registry/ServerNodeManager into master (#5278)
* [Improvement-5275][Server] Move zk/ZKMasterClient and registry/ServerNodeManager into master

* [Improvement-5275][Server] Fix code smells

* [Improvement-5275][Server] Add ZKMasterClientTest
2021-04-16 00:17:21 +08:00
wenjun
f3dfaacca2
[Improvement][Service] Optimize query log (#5205)
* [Improvement][Service] Optimize query log

* remove IPUtils
2021-04-15 20:25:01 +08:00
mrproliu
b6453da298
Remove useless table fields (#5284)
Co-authored-by: dalekliuhan <dalekliuhan@didiglobal.com>
2021-04-15 20:15:20 +08:00
xingchun-chen
029d3eb814
git actions add submodule (#5280)
* Add issue robot automatic reply and Translation

* add license

* git actions add submodule


Co-authored-by: chenxingchun <438044805@qq.com>
2021-04-15 14:13:58 +08:00
Shiwen Cheng
1c1f6663a6
[Improvement][WorkerGroup] Optimize and reduce database and zookeeper queries and replace worker address input with multiple-select (#5182)
* [Improvement][Server] Optimize and reduce database and ZooKeeper query

* [Improvement][WorkerGroup] Replace worker address input with multiple-select

* [Improvement][WorkerGroup] Fix unit test

* [Improvement][API&UI] Optimize long host to short host and long host display in k8s
2021-04-14 21:39:39 +08:00
wenjun
cc7a4446f5
[Improvement][Task] DataX Node doesn't Support Clickhouse as datasource (#5180) (#5243)
* [Improvement][Module Name] DataX Node doesn't Support Clickhouse as the datasource (#5180)

* add ut

* add ut

* resolve code smell
2021-04-14 11:31:40 +08:00
baoliang
0166aebf71 Merge remote-tracking branch 'upstream/dev' into json_split
# Conflicts:
#	dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/enums/Status.java
#	dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/utils/StringUtils.java
#	dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/ProjectMapper.java
#	dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/ProjectMapper.xml
#	dolphinscheduler-service/src/test/java/org/apache/dolphinscheduler/service/process/ProcessServiceTest.java
2021-04-13 23:10:19 +08:00
JinyLeeChina
645847c096
Fix quoted bug about processDefineId of processInstance (#5263)
Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-13 22:47:36 +08:00
xingchun-chen
faa111674f
Add issue robot automatic reply and Translation (#5258)
* Add issue robot automatic reply and Translation

* add license

Co-authored-by: chenxingchun <438044805@qq.com>
2021-04-12 21:41:30 +08:00
didiaode18
0eb8c0c234
[Improvement][common]Task status error 2021-04-12 19:32:57 +08:00
Bruce Lau
3e64f43138
[Test-4124][service] Add the testCreateCommand test of ProcessService Class (#5257)
* [uint test] Improve code test coverage of ProcessService class

* [Test-4124][service] Add the testCreateCommand test of ProcessService Class

Co-authored-by: liuziying <liuziying@longfor.com>
2021-04-12 18:55:00 +08:00
JinyLeeChina
73f5a8e0a7
[Feature][JsonSplit] Fix master/worker server (#5253)
* Fix dependency failure

* Fix taskInstance

* task instance list page

* code review

* fix logger path

* Fix master/worker server

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-12 10:53:22 +08:00
JinyLeeChina
31188ffca0
[Feature][JsonSplit] Fix taskInstance (#5246)
* Fix dependency failure

* Fix taskInstance

* task instance list page

* code review

* fix logger path

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-11 16:52:19 +08:00
wenjun
039d517c13
[Improvement][API] the QueryAuthorizedProject interface adds permission judgment (#5170) (#5184) 2021-04-11 14:44:20 +08:00
zhuangchong
73e917d3c1
Clean up useless files. (#5252) 2021-04-11 14:07:58 +08:00
Jonathan.Wei
d4812f0a34
[Fix-5250][API] Fixed data source parameter type attribute being null (#5251)
* Update DataSourceServiceImpl.java

Fixed data source parameter type attribute being null

* Fixed test case issues related to deleting the type parameter

Co-authored-by: 魏基勇 <weijiyong@ky-tech.com.cn>
2021-04-11 13:26:27 +08:00
wen-hemin
556c37155b
[Feature][JsonSplit] When create the process instance, save the field "locations" and "connects" (#5248)
* fix: dag show bugs

* fix: code format

* fix: code format

* fix: code format

* fix: When create the process instance, save the field "locations" and "connects"

Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-04-10 18:38:10 +08:00
wenjun
641dedd21e
fix dag empty msg (#5245) 2021-04-10 13:44:36 +08:00
JinyLeeChina
8c88bfa222
Fix dependency failure (#5239)
Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-09 11:25:18 +08:00
DS
f3195fce35
Update README.md (#5238) 2021-04-09 01:03:04 +08:00
wangxj3
5c898e38ed
[FIX-#5233][API] Fix bug ofREPEAT RUNNING processInstance throw exceprion (#5234)
* fix bug of REPEAT RUNNING throw exception

Co-authored-by: wangxj <wangxj31>
2021-04-08 18:58:43 +08:00
wen-hemin
cc82a98f50
[FixBug][JsonSplit] dag show bugs (#5226)
* fix: dag show bugs

* fix: code format

* fix: code format

* fix: code format

Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-04-08 14:18:01 +08:00
Simon
8d6c2e3a6c
fix copy locations name error (#5228) 2021-04-07 17:17:51 +08:00
xiaoyu
2f1f193ba8
Update common.properties (#5223) 2021-04-07 16:17:21 +08:00
wen-hemin
305288caea
fix: When modify the node name, circular dependence bug (#5220)
Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-04-07 11:14:33 +08:00
wen-hemin
4e97a0c4fd
fix: When process definition state is release, process version to set enable (#5216)
Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-04-06 16:46:58 +08:00
wenjun
4a1303b625
[Improvement][Worker] Kill task error(#5199) (#5212) 2021-04-06 10:47:53 +08:00
lenboo
027781c55a Merge remote-tracking branch 'upstream/json_split' into spilit 2021-04-04 11:44:23 +08:00
JinyLeeChina
a8f2894b79
[Feature][JsonSplit] Fix master/processInstance bug (#5206)
* transform taskCode from long to string

* fix process bug

* code review

* code review

* code review

* Fix master/processInstance bug

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-04 11:26:42 +08:00
bao liang
86ce8f133a
[JsonSplit-4417][master/worker/api]json split- remove json in task instance. (#5160)
* [json split] refactor json in task instance

* add task_pramas in task_instance

* feature #4417 refactor json split in task instance

* code style

* code style

* code style

* code style

* code style

* update

* update

* update unit test

* update
2021-04-03 17:58:04 +08:00
wenjun
97fb08f0ce
[Improvement][LogServer] Thread pool parameter adjustment #5161 (#5163)
* [Improvement][LogServer] Thread pool parameter adjustment #5161

* change log request processor thread num 2 * cpuCores + 1
2021-04-02 14:24:37 +08:00
JuFeng Li
e8c9c33d7e
[Fix-5055][UI] Fix can not upload file to correct dir (#5056)
* fix udf resource can not upload to the correct dir,and when delete udf resource can not refresh page

Co-authored-by: 李巨丰 <lijf@2345.com>
2021-04-01 20:57:46 +08:00
Hayden Zhou
5d7dc1cb2a
[Improvement][API]optimize tenant code validation (#5093)
* optimize tenant code validation

* fix code style and test err

* fix test error, and remove duplicate tenant code validate
2021-04-01 20:50:14 +08:00