Commit Graph

5000 Commits

Author SHA1 Message Date
xingchun-chen
029d3eb814
git actions add submodule (#5280)
* Add issue robot automatic reply and Translation

* add license

* git actions add submodule


Co-authored-by: chenxingchun <438044805@qq.com>
2021-04-15 14:13:58 +08:00
Shiwen Cheng
1c1f6663a6
[Improvement][WorkerGroup] Optimize and reduce database and zookeeper queries and replace worker address input with multiple-select (#5182)
* [Improvement][Server] Optimize and reduce database and ZooKeeper query

* [Improvement][WorkerGroup] Replace worker address input with multiple-select

* [Improvement][WorkerGroup] Fix unit test

* [Improvement][API&UI] Optimize long host to short host and long host display in k8s
2021-04-14 21:39:39 +08:00
wenjun
cc7a4446f5
[Improvement][Task] DataX Node doesn't Support Clickhouse as datasource (#5180) (#5243)
* [Improvement][Module Name] DataX Node doesn't Support Clickhouse as the datasource (#5180)

* add ut

* add ut

* resolve code smell
2021-04-14 11:31:40 +08:00
baoliang
0166aebf71 Merge remote-tracking branch 'upstream/dev' into json_split
# Conflicts:
#	dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/enums/Status.java
#	dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/utils/StringUtils.java
#	dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/ProjectMapper.java
#	dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/ProjectMapper.xml
#	dolphinscheduler-service/src/test/java/org/apache/dolphinscheduler/service/process/ProcessServiceTest.java
2021-04-13 23:10:19 +08:00
JinyLeeChina
645847c096
Fix quoted bug about processDefineId of processInstance (#5263)
Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-13 22:47:36 +08:00
xingchun-chen
faa111674f
Add issue robot automatic reply and Translation (#5258)
* Add issue robot automatic reply and Translation

* add license

Co-authored-by: chenxingchun <438044805@qq.com>
2021-04-12 21:41:30 +08:00
didiaode18
0eb8c0c234
[Improvement][common]Task status error 2021-04-12 19:32:57 +08:00
Bruce Lau
3e64f43138
[Test-4124][service] Add the testCreateCommand test of ProcessService Class (#5257)
* [uint test] Improve code test coverage of ProcessService class

* [Test-4124][service] Add the testCreateCommand test of ProcessService Class

Co-authored-by: liuziying <liuziying@longfor.com>
2021-04-12 18:55:00 +08:00
JinyLeeChina
73f5a8e0a7
[Feature][JsonSplit] Fix master/worker server (#5253)
* Fix dependency failure

* Fix taskInstance

* task instance list page

* code review

* fix logger path

* Fix master/worker server

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-12 10:53:22 +08:00
JinyLeeChina
31188ffca0
[Feature][JsonSplit] Fix taskInstance (#5246)
* Fix dependency failure

* Fix taskInstance

* task instance list page

* code review

* fix logger path

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-11 16:52:19 +08:00
wenjun
039d517c13
[Improvement][API] the QueryAuthorizedProject interface adds permission judgment (#5170) (#5184) 2021-04-11 14:44:20 +08:00
zhuangchong
73e917d3c1
Clean up useless files. (#5252) 2021-04-11 14:07:58 +08:00
Jonathan.Wei
d4812f0a34
[Fix-5250][API] Fixed data source parameter type attribute being null (#5251)
* Update DataSourceServiceImpl.java

Fixed data source parameter type attribute being null

* Fixed test case issues related to deleting the type parameter

Co-authored-by: 魏基勇 <weijiyong@ky-tech.com.cn>
2021-04-11 13:26:27 +08:00
wen-hemin
556c37155b
[Feature][JsonSplit] When create the process instance, save the field "locations" and "connects" (#5248)
* fix: dag show bugs

* fix: code format

* fix: code format

* fix: code format

* fix: When create the process instance, save the field "locations" and "connects"

Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-04-10 18:38:10 +08:00
wenjun
641dedd21e
fix dag empty msg (#5245) 2021-04-10 13:44:36 +08:00
JinyLeeChina
8c88bfa222
Fix dependency failure (#5239)
Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-09 11:25:18 +08:00
DS
f3195fce35
Update README.md (#5238) 2021-04-09 01:03:04 +08:00
wangxj3
5c898e38ed
[FIX-#5233][API] Fix bug ofREPEAT RUNNING processInstance throw exceprion (#5234)
* fix bug of REPEAT RUNNING throw exception

Co-authored-by: wangxj <wangxj31>
2021-04-08 18:58:43 +08:00
wen-hemin
cc82a98f50
[FixBug][JsonSplit] dag show bugs (#5226)
* fix: dag show bugs

* fix: code format

* fix: code format

* fix: code format

Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-04-08 14:18:01 +08:00
Simon
8d6c2e3a6c
fix copy locations name error (#5228) 2021-04-07 17:17:51 +08:00
xiaoyu
2f1f193ba8
Update common.properties (#5223) 2021-04-07 16:17:21 +08:00
wen-hemin
305288caea
fix: When modify the node name, circular dependence bug (#5220)
Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-04-07 11:14:33 +08:00
wen-hemin
4e97a0c4fd
fix: When process definition state is release, process version to set enable (#5216)
Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-04-06 16:46:58 +08:00
wenjun
4a1303b625
[Improvement][Worker] Kill task error(#5199) (#5212) 2021-04-06 10:47:53 +08:00
lenboo
027781c55a Merge remote-tracking branch 'upstream/json_split' into spilit 2021-04-04 11:44:23 +08:00
JinyLeeChina
a8f2894b79
[Feature][JsonSplit] Fix master/processInstance bug (#5206)
* transform taskCode from long to string

* fix process bug

* code review

* code review

* code review

* Fix master/processInstance bug

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-04 11:26:42 +08:00
bao liang
86ce8f133a
[JsonSplit-4417][master/worker/api]json split- remove json in task instance. (#5160)
* [json split] refactor json in task instance

* add task_pramas in task_instance

* feature #4417 refactor json split in task instance

* code style

* code style

* code style

* code style

* code style

* update

* update

* update unit test

* update
2021-04-03 17:58:04 +08:00
wenjun
97fb08f0ce
[Improvement][LogServer] Thread pool parameter adjustment #5161 (#5163)
* [Improvement][LogServer] Thread pool parameter adjustment #5161

* change log request processor thread num 2 * cpuCores + 1
2021-04-02 14:24:37 +08:00
JuFeng Li
e8c9c33d7e
[Fix-5055][UI] Fix can not upload file to correct dir (#5056)
* fix udf resource can not upload to the correct dir,and when delete udf resource can not refresh page

Co-authored-by: 李巨丰 <lijf@2345.com>
2021-04-01 20:57:46 +08:00
Hayden Zhou
5d7dc1cb2a
[Improvement][API]optimize tenant code validation (#5093)
* optimize tenant code validation

* fix code style and test err

* fix test error, and remove duplicate tenant code validate
2021-04-01 20:50:14 +08:00
guohaozhang
6b565f0aed
[Fix-#5124] fix change fileName when reupload file (#5125) 2021-04-01 20:44:03 +08:00
wenjun
f20bb54896
[Improvement][API] Improvement query all project list (#5169) (#5192) 2021-04-01 20:34:49 +08:00
JinyLeeChina
dd36da8d1f
[Feature][JsonSplit] fix process bug (#5193)
* transform taskCode from long to string

* fix process bug

* code review

* code review

* code review

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-04-01 17:45:44 +08:00
wanghong1314
817328ee8f
[Improvement-5172][UI]process list add Timing state add online/offline marking color (#5190)
Co-authored-by: wanghong <wanghong1@xunlei.com>
2021-03-31 20:50:12 +08:00
zhuangchong
e53369318b
[Fix-4721][worker]The shell background starts the YARN task scenario, and the kill function is abnormal (#4722)
* fix the shell starts the yarn task in the background

* update StringUtils code style.

* solve code smell.

* add method comment in StringUtils class.

* update AlertGroupMapper code style.

* update AlertGroupMapperTest

* update sql script test.
2021-03-30 22:33:49 +08:00
wen-hemin
15b2b1c0ec
[FixBug][Jsonsplit] When to save process definition, upload task code field #4417 (#5178)
* fix: task page, rename "description" to "desc"

* fix: The default value of field dependence is null.

* fix: frontend compile check

* fix: When create process, the version button is set to unavailable

* fix: sql condition bug

* fix: When to save process definition, upload task code field

Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-03-30 14:28:08 +08:00
lenboo
c8ac6f99fe Merge remote-tracking branch 'upstream/dev' into spilit
# Conflicts:
#	dolphinscheduler-common/src/main/resources/common.properties
2021-03-30 11:31:42 +08:00
JinyLeeChina
689106d114
transform taskCode from long to string (#5174)
Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-03-30 11:07:28 +08:00
KonsonChow
9c3cec5bbd
[DS-4891][docs] update DolphinScheduler slack invitation url (#5167)
update DolphinScheduler slack invitation url

Co-authored-by: KonsonChow <KonsonChow@gmail.com>
2021-03-29 23:47:52 +08:00
wen-hemin
f960eacdcd
[FixBug][Jsonsplit] sql condition bug #4417 (#5171)
* fix: task page, rename "description" to "desc"

* fix: The default value of field dependence is null.

* fix: frontend compile check

* fix: When create process, the version button is set to unavailable

* fix: sql condition bug

Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-03-29 22:17:28 +08:00
wen-hemin
0edd783373
[FIxBug][JsonSplit] When create process, the version button is set to unavailable #5137 (#5168)
* fix: task page, rename "description" to "desc"

* fix: The default value of field dependence is null.

* fix: frontend compile check

* fix: When create process, the version button is set to unavailable

Co-authored-by: wen-hemin <wenhemin@apache.com>
2021-03-29 17:24:01 +08:00
JinyLeeChina
a467fffd7b
[Feature][JsonSplit] fix taskId in json (#5165)
* modify checkDAGRing and ProcessService method

* merge

* modify dagRing

* modify process instance for project home page

* fix save process bug

* codeStyle

* Fix logical bug in saving process definition

* codeSytle

* Fix bug in interface of  queryProcessDefinitionList

* codeSytle

* Fix api bug"

* fix taskId in processDefinitionJson

* fix json taskId

* codeStyle

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-03-29 14:22:40 +08:00
guohaozhang
a6a1b94df4
[Feature-#5128]Support turning off sudo permissions (#5129)
* [Feature-#5128]Support turning off sudo permissions

* [Feature-#5128] without sudo permission do not create tenant user
2021-03-29 11:07:39 +08:00
xiaojingXU
9c04396218
[Bug-5132][server] stop the take immediately if an exception occurs in the taskExecuteThread (#5133)
* [DS-5132][fix] stop the take immediately if an exception occurs in the taskExecuteThread
- let softkill() method return true when the process is stopped,else return false;
2021-03-29 10:41:51 +08:00
wenjun
573252f3e1
[Bug][Server] DB transaction failure #5150 (#5152) 2021-03-29 10:30:16 +08:00
wenjun
87ed189ef5
[Improvement] print exception when task execute (#5159) 2021-03-29 10:15:18 +08:00
zhuangchong
f6d62a4924
[Improvement-5144][UI] error v-show directives cannot be put on template tags (#5145)
* fix error v-show directives cannot be put on template tags.

* rerun e2e.
2021-03-26 16:42:13 +08:00
Shiwen Cheng
492b318bd3
[Fix][Server] Fix clear task execute path is related to master (#5123) 2021-03-26 10:11:56 +08:00
wenjun
a8b47e1d4f
[Bug][Master] Typo in MasterConfig #5141 (#5142) 2021-03-26 09:47:21 +08:00
lenboo
0914699fc5 Merge branch 'json_split' of https://github.com/apache/incubator-dolphinscheduler into spilit 2021-03-26 00:06:26 +08:00