Commit Graph

7110 Commits

Author SHA1 Message Date
Wenjun Ruan
1b120e3a59
Refactor worker execute task process (#11540)
* Refactor worker execute task process
2022-08-26 13:33:51 +08:00
xiangzihao
a22b9271ff
add unit test ci timeout (#11655) 2022-08-26 11:45:49 +08:00
Yann Ann
eda9f3d50c
[DOC] should notice that need setting the full path when call the resource file #11620 (#11621) 2022-08-26 10:58:56 +08:00
fuchanghai
ce8db1c5fb
[improvement-#11630]fix document about common.properties (#11653) 2022-08-26 10:50:31 +08:00
JiPeng Wang
cf3b4424d7
[Fix-11616] Workflow Definition Name Change Validation Optimization. (#11617)
* Workflow Definition Name Change Validation Optimization

* [Fix][UI] Add the workflow code entry to the verify name interface.

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/ProcessDefinitionService.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* processDefinitionCode param name change

Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-08-24 19:59:38 +08:00
Wenjun Ruan
b96d69701a
[Improvement-#11613] Add spi priority factory (#11614)
* Add spi priority factory

* Add doc

* Add override log

* Use lombok

* Add comment
2022-08-24 19:51:47 +08:00
labbomb
096fae77f4
feat: Locations Formats the layout if it does not exist (#11535) 2022-08-24 18:59:14 +08:00
songjianet
8789895791
[Fix][UI] Fix the port in the datasource edit. (#11624) 2022-08-24 14:04:19 +08:00
JiPeng Wang
961e67f524
[Improvement][User] Query all users filter un enabled. (#11504)
* user query all filter un enabled
* restore permissions
2022-08-24 11:55:18 +08:00
Eric Gao
3e73829924
Fix homepage email subscription link (#11622)
* Fix homepage email link bug

* Replace dev with latest
2022-08-24 09:25:23 +08:00
Assert
db925f3216
[Improvement-10942][UI]The workflow or task name is too long and resu… (#10957)
* [Improvement-10942][UI]The workflow or task name is too long and results in incomplete display

* [improvement-10942][ui]The workflow or task name is too long and results in incomplete display
2022-08-23 17:12:40 +08:00
longtb
4893bef5a7
[Improvement][TaskInstance] reduce database queries (#11522)
* [Improvement][TaskInstance] reduce database queries

* Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/TaskInstanceMapper.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* [Improvement][TaskInstance] queryByInstanceIdsAndCodes -> queryByProcessInstanceIdsAndTaskCodes

Co-authored-by: zhangshunmin <zhangshunmin@kezaihui.com>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-08-23 14:27:26 +08:00
JinYong Li
3f2ca7bca3
[Fix-9980] [Server] fix heartBeatTaskCount bug (#11232)
* fix heartBeat bug

* modify class name

* fix conflict

Co-authored-by: JinyLeeChina <jiny.li@foxmail.com>
2022-08-23 11:30:13 +08:00
insist777
abfef1a929
[improvement] Add two parameters in workergroup, and support the application of description display and other parameters (#11542)
* [Improvement] Improvement default worker group

* [Improvement] Improvement default worker group

* [Improvement] Improvement default worker group

* [Improvement] Improvement default worker group

* [Improvement] Improvement default worker group

* [improvement] The default worker grouping supports editing

* [improvement] The default worker grouping supports editing

* Update WorkerGroupServiceImpl.java

* Update WorkerGroupServiceImpl.java

* The default worker grouping supports editing

* update sql file

* update

* update

* update

* update
2022-08-23 10:54:17 +08:00
Wenjun Ruan
4d13a5104b
Fix kill task failed will cause the taskGroup cannot release and add taskGroup log (#11469) 2022-08-23 10:05:03 +08:00
Wenjun Ruan
a41c6824fc
Add dependent task instance log (#11541)
* Add dependent task instance log

* Optimize log

* Fix dependent task initialize failed will throw exception
2022-08-23 09:55:38 +08:00
Eric Gao
ff4d2c9460
[Doc][Bug] Fix resource center docs for standalone mode (#11600)
* Fix resource center docs for standalone mode

* Remove useless images
2022-08-23 09:46:01 +08:00
Wenjun Ruan
8886d5a126
Fix quartz threadPriority config name error (#11596)
* Fix quartz threadPriority config name error

* Add batchTriggerAcquisitionMaxCount config
2022-08-23 09:32:05 +08:00
Wenjun Ruan
c110f4acae
Refresh server startup time when recovery from waiting (#11595) 2022-08-22 22:36:49 +08:00
kezhenxu94
17a9dd25fa
Fix vulnerability in LDAP login (#11586) 2022-08-22 13:49:14 +08:00
labbomb
5813a61f09
feat: update slack (#11578) 2022-08-22 11:03:50 +08:00
kezhenxu94
13e4720aa2
Upgrade spring boot and swagger (#11574) 2022-08-22 10:27:40 +08:00
monster
3e360a8ecb
[Improvement-11550] [Doc]Document content update (#11577)
* [Improvement-11550] [Doc]Document content update

* Update pictures

* fix

* Update Process word to Workflow

Co-authored-by: David <davidzollo365@gmail.com>
2022-08-22 00:00:42 +08:00
Yann Ann
d5a984748d
fix status check issue (#11580) 2022-08-21 23:04:12 +08:00
kezhenxu94
0b82755796
Fix some resource leak (#11576) 2022-08-21 01:19:16 +08:00
fuchanghai
d8d5d392a7
[feature-11408] add hive option (#11493) 2022-08-20 08:25:53 +08:00
爱穿格子裤
1c15a7d605
[fix-11404]: make the common.properties to configurable on values.yaml (#11441)
and set the resource.storage.type default to hdfs
2022-08-19 14:06:30 +08:00
Wenjun Ruan
3516533017
Remove logger header in task log file (#11555) 2022-08-19 14:01:52 +08:00
Guanhua Li
8b3f60ed88
[Improvement] [LDAP] Bug fix: Config value return "null" instead of real null currently. (#11325) 2022-08-19 10:34:00 +08:00
juzimao
3b72c6efe7
[Improvement]Add a stop function when you are ready to do pause operation (#11543)
* add can stop for execute state machine

* add execute type check for pause operation
2022-08-18 21:32:53 +08:00
Eric Gao
277c78010f
Enable spotless to fix markdown checkstyle and refactor faq.md as an example (#11384) 2022-08-18 16:48:22 +08:00
Wenjun Ruan
2862f5b67c
Set process instance and task priority default value as 2 (#11539) 2022-08-18 16:21:12 +08:00
Amy0104
c322367846
[Fix][UI] Remove unsupported datasource types in the datax task. (#11527) 2022-08-18 12:34:21 +08:00
JieguangZhou
a974ba74ab
[Feature] New task plugin Pytorch (#11498)
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-08-18 10:20:37 +08:00
insist777
ebdf903dcc
[Improvement-11468] Support re running historical version workflow (#11489)
* Support re running historical version workflow

 Support re running historical version workflow

* Update ExecutorServiceImpl.java

* Update ExecutorServiceImpl.java
2022-08-18 09:46:54 +08:00
insist777
006d8e21a6
[Improvement] File deletion logic optimization (#11519)
* [Improvement] File deletion logic optimization
2022-08-18 09:38:06 +08:00
FangYin Cheng
11d74fd7e8
[test-11432][HttpTask] Add unit tests to http task (#11453)
* [test][HttpTask] Add unit tests to http task

* [test][HttpTask] fix http task test code format problem

* [test][HttpTask] fix http task test code replace http code to constants
2022-08-17 22:02:52 +08:00
sgw
8ec2f79248
[DS-11481][docs] Add log specification document to contribution guidelines. (#11484) 2022-08-17 21:57:02 +08:00
Eric Gao
f93e93cfd2
[Feature][Style] Make sure there is one and only one empty line at the end of each java file (#11520) 2022-08-17 12:59:08 +08:00
Jiajie Zhong
5983e41f4b
[fix] Database change not sync (#11258)
* [fix] Database change not sync

* Make del sql upgrade same as release version
* Correct data quality dml sql
* Upgrade database DDL to avoid log path too long error

* Add missing if exists
2022-08-17 10:50:34 +08:00
lugela
e5d06c40a5
[Feature-10182][task-datax] (#11387)
In the process of realizing datax synchronization, use custom json for better connection to enable kerberos-authenticated clusters, such as using plug-ins such as hdfs and hbase
2022-08-17 10:01:20 +08:00
Amy0104
182455ced7
[Fix][UI] Fix the preTask options are unavailable when creating a task in the task definition page. (#11501) 2022-08-17 09:26:01 +08:00
kezhenxu94
f6ef628030
Support reading application properties from kubernetes config map (#11402) 2022-08-16 20:25:17 +08:00
songjianet
2a7e0bee91
[Doc] Update UI readme. (#11496) 2022-08-16 13:54:31 +08:00
songjianet
d798be0e73
[Refactor][UI] Refactor task definition version using NSpace component. (#11495) 2022-08-16 13:52:36 +08:00
songjianet
68316f68fa
[Fix][UI] Fix the table header in the workflow instance. (#11487) 2022-08-15 21:07:20 +08:00
songjianet
4d063192cd
[Refactor][UI] Refactor task definition batch stream using NSpace component. (#11485)
* [Refactor][UI] Refactor task definition batch stream using NSpace component.

* [Refactor][UI] Refactor task definition batch stream using NSpace component.

* [Refactor][UI] Refactor task definition batch stream using NSpace component.
2022-08-15 21:05:42 +08:00
Eric Gao
9330d6cfcd
[Doc][Security] Update instructions on worker groups (#11483)
* Update instructions on worker groups
2022-08-15 17:44:00 +08:00
Qi Zhang
a4bdadbb84
[doc] Use Rainbond deployment DolphinScheduler Cluster (#10951)
* [doc] Use Rainbond deployment DolphinScheduler Cluster

Signed-off-by: Qi Zhang <smallqi1@163.com>

* Update docs/docs/en/guide/installation/rainbond.md

* Update docs/docs/en/guide/installation/rainbond.md

* Update docs/docs/zh/guide/installation/rainbond.md

* Update docs/docs/zh/guide/installation/rainbond.md

* [doc] modify rainbond doc and add image

Signed-off-by: Qi Zhang <smallqi1@163.com>

* fix: img link

Signed-off-by: Qi Zhang <smallqi1@163.com>

* fix: modify proposal

Signed-off-by: Qi Zhang <smallqi1@163.com>

* docs: move rainbond docs to integration

Signed-off-by: Qi Zhang <smallqi1@163.com>

Signed-off-by: Qi Zhang <smallqi1@163.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-08-15 14:33:37 +08:00
Kerwin
c59a8503f4
update PyDolphinScheduler documentation link. (#11474) 2022-08-15 13:33:51 +08:00