Commit Graph

7084 Commits

Author SHA1 Message Date
爱穿格子裤
1c15a7d605
[fix-11404]: make the common.properties to configurable on values.yaml (#11441)
and set the resource.storage.type default to hdfs
2022-08-19 14:06:30 +08:00
Wenjun Ruan
3516533017
Remove logger header in task log file (#11555) 2022-08-19 14:01:52 +08:00
Guanhua Li
8b3f60ed88
[Improvement] [LDAP] Bug fix: Config value return "null" instead of real null currently. (#11325) 2022-08-19 10:34:00 +08:00
juzimao
3b72c6efe7
[Improvement]Add a stop function when you are ready to do pause operation (#11543)
* add can stop for execute state machine

* add execute type check for pause operation
2022-08-18 21:32:53 +08:00
Eric Gao
277c78010f
Enable spotless to fix markdown checkstyle and refactor faq.md as an example (#11384) 2022-08-18 16:48:22 +08:00
Wenjun Ruan
2862f5b67c
Set process instance and task priority default value as 2 (#11539) 2022-08-18 16:21:12 +08:00
Amy0104
c322367846
[Fix][UI] Remove unsupported datasource types in the datax task. (#11527) 2022-08-18 12:34:21 +08:00
JieguangZhou
a974ba74ab
[Feature] New task plugin Pytorch (#11498)
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-08-18 10:20:37 +08:00
insist777
ebdf903dcc
[Improvement-11468] Support re running historical version workflow (#11489)
* Support re running historical version workflow

 Support re running historical version workflow

* Update ExecutorServiceImpl.java

* Update ExecutorServiceImpl.java
2022-08-18 09:46:54 +08:00
insist777
006d8e21a6
[Improvement] File deletion logic optimization (#11519)
* [Improvement] File deletion logic optimization
2022-08-18 09:38:06 +08:00
FangYin Cheng
11d74fd7e8
[test-11432][HttpTask] Add unit tests to http task (#11453)
* [test][HttpTask] Add unit tests to http task

* [test][HttpTask] fix http task test code format problem

* [test][HttpTask] fix http task test code replace http code to constants
2022-08-17 22:02:52 +08:00
sgw
8ec2f79248
[DS-11481][docs] Add log specification document to contribution guidelines. (#11484) 2022-08-17 21:57:02 +08:00
Eric Gao
f93e93cfd2
[Feature][Style] Make sure there is one and only one empty line at the end of each java file (#11520) 2022-08-17 12:59:08 +08:00
Jiajie Zhong
5983e41f4b
[fix] Database change not sync (#11258)
* [fix] Database change not sync

* Make del sql upgrade same as release version
* Correct data quality dml sql
* Upgrade database DDL to avoid log path too long error

* Add missing if exists
2022-08-17 10:50:34 +08:00
lugela
e5d06c40a5
[Feature-10182][task-datax] (#11387)
In the process of realizing datax synchronization, use custom json for better connection to enable kerberos-authenticated clusters, such as using plug-ins such as hdfs and hbase
2022-08-17 10:01:20 +08:00
Amy0104
182455ced7
[Fix][UI] Fix the preTask options are unavailable when creating a task in the task definition page. (#11501) 2022-08-17 09:26:01 +08:00
kezhenxu94
f6ef628030
Support reading application properties from kubernetes config map (#11402) 2022-08-16 20:25:17 +08:00
songjianet
2a7e0bee91
[Doc] Update UI readme. (#11496) 2022-08-16 13:54:31 +08:00
songjianet
d798be0e73
[Refactor][UI] Refactor task definition version using NSpace component. (#11495) 2022-08-16 13:52:36 +08:00
songjianet
68316f68fa
[Fix][UI] Fix the table header in the workflow instance. (#11487) 2022-08-15 21:07:20 +08:00
songjianet
4d063192cd
[Refactor][UI] Refactor task definition batch stream using NSpace component. (#11485)
* [Refactor][UI] Refactor task definition batch stream using NSpace component.

* [Refactor][UI] Refactor task definition batch stream using NSpace component.

* [Refactor][UI] Refactor task definition batch stream using NSpace component.
2022-08-15 21:05:42 +08:00
Eric Gao
9330d6cfcd
[Doc][Security] Update instructions on worker groups (#11483)
* Update instructions on worker groups
2022-08-15 17:44:00 +08:00
Qi Zhang
a4bdadbb84
[doc] Use Rainbond deployment DolphinScheduler Cluster (#10951)
* [doc] Use Rainbond deployment DolphinScheduler Cluster

Signed-off-by: Qi Zhang <smallqi1@163.com>

* Update docs/docs/en/guide/installation/rainbond.md

* Update docs/docs/en/guide/installation/rainbond.md

* Update docs/docs/zh/guide/installation/rainbond.md

* Update docs/docs/zh/guide/installation/rainbond.md

* [doc] modify rainbond doc and add image

Signed-off-by: Qi Zhang <smallqi1@163.com>

* fix: img link

Signed-off-by: Qi Zhang <smallqi1@163.com>

* fix: modify proposal

Signed-off-by: Qi Zhang <smallqi1@163.com>

* docs: move rainbond docs to integration

Signed-off-by: Qi Zhang <smallqi1@163.com>

Signed-off-by: Qi Zhang <smallqi1@163.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-08-15 14:33:37 +08:00
Kerwin
c59a8503f4
update PyDolphinScheduler documentation link. (#11474) 2022-08-15 13:33:51 +08:00
JiPeng Wang
13d400ceb6
[Fix-11465] Serial first, the last executing instance will be stopped (#11466)
* Serial first, the last executing instance will be stopped

* ut fix
2022-08-13 22:30:56 +08:00
Wenjun Ruan
4362fb8448
If the task processor is not found need to throw error rather than exception (#11461) 2022-08-13 22:01:39 +08:00
Wenjun Ruan
05589606a2
Set master's task running status in runTask to avoid the task group acquire failed, but the task status is in running (#11451) 2022-08-13 14:19:13 +08:00
juzimao
f3d28112ce
optimize sorting priority for workflow define (#11462) 2022-08-13 13:28:35 +08:00
Eric Gao
896fef6c98
[Feature][Style] Enable spotless to manage imports (#11458) 2022-08-13 10:05:03 +08:00
Wenjun Ruan
7ff34c3947
[Feature-7024] Add waiting strategy to support master/worker can recover from registry lost (#11368)
* Add waiting strategy to support master/worker can recover from registry lost

* throw exception when zookeeper registry start failed due to interrupted
2022-08-13 09:52:03 +08:00
Wenjun Ruan
0ca3086296
Fix workflow instance may failover many times due to doesn't check the restart time (#11445) 2022-08-13 00:05:37 +08:00
songjianet
2240b6e708
[Refactor][UI] Refactor task instance stream using NSpace component. (#11454) 2022-08-12 17:07:43 +08:00
Sheldon
376d0a09ae
[Improvement-11386][UI] Concise the logic available for task action buttons (#11419)
* Remove button instead of disable button

* Correct the value of releaseState in the compare statement

Co-authored-by: sheldonliu <sheldonliu>
2022-08-12 16:12:39 +08:00
songjianet
32361f4fef
[Refactor][UI] Refactor workflow instance using NSpace component. (#11446)
* [Refactor][UI] Refactor workflow instance using NSpace component.

* [Refactor][UI] Refactor workflow instance using NSpace component.
2022-08-12 14:26:22 +08:00
Wenjun Ruan
a2b5219315
Fix find last process instance in dependent task is not correct (#11424) 2022-08-12 14:11:28 +08:00
songjianet
dcab16a3eb
[Refactor][UI] Refactor task instance batch using NSpace component. (#11447) 2022-08-12 14:01:55 +08:00
Eric Gao
e3c6ace81d
[Doc][DSIP] Move DSIP docs to the right place (#11442) (#11443) 2022-08-12 11:20:12 +08:00
jackfanwan
abd5798755
[fix-10961][alert server]Change the content of alert to an array (#11033)
* Change the content of alert to an array

* Increase unit test coverage

* Modify the code format

* Modify the code format

* Modify judgment statement

* Deleting invalid References

* Modify the previous code implementation and improve the test data

* Modify the code format

* Move the location of the Content conversion

* Remove useless code

* Change the code format

* Modify unit tests

* Modify unit tests

* Modify unit tests

* Changing the location of the code

* Modify the code

Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
Co-authored-by: 范万龙 <fanwanlong@fanwanlongs-MBP.lan>
2022-08-12 09:57:27 +08:00
Wenjun Ruan
47b50067ef
Clear thread name in BaseTaskProcessor (#11422) 2022-08-12 09:38:48 +08:00
longtb
be66035dee
[Improvement] Avoid using search in for and start using testSaveTaskDefine (#11383)
* [Improvement] Avoid using search in for and start using testSaveTaskDefine()

* [Improvement] not import *

Co-authored-by: zhangshunmin <zhangshunmin@kezaihui.com>
2022-08-12 09:37:24 +08:00
Eric Gao
9d6fc92af9
[Doc][Resources] Instruct users to use local storage if they have remote storage mounted to local (#11435)
* [Doc][Resources] Instruct users to use local storage if they have remote storage mounted to local (#11427)

* Remove dead link in pyds README

* Add hyperlinks for docs

Co-authored-by: Jiajie Zhong <zhongjiajie955@hotmail.com>
2022-08-12 00:18:43 +08:00
Jiajie Zhong
4d427ee215
[python] Add support interpreter version 310 and 311-dev (#11170)
* Change version of package
* Fix tox error
* Change dev status to beta
* py4j not work on py{10,11} OS Windows
2022-08-11 23:39:44 +08:00
Devosend
d02cf85b60
[Fix][UI] fix bug where warn group name not display (#11429) 2022-08-11 20:58:56 +08:00
songjianet
20b87ee761
[Refactor][UI] Refactor workflow definition version using NSpace component. (#11420) 2022-08-11 17:11:38 +08:00
songjianet
16134014f8
[Refactor][UI] Refactor workflow definition timing using NSpace component. (#11415)
* [Refactor][UI] Refactor workflow definition timing using NSpace component.

* [Refactor][UI] Refactor workflow definition timing using NSpace component.
2022-08-11 14:08:16 +08:00
Wenjun Ruan
496c2d4bfa
[Fix-11413] Cannot set task status to kill if the task is not in running(#11414) 2022-08-11 13:38:49 +08:00
insist777
8217784044
[Fix-1360]: Fix Description length check (#11371)
* [Fix-1360]: Fix Description length check

* Update dolphinscheduler_h2.sql

h2 Increase the length of some fields

* Update dolphinscheduler_ddl.sql
2022-08-11 13:26:50 +08:00
labbomb
de4e4af844
feat: Modifying Slack Links (#11416)
* feat: Modifying Slack Links

* append

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-08-11 13:11:23 +08:00
Jiajie Zhong
26afd655cb
[python] Add multiple version of document (#11391)
* Using sphinx-multiversion to support multiple version
of python api document
* change python api sidebar link
* fix whitelist_externals deprecated and add git

close: #8227
2022-08-11 12:02:29 +08:00
rickchengx
3836dd7170
[Improvement-11380][scp-host.sh] Set StrictHostKeyChecking=no option to ssh (#11382)
* [Improvement][scp-host.sh] Set StrictHostKeyChecking=no option to ssh

* add StrictHostKeyChecking=no option to status-all.sh
2022-08-11 10:49:46 +08:00