Commit Graph

7294 Commits

Author SHA1 Message Date
JieguangZhou
5e42f52bdf
[3.1.0-prepare][cherry-pick][DSIP-11][python] create workflows from YAML configuration (#11988)
* [DSIP-11][python] create workflows from YAML configuration (#11611)

(cherry picked from commit 38ee91fb1e)

* fix pydolphin yaml doc link (#11817)

(cherry picked from commit c41fa5a8b1)
2022-09-17 08:56:37 +08:00
caishunfeng
c4953e8660
Example Change the regular expression of the data source password (#11459) (#11990)
Co-authored-by: jackfanwan <61672564+jackfanwan@users.noreply.github.com>
2022-09-16 15:16:05 +08:00
caishunfeng
951f707b61
[fix][doc] Update the registry related configuration in values.yaml (#11444) (#11981)
Co-authored-by: rickchengx <38122586+rickchengx@users.noreply.github.com>
2022-09-16 11:17:33 +08:00
caishunfeng
cd8f32d876
[Bug][Workflow Definition] fix ordinary users can not create depend task (#11961) (#11977) 2022-09-16 09:42:59 +08:00
caishunfeng
f034a09d25
[Bug-11650][worker] #11650 fix SQL type task, stop task cause NPE (#11668) (#11958)
Co-authored-by: 冯剑 <35831367+fengjian1129@users.noreply.github.com>
2022-09-15 14:24:34 +08:00
caishunfeng
0647b3e10c
[Cherry-pick][Improvement] [Doc] Put default task parameters in a new file #11776 (#11957)
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-09-15 14:21:05 +08:00
caishunfeng
27b69e608a
[Bug] [Master] WorkflowExecuteRunnable will face a infinite loop #11838 (#11864) (#11950)
* [Bug] [Master] WorkflowExecuteRunnable will face a infinite loop #11838

Co-authored-by: Yann Ann <2993643785@qq.com>
2022-09-15 10:39:00 +08:00
caishunfeng
0f6cc4fe33
[Fix][db] fix init&upgrade mysql-meta-schema bugs (#11887) (#11935)
Co-authored-by: wendongdi <49931055+wendongdi@users.noreply.github.com>
2022-09-14 18:49:49 +08:00
caishunfeng
8d1c2d3eeb
cherry-pick [Bug] Fix procedure task param pass #11919 (#11926) 2022-09-14 15:44:01 +08:00
阿福Chris
c76301ab51
[Fix-11217] [Doc] add postgresql config in doc: datasource-setting (#11326)
* add postgresql config for datasoruce-setting

* Update docs/docs/en/guide/howto/datasource-setting.md

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-09-05 10:54:01 +08:00
fuchanghai
f8b9aad239
[feature-#11689] change replaceAll to replace in method of tryExecuteSqlResolveColumnNames (#11696) 2022-09-05 09:54:18 +08:00
fuchanghai
554562bfa9
[fix-#11691] Add lz4-java in clickhouse datasource. (#11697) 2022-09-05 09:15:58 +08:00
Amy0104
d0d481d10f
[Fix][UI] Add the task name entry when the workflow instance detail page goes to the task instance page. (#11761) 2022-09-03 11:57:02 +08:00
caishunfeng
f8d46a26c1
[Feature-11530] add state history for process instance (#11757)
* [Feature] add state history for process instance (#97)

* add state history for process instance

* upsertProcessInstance

* remove unuse method

* fix UT

Co-authored-by: caishunfeng <534328519@qq.com>
2022-09-03 10:14:05 +08:00
kezhenxu94
31ba49ac02
Update doc according to recent update of Spring / Swagger (#11755) 2022-09-02 19:06:15 +08:00
kezhenxu94
277f137358
Add Kubernetes configmap reload to all components (#11730) 2022-09-02 12:03:19 +08:00
Tq
b3cc8a55b9
[feature][API]feature: add task type list and enable user to add task type to fav (#11727)
* feature: add task type list and enable user to add task type to fav

* make DependentExecute.java variable protected

* add standalone server fileSet
2022-09-02 11:40:23 +08:00
caishunfeng
f95cdd350a
reduce task dependencies (#11731) 2022-09-01 17:04:07 +08:00
juzimao
d0f5e7edf3
optimize the process instance query, change the date time range (#11719) 2022-08-31 19:53:41 +08:00
Wenjun Ruan
67e7f88d8b
Refactor heart beat task, use json to serialize/deserialize (#11702)
* Refactor heart beat task, use json to serialize/deserialize
2022-08-31 16:20:23 +08:00
Wenjun Ruan
03e1e6fe45
[Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task (#11701)
* Fix kill job may cause worker oom
2022-08-31 15:25:01 +08:00
Evans Sun
5fabce783a
[DOC] improve zk digest doc (#11703) 2022-08-30 21:07:04 +08:00
Eric Gao
4a37345436
[Feature][Task Plugin] Support hive cli task plugin (#11651)
* Add hive cli task plugin

* Add docs for hive-cli task plugin

* Fix hive-cli task related front-end nits and checkstyle

* Fix exception handling logic
2022-08-30 10:45:51 +08:00
xiangzihao
71eeab3d98
[CI] Fix cluster test abnormal (#11688)
* fix cluster test abnormal
2022-08-30 09:33:22 +08:00
seedscoder
145e441afb
[Fix-11633] The data type of the PostgreSQL database column is wrong. (#11633) (#11634) 2022-08-29 16:33:16 +08:00
SongTao Zhuang
6a5367fd57
[Improvement-11662][dao] fix foreach null items in mapper.xml 2022-08-28 20:58:12 +08:00
旺阳
6e4d974b91
[doc] Correct E2E Doc, fix WorkerGroupPage typo (#11629) 2022-08-28 17:44:06 +08:00
Jiajie Zhong
4dca488cd5
[python] Auto location when create process definition (#11681)
* Add auto format when submit process definition from python api
* add UPDATING.md

close: #8254
2022-08-27 23:38:46 +08:00
JieguangZhou
635fde1981
[bug][python] Fix task switch error when default branch not defined last (#11606)
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-08-27 18:48:09 +08:00
陈家名
564a815d21
[fix][python] Sql pattern add truncate. (#11666) 2022-08-27 12:17:06 +08:00
Devosend
769a20e986
[Fix][UI] Fix bug where crontab special of month and year (#11661) 2022-08-26 23:04:29 +08:00
Eric Gao
23d8aaf735
[Feature][UI] Enable highlight and auto-complete for SQL scripts (#11659) 2022-08-26 19:03:44 +08:00
songjianet
cccbd27c58
[Fix][UI] Fix the problem that the pagination component is not centered in the environment management. (#11646) 2022-08-26 14:50:46 +08:00
songjianet
f28a39f984
[Docs] Update README. (#11641) 2022-08-26 14:50:32 +08:00
Wenjun Ruan
1b120e3a59
Refactor worker execute task process (#11540)
* Refactor worker execute task process
2022-08-26 13:33:51 +08:00
xiangzihao
a22b9271ff
add unit test ci timeout (#11655) 2022-08-26 11:45:49 +08:00
Yann Ann
eda9f3d50c
[DOC] should notice that need setting the full path when call the resource file #11620 (#11621) 2022-08-26 10:58:56 +08:00
fuchanghai
ce8db1c5fb
[improvement-#11630]fix document about common.properties (#11653) 2022-08-26 10:50:31 +08:00
JiPeng Wang
cf3b4424d7
[Fix-11616] Workflow Definition Name Change Validation Optimization. (#11617)
* Workflow Definition Name Change Validation Optimization

* [Fix][UI] Add the workflow code entry to the verify name interface.

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/ProcessDefinitionService.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* processDefinitionCode param name change

Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-08-24 19:59:38 +08:00
Wenjun Ruan
b96d69701a
[Improvement-#11613] Add spi priority factory (#11614)
* Add spi priority factory

* Add doc

* Add override log

* Use lombok

* Add comment
2022-08-24 19:51:47 +08:00
labbomb
096fae77f4
feat: Locations Formats the layout if it does not exist (#11535) 2022-08-24 18:59:14 +08:00
songjianet
8789895791
[Fix][UI] Fix the port in the datasource edit. (#11624) 2022-08-24 14:04:19 +08:00
JiPeng Wang
961e67f524
[Improvement][User] Query all users filter un enabled. (#11504)
* user query all filter un enabled
* restore permissions
2022-08-24 11:55:18 +08:00
Eric Gao
3e73829924
Fix homepage email subscription link (#11622)
* Fix homepage email link bug

* Replace dev with latest
2022-08-24 09:25:23 +08:00
Assert
db925f3216
[Improvement-10942][UI]The workflow or task name is too long and resu… (#10957)
* [Improvement-10942][UI]The workflow or task name is too long and results in incomplete display

* [improvement-10942][ui]The workflow or task name is too long and results in incomplete display
2022-08-23 17:12:40 +08:00
longtb
4893bef5a7
[Improvement][TaskInstance] reduce database queries (#11522)
* [Improvement][TaskInstance] reduce database queries

* Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/TaskInstanceMapper.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

* [Improvement][TaskInstance] queryByInstanceIdsAndCodes -> queryByProcessInstanceIdsAndTaskCodes

Co-authored-by: zhangshunmin <zhangshunmin@kezaihui.com>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-08-23 14:27:26 +08:00
JinYong Li
3f2ca7bca3
[Fix-9980] [Server] fix heartBeatTaskCount bug (#11232)
* fix heartBeat bug

* modify class name

* fix conflict

Co-authored-by: JinyLeeChina <jiny.li@foxmail.com>
2022-08-23 11:30:13 +08:00
insist777
abfef1a929
[improvement] Add two parameters in workergroup, and support the application of description display and other parameters (#11542)
* [Improvement] Improvement default worker group

* [Improvement] Improvement default worker group

* [Improvement] Improvement default worker group

* [Improvement] Improvement default worker group

* [Improvement] Improvement default worker group

* [improvement] The default worker grouping supports editing

* [improvement] The default worker grouping supports editing

* Update WorkerGroupServiceImpl.java

* Update WorkerGroupServiceImpl.java

* The default worker grouping supports editing

* update sql file

* update

* update

* update

* update
2022-08-23 10:54:17 +08:00
Wenjun Ruan
4d13a5104b
Fix kill task failed will cause the taskGroup cannot release and add taskGroup log (#11469) 2022-08-23 10:05:03 +08:00
Wenjun Ruan
a41c6824fc
Add dependent task instance log (#11541)
* Add dependent task instance log

* Optimize log

* Fix dependent task initialize failed will throw exception
2022-08-23 09:55:38 +08:00