Commit Graph

6915 Commits

Author SHA1 Message Date
Eric Gao
f1f2953dda
[Fix][Worker] fix wrong env var name for alert in K8S (#12369) (#12635)
Co-authored-by: 司马琦昂 <bruce.maqiang@gmail.com>
2022-11-01 12:12:35 +08:00
Eric Gao
aecff85df7
[dev] Easier release: cherry-pick, changelog, contributor (#11478) (#12634)
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-11-01 11:53:32 +08:00
Eric Gao
d158ae55b9
[Bug-#12057][task-plugin] fix when the sql query result is empty, the email fails to send the attachment, and an exception will be reported (#12059) (#12633)
Co-authored-by: 冯剑 Jian <jian.feng@jiduauto.com>
2022-11-01 11:41:09 +08:00
Eric Gao
457c06c6cf
[Fix-10392][SqlTask]: Fix list param error when use sql task (#11285) (#12632)
Co-authored-by: Stalary <stalary@163.com>
2022-11-01 11:31:24 +08:00
Eric Gao
0b9ef7107c
[Fix-11583][UI] Fix the API usage of gantt graph (#11642) (#12631)
Co-authored-by: Chris <realhezean@gmail.com>
2022-11-01 11:23:07 +08:00
Jiajie Zhong
aec3513266 [fix][python] Task switch branch not show in webui (#12120)
when create task switch in python api, switch branch not show correctly,
due to we add some unnecessary attribute to switch task, this patch we
add `_task_ignore_attr` in class `Task` to ignore those unnecessary
attribute from `_task_default_attr`

(cherry picked from commit a86f4e2693)
2022-10-28 08:59:44 +08:00
zhuangchong
5f85235462 [maven-release-plugin] prepare for next development iteration 2022-09-22 16:10:18 +08:00
zhuangchong
cb03ca8166 [maven-release-plugin] prepare release 3.0.1 2022-09-22 16:10:17 +08:00
caishunfeng
54a19b3cb7
[Bug][Timezone][3.0.1] fix timezone when complement data and preview (#12093)
* fix timezone in complement data and schedule preview

* fix timezone in complement data and schedule preview

* code improvement
2022-09-22 14:32:24 +08:00
songjianet
b3c27efac3 [Fix][UI] Fix the workflow name. 2022-09-21 12:39:04 +08:00
zhuangchong
364cafe138 [maven-release-plugin] prepare for next development iteration 2022-09-19 13:36:46 +08:00
zhuangchong
17e36b7060 [maven-release-plugin] prepare release 3.0.1 2022-09-19 13:36:45 +08:00
Kerwin
018734c31c
[3.0.1-prepare]Modified version before release. (#12038) 2022-09-19 13:01:49 +08:00
Kerwin
ffb58c1e32
[3.0.1-prepare][cherry-pick]3.0.1 UI 1 (#12033)
* [Improvement][UI] Unified local parameters UI (#11190)

* [Fix][UI] fix bug where icons are displayed in one line. (#11320)

* cherry pick [Improvement-11386][UI] Concise the logic available for task action buttons

* [Fix][UI] Fix the preTask options are unavailable when creating a tas...

* fix build

Co-authored-by: Chris Ho <realhezean@gmail.com>
Co-authored-by: Devosend <devosend@gmail.com>
Co-authored-by: Sheldon <39169452+sketchmind@users.noreply.github.com>
Co-authored-by: Amy0104 <amywang0104@163.com>
2022-09-19 10:41:06 +08:00
Kerwin
827eb60dbf
cherry-pick S3 Resource center supports bucket customization (#12022)
Co-authored-by: guodong <guodongym@163.com>
2022-09-19 09:50:03 +08:00
Kerwin
08c187ed27
fix status check issue (#11580) (#12030)
Co-authored-by: Yann Ann <xiaoqiang.yann@gmail.com>
2022-09-19 09:49:40 +08:00
Kerwin
2b016356a5
cherry-pick [Improvement] [LDAP] Config value should return real null instead of 'null' string (#12031)
Co-authored-by: Guanhua Li <guanhua_li@foxmail.com>
2022-09-19 09:48:17 +08:00
Kerwin
3b947cebc7
[3.0.1-preapre][cherry-pick]3.0.1 UI (#12020) 2022-09-19 09:47:54 +08:00
jackfanwan
b709cd9a12 [fix-10961][alert server]Change the content of alert to an array (#11033)
* Change the content of alert to an array

* Increase unit test coverage

* Modify the code format

* Modify the code format

* Modify judgment statement

* Deleting invalid References

* Modify the previous code implementation and improve the test data

* Modify the code format

* Move the location of the Content conversion

* Remove useless code

* Change the code format

* Modify unit tests

* Modify unit tests

* Modify unit tests

* Changing the location of the code

* Modify the code

Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
Co-authored-by: 范万龙 <fanwanlong@fanwanlongs-MBP.lan>
2022-09-19 08:55:15 +08:00
Kerwin
70ddb11636
[Fix][UI] Fix workflow name overlaps bug (#11862) (#12019)
Co-authored-by: Devosend <devosend@gmail.com>
2022-09-19 01:11:16 +08:00
Kerwin
c4c943277c
[3.0.1-prepare]cherry-pick [Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task (#11994)
* cherry-pick [Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
2022-09-18 14:23:35 +08:00
JinYong Li
ab8f878631
fix heartBeatTaskCount bug (#12024) 2022-09-18 11:49:21 +08:00
Wenjun Ruan
bc629f8f58
[3.0.1-prepare]cherry-pick Fix kill task failed will cause the taskGroup cannot release and add taskGroup log (#11469) (#12013)
* Fix kill task failed will cause the taskGroup cannot release and add taskGroup log (#11469)

(cherry picked from commit 4d13a5104b)
2022-09-18 09:37:57 +08:00
JiPeng Wang
c10deeeda6
CP Workflow Definition Name Change Validation Optimization. (#11986) 2022-09-18 09:11:39 +08:00
Kerwin
2bdd0d9c6c
add unit test ci timeout (#11655) (#12021)
Co-authored-by: xiangzihao <460888207@qq.com>
2022-09-18 07:15:48 +08:00
Kerwin
1b2d8be489
[helm] fix worker template persistentVolumeClaim link (#11248) (#12018)
Co-authored-by: shiyu li <675590586@qq.com>
2022-09-18 07:15:11 +08:00
Wenjun Ruan
041e1fd3e6
Set master's task running status in runTask to avoid the task group acquire failed, but the task status is in running (#11451) (#12011)
(cherry picked from commit 05589606a2)
2022-09-17 22:55:40 +08:00
caishunfeng
5df86d0b7e
[Cherry-pick-3.0.1] #11697 #11400 #11696 (#12023)
* [Cherry-pick-3.0.1][fix-#11691] Add lz4-java in clickhouse datasource. #11697

* [Cherry-pick-3.0.1][fix-#11689] change replaceAll to replace in method of tryExecuteSqlResolveColumnNames #11696

* [fix-11378] fix API-Server release response message typo (#11400)

* [fix-11295] remove duplicate classes

* [fix-11378] fix response message error

Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>

Co-authored-by: fuchanghai <33984497+fuchanghai@users.noreply.github.com>
Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>
2022-09-17 22:41:15 +08:00
Jiajie Zhong
257187c521 [python] Refactor structure to avoid cycle import (#11167)
Currently, our core and side module dependent on each others. and will cause
cycle import in our codebase, especially in issue #10905, we try to refactor
to solve this problem.

This patch do the following change:

* Rename module `side` to `models`
* Move `core/base` and `core/sidebase` to dir `modules`
* Move `configuration` and `default_config.yaml` to the root of pydolphinscheduler

(cherry picked from commit 7a766cbcf2)
2022-09-17 22:13:03 +08:00
Jiajie Zhong
9f0b2ca550 [python] Add support interpreter version 310 and 311-dev (#11170)
* Change version of package
* Fix tox error
* Change dev status to beta
* py4j not work on py{10,11} OS Windows

(cherry picked from commit 4d427ee215)
2022-09-17 22:11:52 +08:00
Kerwin
8a12ae746d update PyDolphinScheduler documentation link. (#11474)
(cherry picked from commit c59a8503f4)
2022-09-17 22:08:45 +08:00
JieguangZhou
1f88c5a637 [bug][python] Fix task switch error when default branch not defined last (#11606)
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
(cherry picked from commit 635fde1981)
2022-09-17 22:08:28 +08:00
陈家名
59e745be0a [fix][python] Sql pattern add truncate. (#11666)
(cherry picked from commit 564a815d21)
2022-09-17 22:07:30 +08:00
fuchanghai
85b96ddc15 [improvement-#11630]fix document about common.properties (#11653)
(cherry picked from commit ce8db1c5fb)
2022-09-17 22:04:50 +08:00
旺阳
f41af79ef6 [doc] Correct E2E Doc, fix WorkerGroupPage typo (#11629)
(cherry picked from commit 6e4d974b91)
2022-09-17 22:04:32 +08:00
Eric Gao
11b78a871c Fix homepage email subscription link (#11622)
* Fix homepage email link bug

* Replace dev with latest

(cherry picked from commit 3e73829924)
2022-09-17 22:03:54 +08:00
Yann Ann
6797ae2d97 [DOC] should notice that need setting the full path when call the resource file #11620 (#11621)
(cherry picked from commit eda9f3d50c)
2022-09-17 22:02:53 +08:00
Eric Gao
c8f0a66b37 [Doc][Bug] Fix resource center docs for standalone mode (#11600)
* Fix resource center docs for standalone mode

* Remove useless images

(cherry picked from commit ff4d2c9460)
2022-09-17 22:02:30 +08:00
labbomb
7723f5bcae feat: update slack (#11578)
(cherry picked from commit 5813a61f09)
2022-09-17 22:02:10 +08:00
monster
90cc1284a4 [Improvement-11550] [Doc]Document content update (#11577)
* [Improvement-11550] [Doc]Document content update

* Update pictures

* fix

* Update Process word to Workflow

Co-authored-by: David <davidzollo365@gmail.com>
(cherry picked from commit 3e360a8ecb)
2022-09-17 22:01:43 +08:00
Eric Gao
3d69e9edb1 [Doc][Security] Update instructions on worker groups (#11483)
* Update instructions on worker groups

(cherry picked from commit 9330d6cfcd)
2022-09-17 22:00:59 +08:00
Eric Gao
3447e6765c [Doc][DSIP] Move DSIP docs to the right place (#11442) (#11443)
(cherry picked from commit e3c6ace81d)
2022-09-17 22:00:27 +08:00
Eric Gao
059b66b64f [Doc][Resources] Instruct users to use local storage if they have remote storage mounted to local (#11435)
* [Doc][Resources] Instruct users to use local storage if they have remote storage mounted to local (#11427)

* Remove dead link in pyds README

* Add hyperlinks for docs

Co-authored-by: Jiajie Zhong <zhongjiajie955@hotmail.com>

(cherry picked from commit 9d6fc92af9)
2022-09-17 22:00:05 +08:00
labbomb
f7fb1acef9 feat: Modifying Slack Links (#11416)
* feat: Modifying Slack Links

* append

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>

(cherry picked from commit de4e4af844)
2022-09-17 21:57:34 +08:00
Jiajie Zhong
82deeab2fb [python] Add multiple version of document (#11391)
* Using sphinx-multiversion to support multiple version
of python api document
* change python api sidebar link
* fix whitelist_externals deprecated and add git

close: #8227

(cherry picked from commit 26afd655cb)
2022-09-17 21:54:29 +08:00
insist777
be37dd4886 [doc] Refine the deployment documentation (#11361)
(cherry picked from commit e9ccaffbe0)
2022-09-17 21:49:31 +08:00
阿福Chris
b9cc2639d0 [Fix-11217] [Doc] add postgresql config in doc: datasource-setting (#11326)
* add postgresql config for datasoruce-setting

* Update docs/docs/en/guide/howto/datasource-setting.md

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
(cherry picked from commit c76301ab51)
2022-09-17 21:47:55 +08:00
insist777
82a8956e7b [doc] Improve the document introduction of complement (#11275)
(cherry picked from commit 8ad6e10da5)
2022-09-17 21:47:00 +08:00
Wenjun Ruan
8fefb9ecfd
Add dependent task instance log (#11541) (#12014)
* Add dependent task instance log

* Optimize log

* Fix dependent task initialize failed will throw exception

(cherry picked from commit a41c6824fc)
2022-09-17 18:32:28 +08:00
Wenjun Ruan
84876b9f15
If the task processor is not found need to throw error rather than exception (#11461) (#12012)
(cherry picked from commit 4362fb8448)
2022-09-17 18:25:11 +08:00