Commit Graph

7325 Commits

Author SHA1 Message Date
Jay Chung
afeadbe16b [fix][doc] Dead link for python api (#12848)
* [fix][doc] Dead link for python api

ref: apache/dolphinscheduler#12779 and
apache/dolphinscheduler-sdk-python#1

* fix dead link
2023-01-03 18:25:04 +08:00
Jay Chung
a645cb1c2a cherry-pick [chore] Separate Python API into another repository
#12779
2023-01-03 18:18:25 +08:00
calvin
7fa8454906 cherry-pick [Fix-13260][API] Ironed out the issue with lacking the value of user's name when querying the list of workflow definitions. #13261 2023-01-03 17:57:14 +08:00
calvin
89f84ed166 cherry-pick [Fix-13248][UI] Ironed out the issue with failing to query task instances by some state of task.
#13251
2023-01-03 17:47:39 +08:00
calvin
b46ced7af6 cherry-pick [Bug][DAO] Worked out the issue with throwing the sql exception. 2023-01-03 17:22:24 +08:00
jackfanwan
47c06ae041 cherry-pick when delete workflow, delete related task #12681 2023-01-03 16:58:15 +08:00
Jay Chung
543626aa7a [fix][python] schedule unexpect offline each time update from api #13301 2023-01-03 16:28:45 +08:00
Wenjun Ruan
9564bdeefb cherry-pick Fix task group cannot release when kill task #13314 2023-01-03 16:08:53 +08:00
JieguangZhou
aa18878122 fix sagemaker sync status (#13264) 2023-01-03 16:00:15 +08:00
XCL
5f888c4c1f [Improvement][api]Start the downstream workflow when it is online (#13257)
Start the downstream workflow when it is online
2023-01-03 15:46:24 +08:00
Aaron Wang
ce5fda89ca [Bug][Worker] Fix duplicated key bug when have out parameters of same name (#12930) 2023-01-03 15:44:25 +08:00
calvin
fbbfbda9ed [Fix-13144][UI] Worked out the issue with failing to query workflow instances by the incorrect workflow status.
#13243
2023-01-03 15:40:25 +08:00
HuangWei
32a76ee419 cherry-pick [Fix-13187] refactor OpenmldbParameters #13190 2023-01-03 15:23:05 +08:00
calvin
6b7bcda380 fix the issue with failing to save the settings of timeout alarm (#13234) 2023-01-03 15:17:56 +08:00
Wenjun Ruan
fa78b95a76 cherry-pick Use bigint represent term in mysql registry to avoid time inaccurate #13082 2023-01-03 15:14:26 +08:00
Kerwin
84b1f6dcd2
fix resource data authorization does not take effect. (#13318) 2023-01-03 14:57:00 +08:00
Wenjun Ruan
1796577b53 Fix task group might be rob by multiple task #13115 2022-12-14 10:22:25 +08:00
jackfanwan
f71b864eee [Bug] [dolphinscheduler-api] in the task define list, when edit task, should show pre node list (#12695)
* backend : add pre node list

* resolve workflow error

Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2022-12-14 10:13:50 +08:00
calvin
dc0d46f1aa [Fix-13160][UI] Ironed out the issue with failing to save the correct settings of dependent tasks. (#13179) 2022-12-14 09:59:16 +08:00
JieguangZhou
83e2c14be1 fix retry task failure (#13077) 2022-12-14 09:53:59 +08:00
zhuangchong
a3a9cb9d46 [maven-release-plugin] prepare for next development iteration 2022-12-07 17:23:58 +08:00
zhuangchong
f1aefae5e2 [maven-release-plugin] prepare release 3.1.2 2022-12-07 17:23:57 +08:00
Kerwin
116eff6663
[3.1.2-prepare][version] Modify the version to 3.1.2 (#13121) 2022-12-07 17:09:48 +08:00
Tq
ccc3a61301 [fix][doc] Fix sql-hive and hive-cli doc (#12765) 2022-12-07 10:28:59 +08:00
旺阳
6e520fe8f7 [Bug] [Alert] Ignore alert not write info to db (#12867)
* add alert not match return info
2022-12-07 10:25:55 +08:00
旺阳
87c0a1141a change alert start.sh (#13100) 2022-12-07 10:21:40 +08:00
Jay Chung
56ca041182 [fix] python api upload resource center failed
branch dev already exists in apache/dolphinscheduler#13042
2022-11-29 20:19:12 +08:00
Lyle Shaw
1bfd8f5327 [Feature] Add CURD to the project/tenant/user section of the python-DS (#11162)
- Add CURD in project
- Add CURD in tenant
- Add CURD in user
- Add test in user

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>

(cherry picked from commit cc492c3e13)
2022-11-28 21:06:13 +08:00
Jay Chung
6ed1605680 [chore][python] Change name from process definition to workflow (#12918)
only change its name in python gateway server code, incluing

* Function name: all related to process definition
* Parameter name and comment related

ref: apache/dolphinscheduler-sdk-python#22

(cherry picked from commit f20c9b3102)
2022-11-28 18:54:46 +08:00
Jay Chung
416c41465d [fix] Add token as authentication for python gateway (#12893)
separate from #6407. Authentication, add secret to ensure only trusted people could connect to gateway.

fix: #8255

(cherry picked from commit 6d8befa075)
2022-11-28 18:52:01 +08:00
Jay Chung
696d8ae7f1 [feat] Support set execute type to pydolphinscheduler (#12871)
Up to now, we can only submit workflow with parallel mode. this patch give users ability specific execute type to workflow

(cherry picked from commit 87a88e3662)
2022-11-28 18:48:54 +08:00
Chris
682829e4ea [improve][python] Validate version of Python API at launch (#11626)
(cherry picked from commit 7ed52c3ecb)
2022-11-28 18:46:41 +08:00
Kerwin
a87206228a [Bug-13010] [Task] The Flink SQL task page selects the pre-job deployment mode, but the task executed by the worker is the Flink local mode 2022-11-28 10:14:16 +08:00
Kerwin
9e262a8771 [Bug-12997][API] Fix that the end time is not reset when the workflow instance reruns. (#12998)
* Fix that the end time is not reset when the workflow instance reruns.
2022-11-27 15:44:58 +08:00
Kerwin
b7c994041e The task instance list is sorted by submission time (#12974) 2022-11-27 14:31:47 +08:00
Kerwin
f27db04a8b [Bug-12994] [Worker] Fix kill process does not take effect (#12995) 2022-11-27 14:29:38 +08:00
Wenjun Ruan
00cb3f85ec cherry-pick Fix sql task will send alert if we don't choose the send email
#12984
2022-11-27 14:20:56 +08:00
Kerwin
99b86d112b [Bug-13008] [UI] When using the complement function, turn on the dependent mode to generate multiple unrelated workflow instances (#13009)
* Fix dirty data generated by dependent nodes.
2022-11-27 12:08:54 +08:00
moonkop
3579008c45 Update use-dependent.ts typo (#12462) 2022-11-27 12:08:54 +08:00
Jay Chung
5221428340 [fix][doc] python api release link 2022-11-26 15:24:29 +08:00
Jay Chung
6551112700 [hotfix] Correct python doc link 2022-11-25 17:34:50 +08:00
JieguangZhou
3802599279 [fix] Python task can not pass the parameters to downstream task. (#12961) 2022-11-24 19:27:57 +08:00
旺阳
a8f86de597 [Fix] Fix Java path in Kubernetes Helm Chart (#12987) 2022-11-24 19:04:56 +08:00
Kerwin
d4c6ec4fa1 [Bug-12963] [Master] Fix dependent task node null pointer exception (#12965)
* Fix that there are both manual and scheduled workflow instances in dependent nodes, and one of them will report a null pointer exception during execution.
2022-11-24 19:03:49 +08:00
Kerwin
3afc6e2480 cherry-pick [Bug-12954] [Schedule] Fix that workflow-level configuration information does not take effect when timing triggers execution 2022-11-22 17:11:28 +08:00
Kerwin
937d636613 Fix execute shell task exception no dolphinscheduler_env.sh file execute permission (#12909) 2022-11-17 21:44:55 +08:00
simsicon
fc67fab006 cherry-pick Upgrade clickhouse jdbc driver #12639 2022-11-16 12:33:39 +08:00
Tq
1e816cc757 add spring-context to alert api (#12892) 2022-11-16 11:08:40 +08:00
Kerwin
018e9219ed cherry-pick [Upgrade][SQL]Modify the table t_ds_worker_group to add a description field in the postgresql upgrade script #12883 2022-11-16 11:07:26 +08:00
Kerwin
6ffac27dbc fix NPE while retry task (#12903) 2022-11-16 11:05:13 +08:00