insist777
528f45acc5
[improve]Source skip check ( #12900 )
...
* Source skip check
2022-11-17 14:23:12 +08:00
旺阳
d02991a2e6
[Bug] [Alert] Ignore alert not write info to db ( #12867 )
...
* add alert not match return info
2022-11-17 14:14:12 +08:00
Assert
2dbc79693e
[feature][task plugin] Add new task plugin for apache linkis ( #12693 )
2022-11-17 10:14:36 +08:00
Jay Chung
f20c9b3102
[chore][python] Change name from process definition to workflow ( #12918 )
...
only change its name in python gateway server code, incluing
* Function name: all related to process definition
* Parameter name and comment related
ref: apache/dolphinscheduler-sdk-python#22
2022-11-16 21:23:39 +08:00
xiangzihao
473319c40d
[CI] [Chore] Add label 4.0.0 to mergeable check ( #12921 )
...
* add label 4.0.0 to mergeable check
2022-11-16 21:01:23 +08:00
Zzih
0186413a9f
[Feature][Api] Refactor org.apache.dolphinscheduler.api.controller.TaskInstanceController ( #11747 )
...
* Feature ：Refactor org.apache.dolphinscheduler.api.controller.TaskInstanceController
2022-11-16 18:32:42 +08:00
xuhhui
9e6f4d2bc1
[Improvement][Document]Update architecture and process-start-flow pic ( #12912 )
...
Co-authored-by: xuhaihui <xuhaihui@cmss.chinamobile.com>
2022-11-16 16:03:00 +08:00
Kerwin
c916c60853
fix NPE while retry task ( #12903 )
2022-11-16 10:31:52 +08:00
Wenjun Ruan
d99ba29b66
Fix master cluster may loop command unbalanced ( #12891 )
...
(cherry picked from commit 3b2b86661be76b7c1404a910c865d78b7936313d)
2022-11-16 10:20:22 +08:00
Guanhua Li
83f9588eb0
[Improvement-12856][UT] Refactor duplicated code fragment in UdfFuncMapperTest ( #12857 )
2022-11-15 22:59:11 +08:00
Kerwin
713046b043
Modify the table t_ds_worker_group to add a description field in the postgresql upgrade script ( #12883 )
2022-11-15 17:26:41 +08:00
Wenjun Ruan
92a9b7e243
Use System#lineSeparator to replace /n ( #12889 )
2022-11-15 13:57:45 +08:00
Jay Chung
6d8befa075
[fix] Add token as authentication for python gateway ( #12893 )
...
separate from #6407 . Authentication, add secret to ensure only trusted people could connect to gateway.
fix : #8255
2022-11-14 18:43:08 +08:00
Tq
70fe39bb2d
add spring-context to alert api ( #12892 )
2022-11-14 17:23:28 +08:00
Tq
d324cce6f1
[Feature-12526][Api] add dynamic task function: shell task ( #12840 )
...
* submit dynamic task code
* submit shell.json
* add dynamic-task-type-config.yaml to standalone server
2022-11-14 13:52:44 +08:00
rickchengx
813c44b22b
[Improvement-12838][UT] Improve the ut of datasource ( #12839 )
2022-11-14 11:30:10 +08:00
Kerwin
e3cf72cbcd
[Fix-12832][API] Fix update worker group exception group name already exists. ( #12874 )
2022-11-14 11:20:51 +08:00
Tq
250d81bcf8
[bug][alert-12865] translate alert input field tips to chinese when using chinese ( #12879 )
...
* submit email ding talk changes
* submit alert messages
* submit format
* submit format
2022-11-14 11:14:14 +08:00
Wenjun Ruan
403c6a6bb6
Fix memory leak in worker due to message retry map ( #12878 )
2022-11-13 20:08:38 +08:00
fuchanghai
feb077035e
[fix-#12875] command line that -Dmaven.test.skip=true have no effect ( #12876 )
2022-11-13 09:48:07 +08:00
baihongbin
0373e06615
[Feature-8030][docs] Add sqoop task doc ( #12855 )
...
* [Feature-8030][docs] Add sqoop task doc
* Update docs/docs/zh/guide/task/sqoop.md
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
* Update docs/docs/en/guide/task/sqoop.md
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
* [Feature-8030][docs] Add sqoop task doc
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2022-11-13 00:09:05 +08:00
rickchengx
7c711e622f
[Improvement-12850][UT] Improve the ut of DataSourceMapperTest ( #12851 )
2022-11-12 23:57:40 +08:00
Eric Gao
2ba5bd47dd
Update github mergeable label regex ( #12815 )
2022-11-12 23:37:01 +08:00
Jay Chung
87a88e3662
[feat] Support set execute type to pydolphinscheduler ( #12871 )
...
Up to now, we can only submit workflow with parallel mode. this patch give users ability specific execute type to workflow
2022-11-12 10:31:08 +08:00
JieguangZhou
229c554912
[feature][task] Add Kubeflow task plugin for MLOps scenario ( #12843 )
2022-11-11 16:08:38 +08:00
Kerwin
019e7475d1
The new Chinese document latest version is 3.1.1 ( #12869 )
2022-11-11 16:06:20 +08:00
Kerwin
a887303d48
add 3.1.1 release doc ( #12864 )
2022-11-11 15:39:47 +08:00
simsicon
43d69ae157
Upgrade clickhouse jdbc driver ( #12639 )
2022-11-11 13:38:58 +08:00
seedscoder
1f23d29698
[Improvement-12029][dolphinscheduler-api] Upgrade the snakeyaml version to avoid vulnerabilities ( #12726 )
2022-11-11 13:33:04 +08:00
kezhenxu94
454f1303a0
Add minio as demo storage for helm charts ( #12861 )
2022-11-11 10:26:57 +08:00
muggleChen
5b7a609a0e
Add icon in idea ( #12829 )
2022-11-10 18:56:28 +08:00
songjianet
bf74b4280f
[Feature][UI] Joint debugging of the interface of the mvp version of the dynamic task component. ( #12859 )
...
* [Feature][UI] Joint debugging of the interface of the mvp version of the dynamic task component.
* [Feature][UI] Joint debugging of the interface of the mvp version of the dynamic task component.
* [Feature][UI] Joint debugging of the interface of the mvp version of the dynamic task component.
2022-11-10 17:28:20 +08:00
Jay Chung
6896fa9b47
[fix][doc] Dead link for python api ( #12848 )
...
* [fix][doc] Dead link for python api
ref: apache/dolphinscheduler#12779 and
apache/dolphinscheduler-sdk-python#1
* fix dead link
2022-11-10 14:49:11 +08:00
Kerwin
775b3f87b4
[doc] Add skip spotless check during ASF release. ( #12835 )
2022-11-10 14:26:24 +08:00
Jay Chung
1347a8f94c
[chore] Separate Python API into another repository ( #12779 )
...
Currently, our Python API code is a module in apache/dolphinscheduler codebase,
each time users change Python API code, they need to run all requests CI check
for dolphinscheduler and Python API, But if the user does only change Python
code, it could be merged if Python API CI pass and do not dependent on others CI.
Besides, we release Python API as the same version of dolphinscheduler. It is
easy for user to match Python API version. But when Python API does not change
any code, but dolphinscheduler release a bugfix version, Python API has to
release the new version to match dolphinscheduler. This happened when we
released Python API 2.0.6 and 2.0.7. 2.0.6 and 2.0.7 is bugfix version, and
Python API does not change any code, so the PyPI package is the same.
Separate Python API also makes our code more sense, we will have more
distinguished code in dolphinscheduler and Python API new repository.
Have separate issue tracker and changelog for information to users.
ref PR in other repository: apache/dolphinscheduler-sdk-python#1
see more detail in mail thread: https://lists.apache.org/thread/4z7l5l54c4d81smjlk1n8nq380p9f0oo
2022-11-09 21:20:15 +08:00
muggleChen
72e50b25f1
[Improvement][script] Add installPath verification for install.sh ( #12523 )
2022-11-09 11:50:11 +08:00
jackfanwan
641a2559ea
[fix-12687]when timeout_notify_strategy is null, modify timeout_notify_strategy ( #12689 )
...
* According to timeoutFlag, assign timeoutNotifyStrategy value
Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2022-11-09 11:48:12 +08:00
houshitao
04c6b5e413
[Bug][Api] Added param description. ( #12813 )
...
Co-authored-by: houshitao <shitaohou@163.com>
2022-11-08 21:17:40 +08:00
jackfanwan
23ead4f0e8
[Bug] [dolphinscheduler-api] in the task define list, when edit task, should show pre node list ( #12695 )
...
* backend : add pre node list
* resolve workflow error
Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2022-11-08 13:31:20 +08:00
moonkop
11b1433080
Update use-dependent.ts typo ( #12462 )
2022-11-08 10:05:09 +08:00
songjianet
0793d1a14e
[Feature][UI] Added form stadio parser. ( #12801 )
2022-11-08 08:52:03 +08:00
labbomb
d6fb46b682
fix: Fix some mistakes in the datasource ( #12775 )
...
* fix: Fix some mistakes in the datasource
* fix: delete useless console
2022-11-07 18:12:11 +08:00
rickchengx
58721ba855
[Improvement-12335][ui] Make the resources to be reactive in hivecli task ( #12336 )
2022-11-07 18:05:51 +08:00
Tq
9bba4b105c
[fix][doc] Fix sql-hive and hive-cli doc ( #12765 )
2022-11-07 17:39:02 +08:00
Aaron Wang
6c5ab3fb5c
[Bug] [dolphinscheduler-aop] aspectj-maven-plugin version undefined ( #12756 )
...
* Update pom.xml
2022-11-07 15:07:07 +08:00
songjianet
0e099037bf
[Feature][UI] Added form select parser. ( #12753 )
...
* [Feature][UI] Added form select parser.
* [Feature][UI] Added form select parser.
2022-11-07 14:41:41 +08:00
calvin
4c714cf9c9
adjust the args of router in the dag ( #12759 )
2022-11-07 14:26:12 +08:00
Kerwin
c4fb555883
Modify shell env to bash ( #12742 )
2022-11-07 11:21:11 +08:00
Eric Gao
6d79414491
Add instructions on how to configure logging level for debugging purpose ( #12699 )
2022-11-07 10:30:56 +08:00
XCL
00b18ed422
[Improve]Remove the code logger.isDebugEnabled() #5918 #10542 ( #12738 )
...
Co-authored-by: chunlai.xu <chunlai.xu@zhaopin.com.cn>
2022-11-07 09:58:19 +08:00
