test/DolphinScheduler
1
0
Fork 0
mirror of https://gitee.com/dolphinscheduler/DolphinScheduler.git synced 2024-12-05 05:38:30 +08:00
Code Issues Actions 10 Packages Projects Releases Wiki Activity
7,157 Commits 27 Branches 59 Tags 276 MiB
1aba077fb8
Commit Graph

7157 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Wenjun Ruan
1aba077fb8 Remove not use web service comment in alert server (#11819) 2022-09-19 14:50:16 +08:00
Kengo Seki
52b79b017e [Improvement] Replace commons-lang 2 function invocations with commons-lang3 (#11810) 
* [Improvement] Replace commons-lang 2 function invocations with commons-lang3
 2022-09-19 14:48:17 +08:00
Jiajie Zhong
ed33066178 [python] Fix permission error when create related objects (#11783) 
after we add permission to our codebase in dev branch, will got error
when create objects from pydolphinscheduler, because users with user_id
equal to `Integer.MAX_VALUE` is ordinary users which can not have access
to create unless we grant permission to the role manually. this patch
change dummyUser to admin user's user_id == 1 to fix it
 2022-09-19 14:46:26 +08:00
fuchanghai
f1de1707d5 Update dolphinscheduler_ddl.sql fix alert t_ds_user add time_zone is not correct (#11795) 2022-09-19 14:41:50 +08:00
caishunfeng
113dc4b5c5
[Feature-10273][Datasource] Add dataSource for AWS Athena (#11157) (#12039) 
Co-authored-by: ZhaoGuodong <guodongym@163.com>
 2022-09-19 13:45:19 +08:00
JieguangZhou
dde6f63c31 [Feature][PyDolphinScheduler] Support DVC task in pyds #11922 (#11941) 
* add dvc task in pyds

* add BaseDVC class

(cherry picked from commit bbc228e93f)
 2022-09-18 16:49:34 +08:00
JieguangZhou
cb063732d7 [feat][python] Support MLflow task in python api (#11962) 
(cherry picked from commit ad683c3c42)
 2022-09-18 16:46:45 +08:00
JieguangZhou
f66dedc9da [feat][python] Support OpenMLDB task in python api (#11944) 
Using the whole word zookeeper instead of short cut zk
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>

(cherry picked from commit e50a32d9cc)
 2022-09-18 16:43:36 +08:00
JieguangZhou
1ac2e4a8f3 [feat][python] Add sagemaker yaml example (#11925) 
(cherry picked from commit e05f14ba23)
 2022-09-18 16:43:24 +08:00
JieguangZhou
6f3b4c1624 [feat][python] Support Pytorch task in python api (#11975) 
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
(cherry picked from commit 5202e5cfc6)
 2022-09-18 16:43:08 +08:00
JieguangZhou
e462918ac9
[Feat][python] Add parameter environment to task (#11763) (#11989) 
(cherry picked from commit 8988492c43)
 2022-09-17 10:24:07 +08:00
Wenjun Ruan
1ea2e848cd
[Feature][Registry] Support etcd as registry (#10981) (#11997) 
(cherry picked from commit 2eb8b9f7f0)

Co-authored-by: wjf <jffwang@qq.com>
 2022-09-17 09:01:24 +08:00
Wenjun Ruan
8eadf5e5aa
Fix insertOrUpdate plugin may failed due to concurrent operation (#11471) (#11996) 
(cherry picked from commit 864a90820d)
 2022-09-17 08:59:45 +08:00
JieguangZhou
5e42f52bdf
[3.1.0-prepare][cherry-pick][DSIP-11][python] create workflows from YAML configuration (#11988) 
* [DSIP-11][python] create workflows from YAML configuration (#11611)

(cherry picked from commit 38ee91fb1e)

* fix pydolphin yaml doc link (#11817)

(cherry picked from commit c41fa5a8b1)
 2022-09-17 08:56:37 +08:00
caishunfeng
c4953e8660
Example Change the regular expression of the data source password (#11459) (#11990) 
Co-authored-by: jackfanwan <61672564+jackfanwan@users.noreply.github.com>
 2022-09-16 15:16:05 +08:00
caishunfeng
951f707b61
[fix][doc] Update the registry related configuration in values.yaml (#11444) (#11981) 
Co-authored-by: rickchengx <38122586+rickchengx@users.noreply.github.com>
 2022-09-16 11:17:33 +08:00
caishunfeng
cd8f32d876
[Bug][Workflow Definition] fix ordinary users can not create depend task (#11961) (#11977) 2022-09-16 09:42:59 +08:00
caishunfeng
f034a09d25
[Bug-11650][worker] #11650 fix SQL type task, stop task cause NPE (#11668) (#11958) 
Co-authored-by: 冯剑 <35831367+fengjian1129@users.noreply.github.com>
 2022-09-15 14:24:34 +08:00
caishunfeng
0647b3e10c
[Cherry-pick][Improvement] [Doc] Put default task parameters in a new file #11776 (#11957) 
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2022-09-15 14:21:05 +08:00
caishunfeng
27b69e608a
[Bug] [Master] WorkflowExecuteRunnable will face a infinite loop #11838 (#11864) (#11950) 
* [Bug] [Master] WorkflowExecuteRunnable will face a infinite loop #11838

Co-authored-by: Yann Ann <2993643785@qq.com>
 2022-09-15 10:39:00 +08:00
caishunfeng
0f6cc4fe33
[Fix][db] fix init&upgrade mysql-meta-schema bugs (#11887) (#11935) 
Co-authored-by: wendongdi <49931055+wendongdi@users.noreply.github.com>
 2022-09-14 18:49:49 +08:00
caishunfeng
8d1c2d3eeb
cherry-pick [Bug] Fix procedure task param pass #11919 (#11926) 2022-09-14 15:44:01 +08:00
阿福Chris
c76301ab51
[Fix-11217] [Doc] add postgresql config in doc: datasource-setting (#11326) 
* add postgresql config for datasoruce-setting

* Update docs/docs/en/guide/howto/datasource-setting.md

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
 2022-09-05 10:54:01 +08:00
fuchanghai
f8b9aad239
[feature-#11689] change replaceAll to replace in method of tryExecuteSqlResolveColumnNames (#11696) 2022-09-05 09:54:18 +08:00
fuchanghai
554562bfa9
[fix-#11691] Add lz4-java in clickhouse datasource. (#11697) 2022-09-05 09:15:58 +08:00
Amy0104
d0d481d10f
[Fix][UI] Add the task name entry when the workflow instance detail page goes to the task instance page. (#11761) 2022-09-03 11:57:02 +08:00
caishunfeng
f8d46a26c1
[Feature-11530] add state history for process instance (#11757) 
* [Feature] add state history for process instance (#97)

* add state history for process instance

* upsertProcessInstance

* remove unuse method

* fix UT

Co-authored-by: caishunfeng <534328519@qq.com>
 2022-09-03 10:14:05 +08:00
kezhenxu94
31ba49ac02
Update doc according to recent update of Spring / Swagger (#11755) 2022-09-02 19:06:15 +08:00
kezhenxu94
277f137358
Add Kubernetes configmap reload to all components (#11730) 2022-09-02 12:03:19 +08:00
Tq
b3cc8a55b9
[feature][API]feature: add task type list and enable user to add task type to fav (#11727) 
* feature: add task type list and enable user to add task type to fav

* make DependentExecute.java variable protected

* add standalone server fileSet
 2022-09-02 11:40:23 +08:00
caishunfeng
f95cdd350a
reduce task dependencies (#11731) 2022-09-01 17:04:07 +08:00
juzimao
d0f5e7edf3
optimize the process instance query, change the date time range (#11719) 2022-08-31 19:53:41 +08:00
Wenjun Ruan
67e7f88d8b
Refactor heart beat task, use json to serialize/deserialize (#11702) 
* Refactor heart beat task, use json to serialize/deserialize
 2022-08-31 16:20:23 +08:00
Wenjun Ruan
03e1e6fe45
[Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task (#11701) 
* Fix kill job may cause worker oom
 2022-08-31 15:25:01 +08:00
Evans Sun
5fabce783a
[DOC] improve zk digest doc (#11703) 2022-08-30 21:07:04 +08:00
Eric Gao
4a37345436
[Feature][Task Plugin] Support hive cli task plugin (#11651) 
* Add hive cli task plugin

* Add docs for hive-cli task plugin

* Fix hive-cli task related front-end nits and checkstyle

* Fix exception handling logic
 2022-08-30 10:45:51 +08:00
xiangzihao
71eeab3d98
[CI] Fix cluster test abnormal (#11688) 
* fix cluster test abnormal
 2022-08-30 09:33:22 +08:00
seedscoder
145e441afb
[Fix-11633] The data type of the PostgreSQL database column is wrong. (#11633) (#11634) 2022-08-29 16:33:16 +08:00
SongTao Zhuang
6a5367fd57
[Improvement-11662][dao] fix foreach null items in mapper.xml 2022-08-28 20:58:12 +08:00
旺阳
6e4d974b91
[doc] Correct E2E Doc, fix WorkerGroupPage typo (#11629) 2022-08-28 17:44:06 +08:00
Jiajie Zhong
4dca488cd5
[python] Auto location when create process definition (#11681) 
* Add auto format when submit process definition from python api
* add UPDATING.md

close: #8254
 2022-08-27 23:38:46 +08:00
JieguangZhou
635fde1981
[bug][python] Fix task switch error when default branch not defined last (#11606) 
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
 2022-08-27 18:48:09 +08:00
陈家名
564a815d21
[fix][python] Sql pattern add truncate. (#11666) 2022-08-27 12:17:06 +08:00
Devosend
769a20e986
[Fix][UI] Fix bug where crontab special of month and year (#11661) 2022-08-26 23:04:29 +08:00
Eric Gao
23d8aaf735
[Feature][UI] Enable highlight and auto-complete for SQL scripts (#11659) 2022-08-26 19:03:44 +08:00
songjianet
cccbd27c58
[Fix][UI] Fix the problem that the pagination component is not centered in the environment management. (#11646) 2022-08-26 14:50:46 +08:00
songjianet
f28a39f984
[Docs] Update README. (#11641) 2022-08-26 14:50:32 +08:00
Wenjun Ruan
1b120e3a59
Refactor worker execute task process (#11540) 
* Refactor worker execute task process
 2022-08-26 13:33:51 +08:00
xiangzihao
a22b9271ff
add unit test ci timeout (#11655) 2022-08-26 11:45:49 +08:00
Yann Ann
eda9f3d50c
[DOC] should notice that need setting the full path when call the resource file #11620 (#11621) 2022-08-26 10:58:56 +08:00