test/DolphinScheduler
1
0
Fork 0
mirror of https://gitee.com/dolphinscheduler/DolphinScheduler.git synced 2024-12-04 21:28:00 +08:00
Code Issues Actions 10 Packages Projects Releases Wiki Activity
5,454 Commits 27 Branches 59 Tags 276 MiB
e6239e808b
Commit Graph

5454 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
wind
e6239e808b
[DS-6829][WorkerServer] skip create log dir and print log in dryRun model (#6852) 
Co-authored-by: caishunfeng <534328519@qq.com>
 2021-11-21 17:51:56 +08:00
GaoTianDuo
1b6b5268b6
[Bug] [readme] Error link to Docker and k8s in readme apache#6802 (#6862) 
* [Bug] [readme] Error link to Docker and k8s in readme #6802
1、modify the error link

* [Bug] [readme] Error link to Docker and k8s in readme #6802
1、modify the error link in readme_zh_cn.md
 2021-11-21 17:50:19 +08:00
songjianet
d2666d6739
[Feature][Workflow relationship] The page displays null as -. (#6934) 
* [Feature][Workflow relationship] The page displays `null` as `-`.

* [Feature][Workflow relationship] The page displays `null` as `-`.
 2021-11-20 22:59:18 +08:00
songjianet
024aacacb3
[Feature][Workflow relationship] Improve English support. (#6936) 
* [Feature][Workflow relationship] Improve English support.

* [Feature][Workflow relationship] Improve English support.
 2021-11-20 22:58:30 +08:00
ououtt
1fdbc3270c
[DS-6931][fix] swagger failed to start due to improper use of request param annotation (#6933) 
Co-authored-by: eye <eye.gu@aloudata.com>
 2021-11-19 19:03:34 +08:00
wind
28872d8706
[DS-6891][MasterServer] reduce db operation when process instance running (#6904) 
* remove taskInstanceCacheManager

* remove taskInstanceCacheManager

* [DS-6891][MasterServer] reduce db operation when process instance running

* [DS-6891][MasterServer] reduce db operation when process instance running

* fix test

* fix Transactional method call

* checkstyle

Co-authored-by: caishunfeng <534328519@qq.com>
 2021-11-19 18:31:24 +08:00
wangyizhi
f2d242c7e7
[Feature-6918][UI] DAG page interaction optimization (#6919) 
* [Feature] Add grid layout and optimize DAG style

* [Improvement] Add process definition status label and code optimization

* [Feature] add DAG node search bar

* [Feature] Add DAG scale bar

* [Improvement] Open pre-tasks settings for all tasks

* [Fix] Fix ut

* [Fix] Replace /deep/ with ::v-deep

* [Fix] Fix code smell
 2021-11-19 18:08:51 +08:00
Jiajie Zhong
6e812be14d
[python] Add ut cover process definitions separate mode (#6908) 
* [python] Add ut cover process definitions separate mode

* Remove unused print syntax

* Fix test error, cause raw_script not exists anymore
 2021-11-19 17:24:19 +08:00
Jiajie Zhong
0dce68edd7
[python] Add task type python http (#6906) 
* [python] Add task type python http

* Fix unittest error

* Fix UT error
 2021-11-19 16:37:22 +08:00
JinYong Li
4bec792160
[Fix][Common] rewrite code generate,fix bit shift (#6914) 
* rewrite code generate,fix bit shift

* fix ut

* add algorithm from licenses file

* add algorithm from licenses file

* add algorithm from licenses file

* add algorithm from licenses file

* add algorithm from licenses file

* fix ut
 2021-11-19 16:04:05 +08:00
wind
595e4843d0
[DS-6849][MasterServer] fetch more commands and handle in parallel (#6850) 
* [DS-6849][MasterServer] fetch more commands and handle in parallel

* add return

* handle command with check

* add test

* delete master prefix

Co-authored-by: caishunfeng <534328519@qq.com>
 2021-11-19 12:03:49 +08:00
songjianet
1be080237b
[Fix-6896] fix the problem that the name search cannot be used. (#6911) 2021-11-19 11:46:45 +08:00
Jiajie Zhong
f9a130d73e
Use docker.scarf.sh to track docker user info (#6913) 
* Use docker.scarf.sh to track docker user info

* Revert ci docker image change
 2021-11-19 11:45:37 +08:00
songjianet
eb01f2e617
[Feature][Process definition] add search function to select in batch operation dialog. (#6915) 2021-11-19 11:17:03 +08:00
Kerwin
802fc498b5
[Fix-#6605][Common] Fix the situation where the obtained string property is empty. (#6661) 
* Fix the situation where the obtained string property is empty.

* recovery test

* update code style.

* megre dev.
 2021-11-19 10:58:17 +08:00
songjianet
00813b0a69
[Improvement-6889] split the routing module to increase subsequent maintainability. (#6892) 2021-11-19 09:38:22 +08:00
KyoYang
80dcf9b03e
[Improvement-#5293]upgrade cron-utils version 5.0.5 -> 9.1.3 (#6857) 
* fix complement data retry bug; issues: [Bug] [Master] A bug on task retry mechanism #6613

Co-authored-by: yangqiyu <yangqiyu@deepexi.com>
 2021-11-18 14:32:32 +08:00
Jeff Zhan
3101218c73
[Improvement][API][num-5] The workflow of the main table version is not allowed to be deleted (#6893) 
* feature:deleteProcessDefinitionVersion

* pref:delete duplicate enum definition

Co-authored-by: 北笙 <“zhanqian@cai-inc.com”>
 2021-11-18 14:30:58 +08:00
JinYong Li
fc6a5116c4
[Improvement][API][num-7] add task delete check (#6887) 
* upgrade add sub_process

* add interface method

* add interface method

* fix ut

* add task delete check

* add task delete check
 2021-11-18 10:51:29 +08:00
yihong
861aaaf971
[FIX-#6505][Dao] upgrade the MySQL driver package for building MySQL jdbcUrl (#6708) 
* replace com.mysql.jdbc.Driver everywhere with com.mysql.cj.jdbc.Driver
 2021-11-18 08:39:11 +08:00
OS
653eae2419
[BUG][Master] process cannot finish and its status is always running (#6886) 
* fix 6882: process cannot finish and its status is always running

* fix 6882: process cannot finish and its status is always running
 2021-11-17 17:39:22 +08:00
chouc
f564687a89
[Improvement][Log] optimize task log path to reduce task running time (#6731) 
* [Improvement][Log] optimize task log path to reduce task running time
* Reduce the creation of log directories


Co-authored-by: Kirs <acm_master@163.com>
 2021-11-17 17:08:44 +08:00
DingPengfei
842c3857c1
fix bug of extra 'and' in ResourceMapper.xml (#6876) 
Co-authored-by: ding <dingpf@helowin>
 2021-11-17 15:03:53 +08:00
Jiajie Zhong
7c5c7ec907
[ci][python] Add isort to sort out import (#6871) 
* Add isort config file to fix conflict with black
* Add some doc about isort
 2021-11-17 11:48:52 +08:00
Jiajie Zhong
54933b33e3
[ci][python] Add coverage check in CI (#6861) 
* [ci] Add coverage check in CI

* Coverage add dependent

* Install pydolphinscheduler before run coverage

* Up test coverage to 87% and down threshold to 85%

* Fix code style

* Add doc about coverage
 2021-11-17 09:46:40 +08:00
JinYong Li
f5e7da3cf6
[Improvement][API] add interface method (#6863) 
* upgrade add sub_process

* add interface method

* add interface method

* fix ut
 2021-11-16 20:38:49 +08:00
zwZjut
94352a4f5f
fix switchVersion error (#6783) (#6784) 
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
 2021-11-16 10:16:52 +08:00
OS
1160b53940
[Feature][Master] change sub process id to code (#6858) 
* feature 6597 change sub process id to code

* feature 6597 change sub process id to code
 2021-11-15 20:27:19 +08:00
xiaoguaiguai
44b24cd3df
When the SQL node is selected (#6851) 
The data source list needs to scroll continuously, and the search efficiency is low

Add a quick search box to quickly locate the data source to be selected
 2021-11-15 17:21:34 +08:00
DuChaoJiaYou
36c19748a6
[Feature-6600][UI] Implement page about task-definition (#6762) 
* fix api error in dependent task

* feat: This is a connecting test

* feat: second push test

* feat: email test

* [Feature]add taskdefinition

add new pages named taskDifinition
add new router
add new action in store/dag

* [Feature] add/edit/view task definition

* [DS-6600][feat][UI] Add page about task-definition list

* Add page about task-definition list
* Add create/edit/view/delete task-definition
* Add research task-definition

This closes #6600

* modify API_BASE

Co-authored-by: wangyizhi <wangyizhi1_yewu@cmss.chinamobile.com>
Co-authored-by: duchao <duchao@cmss.chinamobile.com>
 2021-11-15 13:54:28 +08:00
KyoYang
94f6c5c27e
fix complement data retry bug; issues: [Bug] [Master] A bug on task retry mechanism #6613 (#6843) 
Co-authored-by: yangqiyu <yangqiyu@deepexi.com>
 2021-11-15 01:05:13 +08:00
OS
880c1d28ff
[Feature][master] change sub process id to code. (#6846) 
* 6597 change sub process id to code.

* 6597 change sub process id to code.

* 6597 change sub process id to code.

* 6597 change sub process id to code.

* 6597 change sub process id to code.

* 6597 change sub process id to code.

* code style

* fix ut process

* fix ut process
 2021-11-15 01:00:44 +08:00
JinYong Li
7f3b999e5c
upgrade add sub_process (#6845) 2021-11-15 00:11:29 +08:00
kezhenxu94
4114cb07f6
Add actuator and enable metrics, add Grafana configs (#6840) 2021-11-14 20:22:13 +08:00
zwZjut
4b848fb6d9
fix #6807: dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808) 
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
 2021-11-14 13:03:13 +08:00
mask
a998415afe
[Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490) (#6828) 
* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490)

* fix pom dep scope

* filter alert

* filter alert

* filter alert

* fix checkstyle

* remove hikaricp version

* update pom

* add properties

* add properties

* rename properties

* fix e2e fail

* rename properties
 2021-11-14 13:02:58 +08:00
GaoTianDuo
e3dc4016d2
[Bug] [readme] Error link to Docker and k8s in readme #6802 (#6833) 
1、modify the error link
 2021-11-14 13:01:23 +08:00
Jiajie Zhong
e76cf77040
[python] Add parameter schedule for process definition (#6664) 
* [python] Add parameter schedule for process definition

* Rebase and fix some code style

* May schedule work on both string and datetime

* Fix flaky test

* Add comment about freeze time

* Add edge test for schedule_json with None schedule

* Fix test function name

* Fix rebase error
 2021-11-13 17:21:40 +08:00
Assert
089f73ebe4
[Fix-6707][common] Fix complement data error because of global variables (#6759) 
* [Fix-6707][common] Fix complement data error because of global variables

* [Fix-6707][common] Fix complement data error because of global variables

* [Fix-6707][common] Fix complement data error because of global variables

* [Fix-6707][common] Fix complement data error because of global variables

Co-authored-by: shangeyao <sgy960921>
Co-authored-by: OS <29528966+lenboo@users.noreply.github.com>
 2021-11-13 17:06:15 +08:00
Jiajie Zhong
0f92a1f541
[community] Add version selection for issue bug selection (#6793) 
closes: #6620

Co-authored-by: Kirs <acm_master@163.com>
Co-authored-by: Jiwei Guo <technoboy@apache.org>
 2021-11-13 16:47:42 +08:00
Jiajie Zhong
6045728428
[ci] Add checkstyle prohibit rule System.out.println (#6778) 
* [ci] Add checkstyle prohibit rule System.out.println

* Correct RegexpSingleline place
 2021-11-13 16:47:29 +08:00
Jiajie Zhong
cd8205217a
[python] Fix process definition's user assigned not pass (#6753) 2021-11-13 16:47:08 +08:00
wangyizhi
e2d516f279
Optimize DAG page opening speed (#6830) 2021-11-12 15:48:55 +08:00
Jiajie Zhong
5453f1e349
[ci] Remove PR requests strict rebase (#6831) 2021-11-12 15:48:34 +08:00
wind
5741c758b3
[DS-6771][MasterServer] fix failover worker interrupt (#6801) 
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: Kirs <acm_master@163.com>
Co-authored-by: OS <29528966+lenboo@users.noreply.github.com>
 2021-11-12 14:19:57 +08:00
OS
d168a3cdf7
[feature][Install] 6597 add worker group when upgrading from version 1.x to 2.0 (#6806) 
* feature 6597 add worker group. Upgrade dolphinscheduler version 1. X to version 2.0

* feature 6597 add worker group. Upgrade dolphinscheduler version 1. X to version 2.0

* code style

* code style

* code style

* code style

* update postgre sql

Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
 2021-11-12 12:03:23 +08:00
JinYong Li
dfe4945b48
remove processDefinition resourceIds (#6813) 2021-11-12 11:39:16 +08:00
mask
e36d18b588
[Fix-6792] resolve API and alert port conflicts (#6792) (#6815) 
* [Fix-6792]Multiple ApplicationRunners on classpath make SpringApplication.run only run one (#6792)
 2021-11-12 10:51:11 +08:00
JinYong Li
da2a044947
[Feature][API] add processDefinitionSimpleList api (#6814) 
* add processDefinitionSimpleList api

* add processDefinitionSimpleList api
 2021-11-11 23:45:41 +08:00
罗铭涛
975131e913
[Improvement#6655] [UI] remove registry monitor (#6789) 
* [DS-6655][fix] remove zkmonitor
- delete zkmonitor ui

* [DS-6655][fix] remove zkmonitor
- delete zkmonitor ui
- Modify the actions.js comma

* [DS-6655][fix] remove zkmonitor
- remove all backend API

Co-authored-by: Kirs <acm_master@163.com>
 2021-11-11 19:59:10 +08:00