Jiajie Zhong
6e812be14d
[python] Add ut cover process definitions separate mode ( #6908 )
...
* [python] Add ut cover process definitions separate mode
* Remove unused print syntax
* Fix test error, cause raw_script not exists anymore
2021-11-19 17:24:19 +08:00
Jiajie Zhong
0dce68edd7
[python] Add task type python http ( #6906 )
...
* [python] Add task type python http
* Fix unittest error
* Fix UT error
2021-11-19 16:37:22 +08:00
JinYong Li
4bec792160
[Fix][Common] rewrite code generate,fix bit shift ( #6914 )
...
* rewrite code generate,fix bit shift
* fix ut
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* fix ut
2021-11-19 16:04:05 +08:00
wind
595e4843d0
[DS-6849][MasterServer] fetch more commands and handle in parallel ( #6850 )
...
* [DS-6849][MasterServer] fetch more commands and handle in parallel
* add return
* handle command with check
* add test
* delete master prefix
Co-authored-by: caishunfeng <534328519@qq.com>
2021-11-19 12:03:49 +08:00
songjianet
1be080237b
[Fix-6896] fix the problem that the name search cannot be used. ( #6911 )
2021-11-19 11:46:45 +08:00
Jiajie Zhong
f9a130d73e
Use docker.scarf.sh to track docker user info ( #6913 )
...
* Use docker.scarf.sh to track docker user info
* Revert ci docker image change
2021-11-19 11:45:37 +08:00
songjianet
eb01f2e617
[Feature][Process definition] add search function to select in batch operation dialog. ( #6915 )
2021-11-19 11:17:03 +08:00
Kerwin
802fc498b5
[Fix-#6605][Common] Fix the situation where the obtained string property is empty. ( #6661 )
...
* Fix the situation where the obtained string property is empty.
* recovery test
* update code style.
* megre dev.
2021-11-19 10:58:17 +08:00
songjianet
00813b0a69
[Improvement-6889] split the routing module to increase subsequent maintainability. ( #6892 )
2021-11-19 09:38:22 +08:00
KyoYang
80dcf9b03e
[Improvement-#5293]upgrade cron-utils version 5.0.5 -> 9.1.3 ( #6857 )
...
* fix complement data retry bug; issues: [Bug] [Master] A bug on task retry mechanism #6613
Co-authored-by: yangqiyu <yangqiyu@deepexi.com>
2021-11-18 14:32:32 +08:00
Jeff Zhan
3101218c73
[Improvement][API][num-5] The workflow of the main table version is not allowed to be deleted ( #6893 )
...
* feature:deleteProcessDefinitionVersion
* pref:delete duplicate enum definition
Co-authored-by: 北笙 <“zhanqian@cai-inc.com”>
2021-11-18 14:30:58 +08:00
JinYong Li
fc6a5116c4
[Improvement][API][num-7] add task delete check ( #6887 )
...
* upgrade add sub_process
* add interface method
* add interface method
* fix ut
* add task delete check
* add task delete check
2021-11-18 10:51:29 +08:00
yihong
861aaaf971
[FIX-#6505][Dao] upgrade the MySQL driver package for building MySQL jdbcUrl ( #6708 )
...
* replace com.mysql.jdbc.Driver everywhere with com.mysql.cj.jdbc.Driver
2021-11-18 08:39:11 +08:00
OS
653eae2419
[BUG][Master] process cannot finish and its status is always running ( #6886 )
...
* fix 6882: process cannot finish and its status is always running
* fix 6882: process cannot finish and its status is always running
2021-11-17 17:39:22 +08:00
chouc
f564687a89
[Improvement][Log] optimize task log path to reduce task running time ( #6731 )
...
* [Improvement][Log] optimize task log path to reduce task running time
* Reduce the creation of log directories
Co-authored-by: Kirs <acm_master@163.com>
2021-11-17 17:08:44 +08:00
DingPengfei
842c3857c1
fix bug of extra 'and' in ResourceMapper.xml ( #6876 )
...
Co-authored-by: ding <dingpf@helowin>
2021-11-17 15:03:53 +08:00
Jiajie Zhong
7c5c7ec907
[ci][python] Add isort to sort out import ( #6871 )
...
* Add isort config file to fix conflict with black
* Add some doc about isort
2021-11-17 11:48:52 +08:00
Jiajie Zhong
54933b33e3
[ci][python] Add coverage check in CI ( #6861 )
...
* [ci] Add coverage check in CI
* Coverage add dependent
* Install pydolphinscheduler before run coverage
* Up test coverage to 87% and down threshold to 85%
* Fix code style
* Add doc about coverage
2021-11-17 09:46:40 +08:00
JinYong Li
f5e7da3cf6
[Improvement][API] add interface method ( #6863 )
...
* upgrade add sub_process
* add interface method
* add interface method
* fix ut
2021-11-16 20:38:49 +08:00
zwZjut
94352a4f5f
fix switchVersion error ( #6783 ) ( #6784 )
...
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
2021-11-16 10:16:52 +08:00
OS
1160b53940
[Feature][Master] change sub process id to code ( #6858 )
...
* feature 6597 change sub process id to code
* feature 6597 change sub process id to code
2021-11-15 20:27:19 +08:00
xiaoguaiguai
44b24cd3df
When the SQL node is selected ( #6851 )
...
The data source list needs to scroll continuously, and the search efficiency is low
Add a quick search box to quickly locate the data source to be selected
2021-11-15 17:21:34 +08:00
DuChaoJiaYou
36c19748a6
[Feature-6600][UI] Implement page about task-definition ( #6762 )
...
* fix api error in dependent task
* feat: This is a connecting test
* feat: second push test
* feat: email test
* [Feature]add taskdefinition
add new pages named taskDifinition
add new router
add new action in store/dag
* [Feature] add/edit/view task definition
* [DS-6600][feat][UI] Add page about task-definition list
* Add page about task-definition list
* Add create/edit/view/delete task-definition
* Add research task-definition
This closes #6600
* modify API_BASE
Co-authored-by: wangyizhi <wangyizhi1_yewu@cmss.chinamobile.com>
Co-authored-by: duchao <duchao@cmss.chinamobile.com>
2021-11-15 13:54:28 +08:00
KyoYang
94f6c5c27e
fix complement data retry bug; issues: [Bug] [Master] A bug on task retry mechanism #6613 ( #6843 )
...
Co-authored-by: yangqiyu <yangqiyu@deepexi.com>
2021-11-15 01:05:13 +08:00
OS
880c1d28ff
[Feature][master] change sub process id to code. ( #6846 )
...
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* code style
* fix ut process
* fix ut process
2021-11-15 01:00:44 +08:00
JinYong Li
7f3b999e5c
upgrade add sub_process ( #6845 )
2021-11-15 00:11:29 +08:00
kezhenxu94
4114cb07f6
Add actuator and enable metrics, add Grafana configs ( #6840 )
2021-11-14 20:22:13 +08:00
zwZjut
4b848fb6d9
fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars ( #6808 )
...
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
2021-11-14 13:03:13 +08:00
mask
a998415afe
[Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP ( #6490 ) ( #6828 )
...
* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490 )
* fix pom dep scope
* filter alert
* filter alert
* filter alert
* fix checkstyle
* remove hikaricp version
* update pom
* add properties
* add properties
* rename properties
* fix e2e fail
* rename properties
2021-11-14 13:02:58 +08:00
GaoTianDuo
e3dc4016d2
[Bug] [readme] Error link to Docker and k8s in readme #6802 ( #6833 )
...
1、modify the error link
2021-11-14 13:01:23 +08:00
Jiajie Zhong
e76cf77040
[python] Add parameter schedule for process definition ( #6664 )
...
* [python] Add parameter schedule for process definition
* Rebase and fix some code style
* May schedule work on both string and datetime
* Fix flaky test
* Add comment about freeze time
* Add edge test for schedule_json with None schedule
* Fix test function name
* Fix rebase error
2021-11-13 17:21:40 +08:00
Assert
089f73ebe4
[Fix-6707][common] Fix complement data error because of global variables ( #6759 )
...
* [Fix-6707][common] Fix complement data error because of global variables
* [Fix-6707][common] Fix complement data error because of global variables
* [Fix-6707][common] Fix complement data error because of global variables
* [Fix-6707][common] Fix complement data error because of global variables
Co-authored-by: shangeyao <sgy960921>
Co-authored-by: OS <29528966+lenboo@users.noreply.github.com>
2021-11-13 17:06:15 +08:00
Jiajie Zhong
0f92a1f541
[community] Add version selection for issue bug selection ( #6793 )
...
closes : #6620
Co-authored-by: Kirs <acm_master@163.com>
Co-authored-by: Jiwei Guo <technoboy@apache.org>
2021-11-13 16:47:42 +08:00
Jiajie Zhong
6045728428
[ci] Add checkstyle prohibit rule System.out.println ( #6778 )
...
* [ci] Add checkstyle prohibit rule System.out.println
* Correct RegexpSingleline place
2021-11-13 16:47:29 +08:00
Jiajie Zhong
cd8205217a
[python] Fix process definition's user assigned not pass ( #6753 )
2021-11-13 16:47:08 +08:00
wangyizhi
e2d516f279
Optimize DAG page opening speed ( #6830 )
2021-11-12 15:48:55 +08:00
Jiajie Zhong
5453f1e349
[ci] Remove PR requests strict rebase ( #6831 )
2021-11-12 15:48:34 +08:00
wind
5741c758b3
[DS-6771][MasterServer] fix failover worker interrupt ( #6801 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: Kirs <acm_master@163.com>
Co-authored-by: OS <29528966+lenboo@users.noreply.github.com>
2021-11-12 14:19:57 +08:00
OS
d168a3cdf7
[feature][Install] 6597 add worker group when upgrading from version 1.x to 2.0 ( #6806 )
...
* feature 6597 add worker group. Upgrade dolphinscheduler version 1. X to version 2.0
* feature 6597 add worker group. Upgrade dolphinscheduler version 1. X to version 2.0
* code style
* code style
* code style
* code style
* update postgre sql
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
2021-11-12 12:03:23 +08:00
JinYong Li
dfe4945b48
remove processDefinition resourceIds ( #6813 )
2021-11-12 11:39:16 +08:00
mask
e36d18b588
[Fix-6792] resolve API and alert port conflicts ( #6792 ) ( #6815 )
...
* [Fix-6792]Multiple ApplicationRunners on classpath make SpringApplication.run only run one (#6792 )
2021-11-12 10:51:11 +08:00
JinYong Li
da2a044947
[Feature][API] add processDefinitionSimpleList api ( #6814 )
...
* add processDefinitionSimpleList api
* add processDefinitionSimpleList api
2021-11-11 23:45:41 +08:00
罗铭涛
975131e913
[Improvement#6655] [UI] remove registry monitor ( #6789 )
...
* [DS-6655][fix] remove zkmonitor
- delete zkmonitor ui
* [DS-6655][fix] remove zkmonitor
- delete zkmonitor ui
- Modify the actions.js comma
* [DS-6655][fix] remove zkmonitor
- remove all backend API
Co-authored-by: Kirs <acm_master@163.com>
2021-11-11 19:59:10 +08:00
Jiajie Zhong
c110488269
[ci] Remove GA path rule in build and unittest ( #6797 )
...
CI could not be run due to we add 9113817b
2021-11-11 17:32:57 +08:00
zwZjut
088a5a4706
add default constructor ( #6780 )
...
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2021-11-11 12:11:43 +08:00
kezhenxu94
9113817b78
Require build and unit tests before merging ( #6777 )
2021-11-11 08:45:35 +08:00
kezhenxu94
11844415b0
Refactor datasource and task plugins and simplify its usage ( #6767 )
2021-11-10 18:29:17 +08:00
Jiajie Zhong
98f466e09e
Make sql file change synchronize ( #6465 )
...
closes : #6431
2021-11-10 14:50:05 +08:00
zhang
28f871e58b
[Fix-6764]modifying prompt messages and modify dolphinscheduler_mysql.sql dolphinscheduler version ( #6765 )
...
* [FIX:201106]fix issue#6657
* replacement version number
* update resource create error messag
Co-authored-by: 张柏强 <zhangbaiqiang@lvshou.com>
Co-authored-by: crane <zhangbq3306@163.com>
2021-11-09 23:34:13 +08:00
mask
0aea5ae11a
[feature-6071][plugin] add datasource plugin. ( #6071 ) ( #6361 )
...
* [feature-6071][plugin] add datasource plugin. (#6071 )
* remove the dependency of datasource in common and task-plugin module.
* the new datasource-api module provides data source connection acquisition.
* add sqlserver data source plug-in.
* add ds license
* fix check style
* update spi pom
* frx conflict resolution
* fix check style
* fix datasource ut
* fix code check style
* fix code check style
* fix datasource ut
* add pg hive mysql oracle clickhouse db2 datasource
* fix datasource package
* update datasource pom
* update datasource pom
* update datasource pom
* update datasource pom
* update pom
* update pom dep
* update pom dep
* fix license
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* add oracle package
* modify comments
* conflict resolution
* rename log comment
* rename log comment
2021-11-09 20:20:07 +08:00
