Commit Graph

798 Commits

Author SHA1 Message Date
kezhenxu94
4114cb07f6
Add actuator and enable metrics, add Grafana configs (#6840) 2021-11-14 20:22:13 +08:00
mask
a998415afe
[Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490) (#6828)
* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490)

* fix pom dep scope

* filter alert

* filter alert

* filter alert

* fix checkstyle

* remove hikaricp version

* update pom

* add properties

* add properties

* rename properties

* fix e2e fail

* rename properties
2021-11-14 13:02:58 +08:00
JinYong Li
dfe4945b48
remove processDefinition resourceIds (#6813) 2021-11-12 11:39:16 +08:00
mask
e36d18b588
[Fix-6792] resolve API and alert port conflicts (#6792) (#6815)
* [Fix-6792]Multiple ApplicationRunners on classpath make SpringApplication.run only run one (#6792)
2021-11-12 10:51:11 +08:00
JinYong Li
da2a044947
[Feature][API] add processDefinitionSimpleList api (#6814)
* add processDefinitionSimpleList api

* add processDefinitionSimpleList api
2021-11-11 23:45:41 +08:00
罗铭涛
975131e913
[Improvement#6655] [UI] remove registry monitor (#6789)
* [DS-6655][fix] remove zkmonitor
- delete zkmonitor ui

* [DS-6655][fix] remove zkmonitor
- delete zkmonitor ui
- Modify the actions.js comma

* [DS-6655][fix] remove zkmonitor
- remove all backend API

Co-authored-by: Kirs <acm_master@163.com>
2021-11-11 19:59:10 +08:00
zwZjut
088a5a4706
add default constructor (#6780)
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2021-11-11 12:11:43 +08:00
kezhenxu94
11844415b0
Refactor datasource and task plugins and simplify its usage (#6767) 2021-11-10 18:29:17 +08:00
zhang
28f871e58b
[Fix-6764]modifying prompt messages and modify dolphinscheduler_mysql.sql dolphinscheduler version (#6765)
* [FIX:201106]fix issue#6657

* replacement version number

* update resource create error messag

Co-authored-by: 张柏强 <zhangbaiqiang@lvshou.com>
Co-authored-by: crane <zhangbq3306@163.com>
2021-11-09 23:34:13 +08:00
mask
0aea5ae11a
[feature-6071][plugin] add datasource plugin. (#6071) (#6361)
* [feature-6071][plugin] add datasource plugin. (#6071)

* remove the dependency of datasource in common and task-plugin module.

* the new datasource-api module provides data source connection acquisition.

* add sqlserver data source plug-in.

* add ds license

* fix check style

* update spi pom

* frx conflict resolution

* fix check style

* fix datasource ut

* fix code check style

* fix code check style

* fix datasource ut

* add pg hive mysql oracle clickhouse db2  datasource

* fix datasource package

* update datasource pom

* update datasource pom

* update datasource pom

* update datasource pom

* update pom

* update pom dep

* update pom dep

* fix license

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* add oracle package

* modify comments

* conflict resolution

* rename log comment

* rename log comment
2021-11-09 20:20:07 +08:00
kezhenxu94
02350ea37b
Fix datasource not work in tests and standalone server, and run all tests by default (#6743) 2021-11-09 16:57:26 +08:00
kezhenxu94
63602bf77c
Clean up the utility codes (#6732) 2021-11-08 23:22:07 +08:00
OS
24bd8a16e1
[Bug][Master] The task of dependent should use taskCode (#6730)
* fix #6682 The task of dependent should use taskCode

* fix #6682 The task of dependent should use taskCode
2021-11-07 23:20:35 +08:00
Wenjun Ruan
0afb780718
[Improvement-5807][Dao] Use h2 in UT (#6500)
* Use H2 in UT

* change scope

* Change profile name to h2

* Add datasource-h2.properties, datasource-postgresql.properties

* Fix UT

* Resolve conflict

* Remove startDatabase
2021-11-07 23:19:19 +08:00
kezhenxu94
5400abc74f
Refactor registry plugin and simplify its usage (#6712) 2021-11-07 15:18:10 +08:00
ReonYu
d4d59b0627
[FIX 6701] [API] Fix paging error when worker group number more than 10 (#6704) 2021-11-05 20:23:20 +08:00
wangxj3
dc8b87e473
[Feature-#6268][server-master] Serial execte process (#6185)
* add serial processInstance

* fix bug

* add test

* fix code style

* fix style code

* add sql

* fix sql error

* add api

* add test

* fix code style

* modify api

* delete column , fix mapper

* fix unimport

* fix test

* fix bug of missing param for Python

* fix code style

* fix test

* fix test

Co-authored-by: wangxj <wangxj31>
2021-11-05 17:25:45 +08:00
Maxwell
0b93fd577d
fix REGISTER_PATH_PATTERN (#6669)
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
2021-11-04 10:04:11 +08:00
BenjaminWenqiYu
3a8b80971b
1. ResourceMapper rename the original 'existResource' function to 'existResourceByUser' (#6409)
2. ResourceMapper add existResource function without the userId condition
3. change the ResourceServiceImpl's private function 'checkResourceExists' without userId condition
2021-10-31 21:26:48 +08:00
Jiajie Zhong
dd6ed36f65
Add Python API implementation of workflows-as-code (#6269)
* Init DS python SDK pydolphinscheduler: python code definition

* Doc first

* Add quick start and developer doc

* Java documentation change

* Add LICENSE-py4j.txt

* Add py4j to release-docs/LICENSE

* Move dependency version to parent pom

* Remove outdated code

* Add tenant parameter to tutorial
2021-10-31 20:35:46 +08:00
wind
0d26724455
[DS-6591][API] fix process definition import (#6592)
Co-authored-by: caishunfeng <534328519@qq.com>
2021-10-26 17:35:06 +08:00
mask
9b1984c244
[fix-6570][task] add sql task udf resource load (#6570) (#6571)
* [fix-6570][task] add sql task udf resource load (#6570)

-add sql task udf resource load
-Fix UdfFuncRequest serialization

* fix checkstyle

* add defaultFS in sqlTaskContext

* fix checkstyle
2021-10-21 15:23:49 +08:00
JinYong Li
095e2e206a
fix import processDefinition error (#6573) 2021-10-20 23:45:38 +08:00
OS
db04a5b04d
[Feature-6471]Cache Process definition in master (#6485)
* feature-6471 Cache Process definition in master
2021-10-11 20:22:58 +08:00
Kerwin
88690462b4
[Fix-6478] [Server] Fix the lack of scheduling time in complement parallelism mode (#6491)
* fix missing history data

* update code style

* update ExecutorServiceTest test class.
2021-10-11 20:03:25 +08:00
Hua Jiang
fac6b4afd3
[Fix-5875][API] When I saved the task that had the same name task in another flow ,the service would throw DuplicateKeyException (#6430)
* using the task code in the dag
2021-10-08 09:55:54 +08:00
Shukun Zhang
6e453de241
[Feature] workflow level task dry run (#6104)
* feat workflow level task dry run

* feat workflow level task dry run

* feat workflow level task dry run

* feat workflow level task dry run

* feat workflow level task dry run

* feat workflow level task dry run

* feat workflow level task dry run

* feat workflow level task dry run

* feat workflow level task dry run

* feat workflow level task dry run
2021-09-30 11:18:06 +08:00
Jiajie Zhong
3e8fe68128
Remove unused parameter in function genTaskCodeList (#6395) 2021-09-29 11:42:48 +08:00
OS
c013b49e72
[Fix-6347][Master-API]fix bug #6347 the first schedule_time is error in complement data (#6389)
* fix bug #6347  complement data errors
2021-09-28 17:00:46 +08:00
Kirs
67508d8d1b
update project version to 2.0.0-SNAPSHOT (#6383) 2021-09-28 12:00:43 +08:00
Kirs
b2a2fbda1d
Revert "fix the magic number userId '0' (#6368)" (#6378)
This reverts commit 7413b57841.

Co-authored-by: OS <29528966+lenboo@users.noreply.github.com>
2021-09-27 18:50:08 +08:00
BenjaminWenqiYu
7413b57841
fix the magic number userId '0' (#6368) 2021-09-27 16:58:26 +08:00
ououtt
652d690976
[DS-6362][fix] fix switch process definition version failed (#6363) 2021-09-27 00:30:59 +08:00
Liyue
bc8d610e87
fix the mismatch of upload url between frontend and backend (#6226)
* fix: fix the  url mismatch between frontend and backend

* fix the url mismatch between frontend and backend

* fix the resource download url

* fix: update for unit test
2021-09-26 20:56:03 +08:00
JinYong Li
c56daede2f
[Fix-6352] [ApiServer] fix process definition copy bug (#6357)
* fix 6320 batch delete process definition bug

* fix-6352 process definition copy bug

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-09-26 16:36:54 +08:00
HanayoZz
4625783479
[Fix-6072][common] Remove Generic method JsonUtils.toMap (#6283)
* [Fix][common] Remove Generic method JsonUtils.toMap, Replace by parseObj(String json, TypeReference type)
2021-09-23 23:06:53 +08:00
JinYong Li
99f593cf42
fix 6320 batch delete process definition bug (#6321)
Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-09-23 22:43:15 +08:00
JinYong Li
d7160874e4
[Fix-6248] [API] fix processDefinnition release/processInstance update/taskDefinition transaction (#6288)
* fix processDefinition save/update/delete/move/import transaction

* fix ut

* fix processDefinnition release/processInstance update/taskDefinition transaction

* fix processDefinnition release/processInstance update/taskDefinition transaction

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-09-22 20:38:22 +08:00
JinYong Li
7a321505cf
[Fix-6248] [API] fix processDefinition save/update/delete/move/import transaction (#6285)
* fix processDefinition save/update/delete/move/import transaction

* fix ut

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-09-21 23:10:26 +08:00
JinYong Li
8980b7027a
fix deleteProcessDefinitionVersion bug (#6287)
Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-09-21 22:35:50 +08:00
Kirs
b90152fc2e
[SPI][Task]add SQL Task (#6237)
Add Sql Task And Fix Task Parse Err
2021-09-17 13:10:44 +08:00
JinyLeeChina
9d0b00c1b7
[Fix-6139][API]fix envCode in task_definition and process switchVersion (#6231)
* fix envCode in task_definition and process switchVersion

* fix conflicts

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-09-16 19:37:42 +08:00
Tandoy
c1496d8a74
[Bug] [ui] fix cannot edit project (#6227)
* fix cannot edit project

* It has been fixed that when editing a project, if you do not modify the projectName, a project already exists error will be thrown.
2021-09-16 09:45:44 +08:00
JinyLeeChina
07d6542feb
[Fix-6139][API] fix workFlowLineage relation (#6217)
* fix bug of view-tree api

* fix bug of view-tree api

* fix ut

* fix ut

* fix master buildFlowDag error

* fix workFlowLineage relation

* fix ut

* fix ut

* fix ut

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-09-15 17:42:21 +08:00
Jiajie Zhong
170280fab2
Simplify constants variables (#6183)
* Combine `alter` and `registry` properties,
  bese on https://github.com/apache/dolphinscheduler/pull/6180
* Remove duplicate variable `SLASH` and `SINGLE_SLASH`
2021-09-13 22:03:09 +08:00
JinyLeeChina
14e4d7086d
[Fix-6139][API] fix bug of view-tree api (#6188)
* fix bug of view-tree api

* fix bug of view-tree api

* fix ut

* fix ut

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-09-13 20:40:52 +08:00
DittoTool
a245e141d6
Inefficient Usages of Java Collections (#6187) 2021-09-13 14:36:01 +08:00
kezhenxu94
ea2a9dbcb2
Clean up third-party files that are not mentioned in LICENSE (#6165) 2021-09-11 11:27:42 +08:00
JinyLeeChina
4ddfb855a3
[Fix-6156] [API] refactor workflow lineage api (#6157)
* fix mysql create sentence bug

* fix mysql create sentence bug

* fix genTaskCodeList return same code and save proces error

* refactor workflow lineage api

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-09-10 14:20:18 +08:00
kezhenxu94
a632be73c0
Clean up unused util classes... (#6154) 2021-09-10 00:35:39 +08:00