Commit Graph

104 Commits

Author SHA1 Message Date
mask
0aea5ae11a
[feature-6071][plugin] add datasource plugin. (#6071) (#6361)
* [feature-6071][plugin] add datasource plugin. (#6071)

* remove the dependency of datasource in common and task-plugin module.

* the new datasource-api module provides data source connection acquisition.

* add sqlserver data source plug-in.

* add ds license

* fix check style

* update spi pom

* frx conflict resolution

* fix check style

* fix datasource ut

* fix code check style

* fix code check style

* fix datasource ut

* add pg hive mysql oracle clickhouse db2  datasource

* fix datasource package

* update datasource pom

* update datasource pom

* update datasource pom

* update datasource pom

* update pom

* update pom dep

* update pom dep

* fix license

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* fix ut

* add oracle package

* modify comments

* conflict resolution

* rename log comment

* rename log comment
2021-11-09 20:20:07 +08:00
kezhenxu94
05bae0b226
Refactor alert plugins and simplify its usage (#6723) 2021-11-09 18:59:34 +08:00
kezhenxu94
02350ea37b
Fix datasource not work in tests and standalone server, and run all tests by default (#6743) 2021-11-09 16:57:26 +08:00
kezhenxu94
5400abc74f
Refactor registry plugin and simplify its usage (#6712) 2021-11-07 15:18:10 +08:00
Jiajie Zhong
dd6ed36f65
Add Python API implementation of workflows-as-code (#6269)
* Init DS python SDK pydolphinscheduler: python code definition

* Doc first

* Add quick start and developer doc

* Java documentation change

* Add LICENSE-py4j.txt

* Add py4j to release-docs/LICENSE

* Move dependency version to parent pom

* Remove outdated code

* Add tenant parameter to tutorial
2021-10-31 20:35:46 +08:00
Kirs
ea493534df
Add Alibaba Druid to NOTICE file (#6488) 2021-10-11 14:01:07 +08:00
Kerwin
7459ee2531
dist module configuration generates missing task plugin. (#6473) 2021-10-09 21:35:28 +08:00
百岁
d284e44d52
Rename tis to pigeon from backend layer (#6437)
* add mock getTaskLogName() for UT test pass

* make task-tis rename to task-pigeon

* rename module name 'tis' to pigeon

* rename module name 'tis' to pigeon,make sanity check pass

* remove execute console.log()
2021-10-01 14:54:04 +08:00
Kirs
67508d8d1b
update project version to 2.0.0-SNAPSHOT (#6383) 2021-09-28 12:00:43 +08:00
百岁
34352c1bf8
Enhance using experience of DataX by introduce TIS (#6229)
* Enhance using experience of DataX by introduce TIS [Feature-5992]

* Enhance using experience of DataX by introduce TIS [Feature-5992]

* fix stylecheck error

* make testCase pass

* make dev testCase pass

* add new java dependency Java-WebSocket

* modfiy TISParameters.java avoid to name confliction

* add InterruptedException checking

* reAdd async-http-client annotation

* in order to staisfy the coverage degree add test which has been removed

* make testCase pass

* make testCase pass

* add jacoco dependency

* make code duplications be more lower

* add Java-WebSocket dependency in root pom

* remove useless code comment

* make tis http apply path and post body configurable ,the params save in config.properites

* Remove the dangerous instance of double-checked locking
2021-09-26 18:40:41 +08:00
Kirs
b90152fc2e
[SPI][Task]add SQL Task (#6237)
Add Sql Task And Fix Task Parse Err
2021-09-17 13:10:44 +08:00
Kirs
4715de11fc
[Feature][Plugin]Task (#6105)
* [Improvement][dao]When I search for the keyword description, the web UI shows empty (#5952)

* [Bug][WorkerServer] SqlTask NullPointerException #5549

* [Improvement][dao]When I search for the keyword Modify User, the web UI shows empty #5428

* [Improvement][dao]When I search for the keyword Modify User, the web UI shows empty #5428

* [Improvement][dao]When I search for the keyword Modify User, the web UI shows empty #5428

* [Improvement][dao]When I search for the keyword Modify User, the web UI shows empty #5428

* [Improvement][dao]When I search for the keyword Modify User, the web UI shows empty #5428

* [Improvement][dao]When I search for the keyword Modify User, the web UI shows empty #5428

* [Improvement][dao]When I search for the keyword description, the web UI shows empty #5428

* fix the readme typing issue (#5998)

* Fix unchecked type conversions

* Use indentation level reported by checkstyle

* Reorganize CI workflows to fasten the wasted time and resources (#6011)

* Add standalone server module to make it easier to develop (#6022)

* Task node of SWITCH (#5939)

* [Feature-#5273][server-master] Task node of SWITCH (#5922)



Co-authored-by: wangxj <wangxj31>

* remove description of bonecp (#6030)

Co-authored-by: shaojwu <shaojwu@ebay.com>

* [Improvement][Api Module]split alert group list-paging interface (#5941)

* [Improvement][Api Module]split alert group list-paging interface

* [FIX-#6007]Wrong complement date (#6026)

* [FIX-#6007]Wrong complement date

* [style]Wrong complement date

* [Improvement-6024][dist] Remove useless packaging commands (#6029)

·Remove useless packaging commands in dolphinscheduler-bin.xml

This closes #6024

Co-authored-by: mask <liuhu@zhiyoutec.com>

* [FIX-5908][MasterServer] When executing an compensation task, the execution thread would have a NPE (#5909)

* fix the npe in MasterExec

* fix the compile error

* Add `.asf.yaml` to easily set the GitHub metadata (#6035)

* fix dead server cannot stop (#6046)

* Enhancement Translation (#6042)

* replaced Loading... with i18n

* modified Edit zh_CN translation

* Delete zh_CN.js

Co-authored-by: David <dailidong66@gmail.com>

* fix bug #6053 zh_CN.js is lost

* [Feature][Plugin]Task

* fix license head

* fix code style

* fix code style

* fix build err

Co-authored-by: didiaode18 <563646039@qq.com>
Co-authored-by: Roy <yongjuncao1213@gmail.com>
Co-authored-by: lyxell <alyxell@kth.se>
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
Co-authored-by: myangle1120 <942542838@qq.com>
Co-authored-by: wangxj3 <857234426@qq.com>
Co-authored-by: gabry.wu <gabrywu@apache.org>
Co-authored-by: shaojwu <shaojwu@ebay.com>
Co-authored-by: Shukun Zhang <60541766+andream7@users.noreply.github.com>
Co-authored-by: linquan <1175687813@qq.com>
Co-authored-by: mask <39329477+Narcasserun@users.noreply.github.com>
Co-authored-by: mask <liuhu@zhiyoutec.com>
Co-authored-by: kyoty <echohlne@gmail.com>
Co-authored-by: RichardStark <49977764+RichardStark@users.noreply.github.com>
Co-authored-by: David <dailidong66@gmail.com>
Co-authored-by: lenboo <baoliang.leon@gmail.com>
2021-09-06 09:38:29 +08:00
百岁
b04bceb03c
[Feature-5992] Enhance using experience of DataX in DS by integeration with TIS (#6015) 2021-08-27 21:07:51 +08:00
Kerwin
22c5292b93
[Feature][SPI] Task (#6044) 2021-08-27 15:02:24 +08:00
Kirs
e2243d63be
[Feature-#3961][Registry]Registry-SPI (#5562)
[Feature#3961]Registry SPI

All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD
The registry supports distributed locks.
todo: The specific information about the registration center of the API module needs to be adjusted.
2021-06-09 15:21:02 +08:00
zhuangchong
802f4af159
fix dist packaging lacks alert jar. (#5536) 2021-05-22 23:02:55 +08:00
ruanwenjun
a925f64571
[Feature][api] schedule add timezone support #5259 (#5465)
* [Feature][api] schedule add timezone support #5259

* import moment-timezone

* fix code smell
2021-05-17 21:08:20 +08:00
baoliang
156dadac69 Merge remote-tracking branch 'upstream/dev' into json_split
# Conflicts:
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/MasterExecThread.java
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/utils/DependentExecute.java
2021-05-11 10:08:28 +08:00
ruanwenjun
25727d2d95
[Improvement][Alert] Replace HSSFWorkbook (#5400)
* [Improvement][Alert] Replace HSSFWorkbook

* add license
2021-05-10 09:57:49 +08:00
zhuangchong
0d8011f9c1
Cleanup of useless files in the binary package lib directory. (#5430) 2021-05-10 09:44:17 +08:00
baoliang
746d9eca1d Merge remote-tracking branch 'upstream/dev' into json_split
# Conflicts:
#	dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/ProcessDefinitionController.java
#	dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ProcessDefinitionVersionServiceImpl.java
#	dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ProjectServiceImpl.java
#	dolphinscheduler-api/src/test/java/org/apache/dolphinscheduler/api/controller/ProcessDefinitionControllerTest.java
#	dolphinscheduler-api/src/test/java/org/apache/dolphinscheduler/api/service/ProcessDefinitionVersionServiceTest.java
#	dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/model/TaskNode.java
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/MasterBaseTaskExecThread.java
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/processdure/ProcedureTask.java
#	dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/process/ProcessService.java
2021-04-26 14:14:05 +08:00
Shiwen Cheng
2e1d6975fd
[Improvement][Build] Optimize long release name and remove unused nginx release and upgrade spring boot version (#5308)
* [Build] Optimize long release name and remove unused nginx release

* [Build] Upgrade spring boot version

* [Improvement] Improve code style
2021-04-25 09:55:38 +08:00
didiaode18
f82da57277
There is a vulnerability in postgresql 42.1.4 ,upgrade recommended #5292 (#5318)
* There is a vulnerability in postgresql 42.1.4 ,upgrade recommended #5292
2021-04-20 15:04:29 +08:00
Shiwen Cheng
e92e29ef9a
[Fix-5309][Common] Fix the wrong memory (#5312)
* [Fix-5309][Common] Fix the wrong memory

* [Fix-5309][Common] Fix unit test and remove unused code
2021-04-19 10:24:54 +08:00
Shiwen Cheng
94a08c8f32
[Improvement] Remove incubating (#5305) 2021-04-16 22:56:51 +08:00
lenboo
2603d52044 Merge remote-tracking branch 'upstream/dev' into spilit 2021-03-01 15:20:34 +08:00
CalvinKirs
dc20d6a4cb add NOTICE 2021-02-26 18:15:46 +08:00
CalvinKirs
b4c7e35340 Merge branch 'dev' into rpc
# Conflicts:
#	tools/dependencies/known-dependencies.txt
2021-02-26 18:10:49 +08:00
lenboo
ccc5aa91d8 merge from dev 2021-02-25 18:09:32 +08:00
Kirs
a9e1d316f5
[Improvement][SPI]Migrate related classes loaded by SPI classes to public modules (#4586)
* Migrate related classes loaded by SPI classes to public modules

* Migrate related classes loaded by SPI classes to public modules

* remove guava

* update guava

* update guava

* move to common model

* code style

* code style

* resolved conflicting file

* remove ignore test

* add jar

* fix ut error

* fix test

* fix error

* test

* exclude asm、resolver、aether-api

* code style

* remove default plugin jar config

* add LICENSE file

* add version

* add version

* remove ignore ut

* fix ut error

* add ut

* code style

* add license
2021-02-25 11:39:46 +08:00
lenboo
4c9c41933d Merge remote-tracking branch 'upstream/dev' into spilit
# Conflicts:
#	dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/ProcessInstanceService.java
#	dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ProcessDefinitionServiceImpl.java
#	dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/ProcessDefinitionVersionServiceImpl.java
2021-02-21 14:54:18 +08:00
Shiwen Cheng
8879d8ff60
[Improvement][*] Define version with revision globally and update version to 1.3.6-SNAPSHOT (#4773)
* [Improvement][*] Update version to 1.4.0-SNAPSHOT

* [Improvement][*] Update tab to space under checkstyle

* [Improvement][*] Define version with revision globally

* [Improvement][*] Update version to 1.3.6-SNAPSHOT
2021-02-20 14:22:49 +08:00
lenboo
9fb7c9a903 Merge remote-tracking branch 'upstream/dev' into spilit 2021-02-09 22:57:22 +08:00
Kirs
c9972936d6
[SPI][License]Add missing license (#4749) 2021-02-09 19:48:54 +08:00
CalvinKirs
d30500f261 test 2021-02-09 13:17:24 +08:00
CalvinKirs
dad9436992 Merge branch 'dev' into rpc 2021-02-09 12:00:08 +08:00
lenboo
52beecb4d7 Merge remote-tracking branch 'upstream/dev' into spilit 2021-02-09 09:43:41 +08:00
zhuangchong
5d89bb0f5a
[Improvement][alert] Improvement alert plugin dist. (#4731)
* imp dev alert plugin dist.

* update xml code style.

* update xml code style.
2021-02-08 23:13:27 +08:00
CalvinKirs
fba133c94c move license 2021-02-03 11:17:45 +08:00
lenboo
c8d5454741 merge form dev 2021-01-31 16:45:54 +08:00
dailidong
3c18d63993
Delete LICENSE-protostuff-runtime.txt 2021-01-30 21:50:20 +08:00
dailidong
3a8df41862
Delete LICENSE-protostuff-core.txt 2021-01-30 21:49:36 +08:00
dailidong
efde946afd
Delete LICENSE-protostuff-collectionschema.txt 2021-01-30 21:49:00 +08:00
dailidong
825870c3a9
Rename LICENSE-protostuff-api.txt to LICENSE-protostuff.txt 2021-01-30 21:48:19 +08:00
felix.wang
d80f0614ef
[Feature-#4350][Alert]support feishu plugin (#4594)
* feishu robot

* Add Feishu to the plugin packing process
2021-01-29 22:41:13 +08:00
cooper
0e43b0d82a
Remove duplicate license(LICENSE-@form-create-element-ui ) (#4630)
Co-authored-by: 李长福 <changfu.li@dmall.com>
2021-01-29 22:08:58 +08:00
JinyLeeChina
47e620fbc9
[Feature][JsonSplit] add task query (#4619)
* add task query

* modify codestyle

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-01-29 18:11:46 +08:00
CalvinKirs
ea97ed1781 fix bug and add license 2021-01-25 23:30:05 +08:00
CalvinKirs
958d2fd66d add license 2021-01-25 22:25:36 +08:00
CalvinKirs
a97f781884 add license 2021-01-25 22:08:00 +08:00