test/DolphinScheduler
1
0
Fork 0
mirror of https://gitee.com/dolphinscheduler/DolphinScheduler.git synced 2024-12-05 13:48:10 +08:00
Code Issues Actions 10 Packages Projects Releases Wiki Activity
5,007 Commits 27 Branches 59 Tags 276 MiB
728bd31f73
Commit Graph

5007 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
JinyLeeChina
728bd31f73
[Feature][JsonSplit-api] api of project (#5630) 
* processDefinition create/update

* fix codeStyle

* fix codeStyle

* fix ut

* api of project

* fix ut

* project update method

Co-authored-by: JinyLeeChina <297062848@qq.com>
 2021-06-15 10:52:03 +08:00
kyoty
71a44f8a57 [Fix-5483] [Bug][API] Can't view variables in the page of Process Instance (#5631) 2021-06-15 10:30:26 +08:00
Shiwen Cheng
3fb01e1b4c [Fix-5596][Python] Fix conflict between python_home and datax_home configuration in dolphinscheduler_env.sh (#5612) 2021-06-15 10:30:26 +08:00
xingchun-chen
109e6543b9 modify issues translation robot (#5624) 
* Add issue robot automatic reply and Translation


Co-authored-by: chenxingchun <438044805@qq.com>
 2021-06-15 10:30:26 +08:00
Shiwen Cheng
43be965b34 [Improvement-5567][UI] Add project id in web ui url for sharing and project name in project page (#5568) 
* [Improvement-5567][UI] Add project id in web ui url for sharing

* [Improvement-5577][UI] Add Project Name in Project Page
 2021-06-15 10:30:26 +08:00
xingchun-chen
6e818032b9 modify issues translation robot (#5614) 
* Add issue robot automatic reply and Translation
 2021-06-15 10:30:26 +08:00
Shiwen Cheng
47812d2691 [Fix][Docker] Fix docker image build error (#5613) 2021-06-15 10:30:26 +08:00
blackberrier
053e548bf3 [Improvement-5539][Master] Check status of taskInstance from cache (#5572) 
* improvement:check status of taskInstance from cache

* issue5572 use timer instead of while&sleep; consider concurrent modification

* use computeifpresent instead of lock

* simplify getByTaskInstanceId function

* add ut for TaskInstanceCacheManagerImpl; fix bug in TaskInstanceCacheManagerImpl

* add Apache license header;add test class in root pom
 2021-06-15 10:30:26 +08:00
Kirs
30c88032d3 [Feature-#3961][Registry]Registry-SPI (#5562) 
[Feature#3961]Registry SPI

All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD
The registry supports distributed locks.
todo: The specific information about the registration center of the API module needs to be adjusted.
 2021-06-15 10:30:26 +08:00
leeli
006fb67439 [Fix-5583][sql] fix table name error in sql upgrade script (#5606) 
* [DS-5583][fix] fix table ·name error in sql upgrade script

* [DS-5583][fix] fix table ·name error in sql upgrade script

Co-authored-by: lihongwei <lihongwei@ebchinatech.com>
 2021-06-15 10:30:26 +08:00
Shiwen Cheng
d8f2aa3f20 [Fix-5468][Common] Fix obtaining IP is incorrect (#5594) 2021-06-15 10:30:26 +08:00
Chouc
3193837f5a [DS-5559][fix][Master Server] Master Server was shutdown but the process still in system (#5588) 
* Close spring context to destory beans that has running thread
 2021-06-15 10:30:26 +08:00
Shiwen Cheng
309deaefe8 [Fix-5581][SQL] Specific key was too long, max key length is 767 bytes for varchar(256) in some mysql with innodb_large_prefix=OFF (#5582) 2021-06-15 10:30:26 +08:00
JinyLeeChina
a561a618af
[Feature][JsonSplit-api] api of processDefinition create/update (#5602) 
* processDefinition create/update

* fix codeStyle

* fix codeStyle

* fix ut

Co-authored-by: JinyLeeChina <297062848@qq.com>
 2021-06-11 09:43:05 +08:00
Squidyu
cc9e5d5d34
Add:Name verification remove the first and last spaces. (#5574) 
Co-authored-by: Squid <2824638304@qq.com>
 2021-06-02 12:01:01 +08:00
Shiwen Cheng
a5a0c7c5f8
[Fix-5570][Worker] Fix worker.groups in worker.properties is still commented and improve install scripts and configurations (#5571) 2021-06-02 11:21:01 +08:00
ruanwenjun
f8ecb536b7
[Improvement][Alert] server down will send repetitive message #5525 (#5529) 
* [Improvement][Alert] server down will send repetitive message #5525

* add ut
 2021-06-01 10:21:46 +08:00
geosmart
60af52fb2b
[Improvement][ApiDoc] fix-queue controller verifyQueue param (#5558) 
Co-authored-by: wanggang <wanggy01@servyou.com.cn>
 2021-05-31 21:07:21 +08:00
geosmart
56273319a2
[Bug][Master] remove check with executePath when kill yarn job (#5552) 
* [Bug][Master] remove check with executePath when kill yarn job

* [Bug][Master] init execute path if not exist

* [Bug][Master] move createWorkDirIfAbsent out side of executePath calculate  part

Co-authored-by: wanggang <wanggy01@servyou.com.cn>
 2021-05-29 12:14:46 +08:00
ruanwenjun
842c5400e6
[Improvement][Server] Must restart master if Zk reconnect (#5210) (#5211) 2021-05-25 05:03:29 +08:00
ruanwenjun
9d0c816cee
[Bug][worker] task throw ConcurrentModifiedException #5528 (#5530) 
* [Bug][worker] task throw ConcurrentModifiedException #5528

* fix code smell
 2021-05-25 04:53:56 +08:00
Shiwen Cheng
b537f4eb26
[Improvement][Docker/K8s] Support more configurations and service accesses, reduce the duplication configurations, improve image for python and the compatibility of python home (#5393) 
* [Improvement][Docker] Support more configurations and improve image for python

* [Improvement][K8s] Support more configurations, more service accesses, and reduce the duplication configurations

* [Improvement][Python] Improve the compatibility of python home

* [Improvement][Install] Fix install config and install.sh

* [Improvement][Install] Fix workflow ut

* [Improvement][Docker] Optimize docker-swarm/check script

* [Improvement][DB] Update default username and password of database

* Update comments in master/worker.properties

* Specify version for all images

* [Improvement][Docker] Optimize PS1 and WORKDIR

* [Improvement][SQL] Reduce heap size to 64m in create-dolphinscheduler.sh and upgrade-dolphinscheduler.sh

* [Fix-5431][K8s] Fix master and worker cannot get the right address with custom DNS
 2021-05-24 00:03:35 +08:00
zhuangchong
9ba4ffbe48
[Improvement-5527][api-server] failed find any kerberos (#5533) 
* fix failed find any kerberos.

* increase code coverage.

* update common utils test.

* update common utils test.

* update common utils test.

* fix exception type.
 2021-05-23 23:43:59 +08:00
QuakeWang
46660b58ed
[Test] Add SparkParameters test (#5478) 
* Create SparkparametersTest.java

Add a test case

* Update and rename SparkparametersTest.java to SparkParametersTest.java

* Update pom.xml

add SparkParametersTest.java in pom file
 2021-05-22 23:56:39 +08:00
zhuangchong
802f4af159
fix dist packaging lacks alert jar. (#5536) 2021-05-22 23:02:55 +08:00
Kirs
8a1d849701
[ut]ignore plugin ut (#5532) 2021-05-21 10:36:08 +08:00
Shuyang Wu
d9f7d1f63e
feat: add contributor over time graph to README (#5531) 2021-05-21 10:24:55 +08:00
zhuangchong
1b7dcea610
[Improvement-5440][Maven] Project module maven dependency optimization (#5441) 
* Optimize dependencies between modules.

* update module-alert dependency.

* add repository in the pom xml.

* update Central Repository in the pom.xml.
 2021-05-19 10:05:00 +08:00
Yao WANG
bc22ae7c91
[Improvement][Task] Remove deprecated TaskRecordDao and simply the after() method in the AbstractTask class (#5492) 
* remove the depreated data quality module

* fix lint

Co-authored-by: Yao <ywang46@paypal.com>
 2021-05-18 17:00:03 +08:00
ruanwenjun
018f5c89f6
fix sql symbol error (#5462) 2021-05-18 10:20:18 +08:00
ruanwenjun
a925f64571
[Feature][api] schedule add timezone support #5259 (#5465) 
* [Feature][api] schedule add timezone support #5259

* import moment-timezone

* fix code smell
 2021-05-17 21:08:20 +08:00
ruanwenjun
68301db6b9
[Improvement][Api] Upload resource to remote failed, the local tmp file need to be cleared #5475 (#5476) 2021-05-17 11:13:14 +08:00
lcdrs
d04f4b6053
[Implement][Common] Modify the plug-in loading log to print messages 
Co-authored-by: caoping <caoping@staff.weibo.com>
 2021-05-13 16:26:21 +08:00
Kirs
a3e5dfc146
Merge pull request #5390 from apache/json_split 
[Feature-4417] Process definition json split
 2021-05-12 18:44:30 +08:00
baoliang
dd80f98196 update sleep exception 2021-05-12 16:50:39 +08:00
baoliang
1c72a4b9d8 Merge remote-tracking branch 'upstream/dev' into json_split 2021-05-12 10:32:54 +08:00
wen-hemin
5079600c98
fix: field length (#5446) 
Co-authored-by: wen-hemin <wenhemin@apache.com>
 2021-05-12 10:15:01 +08:00
ruanwenjun
5556e47a85
[Feature][Plugin-Email] Numeric data type support in email attachment #5424 (#5426) 2021-05-11 20:53:27 +08:00
baoliang
7aa8b518ac Merge remote-tracking branch 'upstream/dev' into json_split 
# Conflicts:
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/MasterExecThread.java
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/utils/DependentExecute.java
 2021-05-11 13:55:27 +08:00
baoliang
2dd0d936fb Merge remote-tracking branch 'upstream/dev' into json_split 
# Conflicts:
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/MasterExecThread.java
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/utils/DependentExecute.java
 2021-05-11 11:45:40 +08:00
baoliang
156dadac69 Merge remote-tracking branch 'upstream/dev' into json_split 
# Conflicts:
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/MasterExecThread.java
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/utils/DependentExecute.java
 2021-05-11 10:08:28 +08:00
ruanwenjun
fbef290cc5
[Bug][Service] All tasks that need to send attachment will fail due to chennel idle (#5442) 2021-05-11 03:03:52 +08:00
JinyLeeChina
515fa4912e
[Feature][JsonSplit] Fix ProcessService ut (#5435) 
* Fix ProcessService ut

* codeStyle

* Fix AlertPlugin ut

* Fix AlertPlugin ut

* Fix server module ut

* Fix server module ut

* Fix api ut

* codeStyle

Co-authored-by: JinyLeeChina <297062848@qq.com>
 2021-05-10 23:17:56 +08:00
ruanwenjun
25727d2d95
[Improvement][Alert] Replace HSSFWorkbook (#5400) 
* [Improvement][Alert] Replace HSSFWorkbook

* add license
 2021-05-10 09:57:49 +08:00
zhuangchong
9c77faa8ac
[Improvement-5058][Master] The master-server creates the DB data source twice (#5139) 
* reduce the number of data sources created twice by master server.

* update ProcessAlertManagerTest test class to increase coverage.

* add DolphinSchedulerPluginLoaderTest test ignore.

Co-authored-by: zhuang chong
 2021-05-10 09:56:17 +08:00
zhuangchong
0d8011f9c1
Cleanup of useless files in the binary package lib directory. (#5430) 2021-05-10 09:44:17 +08:00
JinyLeeChina
847865fba6
[Feature][JsonSplit] Fix dao ut (#5433) 
* update taskParams/add task delayTime/fix conditionType bug

* update codeStyle for merge to dev

* fix process lineage bug

* fix codeStyle for json_split

* Fix dao ut

* Fix dao ut

* codeStyle

* modify postgreSQL

* fix TaskInstanceMapper ut

* fix ProjectMapper ut

* fix ProcessDefinitionDao ut

* datasource

* fix postgreSQL

Co-authored-by: JinyLeeChina <297062848@qq.com>
 2021-05-09 13:53:14 +08:00
JinyLeeChina
f7b71fb9ca
[Feature][JsonSplit] Fix codeStyle for json_split (#5432) 
* update taskParams/add task delayTime/fix conditionType bug

* update codeStyle for merge to dev

* fix process lineage bug

* fix codeStyle for json_split

Co-authored-by: JinyLeeChina <297062848@qq.com>
 2021-05-09 00:01:09 +08:00
QuakeWang
f88bbbd637
[Improvement] Create RollViewLogRequestCommandTest.java (#5417) 
* Create RollViewLogRequestCommandTest.java

Add a test case about RollViewLogRequestCommand

* Update pom.xml

add the test files in the parent pom
 2021-05-07 20:58:23 +08:00
JinyLeeChina
363426de71
[Feature][JsonSplit] fix process lineage bug (#5418) 
* update taskParams/add task delayTime/fix conditionType bug

* update codeStyle for merge to dev

* fix process lineage bug

Co-authored-by: JinyLeeChina <297062848@qq.com>
 2021-05-07 16:37:49 +08:00