test/DolphinScheduler
1
0
Fork 0
mirror of https://gitee.com/dolphinscheduler/DolphinScheduler.git synced 2024-11-30 03:08:01 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
5,014 Commits 30 Branches 57 Tags 276 MiB
3026f04d85
Commit Graph

5014 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
zhuangchong
3026f04d85
[Improvement-5452][Task] ds flink task support submit a PyFlink job via the CLI (#5453) 
* flink task support submit a PyFlink job via the CLI.

* optimize attribute name.

* Modify pyflink parameter judgment logic
 2021-06-17 15:19:25 +08:00
kyoty
b05957db41
[Improvement] The newly introduced spi pugin support work in windows os 
The newly introduced spi can't work in windows os.
 2021-06-17 14:54:55 +08:00
LOUKHNATI Mohamed Khalil
86ffc1f3f2
[Bug][WorkerServer] SqlTask NullPointerException (#5556) 
* [Bug][WorkerServer] add null checks to sqlParamsMap and sqlParamsMap.get(i), Add test to verify it

* Change Test Name

* Fix Code style issues, Modify checking null for Sql params in sqlParamsMap with clearer logging.
 2021-06-16 18:21:41 +08:00
kyoty
015ed7ffa6
[Bug Fix] Edit the note of existed datasource does't work. (#5642) 
* Update DataSourceServiceImpl.java

* Update DataSourceServiceImpl.java
 2021-06-16 17:29:17 +08:00
kyoty
0a5670f195
Fix the bug Edit User Info will always shows failed. (#5627) 
* Update createUser.vue

* Update createUser.vue
 2021-06-16 13:03:01 +08:00
kyoty
67711442d5
[Improvement][SQL] Query return number In SQL should be configurable (#5632) 
* [Improvement][SQL] Query return number should be configurable #5580

* Update SqlTaskTest.java

* Update sql.vue
 2021-06-16 09:40:21 +08:00
zhuangchong
e2d6265e26
[Improvement][registry-plugin] Optimize registry plugin loading and initial installation #5635 2021-06-15 20:51:52 +08:00
kyoty
9d70c7e534
Update ProcessDefinitionMapperTest.java (#5633) 2021-06-15 19:29:09 +08:00
kyoty
c5bea3c774
[Fix-5540][JSON Split] Fix some new tables and fields are missing in the sql upgrade script (#5611) 
* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Create dolphinscheduler_ddl.sql

* Update dolphinscheduler_postgre.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Create dolphinscheduler_ddl.sql

* Update dolphinscheduler_mysql.sql

* Update dolphinscheduler_postgre.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_postgre.sql
 2021-06-15 14:45:39 +08:00
kyoty
0d5037e7c3
[Fix-5483] [Bug][API] Can't view variables in the page of Process Instance (#5631) 2021-06-13 11:43:53 +08:00
Shiwen Cheng
8bf042ae6e
[Fix-5596][Python] Fix conflict between python_home and datax_home configuration in dolphinscheduler_env.sh (#5612) 2021-06-12 01:23:18 +08:00
xingchun-chen
b436ef0a2c
modify issues translation robot (#5624) 
* Add issue robot automatic reply and Translation


Co-authored-by: chenxingchun <438044805@qq.com>
 2021-06-11 11:22:42 +08:00
Shiwen Cheng
5d3b75a0a3
[Improvement-5567][UI] Add project id in web ui url for sharing and project name in project page (#5568) 
* [Improvement-5567][UI] Add project id in web ui url for sharing

* [Improvement-5577][UI] Add Project Name in Project Page
 2021-06-10 15:42:03 +08:00
xingchun-chen
d70fdf2a65
modify issues translation robot (#5614) 
* Add issue robot automatic reply and Translation
 2021-06-10 15:24:47 +08:00
Shiwen Cheng
0d303a804d
[Fix][Docker] Fix docker image build error (#5613) 2021-06-10 14:00:28 +08:00
blackberrier
79eb2e85d7
[Improvement-5539][Master] Check status of taskInstance from cache (#5572) 
* improvement:check status of taskInstance from cache

* issue5572 use timer instead of while&sleep; consider concurrent modification

* use computeifpresent instead of lock

* simplify getByTaskInstanceId function

* add ut for TaskInstanceCacheManagerImpl; fix bug in TaskInstanceCacheManagerImpl

* add Apache license header;add test class in root pom
 2021-06-10 09:39:12 +08:00
Kirs
e2243d63be
[Feature-#3961][Registry]Registry-SPI (#5562) 
[Feature#3961]Registry SPI

All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD
The registry supports distributed locks.
todo: The specific information about the registration center of the API module needs to be adjusted.
 2021-06-09 15:21:02 +08:00
leeli
697f37d2c2
[Fix-5583][sql] fix table name error in sql upgrade script (#5606) 
* [DS-5583][fix] fix table ·name error in sql upgrade script

* [DS-5583][fix] fix table ·name error in sql upgrade script

Co-authored-by: lihongwei <lihongwei@ebchinatech.com>
 2021-06-09 11:45:08 +08:00
Shiwen Cheng
281b5aea6b
[Fix-5468][Common] Fix obtaining IP is incorrect (#5594) 2021-06-07 22:12:49 +08:00
Chouc
75be09735a
[DS-5559][fix][Master Server] Master Server was shutdown but the process still in system (#5588) 
* Close spring context to destory beans that has running thread
 2021-06-04 13:27:18 +08:00
Shiwen Cheng
87604b7a3d
[Fix-5581][SQL] Specific key was too long, max key length is 767 bytes for varchar(256) in some mysql with innodb_large_prefix=OFF (#5582) 2021-06-04 09:55:42 +08:00
Squidyu
cc9e5d5d34
Add:Name verification remove the first and last spaces. (#5574) 
Co-authored-by: Squid <2824638304@qq.com>
 2021-06-02 12:01:01 +08:00
Shiwen Cheng
a5a0c7c5f8
[Fix-5570][Worker] Fix worker.groups in worker.properties is still commented and improve install scripts and configurations (#5571) 2021-06-02 11:21:01 +08:00
ruanwenjun
f8ecb536b7
[Improvement][Alert] server down will send repetitive message #5525 (#5529) 
* [Improvement][Alert] server down will send repetitive message #5525

* add ut
 2021-06-01 10:21:46 +08:00
geosmart
60af52fb2b
[Improvement][ApiDoc] fix-queue controller verifyQueue param (#5558) 
Co-authored-by: wanggang <wanggy01@servyou.com.cn>
 2021-05-31 21:07:21 +08:00
geosmart
56273319a2
[Bug][Master] remove check with executePath when kill yarn job (#5552) 
* [Bug][Master] remove check with executePath when kill yarn job

* [Bug][Master] init execute path if not exist

* [Bug][Master] move createWorkDirIfAbsent out side of executePath calculate  part

Co-authored-by: wanggang <wanggy01@servyou.com.cn>
 2021-05-29 12:14:46 +08:00
ruanwenjun
842c5400e6
[Improvement][Server] Must restart master if Zk reconnect (#5210) (#5211) 2021-05-25 05:03:29 +08:00
ruanwenjun
9d0c816cee
[Bug][worker] task throw ConcurrentModifiedException #5528 (#5530) 
* [Bug][worker] task throw ConcurrentModifiedException #5528

* fix code smell
 2021-05-25 04:53:56 +08:00
Shiwen Cheng
b537f4eb26
[Improvement][Docker/K8s] Support more configurations and service accesses, reduce the duplication configurations, improve image for python and the compatibility of python home (#5393) 
* [Improvement][Docker] Support more configurations and improve image for python

* [Improvement][K8s] Support more configurations, more service accesses, and reduce the duplication configurations

* [Improvement][Python] Improve the compatibility of python home

* [Improvement][Install] Fix install config and install.sh

* [Improvement][Install] Fix workflow ut

* [Improvement][Docker] Optimize docker-swarm/check script

* [Improvement][DB] Update default username and password of database

* Update comments in master/worker.properties

* Specify version for all images

* [Improvement][Docker] Optimize PS1 and WORKDIR

* [Improvement][SQL] Reduce heap size to 64m in create-dolphinscheduler.sh and upgrade-dolphinscheduler.sh

* [Fix-5431][K8s] Fix master and worker cannot get the right address with custom DNS
 2021-05-24 00:03:35 +08:00
zhuangchong
9ba4ffbe48
[Improvement-5527][api-server] failed find any kerberos (#5533) 
* fix failed find any kerberos.

* increase code coverage.

* update common utils test.

* update common utils test.

* update common utils test.

* fix exception type.
 2021-05-23 23:43:59 +08:00
QuakeWang
46660b58ed
[Test] Add SparkParameters test (#5478) 
* Create SparkparametersTest.java

Add a test case

* Update and rename SparkparametersTest.java to SparkParametersTest.java

* Update pom.xml

add SparkParametersTest.java in pom file
 2021-05-22 23:56:39 +08:00
zhuangchong
802f4af159
fix dist packaging lacks alert jar. (#5536) 2021-05-22 23:02:55 +08:00
Kirs
8a1d849701
[ut]ignore plugin ut (#5532) 2021-05-21 10:36:08 +08:00
Shuyang Wu
d9f7d1f63e
feat: add contributor over time graph to README (#5531) 2021-05-21 10:24:55 +08:00
zhuangchong
1b7dcea610
[Improvement-5440][Maven] Project module maven dependency optimization (#5441) 
* Optimize dependencies between modules.

* update module-alert dependency.

* add repository in the pom xml.

* update Central Repository in the pom.xml.
 2021-05-19 10:05:00 +08:00
Yao WANG
bc22ae7c91
[Improvement][Task] Remove deprecated TaskRecordDao and simply the after() method in the AbstractTask class (#5492) 
* remove the depreated data quality module

* fix lint

Co-authored-by: Yao <ywang46@paypal.com>
 2021-05-18 17:00:03 +08:00
ruanwenjun
018f5c89f6
fix sql symbol error (#5462) 2021-05-18 10:20:18 +08:00
ruanwenjun
a925f64571
[Feature][api] schedule add timezone support #5259 (#5465) 
* [Feature][api] schedule add timezone support #5259

* import moment-timezone

* fix code smell
 2021-05-17 21:08:20 +08:00
ruanwenjun
68301db6b9
[Improvement][Api] Upload resource to remote failed, the local tmp file need to be cleared #5475 (#5476) 2021-05-17 11:13:14 +08:00
lcdrs
d04f4b6053
[Implement][Common] Modify the plug-in loading log to print messages 
Co-authored-by: caoping <caoping@staff.weibo.com>
 2021-05-13 16:26:21 +08:00
Kirs
a3e5dfc146
Merge pull request #5390 from apache/json_split 
[Feature-4417] Process definition json split
 2021-05-12 18:44:30 +08:00
baoliang
dd80f98196 update sleep exception 2021-05-12 16:50:39 +08:00
baoliang
1c72a4b9d8 Merge remote-tracking branch 'upstream/dev' into json_split 2021-05-12 10:32:54 +08:00
wen-hemin
5079600c98
fix: field length (#5446) 
Co-authored-by: wen-hemin <wenhemin@apache.com>
 2021-05-12 10:15:01 +08:00
ruanwenjun
5556e47a85
[Feature][Plugin-Email] Numeric data type support in email attachment #5424 (#5426) 2021-05-11 20:53:27 +08:00
baoliang
7aa8b518ac Merge remote-tracking branch 'upstream/dev' into json_split 
# Conflicts:
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/MasterExecThread.java
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/utils/DependentExecute.java
 2021-05-11 13:55:27 +08:00
baoliang
2dd0d936fb Merge remote-tracking branch 'upstream/dev' into json_split 
# Conflicts:
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/MasterExecThread.java
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/utils/DependentExecute.java
 2021-05-11 11:45:40 +08:00
baoliang
156dadac69 Merge remote-tracking branch 'upstream/dev' into json_split 
# Conflicts:
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/MasterExecThread.java
#	dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/utils/DependentExecute.java
 2021-05-11 10:08:28 +08:00
ruanwenjun
fbef290cc5
[Bug][Service] All tasks that need to send attachment will fail due to chennel idle (#5442) 2021-05-11 03:03:52 +08:00
JinyLeeChina
515fa4912e
[Feature][JsonSplit] Fix ProcessService ut (#5435) 
* Fix ProcessService ut

* codeStyle

* Fix AlertPlugin ut

* Fix AlertPlugin ut

* Fix server module ut

* Fix server module ut

* Fix api ut

* codeStyle

Co-authored-by: JinyLeeChina <297062848@qq.com>
 2021-05-10 23:17:56 +08:00