Commit Graph

5077 Commits

Author SHA1 Message Date
JinyLeeChina
85f3ab43a5
[Feature][JsonSplit-api] define task api (#5647)
* processDefinition create/update

* fix codeStyle

* fix codeStyle

* fix ut

* api of project

* fix ut

* project update method

* define task api

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-06-17 10:57:30 +08:00
LOUKHNATI Mohamed Khalil
86ffc1f3f2
[Bug][WorkerServer] SqlTask NullPointerException (#5556)
* [Bug][WorkerServer] add null checks to sqlParamsMap and sqlParamsMap.get(i), Add test to verify it

* Change Test Name

* Fix Code style issues, Modify checking null for Sql params in sqlParamsMap with clearer logging.
2021-06-16 18:21:41 +08:00
kyoty
015ed7ffa6
[Bug Fix] Edit the note of existed datasource does't work. (#5642)
* Update DataSourceServiceImpl.java

* Update DataSourceServiceImpl.java
2021-06-16 17:29:17 +08:00
kyoty
0a5670f195
Fix the bug Edit User Info will always shows failed. (#5627)
* Update createUser.vue

* Update createUser.vue
2021-06-16 13:03:01 +08:00
kyoty
67711442d5
[Improvement][SQL] Query return number In SQL should be configurable (#5632)
* [Improvement][SQL] Query return number should be configurable #5580

* Update SqlTaskTest.java

* Update sql.vue
2021-06-16 09:40:21 +08:00
zhuangchong
e2d6265e26
[Improvement][registry-plugin] Optimize registry plugin loading and initial installation #5635 2021-06-15 20:51:52 +08:00
kyoty
9d70c7e534
Update ProcessDefinitionMapperTest.java (#5633) 2021-06-15 19:29:09 +08:00
kyoty
c5bea3c774
[Fix-5540][JSON Split] Fix some new tables and fields are missing in the sql upgrade script (#5611)
* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Create dolphinscheduler_ddl.sql

* Update dolphinscheduler_postgre.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Create dolphinscheduler_ddl.sql

* Update dolphinscheduler_mysql.sql

* Update dolphinscheduler_postgre.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_postgre.sql
2021-06-15 14:45:39 +08:00
JinyLeeChina
728bd31f73
[Feature][JsonSplit-api] api of project (#5630)
* processDefinition create/update

* fix codeStyle

* fix codeStyle

* fix ut

* api of project

* fix ut

* project update method

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-06-15 10:52:03 +08:00
kyoty
71a44f8a57 [Fix-5483] [Bug][API] Can't view variables in the page of Process Instance (#5631) 2021-06-15 10:30:26 +08:00
Shiwen Cheng
3fb01e1b4c [Fix-5596][Python] Fix conflict between python_home and datax_home configuration in dolphinscheduler_env.sh (#5612) 2021-06-15 10:30:26 +08:00
xingchun-chen
109e6543b9 modify issues translation robot (#5624)
* Add issue robot automatic reply and Translation


Co-authored-by: chenxingchun <438044805@qq.com>
2021-06-15 10:30:26 +08:00
Shiwen Cheng
43be965b34 [Improvement-5567][UI] Add project id in web ui url for sharing and project name in project page (#5568)
* [Improvement-5567][UI] Add project id in web ui url for sharing

* [Improvement-5577][UI] Add Project Name in Project Page
2021-06-15 10:30:26 +08:00
xingchun-chen
6e818032b9 modify issues translation robot (#5614)
* Add issue robot automatic reply and Translation
2021-06-15 10:30:26 +08:00
Shiwen Cheng
47812d2691 [Fix][Docker] Fix docker image build error (#5613) 2021-06-15 10:30:26 +08:00
blackberrier
053e548bf3 [Improvement-5539][Master] Check status of taskInstance from cache (#5572)
* improvement:check status of taskInstance from cache

* issue5572 use timer instead of while&sleep; consider concurrent modification

* use computeifpresent instead of lock

* simplify getByTaskInstanceId function

* add ut for TaskInstanceCacheManagerImpl; fix bug in TaskInstanceCacheManagerImpl

* add Apache license header;add test class in root pom
2021-06-15 10:30:26 +08:00
Kirs
30c88032d3 [Feature-#3961][Registry]Registry-SPI (#5562)
[Feature#3961]Registry SPI

All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD
The registry supports distributed locks.
todo: The specific information about the registration center of the API module needs to be adjusted.
2021-06-15 10:30:26 +08:00
leeli
006fb67439 [Fix-5583][sql] fix table name error in sql upgrade script (#5606)
* [DS-5583][fix] fix table ·name error in sql upgrade script

* [DS-5583][fix] fix table ·name error in sql upgrade script

Co-authored-by: lihongwei <lihongwei@ebchinatech.com>
2021-06-15 10:30:26 +08:00
Shiwen Cheng
d8f2aa3f20 [Fix-5468][Common] Fix obtaining IP is incorrect (#5594) 2021-06-15 10:30:26 +08:00
Chouc
3193837f5a [DS-5559][fix][Master Server] Master Server was shutdown but the process still in system (#5588)
* Close spring context to destory beans that has running thread
2021-06-15 10:30:26 +08:00
Shiwen Cheng
309deaefe8 [Fix-5581][SQL] Specific key was too long, max key length is 767 bytes for varchar(256) in some mysql with innodb_large_prefix=OFF (#5582) 2021-06-15 10:30:26 +08:00
kyoty
0d5037e7c3
[Fix-5483] [Bug][API] Can't view variables in the page of Process Instance (#5631) 2021-06-13 11:43:53 +08:00
Shiwen Cheng
8bf042ae6e
[Fix-5596][Python] Fix conflict between python_home and datax_home configuration in dolphinscheduler_env.sh (#5612) 2021-06-12 01:23:18 +08:00
xingchun-chen
b436ef0a2c
modify issues translation robot (#5624)
* Add issue robot automatic reply and Translation


Co-authored-by: chenxingchun <438044805@qq.com>
2021-06-11 11:22:42 +08:00
JinyLeeChina
a561a618af
[Feature][JsonSplit-api] api of processDefinition create/update (#5602)
* processDefinition create/update

* fix codeStyle

* fix codeStyle

* fix ut

Co-authored-by: JinyLeeChina <297062848@qq.com>
2021-06-11 09:43:05 +08:00
Shiwen Cheng
5d3b75a0a3
[Improvement-5567][UI] Add project id in web ui url for sharing and project name in project page (#5568)
* [Improvement-5567][UI] Add project id in web ui url for sharing

* [Improvement-5577][UI] Add Project Name in Project Page
2021-06-10 15:42:03 +08:00
xingchun-chen
d70fdf2a65
modify issues translation robot (#5614)
* Add issue robot automatic reply and Translation
2021-06-10 15:24:47 +08:00
Shiwen Cheng
0d303a804d
[Fix][Docker] Fix docker image build error (#5613) 2021-06-10 14:00:28 +08:00
blackberrier
79eb2e85d7
[Improvement-5539][Master] Check status of taskInstance from cache (#5572)
* improvement:check status of taskInstance from cache

* issue5572 use timer instead of while&sleep; consider concurrent modification

* use computeifpresent instead of lock

* simplify getByTaskInstanceId function

* add ut for TaskInstanceCacheManagerImpl; fix bug in TaskInstanceCacheManagerImpl

* add Apache license header;add test class in root pom
2021-06-10 09:39:12 +08:00
Kirs
e2243d63be
[Feature-#3961][Registry]Registry-SPI (#5562)
[Feature#3961]Registry SPI

All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD
The registry supports distributed locks.
todo: The specific information about the registration center of the API module needs to be adjusted.
2021-06-09 15:21:02 +08:00
leeli
697f37d2c2
[Fix-5583][sql] fix table name error in sql upgrade script (#5606)
* [DS-5583][fix] fix table ·name error in sql upgrade script

* [DS-5583][fix] fix table ·name error in sql upgrade script

Co-authored-by: lihongwei <lihongwei@ebchinatech.com>
2021-06-09 11:45:08 +08:00
Shiwen Cheng
281b5aea6b
[Fix-5468][Common] Fix obtaining IP is incorrect (#5594) 2021-06-07 22:12:49 +08:00
Chouc
75be09735a
[DS-5559][fix][Master Server] Master Server was shutdown but the process still in system (#5588)
* Close spring context to destory beans that has running thread
2021-06-04 13:27:18 +08:00
Shiwen Cheng
87604b7a3d
[Fix-5581][SQL] Specific key was too long, max key length is 767 bytes for varchar(256) in some mysql with innodb_large_prefix=OFF (#5582) 2021-06-04 09:55:42 +08:00
Squidyu
cc9e5d5d34
Add:Name verification remove the first and last spaces. (#5574)
Co-authored-by: Squid <2824638304@qq.com>
2021-06-02 12:01:01 +08:00
Shiwen Cheng
a5a0c7c5f8
[Fix-5570][Worker] Fix worker.groups in worker.properties is still commented and improve install scripts and configurations (#5571) 2021-06-02 11:21:01 +08:00
ruanwenjun
f8ecb536b7
[Improvement][Alert] server down will send repetitive message #5525 (#5529)
* [Improvement][Alert] server down will send repetitive message #5525

* add ut
2021-06-01 10:21:46 +08:00
geosmart
60af52fb2b
[Improvement][ApiDoc] fix-queue controller verifyQueue param (#5558)
Co-authored-by: wanggang <wanggy01@servyou.com.cn>
2021-05-31 21:07:21 +08:00
geosmart
56273319a2
[Bug][Master] remove check with executePath when kill yarn job (#5552)
* [Bug][Master] remove check with executePath when kill yarn job

* [Bug][Master] init execute path if not exist

* [Bug][Master] move createWorkDirIfAbsent out side of executePath calculate  part

Co-authored-by: wanggang <wanggy01@servyou.com.cn>
2021-05-29 12:14:46 +08:00
ruanwenjun
842c5400e6
[Improvement][Server] Must restart master if Zk reconnect (#5210) (#5211) 2021-05-25 05:03:29 +08:00
ruanwenjun
9d0c816cee
[Bug][worker] task throw ConcurrentModifiedException #5528 (#5530)
* [Bug][worker] task throw ConcurrentModifiedException #5528

* fix code smell
2021-05-25 04:53:56 +08:00
Shiwen Cheng
b537f4eb26
[Improvement][Docker/K8s] Support more configurations and service accesses, reduce the duplication configurations, improve image for python and the compatibility of python home (#5393)
* [Improvement][Docker] Support more configurations and improve image for python

* [Improvement][K8s] Support more configurations, more service accesses, and reduce the duplication configurations

* [Improvement][Python] Improve the compatibility of python home

* [Improvement][Install] Fix install config and install.sh

* [Improvement][Install] Fix workflow ut

* [Improvement][Docker] Optimize docker-swarm/check script

* [Improvement][DB] Update default username and password of database

* Update comments in master/worker.properties

* Specify version for all images

* [Improvement][Docker] Optimize PS1 and WORKDIR

* [Improvement][SQL] Reduce heap size to 64m in create-dolphinscheduler.sh and upgrade-dolphinscheduler.sh

* [Fix-5431][K8s] Fix master and worker cannot get the right address with custom DNS
2021-05-24 00:03:35 +08:00
zhuangchong
9ba4ffbe48
[Improvement-5527][api-server] failed find any kerberos (#5533)
* fix failed find any kerberos.

* increase code coverage.

* update common utils test.

* update common utils test.

* update common utils test.

* fix exception type.
2021-05-23 23:43:59 +08:00
QuakeWang
46660b58ed
[Test] Add SparkParameters test (#5478)
* Create SparkparametersTest.java

Add a test case

* Update and rename SparkparametersTest.java to SparkParametersTest.java

* Update pom.xml

add SparkParametersTest.java in pom file
2021-05-22 23:56:39 +08:00
zhuangchong
802f4af159
fix dist packaging lacks alert jar. (#5536) 2021-05-22 23:02:55 +08:00
Kirs
8a1d849701
[ut]ignore plugin ut (#5532) 2021-05-21 10:36:08 +08:00
Shuyang Wu
d9f7d1f63e
feat: add contributor over time graph to README (#5531) 2021-05-21 10:24:55 +08:00
zhuangchong
1b7dcea610
[Improvement-5440][Maven] Project module maven dependency optimization (#5441)
* Optimize dependencies between modules.

* update module-alert dependency.

* add repository in the pom xml.

* update Central Repository in the pom.xml.
2021-05-19 10:05:00 +08:00
Yao WANG
bc22ae7c91
[Improvement][Task] Remove deprecated TaskRecordDao and simply the after() method in the AbstractTask class (#5492)
* remove the depreated data quality module

* fix lint

Co-authored-by: Yao <ywang46@paypal.com>
2021-05-18 17:00:03 +08:00
ruanwenjun
018f5c89f6
fix sql symbol error (#5462) 2021-05-18 10:20:18 +08:00