Commit Graph

5024 Commits

Author SHA1 Message Date
xingchun-chen
8ebd6469e6
update submodule translate-on-issue (#5677)
* Add issue robot automatic reply and Translation

Co-authored-by: chenxingchun <438044805@qq.com>
2021-06-22 15:12:41 +08:00
kyoty
60f93d16eb
update maven repository url (#5674) 2021-06-22 14:03:04 +08:00
kyoty
d64e3cb658
add the pageSize parameter (#5663) 2021-06-22 10:28:54 +08:00
kyoty
e628e4e8fd
[Improvement][API] Simplify the Check of Result by introducing several new methods. (#5666) 2021-06-22 01:47:24 +08:00
kyoty
e2eed1f24f
[Improvement] Fix a potential problem when editing an existing mysql data source 2021-06-21 18:52:25 +08:00
YulongZ
f7e551282a
docker-compose wrong env (#5664)
* docker-compose wrong env
2021-06-21 11:51:49 +08:00
myangle1120
a7682143ac
[Feature-#5565][UI] Global Param passed by sense dependencies (#5628)
* modify-globalParams

* del comment

Co-authored-by: liangfengjie <liangfengjie@hetao101.com>
2021-06-18 19:19:07 +08:00
kyoty
75813e7866
[bug fix] Some password attributes can be viewd directly in the log (#5638)
* fix the password display incorrectly

* update

* update

* fic code style

fic code style

* Update SensitiveDataConverterTest.java

* Update SensitiveDataConverter.java

* Update SensitiveDataConverter.java

* Update SensitiveDataConverterTest.java

* Update pom.xml
2021-06-18 19:10:57 +08:00
zhuangchong
b21e821845
fix PSQLException: ERROR: operator does not exist. (#5654) 2021-06-17 21:23:39 +08:00
justoy
0d7c32a1e8
Update TaskInstanceCacheManagerImpl.java (#5656) 2021-06-17 18:45:34 +08:00
zhuangchong
3026f04d85
[Improvement-5452][Task] ds flink task support submit a PyFlink job via the CLI (#5453)
* flink task support submit a PyFlink job via the CLI.

* optimize attribute name.

* Modify pyflink parameter judgment logic
2021-06-17 15:19:25 +08:00
kyoty
b05957db41
[Improvement] The newly introduced spi pugin support work in windows os
The newly introduced spi can't work in windows os.
2021-06-17 14:54:55 +08:00
LOUKHNATI Mohamed Khalil
86ffc1f3f2
[Bug][WorkerServer] SqlTask NullPointerException (#5556)
* [Bug][WorkerServer] add null checks to sqlParamsMap and sqlParamsMap.get(i), Add test to verify it

* Change Test Name

* Fix Code style issues, Modify checking null for Sql params in sqlParamsMap with clearer logging.
2021-06-16 18:21:41 +08:00
kyoty
015ed7ffa6
[Bug Fix] Edit the note of existed datasource does't work. (#5642)
* Update DataSourceServiceImpl.java

* Update DataSourceServiceImpl.java
2021-06-16 17:29:17 +08:00
kyoty
0a5670f195
Fix the bug Edit User Info will always shows failed. (#5627)
* Update createUser.vue

* Update createUser.vue
2021-06-16 13:03:01 +08:00
kyoty
67711442d5
[Improvement][SQL] Query return number In SQL should be configurable (#5632)
* [Improvement][SQL] Query return number should be configurable #5580

* Update SqlTaskTest.java

* Update sql.vue
2021-06-16 09:40:21 +08:00
zhuangchong
e2d6265e26
[Improvement][registry-plugin] Optimize registry plugin loading and initial installation #5635 2021-06-15 20:51:52 +08:00
kyoty
9d70c7e534
Update ProcessDefinitionMapperTest.java (#5633) 2021-06-15 19:29:09 +08:00
kyoty
c5bea3c774
[Fix-5540][JSON Split] Fix some new tables and fields are missing in the sql upgrade script (#5611)
* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Create dolphinscheduler_ddl.sql

* Update dolphinscheduler_postgre.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Create dolphinscheduler_ddl.sql

* Update dolphinscheduler_mysql.sql

* Update dolphinscheduler_postgre.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_ddl.sql

* Update dolphinscheduler_postgre.sql
2021-06-15 14:45:39 +08:00
kyoty
0d5037e7c3
[Fix-5483] [Bug][API] Can't view variables in the page of Process Instance (#5631) 2021-06-13 11:43:53 +08:00
Shiwen Cheng
8bf042ae6e
[Fix-5596][Python] Fix conflict between python_home and datax_home configuration in dolphinscheduler_env.sh (#5612) 2021-06-12 01:23:18 +08:00
xingchun-chen
b436ef0a2c
modify issues translation robot (#5624)
* Add issue robot automatic reply and Translation


Co-authored-by: chenxingchun <438044805@qq.com>
2021-06-11 11:22:42 +08:00
Shiwen Cheng
5d3b75a0a3
[Improvement-5567][UI] Add project id in web ui url for sharing and project name in project page (#5568)
* [Improvement-5567][UI] Add project id in web ui url for sharing

* [Improvement-5577][UI] Add Project Name in Project Page
2021-06-10 15:42:03 +08:00
xingchun-chen
d70fdf2a65
modify issues translation robot (#5614)
* Add issue robot automatic reply and Translation
2021-06-10 15:24:47 +08:00
Shiwen Cheng
0d303a804d
[Fix][Docker] Fix docker image build error (#5613) 2021-06-10 14:00:28 +08:00
blackberrier
79eb2e85d7
[Improvement-5539][Master] Check status of taskInstance from cache (#5572)
* improvement:check status of taskInstance from cache

* issue5572 use timer instead of while&sleep; consider concurrent modification

* use computeifpresent instead of lock

* simplify getByTaskInstanceId function

* add ut for TaskInstanceCacheManagerImpl; fix bug in TaskInstanceCacheManagerImpl

* add Apache license header;add test class in root pom
2021-06-10 09:39:12 +08:00
Kirs
e2243d63be
[Feature-#3961][Registry]Registry-SPI (#5562)
[Feature#3961]Registry SPI

All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD
The registry supports distributed locks.
todo: The specific information about the registration center of the API module needs to be adjusted.
2021-06-09 15:21:02 +08:00
leeli
697f37d2c2
[Fix-5583][sql] fix table name error in sql upgrade script (#5606)
* [DS-5583][fix] fix table ·name error in sql upgrade script

* [DS-5583][fix] fix table ·name error in sql upgrade script

Co-authored-by: lihongwei <lihongwei@ebchinatech.com>
2021-06-09 11:45:08 +08:00
Shiwen Cheng
281b5aea6b
[Fix-5468][Common] Fix obtaining IP is incorrect (#5594) 2021-06-07 22:12:49 +08:00
Chouc
75be09735a
[DS-5559][fix][Master Server] Master Server was shutdown but the process still in system (#5588)
* Close spring context to destory beans that has running thread
2021-06-04 13:27:18 +08:00
Shiwen Cheng
87604b7a3d
[Fix-5581][SQL] Specific key was too long, max key length is 767 bytes for varchar(256) in some mysql with innodb_large_prefix=OFF (#5582) 2021-06-04 09:55:42 +08:00
Squidyu
cc9e5d5d34
Add:Name verification remove the first and last spaces. (#5574)
Co-authored-by: Squid <2824638304@qq.com>
2021-06-02 12:01:01 +08:00
Shiwen Cheng
a5a0c7c5f8
[Fix-5570][Worker] Fix worker.groups in worker.properties is still commented and improve install scripts and configurations (#5571) 2021-06-02 11:21:01 +08:00
ruanwenjun
f8ecb536b7
[Improvement][Alert] server down will send repetitive message #5525 (#5529)
* [Improvement][Alert] server down will send repetitive message #5525

* add ut
2021-06-01 10:21:46 +08:00
geosmart
60af52fb2b
[Improvement][ApiDoc] fix-queue controller verifyQueue param (#5558)
Co-authored-by: wanggang <wanggy01@servyou.com.cn>
2021-05-31 21:07:21 +08:00
geosmart
56273319a2
[Bug][Master] remove check with executePath when kill yarn job (#5552)
* [Bug][Master] remove check with executePath when kill yarn job

* [Bug][Master] init execute path if not exist

* [Bug][Master] move createWorkDirIfAbsent out side of executePath calculate  part

Co-authored-by: wanggang <wanggy01@servyou.com.cn>
2021-05-29 12:14:46 +08:00
ruanwenjun
842c5400e6
[Improvement][Server] Must restart master if Zk reconnect (#5210) (#5211) 2021-05-25 05:03:29 +08:00
ruanwenjun
9d0c816cee
[Bug][worker] task throw ConcurrentModifiedException #5528 (#5530)
* [Bug][worker] task throw ConcurrentModifiedException #5528

* fix code smell
2021-05-25 04:53:56 +08:00
Shiwen Cheng
b537f4eb26
[Improvement][Docker/K8s] Support more configurations and service accesses, reduce the duplication configurations, improve image for python and the compatibility of python home (#5393)
* [Improvement][Docker] Support more configurations and improve image for python

* [Improvement][K8s] Support more configurations, more service accesses, and reduce the duplication configurations

* [Improvement][Python] Improve the compatibility of python home

* [Improvement][Install] Fix install config and install.sh

* [Improvement][Install] Fix workflow ut

* [Improvement][Docker] Optimize docker-swarm/check script

* [Improvement][DB] Update default username and password of database

* Update comments in master/worker.properties

* Specify version for all images

* [Improvement][Docker] Optimize PS1 and WORKDIR

* [Improvement][SQL] Reduce heap size to 64m in create-dolphinscheduler.sh and upgrade-dolphinscheduler.sh

* [Fix-5431][K8s] Fix master and worker cannot get the right address with custom DNS
2021-05-24 00:03:35 +08:00
zhuangchong
9ba4ffbe48
[Improvement-5527][api-server] failed find any kerberos (#5533)
* fix failed find any kerberos.

* increase code coverage.

* update common utils test.

* update common utils test.

* update common utils test.

* fix exception type.
2021-05-23 23:43:59 +08:00
QuakeWang
46660b58ed
[Test] Add SparkParameters test (#5478)
* Create SparkparametersTest.java

Add a test case

* Update and rename SparkparametersTest.java to SparkParametersTest.java

* Update pom.xml

add SparkParametersTest.java in pom file
2021-05-22 23:56:39 +08:00
zhuangchong
802f4af159
fix dist packaging lacks alert jar. (#5536) 2021-05-22 23:02:55 +08:00
Kirs
8a1d849701
[ut]ignore plugin ut (#5532) 2021-05-21 10:36:08 +08:00
Shuyang Wu
d9f7d1f63e
feat: add contributor over time graph to README (#5531) 2021-05-21 10:24:55 +08:00
zhuangchong
1b7dcea610
[Improvement-5440][Maven] Project module maven dependency optimization (#5441)
* Optimize dependencies between modules.

* update module-alert dependency.

* add repository in the pom xml.

* update Central Repository in the pom.xml.
2021-05-19 10:05:00 +08:00
Yao WANG
bc22ae7c91
[Improvement][Task] Remove deprecated TaskRecordDao and simply the after() method in the AbstractTask class (#5492)
* remove the depreated data quality module

* fix lint

Co-authored-by: Yao <ywang46@paypal.com>
2021-05-18 17:00:03 +08:00
ruanwenjun
018f5c89f6
fix sql symbol error (#5462) 2021-05-18 10:20:18 +08:00
ruanwenjun
a925f64571
[Feature][api] schedule add timezone support #5259 (#5465)
* [Feature][api] schedule add timezone support #5259

* import moment-timezone

* fix code smell
2021-05-17 21:08:20 +08:00
ruanwenjun
68301db6b9
[Improvement][Api] Upload resource to remote failed, the local tmp file need to be cleared #5475 (#5476) 2021-05-17 11:13:14 +08:00
lcdrs
d04f4b6053
[Implement][Common] Modify the plug-in loading log to print messages
Co-authored-by: caoping <caoping@staff.weibo.com>
2021-05-13 16:26:21 +08:00