Commit Graph

4487 Commits

Author SHA1 Message Date
wuxiaofei
f2e41c298f [Checkstyle][TaskPriorityQueueConsumer]import check 2021-02-22 01:16:07 +08:00
wuxiaofei
b352c52f33 [Improvement][master] Replace sleep&task with poll in TaskPriorityQueueConsumer#4137 2021-02-21 23:47:48 +08:00
wuxiaofei
11c22ccbca Merge branch 'dev' of https://github.com/apache/incubator-dolphinscheduler into dev_wuxiaofei_server 2021-02-21 22:36:48 +08:00
zhuangchong
4aac23481e
[Fix-4757][worker] fix worker failover host error (#4799)
* resolve code conflicts

* resolve code conflicts

* resolve code conflicts

* update WorkerGroupServiceImpl code style.

* update worker group service test host data.

* add ZookeeperNodeHandlerTest class

* change WorkerZkNode to Host class.

* add generate host string method.
2021-02-21 00:34:23 +08:00
Shiwen Cheng
8879d8ff60
[Improvement][*] Define version with revision globally and update version to 1.3.6-SNAPSHOT (#4773)
* [Improvement][*] Update version to 1.4.0-SNAPSHOT

* [Improvement][*] Update tab to space under checkstyle

* [Improvement][*] Define version with revision globally

* [Improvement][*] Update version to 1.3.6-SNAPSHOT
2021-02-20 14:22:49 +08:00
zhuangchong
a4de385a21
the alert instance page displays the name of the alert plug-in. (#4815) 2021-02-20 09:32:49 +08:00
Shiwen Cheng
fdf719c1e9
[Fix-4796][UI] Fix child file upload failure and file id mixed problem (#4797) 2021-02-20 08:43:12 +08:00
zhuangchong
4c8f06002f
fix api swagger params error. (#4818) 2021-02-20 08:16:24 +08:00
felix.wang
3110f023af
[BUG][API]Fix format2Duration when parameter has one is null (#4802)
* fix format2Duration when parameter has one is null
2021-02-19 23:18:11 +08:00
dddyszy
ce007813fb
[Improvement][Api] add @Override on the Override method (#4808)
Co-authored-by: 施洲轶 <shizhy@yoozoo.com>
2021-02-19 18:15:43 +08:00
Shiwen Cheng
61397b338a
[Improvement][api] Introduce base service interface for clear code and unify all controllers, services and tests of api (#4798)
* [Improvement][api] Introduce base service interface for clear code

* [Improvement][api] Unify all controllers, services and tests of api

* [Fix][api] Fix unit tests left over from the past

* [Improvement][api] Use RegexUtils.escapeNRT instead of StringUtils.replaceNRTtoUnderline for vulnerable check
2021-02-19 11:52:42 +08:00
zhuangchong
68de43ad27
[Fix-4776][Alert] Alert instance edit page partial parameter values are not displayed (#4782)
* generate warning instance plugin params.

* update PluginParamsTransfer.generatePluginParams method.

* update code style in the AlertPluginInstanceServiceImpl class.

* JSONUtils rollback.

* rerun e2e test.

* update alert channel generate params.

* update email alert channel test class.

* update json utils parse object method.

* update the data structure of the alarm script plug-in script type parameter to String.
2021-02-19 09:50:47 +08:00
Shiwen Cheng
15a5b05883
[Improvement-3369][api] Introduce executor and datasource service interface for clear code (#4759) 2021-02-18 23:27:37 +08:00
Shiwen Cheng
9ae29a756f
[Improvement-3369][api] Introduce resources, scheduler and taskinstance service interface for clear code (#4766)
* [Improvement-3369][api] Introduce resources, scheduler and taskinstance service interface for clear code
2021-02-18 23:17:01 +08:00
wuxiaofei
8ec345c35b [Improvement][TaskExecuteProcessor]Delete redundant code in method of setTaskCache 2021-02-18 20:48:09 +08:00
Shiwen Cheng
dc55b5ba6f
[Improvement-3369][api] Introduce monitor, processinstance and queue service interface for clear code (#4765)
* [Improvement-3369][api] Introduce monitor, processinstance and queue service interface for clear code
2021-02-18 19:27:13 +08:00
Shiwen Cheng
070424fc78
[Improvement-3369][api] Introduce taskrecord, udffunc, workflowlineage and workergroup service interface for clear code (#4768)
* [Improvement-3369][api] Introduce taskrecord, udffunc, workflowlineage and workergroup service interface for clear code
2021-02-18 19:18:05 +08:00
yimaixinchen
938621ab34
initStateLister rename to initStateListener (#4795)
Co-authored-by: v_taoouyang <v_taoouyang@tencent.com>
2021-02-18 18:48:09 +08:00
Shiwen Cheng
a53195fa15
[Improvement-3369][api] Introduce alert group and users service interface for clear code (#4758) 2021-02-18 15:05:49 +08:00
zhuangchong
36d7a4fea0
Implement workflow definition page button unelectable state to add button prompt (#4762) 2021-02-18 11:52:41 +08:00
Shiwen Cheng
d4fd9811f8
[Fix-4734][UI] Fix file update dialog not reset after re-open the dialog (#4735) 2021-02-18 11:51:55 +08:00
zhuangchong
5e193cf414
[Fix-4674][UI] create warning instance and click Submit , without validate the required parameters (#4767)
* fix wareningInstance create instance validate parameter.

* rerun e2e test.
2021-02-18 11:46:50 +08:00
Shiwen Cheng
8ebddc1f5b
[Fix-3298][K8s] Fix wrong host of task instance in k8s (#4786) 2021-02-18 11:41:58 +08:00
wuxiaofei
91e563daeb Merge branch 'dev' of https://github.com/apache/incubator-dolphinscheduler into dev 2021-02-18 10:22:11 +08:00
zhuangchong
23591b71a2
[Improvement-4751][API] Improvement the duration field modify the display to a time-based minute-second format (e.g. 1d 10h 20m 1s) (#4752)
* imp ui instance duration field display content.

* update DateUtils format2Duration method.
2021-02-18 10:08:23 +08:00
Shiwen Cheng
d41dd10a16
[Fix][CI] Fix error: unable to resolve action apache/skywalking-eyes@9bd5feb (#4784) 2021-02-17 11:48:47 +08:00
zhuangchong
18e4087c7e
[Improvement][JSONUtils] Improvement JSONUtils parse object method (#4781)
* Improvement JSONUtils parse object method.

* update JSONUtils toMap method.

* rerun ut test.
2021-02-16 20:22:01 +08:00
zhuangchong
5025b5015f
Repair dolphinscheduler-mysql.sql error sql. (#4780) 2021-02-16 10:19:27 +08:00
Shiwen Cheng
fef1a7ef21
[Fix-4760][api] Repair dolphinscheduler-postgre.sql error sql (#4774) 2021-02-15 23:38:42 +08:00
Shiwen Cheng
5f40fce1f5
[Improvement][UI] Improve long host display in K8s (#4756) 2021-02-14 21:37:25 +08:00
Shiwen Cheng
93514ddf31
[Improvement][K8s] Improve K8s for helm (#4746) 2021-02-14 21:35:23 +08:00
Shiwen Cheng
53598fdd18
[Fix-3298][K8s] Fix task log disappear after recreating or upgrading helm release (#4755)
* [Improvement][K8s] Alter column host varchar(15) to varchar(135) for long host

* [Improvement][K8s] Improve getHost and getAddr in NetUtils

* [Improvement][K8s] Replace getHost with getAddr
2021-02-14 21:33:45 +08:00
Shiwen Cheng
a6ea04d4a3
[Fix-4741][UI] Fix task instance log not change (#4744) 2021-02-14 21:31:41 +08:00
Shiwen Cheng
60016fbd66
[Improvement-4740][UI] Set the default Tenant as default or the first exist tenant in save process (#4742) 2021-02-14 21:28:02 +08:00
Shiwen Cheng
cbada7c16d
[Improvement][Docker] Reduce docker image size, remove frontend/nginx, remove stdout log, improve compose/swarm deployment and fix random PSQLException (#4643)
* [Improvement][Docker] Reduce docker image size, remove frontend/nginx, remove stdout log and improve compose/swarm deployment

* [Improvement][Docker] Fix random PSQLException
2021-02-14 17:42:04 +08:00
guohaozhang
7a6b905597
[Fix-#4716][mater,worker] The task execution path should be calculated by the worker, not the master (#4717)
* [fix][api,mater,worker] 修复master 计算实际执行路径,worker上报实际执行路径

* remove unused import
2021-02-12 18:50:38 +08:00
yankexi
c1efbf3080
[Fix-4760][api][Repair dolphinscheduler-postgre.sql error sql] (#4763)
* Repair error sql about dolphinscheduler-postgre.sql

* Repair error sql about dolphinscheduler-postgre.sql

* Repair error sql about dolphinscheduler-postgre.sql

(cherry picked from commit 739a633)

* [Fix-4760][api][Repair dolphinscheduler-postgre.sql error sql]
2021-02-12 18:40:30 +08:00
Shiwen Cheng
0c26e10f3f
[Fix-4738][Mail] Fix send mail failed instead of execute sql error (#4739) 2021-02-11 09:54:07 +08:00
Kirs
c9972936d6
[SPI][License]Add missing license (#4749) 2021-02-09 19:48:54 +08:00
Zhenxu Ke
725e386af4
chore: fix license checker to allow nested directories (#4748)
* chore: fix license checker to allow nested directories

* chore: fix license checker to allow nested directories
2021-02-09 13:41:51 +08:00
zhuangchong
5d89bb0f5a
[Improvement][alert] Improvement alert plugin dist. (#4731)
* imp dev alert plugin dist.

* update xml code style.

* update xml code style.
2021-02-08 23:13:27 +08:00
Alleria Windrunner
03ac3b42b2
Fix(UI):Fix tips error when login with username and without password. (#4728)
Replace isUserPassword to isUserName on the label that userNameText error tip.
2021-02-08 13:12:08 +08:00
zapjone
743975cc5f
[Fix-4727]Update worker.properties misspell error #4730
modify work.weight to worker.weight
2021-02-08 12:49:43 +08:00
felix.wang
aa07b081b4
[fix][Alert-plugin ]Fixed SQLTask content, JSON Formate exceptions. (#4724)
* Fixed SQLTask content, JSON Formate exceptions.

* add ut

* add ut

* fix code smell
2021-02-07 23:52:51 +08:00
zhuangchong
a5443f1173
[fix-4128][worker] Dolphin executes the command using sudo to specify the -u parameter (#4217)
* update sudo cmd.

* update sudo cmd.

* update OSUtils code style.

* add OSUtils test method.
2021-02-06 22:20:25 +08:00
zhuangchong
7c07900ea6
[Improvement][install] alert-server properties make adjustments in the Install script (#4709)
* imp alert-server alert.properties install config.

* add alert plugin dir param in the install_config.conf
2021-02-06 22:12:35 +08:00
zhuangchong
03a2c6b7b7
[Improvement-4450][datasource] Hive/Spark data sources do not support multi-tenancy when Kerberos authentication is enabled (#4593)
* hive/spark jdbc add kerberos paramter.

* update datasource vue paramter placeholder.

* update code style.

* add datasource ApiImplicitParam in the kerberos paramter.

* update constants class code style.

* add code test and code style.

* update BaseDataSourceTest code style.

* update BaseDataSourceTest class code style.

* update DataSourceController class code style.

* update DataSourceController ApiImplicitParam

* update ui create data source vue.
2021-02-06 16:57:59 +08:00
Shiwen Cheng
773909efe2
[Improvement][Common] Add more resource suffix (#4683) 2021-02-05 22:17:51 +08:00
Yibo-Liu
369ff6fd03
first PR (#4699) 2021-02-05 21:47:10 +08:00
Shiwen Cheng
03c7e1f368
[Fix][UDF] Fix udf jar path not exist when fs.defaultFS starts with file:/// (#4692) 2021-02-05 14:09:02 +08:00