Commit Graph

4093 Commits

Author SHA1 Message Date
Tq
2486451221
remove AbstractTask.getCurTaskParamsClass()and replace with TaskParametersUtils.getParameters() (#4262)
* remove getCurTaskParamsClass() in AbstractTask.java and replace it with TaskParametersUtils.getParameters()

* remove unused imports in AbstractTask.java

* reformat
2020-12-20 21:52:52 +08:00
zhuangchong
3bcd3fbcd3
[Improvement-4069][server] When the tenant does not exist, the task execution should throw an exception (#4108)
* when  the tenant does not exist, the task execution should throw an exception

* remote method createWorkDirAndUserIfAbsent

* set the task status failed when the tenant code does not exist.

* add taskLog.

* update check os user exists

* update TaskExecuteThreadTest test method.

* solving sonar fail.
2020-12-20 21:17:39 +08:00
dailidong
64dd9dbb53
update bug template (#4260) 2020-12-18 18:41:04 +08:00
lgcareer
9fe5c3717d
[Fix-4222][Master]Add the priority queue to ensure that tasks are submitted according to priority. (#4250)
* [Fix-4222][Master]Add the priority queue to ensure that tasks are submitted according to priority.

* [Fix-4222][Master]Add the priority queue to ensure that tasks are submitted according to priority.

* [Fix-4222][Master]Remove useless import

* [Fix-4222][Master]Reformat code style

* [Fix-4222][Master]Reformat code style

* [Fix-4222][Master]Reformat code style

* [Fix-4222][Master]add PeerTaskInstancePriorityQueueTest

* [Fix-4222][Master]Fix code smell

* [Fix-4222][Master]Reformat code style

* [Fix-4222][Master]Fix code smell

Co-authored-by: xingchun-chen <55787491+xingchun-chen@users.noreply.github.com>
2020-12-18 17:28:37 +08:00
felix.wang
3f7759ef64
[FIX][UI ] security user state tenantCode User Type Display abnormal (#4255)
* fix user state error

* fix userType  error

* fix tenantCode  error
2020-12-17 17:39:47 +08:00
Shiwen Cheng
6f72deff57
[Improvement][UI] Add no-var rule for eslint and add 'npm run lint:fix' command (#4225)
Add no-var rule for eslint, and fix related files
Add npm run lint:fix command, which distinguished from the default command npm run lint
The behavior of command npm run lint and command npm run lint:fix should be distinguished
The first command is used to lint only, and the second one is used to lint and fix problems automatically
2020-12-17 09:52:30 +08:00
Shiwen Cheng
f2a996f2a2
[Fix][UI]: fix re-login problem in new tab and state synchronization problem in multiple tabs (#4162)
* fix(ui): re-login problem in new tab

* refresh page in new tab automatically

* support to reload router view in lightweight

* optimize visibility code
2020-12-17 09:38:57 +08:00
Kirs
d7b3936205
[FIX-3177]Task time parameter parsing error (#4228)
* [FIX-3177]Task time parameter parsing error
when system.datetime !=null $[datetime] = system.datetime
else $[datetime] = current time

* remove unused import
2020-12-15 16:24:31 +08:00
felix.wang
8f2369214b
fix sql error (#4227) 2020-12-15 15:10:59 +08:00
Kirs
8919e3838f
[FIX-#3177]Task time parameter parsing error (#4224)
* [FIX-#3177]Task time parameter parsing error

rerun schedule time error

this closes #3177

* [FIX-#3177]Task time parameter parsing error

rerun schedule time error

this closes #3177
2020-12-15 10:30:36 +08:00
xingchun-chen
95d320d7da
Merge pull request #4214 from chengshiwen/ui-eslint
[Improvement][UI] UI eslint support for better code quality and fewer bugs
2020-12-14 09:42:17 +08:00
Saksham Gupta
426eb9af03
deleted invalid code as assigned in issue 4215 (#4221)
deleted the code at following two places:
org.apache.dolphinscheduler.service.process.ProcessService#checkTaskExistsInTaskQueue
org.apache.dolphinscheduler.service.process.ProcessService#taskZkInfo
2020-12-13 23:05:27 +08:00
bao liang
b694474c78
fix bug: start from the setting nodes with NODE_PRE would be NPE. (#4219) 2020-12-13 12:17:43 +08:00
chengshiwen
d06c9f8ad6 fix eslint: unexpected mutation of prop 2020-12-12 11:13:22 +08:00
chengshiwen
cac35888e2 fix eslint: component has been registered but not used 2020-12-12 00:32:50 +08:00
chengshiwen
ffcf66c57e fix eslint: assigned a value but never used 2020-12-12 00:20:12 +08:00
chengshiwen
9234e46b22 fix eslint: Unexpected side effect in 'cacheParams' computed property 2020-12-12 00:08:47 +08:00
chengshiwen
e7501f75e3 fix eslint: expected '!==' but instead saw '!=', expected '===' but instead saw '==' 2020-12-12 00:01:35 +08:00
chengshiwen
cfcae24958 fix eslint: fatal syntax errors 2020-12-11 23:56:22 +08:00
chengshiwen
5334703593 fix eslint: fix syntax by npm run lint automatically 2020-12-11 23:20:08 +08:00
chengshiwen
d754bca766 update .eslintrc.yml and license check exclude .eslintignore 2020-12-11 23:16:55 +08:00
chengshiwen
51780cc749 support auto eslint for .js, .vue file on save 2020-12-11 23:12:34 +08:00
break60
e033f81e9d
[Feature-3878]Replace the page with element-ui (#4065)
* [Feature-3878]Introduce elment-ui and replace the security center module page with elment-ui

* Change node version

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* Replace the page with element-ui

* Replace user management with elment-ui

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* Repair the last Sunday of each month
2020-12-11 22:58:28 +08:00
Kirs
a13e737eb4
[FIX-#4172][server-worker] kill task NPE (#4182)
* [FIX-#4172][server-worker] kill task NPE

The cache task will be sent when the Process is generated. Before that, if a kill task appears, then NPE will appear
Modification method: write into the cache when the task is received, and mark it as preData
If the task is killed before the Process is generated, delete the cache directly at this time
It will be judged before the process is generated. If the task has been killed, it will not be executed.
After the new process is created, write it into the cache, and judge again, if kill, then kill the process.

this closes #4172

* Delete the commented out code
Add spring beans

* code smell

* add test

* add test

* fix error

* test

* test

* revert

* fix error
2020-12-11 15:41:35 +08:00
BoYiZhang
b3120a74d2
[Feature-4138][Master] dispatch workgroup error add sleep time (#4139)
* When there are tasks with assignment failure and the number of tasks in the current task queue is less than 10, sleep for 1 second

* When there are tasks with assignment failure and the number of tasks in the current task queue is less than 10, sleep for 1 second

* fix code smell & code style

* fix code smell & code style

Co-authored-by: zhanglong <zhanglong@ysstech.com>
2020-12-11 15:35:40 +08:00
Kirs
0039b1bfcb
[common]del windows file( not support windows ) (#4204)
* del support win

* del support win
2020-12-10 22:39:20 +08:00
Shiwen Cheng
cbc30b4900
[Fix-3457][flink] fix flink args build problem (#4166)
* [Fix][Flink] fix flink args build problem

* [Fix][Flink] fix FlinkArgsUtilsTest

* [Improvement][UI] hide version and cluster input when deployMode is local
2020-12-10 22:37:21 +08:00
bao liang
68541f281d
[FIX-4190][DAO] When the amount of json data is large, the process list page display slowly. (#4201)
* fix 4190: When the amount of json data is large, process list page display slowly

* fix 4190: When the amount of json data is large, process list page display slowly

* fix 4190: When the amount of json data is large, process list page display slowly

Co-authored-by: baoliang <baoliang@analysys.com.cn>
2020-12-10 17:46:15 +08:00
chengp
e5462741c2
fix bug #4125 (#4127)
* fix bug #4125

* code style!

* code style.

Co-authored-by: chengp <chengp@chengp.net>
2020-12-10 14:20:38 +08:00
Kirs
aa19a06abb
[FIX-PR-4097][server-master]task ack miss (#4189)
When the message of successful execution arrives earlier than
the message of ack,
the message of ack will be discarded,
resulting in some information missing
2020-12-10 10:57:12 +08:00
dailidong
9798123f47
Merge pull request #4186 from wangxj3/dev
[FIX-#4184][server-api] load TaskInstance slow
2020-12-09 16:43:48 +08:00
wangxj3
96c7a8c7e9
Update TaskInstanceMapper.xml
optimize page of [TaskInstance] load data slow
2020-12-09 11:29:38 +08:00
dailidong
966600cc37
Merge pull request #4150 from kevinsun2010/dev
[Fix-4143][jar upgrade]upgrade quartz version to 2.3.0
2020-12-06 13:44:18 +08:00
dailidong
99e516baf9
Update known-dependencies.txt 2020-12-06 13:19:49 +08:00
dailidong
d706c010be
Delete LICENSE-HikariCP-java6.txt 2020-12-06 13:19:05 +08:00
dailidong
588b8f3990
Update LICENSE
not need to add HikariCP-java6
2020-12-06 13:18:19 +08:00
dailidong
7778e97ac7
Update pom.xml 2020-12-05 23:38:43 +08:00
dailidong
99daada5fa
Update pom.xml 2020-12-05 23:34:47 +08:00
karlsun
7d3aa09cc4 update code style 2020-12-05 13:04:29 +08:00
karlsun
6a6efe5d9b update Check code style 2020-12-05 09:54:11 +08:00
karlsun
81f4b5a25f remove c3p0,mchange-commons-java license 2020-12-05 09:41:39 +08:00
karlsun
1a854f8056 upgrade jackson version to 2.9.10 2020-12-03 15:25:49 +08:00
karlsun
a522da068f add HikariCP-java6,c3p0,mchange-commons-java license 2020-12-03 14:05:55 +08:00
dailidong
62c2e85252
Merge pull request #4110 from chengshiwen/dev
[Improvement][UI] download url resolve and security page disappear delay problem under GENERAL_USER
2020-12-03 11:41:23 +08:00
karlsun
c5084a367a upgrade quartz version to 2.3.0 2020-12-03 10:18:11 +08:00
Yelli
aa0974fd1f
split sqoop import hive database and table (#4141) 2020-12-02 15:50:50 +08:00
Kirs
3ceb612467
[FIX#4033] $[] conflicts with mysql keywords (#4111)
* [FIX#4033] $[] conflicts with mysql keywords
We currently only use this symbol for dates, so I filtered out the number type.
this close #4033

* test

* fix error
2020-12-01 14:34:03 +08:00
felix.wang
3e411d075f
[Improvement][Code style] FIX SPELL WAITTING TO WAITING , etc. (#4118)
* FIX SPELL

* FIX SPELL AND  Optimizing code conventions

* add ut  cannot construct process instance, return null;

* add ut testExportProcessMetaData

* add ut testExportProcessMetaData

* add ut testImportProcessSchedule

* add ut MasterExecThreadTest

* add ut MasterExecThreadTest

* add ut testSubProcessViewTree

* add ut testComplementWithStartNodeList

* add ut testRecurseFindSubProcessId

* add ut testRecurseFindSubProcessId

* add ut testRecurseFindSubProcessId
2020-12-01 08:58:55 +08:00
felix.wang
b46044d592
[Improvement][API] ignore noNodeException when get worker groups (#4120)
* ignore noNodeException when get worker groups

* add ut
2020-11-30 10:39:13 +08:00
Shiwen Cheng
763c65938d
[Feature][API]enable response resources gzip compression (#4121)
* enable response compression

* add server.compression.mime-types with default value explicitly
2020-11-30 10:11:50 +08:00