qiaozhanwei
fd2c2eeb32
1，encapsulate the parameters required by sqltask 2，SQLTask optimization ( #2135 )
...
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment
* ExecutorManager interface add generic type
* add TaskInstanceCacheManager receive Worker report result
* TaskInstance setExecutePath
* add TaskInstanceCacheManager to receive Worker Task result report
* TaskInstanceCacheManager add remove method
* add license
* add dispatcht task method
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* taskInstanceCache is null ,need load from db
* taskInstanceCache is null ,need load from db
* taskInstanceCache is null ,need load from db
* 1，worker TaskPros use TaskExecutionContext replase
2，Master kill Task , KillTaskProcessor modify
* worker remove db
* ShellTask modify
* master persistence processId and appIds
* master persistence processId and appIds
* master add kill task logic
* master add kill task logic
* master add kill task logic
* javadoc error modify
* remove chinese log
* executeDirectly method add Override
* remote module modify
* TaskKillResponseProcessor command type modify
* create buildKillCommand
* host add host:port format
* host add host:port format
* TaskAckProcessor modify
* TaskAckProcessor modify
* task prioriry refator
* remove ITaskQueue
* task prioriry refator
* remove ITaskQueue
* TaskPriority refactor
* remove logs
* WorkerServer refactor
* MasterSchedulerService modify
* WorkerConfig listen port modify
* modify master and worker listen port
* cancelTaskInstance set TaskExecutionContext host,logPath,executePath
* cancelTaskInstance set TaskExecutionContext host,logPath,executePath
* Encapsulate the parameters required by sqltask
* 1，Encapsulate the parameters required by sqltask
2，SQLTask optimization
* AbstractTask modify
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
2020-03-10 17:15:27 +08:00
lgcareer
bbe2cd4864
refactor worker group ( #2132 )
...
* replace worker group id with worker group
* add worker group field in ddl
* remove worker group id
2020-03-10 17:10:47 +08:00
dailidong
f551913249
split logback config into seperate child module logback ( #2120 )
...
* update logback
* update log
2020-03-09 19:03:51 +08:00
qiaozhanwei
8aaee39aa2
task prioriry refator ( #2094 )
...
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment
* ExecutorManager interface add generic type
* add TaskInstanceCacheManager receive Worker report result
* TaskInstance setExecutePath
* add TaskInstanceCacheManager to receive Worker Task result report
* TaskInstanceCacheManager add remove method
* add license
* add dispatcht task method
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* taskInstanceCache is null ,need load from db
* taskInstanceCache is null ,need load from db
* taskInstanceCache is null ,need load from db
* 1，worker TaskPros use TaskExecutionContext replase
2，Master kill Task , KillTaskProcessor modify
* worker remove db
* ShellTask modify
* master persistence processId and appIds
* master persistence processId and appIds
* master add kill task logic
* master add kill task logic
* master add kill task logic
* javadoc error modify
* remove chinese log
* executeDirectly method add Override
* remote module modify
* TaskKillResponseProcessor command type modify
* create buildKillCommand
* host add host:port format
* host add host:port format
* TaskAckProcessor modify
* TaskAckProcessor modify
* task prioriry refator
* remove ITaskQueue
2020-03-05 18:25:48 +08:00
qiaozhanwei
bb3885cfe2
master add kill task logic ( #2058 )
...
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment
* ExecutorManager interface add generic type
* add TaskInstanceCacheManager receive Worker report result
* TaskInstance setExecutePath
* add TaskInstanceCacheManager to receive Worker Task result report
* TaskInstanceCacheManager add remove method
* add license
* add dispatcht task method
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* taskInstanceCache is null ,need load from db
* taskInstanceCache is null ,need load from db
* taskInstanceCache is null ,need load from db
* 1，worker TaskPros use TaskExecutionContext replase
2，Master kill Task , KillTaskProcessor modify
* worker remove db
* ShellTask modify
* master persistence processId and appIds
* master persistence processId and appIds
* master add kill task logic
* master add kill task logic
* master add kill task logic
* javadoc error modify
2020-03-02 21:30:04 +08:00
Tboy
3bad56ca15
Refactor worker ( #2042 )
...
* Refactor worker (#10 )
* Refactor worker (#2000 )
* Refactor worker (#2 )
* Refactor worker (#1993 )
* Refactor worker (#1 )
* add TaskResponseProcessor (#1983 )
* 1, master persistent task 2. extract master and worker communication model (#1992 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* updates
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* TaskExecutionContext create modify (#1994 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* updates
* add- register processor
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* buildAckCommand taskInstanceId not set modify (#2002 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify (#2004 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment (#2006 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment
* ExecutorManager interface add generic type (#2012 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment
* ExecutorManager interface add generic type
* Refactor worker (#2018 )
* Refactor worker (#7 )
* Refactor worker (#2000 )
* Refactor worker (#2 )
* Refactor worker (#1993 )
* Refactor worker (#1 )
* add TaskResponseProcessor (#1983 )
* 1, master persistent task 2. extract master and worker communication model (#1992 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* updates
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* TaskExecutionContext create modify (#1994 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* updates
* add- register processor
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* buildAckCommand taskInstanceId not set modify (#2002 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify (#2004 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment (#2006 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment
* ExecutorManager interface add generic type (#2012 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment
* ExecutorManager interface add generic type
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* Refactor worker (#8 )
* Refactor worker (#2000 )
* Refactor worker (#2 )
* Refactor worker (#1993 )
* Refactor worker (#1 )
* add TaskResponseProcessor (#1983 )
* 1, master persistent task 2. extract master and worker communication model (#1992 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* updates
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* TaskExecutionContext create modify (#1994 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* updates
* add- register processor
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* buildAckCommand taskInstanceId not set modify (#2002 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify (#2004 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment (#2006 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment
* ExecutorManager interface add generic type (#2012 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment
* ExecutorManager interface add generic type
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* add kill command
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* add TaskInstanceCacheManager receive Worker report result，modify master polling db transfrom to cache (#2021 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment
* ExecutorManager interface add generic type
* add TaskInstanceCacheManager receive Worker report result
* TaskInstance setExecutePath
* add TaskInstanceCacheManager to receive Worker Task result report
* TaskInstanceCacheManager add remove method
* add license
* add dispatcht task method
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* refactor heartbeat logic
* update registry and add worker group
* add worker group
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
2020-03-01 11:38:37 +08:00
qiaozhanwei
7f94122f6e
1，worker TaskPros use TaskExecutionContext replase TaskPros 2，Master kill Task , KillTaskProcessor modify ( #2039 )
...
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment
* ExecutorManager interface add generic type
* add TaskInstanceCacheManager receive Worker report result
* TaskInstance setExecutePath
* add TaskInstanceCacheManager to receive Worker Task result report
* TaskInstanceCacheManager add remove method
* add license
* add dispatcht task method
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* taskInstanceCache is null ,need load from db
* taskInstanceCache is null ,need load from db
* taskInstanceCache is null ,need load from db
* 1，worker TaskPros use TaskExecutionContext replase
2，Master kill Task , KillTaskProcessor modify
2020-02-28 17:03:36 +08:00
qiaozhanwei
2bb5ebaf3a
add TaskInstanceCacheManager receive Worker report result，modify master polling db transfrom to cache ( #2021 )
...
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment
* ExecutorManager interface add generic type
* add TaskInstanceCacheManager receive Worker report result
* TaskInstance setExecutePath
* add TaskInstanceCacheManager to receive Worker Task result report
* TaskInstanceCacheManager add remove method
* add license
* add dispatcht task method
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
2020-02-26 18:46:05 +08:00
Tboy
e4679109af
Refactor worker ( #1997 )
...
* Refactor worker (#2 )
* Refactor worker (#1993 )
* Refactor worker (#1 )
* add TaskResponseProcessor (#1983 )
* 1, master persistent task 2. extract master and worker communication model (#1992 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* updates
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* TaskExecutionContext create modify (#1994 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* updates
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
2020-02-22 21:39:48 +08:00
qiaozhanwei
ff86dc7d57
1, master persistent task 2. extract master and worker communication model ( #1992 )
...
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
2020-02-21 20:18:02 +08:00
Tboy
158322bd41
add TaskResponseProcessor ( #1983 )
2020-02-21 09:01:42 +08:00
dailidong
24f22974a2
solve jar conflict, delete servlet-api 2.5 jar ( #1966 )
...
* update README about DolphinScheduler
* Update issue templates
* update
* regularize api pom xml
update rpc maven compile to 1.8
* regularize api pom xml
* change commons.lang3.StringUtils to common.utils.StringUtils
* update pom.xml
* update
* correct equals method
* jasper-runtime is needed when api server start
* jasper-runtime jar is needed when api server start
* combine logback config of master/worker/alert/api server to one logback.xml
* remove tomcat runtime jar
* add UT
* add license
* remove jasper-runtime jar, not need anymore
* sovle jar conflict， remove servlet-api 2.5 jar
* remove servlet 2.5
Co-authored-by: DS <escheduler@outlook.com>
2020-02-17 10:16:40 +08:00
liwenhe1993
d674eaba57
Support DS to create user and group in windows environment ( #1953 )
...
* Support DS to create user and group in windows environment
* Add unit test
2020-02-16 09:52:47 +08:00
gabry.wu
99ac739851
rename vaild to valid ( #1961 )
2020-02-15 18:55:16 +08:00
qiaozhanwei
c1ee133392
Refactor Architecture Basic modification #1658 ( #1946 )
...
* 1，remove dolphinscheduler-rpc module 2，add dolphinscheduler-remote module 3，add dolphinscheduler-service module 4，refactor LoggerServer module (#1925 )
* 1，remove dolphinscheduler-rpc module
2，add dolphinscheduler-remote module
3，add dolphinscheduler-service module
4，refactor LoggerServer module
* ProcessUtils modify
* Refactor architecture (#1926 )
* move version to parent pom
* move version properties to parent pom for easy management
* remove freemarker dependency
* delete CombinedApplicationServer
* #1871 correct spelling
* #1873 some updates for TaskQueueZkImpl
* #1875 remove unused properties in pom
* #1878
1. remove tomcat dependency
2. remove combined_logback.xml in api module
3. format pom.xml for not aligning
* #1885 fix api server startup failure
1. add jsp-2.1 dependency
2. remove jasper-runtime dependency
* add stringutils ut (#1921 )
* add stringutils ut
* Newfeature for #1675 . (#1908 )
Continue to finish the rest works, add the cache feature for dependence,mr,python,sub_process,procedure and shell.
* Add modify user name for process definition (#1919 )
* class overrides equals() and should therefore also override hashCode()
* #1862 add modify user in process difinition list
* #1862 add pg-1.2.2 ddl.sql
* modify ScriptRunnerTest
* add updateProessDifinition UT
* modify updateProcessDifinition UT
* modify updateProcessDifinition UT
* modify mysql 1.2.2 ddl.sql&dml.sql
* add scope test to mysql in pom
* modify pg-1.2.2 ddl.sql
* refactor module
* updates
Co-authored-by: khadgarmage <khadgar.mage@outlook.com>
Co-authored-by: zhukai <boness@qq.com>
Co-authored-by: Yelli <amarantine@my.com>
* dolphinscheduler-common remove spring (#1931 )
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* SpringApplicationContext class title add license (#1932 )
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* add license (#1934 )
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* Refactor architecture (#1936 )
* move datasource classes to dao module
* fix send4LetterWord bug
* LoggerServiceTest remove ProcessDao (#1944 )
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* LoggerServiceTest remove ProcessDao
* exclude jasper-compiler in case of runtime conflict (#1938 )
* move datasource classes to dao module
* fix send4LetterWord bug
* exclude jasper-compiler in case of runtime conflict
* DataAnaylysisServiceTest and ProcessDefinitionService modify
* remote module add comment
* OSUtilsTest modify
* add finally block to close channel (#1951 )
* move datasource classes to dao module
* fix send4LetterWord bug
* exclude jasper-compiler in case of runtime conflict
* add finally block to close channel
Co-authored-by: Tboy <technoboy@yeah.net>
Co-authored-by: khadgarmage <khadgar.mage@outlook.com>
Co-authored-by: zhukai <boness@qq.com>
Co-authored-by: Yelli <amarantine@my.com>
2020-02-14 22:00:20 +08:00
gabry.wu
44b76468a8
Adapting partial code(file name start with C) to the sonar cloud rules ( #1918 )
...
* Adapting partial code(file name start with C) to the sonar cloud rules
* add some UT
* add some UT(rollback JSONUtils.checkJsonVaild)
* add some UT(fix OSUtils.exeCmd UT)
2020-02-13 12:42:08 +08:00
samz406
95d62133a4
Merge pull request #1928 from khadgarmage/ut-resinfo
...
add ResInfoTest.java ut
2020-02-11 09:49:08 +08:00
xiaochun.liu
0ed6156b22
swap param
2020-02-11 09:26:43 +08:00
xiaochun.liu
980b5ae5ea
swap param
2020-02-11 09:21:59 +08:00
xiaochun.liu
17162341c3
add ResInfoTest.java ut
2020-02-11 00:18:06 +08:00
Yelli
d937a6ae94
Add modify user name for process definition ( #1919 )
...
* class overrides equals() and should therefore also override hashCode()
* #1862 add modify user in process difinition list
* #1862 add pg-1.2.2 ddl.sql
* modify ScriptRunnerTest
* add updateProessDifinition UT
* modify updateProcessDifinition UT
* modify updateProcessDifinition UT
* modify mysql 1.2.2 ddl.sql&dml.sql
* add scope test to mysql in pom
* modify pg-1.2.2 ddl.sql
2020-02-10 16:37:51 +08:00
khadgarmage
c447bb489f
add stringutils ut ( #1921 )
...
* add stringutils ut
2020-02-10 13:52:32 +08:00
gabry.wu
b77dddfeef
Adapting partial code(file name start with B) to the sonar cloud rules ( #1915 )
...
* Adapting partial code(file name start with B) to the sonar cloud rules
* add @Ignore to BaseTaskQueueTest class
2020-02-09 17:56:55 +08:00
xiaochun.liu
2f33a9e2ab
delete dup code
2020-02-09 10:20:18 +08:00
xiaochun.liu
bd10b78e29
delete dup code
2020-02-09 10:09:31 +08:00
xiaochun.liu
3364a8c8a9
add script runner ut
2020-02-08 21:22:20 +08:00
Jave-Chen
b3b075d915
Fix bug: Use try-with-resources or close this "Statement" in a "finally" clause. ( #1702 )
...
* #1701 Fix bug: Use try-with-resources or close this "Statement" in a "finally" clause.
* fix some indent
* refix code smell
2020-02-06 19:32:31 +08:00
dailidong
c63cd3e237
combine logback config of master/worker/alert/api server to one ( #1898 )
...
* combine logback config of master/worker/alert/api server to one logback.xml
2020-02-06 11:08:06 +08:00
魔方不在手
f942e5ced3
[feature] data synchronization function ( #1881 )
...
* feature：data synchronization function
* feature：data synchronization function
* feature：data synchronization function
* fix：add license
* fix：resource close bug
* fix：remove class author
* fix：Improve test coverage
* fix：add UT
* fix：add UT
* fix：data sync node renamed to datax
* fix：add UT
* fix: UT bug
* fix：Optimize variable name
* fix：pom
* fix：Variable name error
* fix：optimize the code
2020-02-06 09:29:23 +08:00
Yelli
5169689c35
class overrides equals() and should therefore also override hashCode() ( #1882 )
2020-02-03 10:24:24 +08:00
Tboy
38eaaa98e6
some updates for TaskQueueZkImpl ( #1874 )
...
small changes, no need more people review, I will merge.
2020-01-27 21:09:11 +08:00
gabry.wu
0d5c6e4e7c
[Feature] set acquireTriggersWithinLock true ( #1866 )
...
issue: https://github.com/apache/incubator-dolphinscheduler/issues/1863
2020-01-22 21:09:12 +08:00
liwenhe1993
30db5c1467
Api module relp server module/1756 ( #1766 )
...
* Remove server module on api module
1. Remove server module and add dao module.
2. Move quartz in server module to dao module.
3. Update config and class.
to resolve conflicts，I deleted CombinedApplicationServer.java
Co-authored-by: dailidong <dailidong66@gmail.com>
2020-01-20 16:26:23 +08:00
Jave-Chen
16913bacd7
fix return, obj error ( #1855 )
2020-01-17 21:55:50 +08:00
Jave-Chen
c522ea7ebb
Fix bug: NullPointerException etc. ( #1721 )
...
* #1720 Fix bug: NullPointerException etc.
* fix code smell
* Update DateInterval.java
refactor equals method
Co-authored-by: dailidong <dailidong66@gmail.com>
2020-01-17 16:55:01 +08:00
lgcareer
779672ec2a
[Fix issue #1770 ]check udf and data source in order to fix issue 1770 ( #1826 )
...
* check udf and data source in order to fix issue 1770
* check udf and data source in order to fix issue 1770
* update testListAuthorizedUdfFunc
2020-01-15 15:07:00 +08:00
ZHAOLIPAN
07f96375b3
replace strings with constants already exist. ( #1825 )
2020-01-15 14:00:28 +08:00
bao liang
0b272f9ca6
[feature] #1813 remove "_001" after the master/server register path in zookeeper ( #1820 )
...
* change master/worker register path.
* remove "_" from register path.
2020-01-14 16:27:10 +08:00
ZHAOLIPAN
68f736953b
fix typos ( #1821 )
2020-01-14 16:15:34 +08:00
DK.Pino
ea0caef88f
Regularize quartz.properties conf file ( #1783 )
...
* remove lombok dependency(last)
* regularize quartz.properties conf file
2020-01-09 16:53:03 +08:00
Yelli
2ec9943f64
fix bug: zk hasTask method NPE ( #1785 )
2020-01-09 14:50:15 +08:00
gabry.wu
88b022cb57
ITaskQueue should have "hasTask" function ( #1744 )
...
* issue https://github.com/apache/incubator-dolphinscheduler/issues/1742
* remove unnecessary catch
* fix exception type
* fix bad code smell
* remove log exceptions
* catch exception
2020-01-09 10:41:48 +08:00
bao liang
e0e0696b4f
add out put log when master/worker server start ( #1769 )
...
* merge hadoop.properties into common.properties
* merge hadoop,zookeeper.properties into common.properties
remove combined.properties/master.properties/worker.properties
* change db user/pwd to test/test
* rename .dolphinscheduler_en.sh to dolphinscheduler_env.sh
remove some unused in install.sh
* add out put log when master/worker server start...
* add start log when servers start
2020-01-09 10:36:15 +08:00
Yelli
963ed4a8c6
ds.server & ds.common.zk regularize log print ( #1754 )
2020-01-08 10:00:34 +08:00
xingchun-chen
dad643dbb5
commom/Preconditions Util Test ( #1727 )
...
* common/parameterUtils unit test
2020-01-06 15:51:55 +08:00
Tboy
4d1abb3fc7
remove commons-lang3 dependancy ( #1709 )
...
* remove commons-lang3 dependancy
* remove commons-lang3 dependancy
* remove unused import
2020-01-04 18:01:10 +08:00
khadgarmage
5f145efa6b
DependentUtils.java ut ( #1703 )
...
* delete bytes file
* DependentUtilsTest.java ut
2020-01-04 17:58:29 +08:00
Yelli
7ecd38f7d6
fix sonar bug: change condition & not enough arguments ( #1692 )
...
* modify FileUtils.readFile2Str
* #1300 Add right alignment function in sql email content
* cancel formatted for alert_mail_template.ftl
* #747 sql task password Log desensitization
* cancel mail_temple
* edit ExcelUtils
* modify test method name
* #747 sql task password Log desensitization
* #1544 workflow import
* Constants add DATASOURCE_PASSWORD_REGEX
* #747 sql task password Log desensitization
* deal with import project have sub process
* modify export process addTaskNodeParam method name
* add testAddTaskNodeSpecialParam UT
* add ProcessDefinitionServiceTest-ut to pom
* add testImportSubProcess in ProcessDefinitionServiceTest
* add testImportSubProcess in ProcessDefinitionServiceTest
* add testImportProcessDefinition
* fix sonar bug: not enough arguments
* fix sonar bug: change condition & not enough arguments
2020-01-04 11:32:07 +08:00
Tboy
0a3954107e
Merge pull request #1699 from lgcareer/dev-taskqueue
...
get root path from zookeeper config
2020-01-03 19:30:51 +08:00
Tboy
672a48255a
Merge pull request #1700 from fordeal-smalldata/fix-task-zknode-miss
...
Fixed tasks_queue and tasks_kill did not exist in zookeeper #1696
2020-01-03 19:30:21 +08:00
