Commit Graph

5584 Commits

Author SHA1 Message Date
wind
41bf1a955e
[Improvement-7213][MasterServer] execute thread pool code optimization (#7258)
* threadpool optimization

* threadpool params

* rebase dev

* ut check fix

* add return

* rebase dev

* event loop

Co-authored-by: caishunfeng <534328519@qq.com>
2021-12-16 23:45:32 +08:00
calvin
6cad119806
[Fix-7340] Improve the prompt content for deleting a project that didn't exist. (#7449)
* improve the prompt
2021-12-16 17:14:37 +08:00
wind
1cbc86b9e6
add task-logger config (#7423)
Co-authored-by: caishunfeng <534328519@qq.com>
2021-12-16 16:14:46 +08:00
labbomb
7aeb12c5de
feat: Added the configuration of routes (#7433) 2021-12-16 10:22:15 +08:00
Jiajie Zhong
6f93ebf3ba
[python] Add task dependent (#7405)
fix: #6926
2021-12-16 09:58:50 +08:00
KyoYang
676a952bcb
[Fix-#6854][dao] fix "ResourceMapper.xml -> queryResourcePaging" sql bug (#6907)
* fix complement data retry bug; issues: [Bug] [Master] A bug on task retry mechanism #6613

* [DS-#5293][chore]upgrade cron-utils version 5.0.5 -> 9.1.3

* [DS-#5293]update the licensing information of that dependency

* [DS-#5293]update the licensing information of that dependency

* update the licensing information of that dependency

* [DS-#5293]update the licensing information of that dependency

* [DS-#6854][fix] fix "ResourceMapper.xml -> queryResourcePaging" sql bug

* [DS-#6854][fix] fix "ResourceMapper.xml -> queryResourcePaging" sql bug

Co-authored-by: yangqiyu <yangqiyu@deepexi.com>
2021-12-15 19:18:00 +08:00
songjianet
f36ca02907
[Feature][UI Next] Improve some basic configuration. (#7430) 2021-12-15 17:38:32 +08:00
SbloodyS
a17a8d777a
[Fix-7392][dolphinscheduler-datasource] Add hive datasource failed (#7393)
* fix bug_7392

* fix bug_7392

* fix bug_7392

Co-authored-by: SbloodyS <sbloodys@qq.com>
2021-12-15 17:36:05 +08:00
ouyangyewei
801e6dd6bb
to feature 7418 (#7420)
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
2021-12-15 13:40:07 +08:00
mgduoduo
bc995752d6
[DS-7256][refactor] Optimization for task instances query (#7331)
- assemble a Map<Long, User> outside of the loop instead of the query inside

Co-authored-by: gq47193 <gq47193@ly.com>
2021-12-15 10:53:52 +08:00
ouyangyewei
6b5c393449
[Feature-7408][dolphinscheduler-api] Built GenerateToken into the UpdateToken API (#7411)
* to feature 7408

* trigger e2e test

Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
2021-12-15 10:39:43 +08:00
Jiajie Zhong
4988004150
[python] Fix task procedure define error (#7407)
Cause procedure parameter name need `method` instead of `sql`
we change it's name. And remove parameter `sql` from parent
class `Database`

closes: #7386
2021-12-15 10:19:32 +08:00
Zonglei Dong
7e0010de35
[Refactor] Rename class file, unified word spelling. (#7261) 2021-12-15 01:04:50 +08:00
ouyangyewei
14343864bf
to feature 7401 (#7404)
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
2021-12-14 17:54:35 +08:00
songjianet
1f1edb2f23
[Fix][Project List UI] Fix the calling interface that keeps decreasing by one after manually setting the pageNo parameter. (#7399) 2021-12-14 16:31:08 +08:00
ouyangyewei
57697602c5
[Feature-7110][dolphinscheduler-api] support grant project by code (#7390)
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
2021-12-14 12:39:08 +08:00
Jiajie Zhong
04805818c2
Fix alert plugin instance filter (#7172) (#7210)
* Fix alert plugin instance filter (#7172)

alert plugin could not filter by given
pattern, cause api server do not handle
parameter searchVal, This patch add parameter
`searchVal` for alert plugin.

fix: #7209

* Add test

* Recover AlertPluginInstanceVO
2021-12-14 12:08:22 +08:00
songjianet
e4955934fd
[Feature][UI-Next]: Build a front-end refactoring project. (#7387) 2021-12-14 11:45:38 +08:00
mask
8e62dd8246
[Fix-7291][datasource] Compatible with different versions of MySQL data source loading (#7291) (#7305) 2021-12-13 22:49:46 +08:00
wind
99b8ec6492
[Bug-7319][MasterServer] fix taskNode NPE when switch else branch is empty (#7320)
Co-authored-by: caishunfeng <534328519@qq.com>
2021-12-13 22:46:48 +08:00
mask
8c3fa47903
[Fix-7375][datasource] remove excess hive jdbc principal (#7375) (#7381)
* [Fix-7375][datasource] remove excess hive jdbc principal (#7375)

* fix ut
2021-12-13 21:38:50 +08:00
kezhenxu94
b3fe217e08
Fix E2E workflow (#7377) 2021-12-13 20:20:20 +08:00
Jiajie Zhong
1948030151
[python] Add task base database and procedure (#7279)
We add a new task procedure, and add parent class database
for both sql task and procedure task

fix: #6929
2021-12-13 19:54:24 +08:00
kezhenxu94
12b46dfaa6
Adjust Helm Chart templates in dev branch (#7353) 2021-12-12 23:17:50 +08:00
kezhenxu94
bacb7c1598
Fix typo in docker swarm (#7336) 2021-12-12 12:02:21 +08:00
kezhenxu94
2ff76c7e73
Fix some SQL issues and make docker-compose runnable (#7329) 2021-12-10 23:51:42 +08:00
calvin
ac67a11d44
fix a few issues in the sql file (#7327) 2021-12-10 19:50:55 +08:00
Kerwin
f1b85cf892
Fix the missing project information in the process instance timeout alarm (#7324) 2021-12-10 18:55:10 +08:00
wind
0f7e38ed3c
[Bug-7292][ApiServer] fix cache error when standalone (#7293) 2021-12-10 18:46:41 +08:00
Kerwin
939fa0c3ba
fix TaskResponseProcessor process NullPointerException (#7318) 2021-12-10 16:55:56 +08:00
ouyangyewei
f03b0e8c7b
to feature-7301 (#7308)
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
2021-12-10 14:40:06 +08:00
Kerwin
3fadfca085
fix in the process alarm message, projectid is 0 (#7298) 2021-12-10 12:25:35 +08:00
kezhenxu94
67cc260d52
Split the components into individual package, refactor configurations to use Spring properties (#7160)
* Split the components into individual package

A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.

* Split the components into individual package

A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.

* Split the components into individual package

A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.
2021-12-10 11:28:53 +08:00
mask
8d68cf48dd
[Fix-7277][datasource] Support Kerberos auto renewal (#7277) (#7278) 2021-12-09 09:27:57 +08:00
Jiajie Zhong
2a7d6b468f
[python] Refactor get object define communicate to gateway (#7272)
* Change class Base `to_dict` to `get_define` for more clearer
* Remove class TaskParams and sub class make code easy to
  understand and avoid task implement cycle dependence
* Remove class ObjectJsonBase in Task to reduce complexity

fix: #7271
2021-12-08 22:17:13 +08:00
wind
3a351da752
fix failover logic (#7275)
Co-authored-by: caishunfeng <534328519@qq.com>
2021-12-08 21:35:18 +08:00
百岁
f21eb8f9fe
[ISSUE 6444]Optimize task node helper document in workflow toolbar (#7226)
* [ISSUE 6444]Optimize task node helper document in workflow toolbar

* fix some review issue than submit by DS

* refact by add guard judgement when type is undefined

* move method helpUrlEnable and helpUrl nest in 'methods' body
2021-12-08 15:09:01 +08:00
songjianet
3ca2ee9ac8
[Bug][dolphinscheduler ui] When the edit time is repaired, the alarm group display. (#7262) 2021-12-08 14:24:53 +08:00
mask
deefc8e98a
[Fix-7235][datasource] unable to confige the multi-hosts (#7235) (#7253) 2021-12-08 09:21:54 +08:00
Kerwin
4e6265df11
fix Property or field 'all' cannot be found (#7246) 2021-12-08 09:00:00 +08:00
EdwardYang
6a144d69bf
[bug] fix task definition delete (#7244)
Co-authored-by: edward-yang <yangjianh210@gmail.com>
2021-12-07 20:20:29 +08:00
zwZjut
f7bdf174be
[Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238)
* to #7237

* rerun test

Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2021-12-07 20:17:45 +08:00
zwZjut
f577b5bd30
to #7228 (#7249)
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
2021-12-07 20:05:57 +08:00
Jiajie Zhong
29414a080f
Fix homepage user wrong statistics result for new user (#7242)
* Fix homepage user wrong statistics result for new user

For now, when we create a new user, it would see homepage
statistic info as admin user like, cause `projectCodeArray`
would not filter when we render SQL. So I add prefix conditions
to handle this situation.

Also, I do some minimal refactor here. including change function
name no quit fit

fix: #7182

* Fix UT
2021-12-07 18:50:06 +08:00
Zonglei Dong
0b9792db76
[Refactor]Rename class file, DatasourceUtil to DataSourceUtils. (#7181)
* Rename class file, DatasourceUtil  to  DataSourceUtils.
2021-12-07 18:49:05 +08:00
wind
a80a7b3fcf
[Feature-6963][MasterServer] unified cache manager (#7187)
* unified cache

* reduce db select

* checkstyle

Co-authored-by: caishunfeng <534328519@qq.com>
2021-12-07 15:55:22 +08:00
JinYong Li
544b015f76
[Bug] [API] task definition release/delete bug (#7232)
* fix worker group display

* fix workflow query bug

* fix workflow query bug

* fix task definition release/delete bug
2021-12-07 15:26:28 +08:00
JinYong Li
2792c35d68
[Bug] [API] queryProcessDefinitionByCode bug (#7221) 2021-12-07 14:41:26 +08:00
wind
9d65bf1452
fix postgre upgrade (#7230)
Co-authored-by: caishunfeng <534328519@qq.com>
2021-12-07 14:19:32 +08:00
Hua Jiang
4743e8f891
add two files (#7223) 2021-12-06 22:55:28 +08:00