Commit Graph

6273 Commits

Author SHA1 Message Date
Eric Gao
4c1578a374
[Feature-8369][Document]Add docs building test instructions in pydolphinscheduler DEVELOP.md (#8369) (#8693) 2022-03-29 10:56:53 +08:00
Amy0104
a56e1d260d
[Fix][UI Next][V1.0.0-Alpha] Fix the timeout strategy display error. (#9245) 2022-03-28 22:59:20 +08:00
JinYong Li
85e56b5e2a
fix 9243 (#9244) 2022-03-28 20:45:01 +08:00
Tq
03a0c9f544
[Bug] [ALERT-9224] fix wechat alert functions: app and group chat (#9225)
* fix wechat alert with app and group chat

* add apache header and fix imports

* delete wechat alert 'userSendMsg' property code

* delete wechat alert 'userSendMsg' property code in Test

* delete wechat alert 'userSendMsg' property code in factory Test

* change `getSubWorkFlowParam` from private to protected
2022-03-28 20:33:14 +08:00
songjianet
0d0674df1f
[Fix][UI Next][V1.0.0-Alpha] Fix the cannot update tenant individually on user info site. (#9237) 2022-03-28 17:55:15 +08:00
Amy0104
3e82312713
[Fix][UI Next][V1.0.0-Alpha]Fix the rules display incorrect in DATA_QUALITY. (#9236)
* [Fix][UI Next][V1.0.0-Alpha]Fix the rules display incorrect in DATA_QUALITY.

* [Fix][UI Next][V1.0.0-Alpha]Remove the unuse watch.
2022-03-28 14:51:05 +08:00
worry
13cc84eb8a
[Fix-8281][DataSource]Mysql jdbc connect failed. (#9199)
* [Fix-8281][DataSource]Mysql jdbc connect failed.This bug occurs when MySQL has no password.

* [Fix-8281][DataSource]Mysql jdbc connect failed.This bug occurs when MySQL has no password.
2022-03-28 12:32:49 +08:00
songjianet
052df581f5
[Feature][UI Next][V1.0.0-Alpha] Master adds empty data prompt. (#9233) 2022-03-28 12:15:44 +08:00
caishunfeng
994de4c902
[Bug-9045][Server] improve log detail error if task instance host is null (#9205)
* improve log detail error if task instance host is null

* test

Co-authored-by: caishunfeng <534328519@qq.com>
2022-03-28 11:36:56 +08:00
worry
d3251c9bcc
[Improvement-9227][master]implement use the slot to scan the database (#9228)
when the master assigns tasks by slot,implement use the slot to scan the database.

This closes #9227
2022-03-28 09:52:12 +08:00
caishunfeng
263791a63e
[Bug-9137][Server] fix timezone init (#9219)
Co-authored-by: caishunfeng <534328519@qq.com>
2022-03-28 09:38:51 +08:00
Devosend
b2cccc8959
[Fix][UI Next][V1.0.0-Alpha] Serial execte proces (#9229)
* add Process execute type for workflow

* fix icon spin
2022-03-28 09:12:57 +08:00
guoshupei
258285e6bb
[Fix-8980] [master] fixed repeat processing command (#9220)
This closes #8980

Co-authored-by: guoshupei <guoshupei@lixiang.com>
2022-03-27 23:33:30 +08:00
labbomb
7553ae5a17
[Fix][UI Next][V1.0.0-Alpha] Empty data in UDF resources is uploaded (#9218) 2022-03-27 22:13:23 +08:00
labbomb
91319e3111
[Fix][UI Next][V1.0.0-Alpha] Fixed an issue with long workflow names (#9217) 2022-03-27 16:53:02 +08:00
labbomb
aea0025035
[Feature][UI Next]Added loading state to all tables (#9215)
* Added loading state to all tables

* Delete useless variables
2022-03-27 13:54:00 +08:00
Amy0104
0841ccacc0
[Fix][UI Next][V1.0.0-Alpha] Fix the default items display error in SQOOP. (#9211) 2022-03-27 11:33:28 +08:00
zhangxinruu
8d60e920ad
[Fix][UI Next][V1.0.0-Alpha] Monitoring Center does not support multiple (#9207)
* fixSupportMultipleMaster

* clear
2022-03-27 10:25:57 +08:00
Kerwin
d7d756e7b0
Fix DataX and Sqoop Task execute NullPointerException (#9192) 2022-03-26 20:15:41 +08:00
Devosend
e8eb50e738
[Fix][UI Next][V1.0.0-Alpha] Fix preview error in workflow scheduler (#9203) 2022-03-26 19:20:59 +08:00
Devosend
f9e1ca50e4
[Fix][UI Next][V1.0.0-Alpha] Fix workflow timing timezone display bug (#9202) 2022-03-26 19:13:14 +08:00
worry
e4d95eb90b
[Improvement][Datasource]clear warning (#9200) 2022-03-26 15:17:52 +08:00
Amy0104
e00727c0c2
[Fix][UI Next][V1.0.0-Alpha] Fix wrong order of form items in DATA_QUALITY. (#9196) 2022-03-25 20:04:53 +08:00
Amy0104
ff93dda6c5
[Fix][UI Next][V1.0.0-Alpha] Fix several problems in SQOOP. (#9194) 2022-03-25 19:45:59 +08:00
songjianet
294f94e860
[Feature][UI Next][V1.0.0-Alpha] Added results page without workflow nodes. (#9189) 2022-03-25 17:25:11 +08:00
Devosend
3ca0986acf
[Fix][UI Next][V1.0.0-Alpha] Fix worklfow localParams null error (#9190) 2022-03-25 17:09:26 +08:00
lidongdai
c6e0882113
[Improve] no need to subscribe the dev mailing list when asking questions (#9175)
* no need to subscribe the dev mailing list when asking questions 

there is no need to subscribe the dev mailing list when users only ask usage questions

* Update bug-report.yml
2022-03-25 15:55:52 +08:00
Amy0104
c8a90043ee
[Fix][UI Next][V1.0.0-Alpha] Fix some fields not hidden when the custom job is true in SQOOP. (#9185) 2022-03-25 15:15:40 +08:00
Amy0104
cbee25d4ae
[Fix][UI Next][V1.0.0-Alpha] Fix the pigeon node save failure. (#9181) 2022-03-25 14:39:58 +08:00
shuai hou
5bd8ba4268
[fix-8929][DAO]Description Failed to upload the file because the full name was too long (#9020)
* [fix-8929][DAO]Description Failed to upload the file because the full name was too long

* [DS-#8929][fix]Description Failed to upload the file because the full name was too long

* [DS-#8929][fix]Description Failed to upload the file because the full name was too long

* [DS-#8929][fix]Description Failed to upload the file because the full name was too long

Co-authored-by: houshuai <houshuai@jiguang.cn>
2022-03-25 13:40:20 +08:00
nobolity
0e3cafec1d
[Feature-8612][RESOURCE] extend s3 to the storage of ds (#8637)
* feat(resource  manager): extend s3 to the storage of ds

1.fix some spell question
2.extend the type of storage
3.add the s3utils
to manager resource
4.automatic inject the storage in addition to your
config

* fix(resource  manager): update the dependency

* fix(resource  manager): extend s3 to the storage of ds

fix the constant of hadooputils

* fix(resource  manager): extend s3 to the storage of ds

1.fix some spell question
2.delete the import *

* fix(resource  manager):

merge  the unitTest:
1.TenantServiceImpl
2.ResourceServiceImpl
3.UserServiceImpl

* fix(resource  manager): extend s3 to the storage of ds

merge the resourceServiceTest

* fix(resource  manager): test  cancel the test method

createTenant verifyTenant

* fix(resource  manager): merge the code  follow the check-result of sonar

* fix(resource  manager): extend s3 to the storage of ds

fit the spell question

* fix(resource  manager): extend s3 to the storage of ds

revert the common.properties

* fix(resource  manager): extend s3 to the storage of ds

update the storageConfig with None

* fix(resource  manager): extend s3 to the storage of ds

fix the judge of resourceType

* fix(resource  manager): extend s3 to the storage of ds

undo the compile-mysql

* fix(resource  manager): extend s3 to the storage of ds

delete hadoop aws

* fix(resource  manager): extend s3 to the storage of ds

update the know-dependencies to delete aws 1.7.4
update the e2e
file-manager common.properties

* fix(resource  manager): extend s3 to the storage of ds

update the aws-region

* fix(resource  manager): extend s3 to the storage of ds

fix the storageconfig init

* fix(resource  manager): update e2e docker-compose

update e2e docker-compose

* fix(resource  manager): extend s3 to the storage of ds

revent the e2e common.proprites

print the resource type in propertyUtil

* fix(resource  manager): extend s3 to the storage of ds
1.println the properties

* fix(resource  manager): println the s3 info

* fix(resource  manager): extend s3 to the storage of ds

delete the info  and upgrade the s3 info to e2e

* fix(resource  manager): extend s3 to the storage of ds

add the bucket init

* fix(resource  manager): extend s3 to the storage of ds

1.fix some spell question
2.delete the import *

* fix(resource  manager): extend s3 to the storage of ds

upgrade the s3 endpoint

* fix(resource  manager): withPathStyleAccessEnabled(true)

* fix(resource  manager): extend s3 to the storage of ds

1.fix some spell question
2.delete the import *

* fix(resource  manager): upgrade the  s3client builder

* fix(resource  manager): correct  the s3 point to s3client

* fix(resource  manager): update the constant BUCKET_NAME

* fix(resource  manager): e2e  s3 endpoint -> s3:9000

* fix(resource  manager): extend s3 to the storage of ds

1.fix some spell question
2.delete the import *

* style(resource  manager): add info to createBucket

* style(resource  manager): debug the log

* ci(resource  manager): test

test s3

* ci(ci): add INSERT INTO dolphinscheduler.t_ds_tenant (id, tenant_code, description, queue_id, create_time, update_time) VALUES(1, 'root', NULL, 1, NULL, NULL); to h2.sql

* fix(resource  manager): update the h2 sql

* fix(resource  manager): solve to delete the tenant

* style(resource  manager): merge the style end delete the unuse s3 config

* fix(resource  manager): extend s3 to the storage of ds

UPDATE the rename resources when s3

* fix(resource  manager): extend s3 to the storage of ds

1.fix the code style of QuartzImpl

* fix(resource  manager): extend s3 to the storage of ds

1.impoort restore_type to CommonUtils

* fix(resource  manager): update the work thread

* fix(resource  manager): update  the baseTaskProcessor

* fix(resource  manager): upgrade dolphinscheduler-standalone-server.xml

* fix(resource  manager): add  user Info to dolphinscheduler_h2.sql

* fix(resource  manager): merge  the resourceType to NONE

* style(upgrade the log level to info):

* fix(resource  manager): sysnc the h2.sql

* fix(resource  manager): update the merge the user tenant

* fix(resource  manager): merge the resourcesServiceImpl

* fix(resource  manager):

when the storage is s3 ,that the directory can't be renamed

* fix(resource  manager): in s3 ,the directory cannot be renamed

* fix(resource  manager): delete the deleteRenameDirectory in E2E

* fix(resource  manager): check the style and  recoverd the test

* fix(resource  manager): delete the log.print(LoginUser)
2022-03-25 13:28:13 +08:00
Tq
97807390a2
fix alert instance proxy configs when no username and password (#9171) 2022-03-25 09:43:59 +08:00
sparklezzz
934d0ad063
[Feat]Restore presto and spark sql datasource in datasource plugin module (#7619)
* feat(datasource-plugin): restore presto and spark sql datasource

* feat(datasource-plugin): restore presto and spark sql datasource

* feat(datasource for spark/presto): fix pom and simplify code

Co-authored-by: xudong.zhang <xudong.zhang@nio.com>
2022-03-24 22:48:55 +08:00
gaojun2048
9996f7a4fa
update some method to protected (#9169) 2022-03-24 21:43:13 +08:00
Amy0104
64d449952d
[Fix][UI Next][V1.0.0-Alpha] Fix the unlimited label in the language pack configuration in DATAX. (#9167) 2022-03-24 18:43:57 +08:00
Devosend
6e6407cb18
[Fix][UI Next][V1.0.0-Alpha] Home white screen bug (#9161)
* fix timezone label bug

* modify default timezone

* support filter for timimg modal
2022-03-24 18:14:03 +08:00
Amy0104
327a60efd3
[Fix][UI Next][V1.0.0-Alpha]Fix the default value of custom template incorrect in DATAX. (#9163) 2022-03-24 18:12:43 +08:00
Amy0104
8ebd24a420
[Fix][UI Next][V1.0.0-Alpha] Fix the title and alarm group not hidden when the sql type is non query in SQL. (#9157) 2022-03-24 17:31:06 +08:00
Amy0104
2d444e56b3
[Fix][UI Next][V1.0.0-Alpha] Remove the resources in SQL. (#9153) 2022-03-24 16:57:50 +08:00
songjianet
647b0990aa
[Fix][UI Next][V1.0.0-Alpha] Fix the upstream Tasks field UI display extra long. (#9148)
* [Fix][UI Next][V1.0.0-Alpha] Fix the upstream Tasks field UI display extra long.
2022-03-24 16:35:29 +08:00
Amy0104
0868a81061
[Fix][UI Next][V1.0.0-Alpha] Remove the timeout settings switch in HTTP. (#9149) 2022-03-24 16:02:26 +08:00
Jiajie Zhong
5289b09817
[python] Fix change exists pd attribute user error (#9140)
* [python] Fix change exists pd attribute user error

* Remove attribute from class ProcessDefinition, cause it should to
  object User instead of object ProcessDefinition.
* Grant project to user if attribute user change for exists ProcessDefinition

close: #8751

* Add py.test conftest.py for package integration
2022-03-24 15:24:02 +08:00
labbomb
da2e85e9ec
[BUG][UI Next]fix the problem about Batch delete not working (#9080)
* fix the problem about Batch delete not working while click the border of the button

* try to fix e2e

Co-authored-by: Jiajie Zhong <zhongjiajie955@hotmail.com>
2022-03-24 14:43:02 +08:00
Amy0104
926fad861e
[Fix][UI Next][V1.0.0-Alpha]Fix the resources options incorrect in FLINK. (#9146) 2022-03-24 13:57:56 +08:00
Amy0104
73ca831cb4
[Fix][UI Next][V1.0.0-Alpha] Add direct and type into the custom par… (#9081)
* [Fix][UI Next][V1.0.0-Alpha] Add direct and type  into the custom parameters  in shell.

* [Fix][UI Next][V1.0.0-Alpha] Add the classes for e2e.
2022-03-24 12:09:25 +08:00
Tq
b9448c3f6f
fix email alert session configs (#9142) 2022-03-24 09:50:50 +08:00
calvin
49de0f092c
[Improve-9109][UI Next][V1.0.0-Alpha] When there's not any relations of workflows this page will display prompts. (#9133) 2022-03-23 22:08:34 +08:00
Amy0104
9c33c3e692
[Fix][UI Next][V1.0.0-Alpha] Fix the Flink Version and App Name not hidden when the deploy mode is local in FLINK. (#9135) 2022-03-23 22:07:34 +08:00
Devosend
d3cbb011c6
[Fix][UI Next][V1.0.0-Alpha] Alarm Instance console error (#9141) 2022-03-23 22:05:47 +08:00
songjianet
ddfd4a5762
[Fix][UI Next][V1.0.0-Alpha] Fix the user token edit bug. (#9123)
* [Fix][UI Next][V1.0.0-Alpha] Fix the user token edit bug.
2022-03-23 19:00:53 +08:00