Commit Graph

6654 Commits

Author SHA1 Message Date
Wenjun Ruan
3a9e67325e
Fix database initialize late in standalone. (#10296) 2022-05-31 11:52:00 +08:00
JinYong Li
49979c658e
[Fix-8828] [Master] Assign tasks to worker optimization (#9919)
* fix 9584

* master recall

* fix ut

* update logger

* update delay queue

* fix ut

* remove sleep

Co-authored-by: 进勇 <lijinyong@cai-inc.com>
Co-authored-by: JinyLeeChina <jiny.li@foxmail.com>
2022-05-31 11:49:54 +08:00
Eric Gao
a8a5da367a
[Feature][Task Plugin] Add support for dynamic form for zeppelin task plugin (#9977) (#10269) 2022-05-31 11:19:41 +08:00
HuangWei
c5961aed25
[feat][task] Add OpenMLDB task plugin (#10198) 2022-05-31 11:00:21 +08:00
WangJPLeo
a4948f58e6
[Feature][Permission] Reconstruction of permissions of resource center and monitoring center. (#10307)
* Reconstruction of permissions of resource center and monitoring center.

* clear local logs.

* resource query fix
2022-05-31 08:14:45 +08:00
hstdream
53ab6f7b92
[Feature][API] Modify the permissions of project management, security center, data source center and data quality module. (#10289)
* Resource userName is null

* [Fix-10082]Resource userName is null and udf function manager add a username

* [Fix-10082]Resource userName is null and udf function manager add a username

* [Fix-10082]Resource userName is null and udf function manager add a username

* [Feature][API] Modify the permissions of project management, security center, data source center and data quality module.

* [Feature][API] Modify the permissions of project management, security center, data source center and data quality module.

* [Feature][API] Modify the permissions of project management, security center, data source center and data quality module.

Co-authored-by: houshitao <shitaohou@163.com>
2022-05-30 23:32:25 +08:00
Jiajie Zhong
a241135cbc
[chore] update by release version (#10299) 2022-05-30 23:09:01 +08:00
songjianet
2e6d3f5190
[Fix][UI] Display the result page when the DB page has no data. (#10298) 2022-05-30 19:28:36 +08:00
xiangzihao
12a09f6d5d
[doc] Fix api standard error (#10292)
* fix api standard error
* add patch method
2022-05-30 16:07:25 +08:00
Mr.An
8d26d4fe72
[doc] Update the development environment to build the software version (#10246) 2022-05-30 14:46:12 +08:00
Tq
592e433b1e
[Feature][Datasource]replace DataSourceController API with string JSON and cast to DTO (#10276)
* replace DataSourceController API with string JSON and cast to DTO

* add DataSourceProcessorManager and DataSourceProcessorProvider to datasource processor functions
2022-05-30 14:12:19 +08:00
Amy0104
e7fbfa3a26
[Fix][UI] Add mapping_columns filed for the data_quality ruleInputParamter. (#10286) 2022-05-30 13:54:10 +08:00
Yiming Guo
2294160cdb
[docs] Added local file configuration guide for resource center (#10264)
* Added Local File Resource Configuration Guide to the document.
* Removed contents with windows features in the documents and improved expression.
* Specify `the user who deploy dolphinscheduler have read and write permissions` in en and zh docs.

Co-authored-by: xiangzihao <460888207@qq.com>
2022-05-30 12:07:29 +08:00
QuakeWang
cd36401a6a
[doc] Refactor context parameter docment (#10227) 2022-05-30 11:44:10 +08:00
QuakeWang
58b1e1da1e
[doc] Upgrade screenshot to latest version in dev document (#10242)
* fix issue-9898
* delete no use pictures
2022-05-30 11:04:42 +08:00
cadl
13af2adfc1
[fix] Fix the SERIAL_DISCARD execution_type not working (#10258)
* fix always stop process_instance when execution_type is SERIAL_DISCARD

* test: no running_process, submit it
2022-05-30 09:54:15 +08:00
juzimao
62bd9d2c4c
[Fix] Fix the line.separator problem for alert-plugin' test case #10277 (#10278)
* [Fix] Fix the line.separator problem for alert-plugin' test case

* [Fix] Fix the line.separator problem for alert-plugin' test case
2022-05-29 18:44:26 +08:00
WangJPLeo
7ac8ea493c
[Feature][Permission] Project management module authority control refactoring, authority abstract interface setting. (#10261)
* Create process definition with task group and task group priority cannot be save into db

* [Feature][API] Permission control of project

* [Feature][API] Permission control of project

* [Feature][API] Permission control of project

* [Feature][API] Permission control of project

* [Feature][API] Permission control of project

* [Feature][API] Permission control of project

* [Feature][API] Permission control of project

* [Feature][API] Permission control of project

* [Feature][API] Permission control of project

* [Feature][API] Permission control of project

* [Feature][API] Permission control of project

* [Feature][API] Permission control of project

* [Feature][API] Permission control of project

* [Feature][API] Permission control of project

* [Feature][API] Permission control of project

* [Feature][API] Permission control of project

* The result of the assertion cannot be changed. The only difference is the judgment condition.

* test recovery.

* controller test fix.

* ProjectE2ETest fix.

* WebElement import.

* Prioritize problem solving.

* Judging the length of the set fix

Co-authored-by: houshitao <shitaohou@163.com>
Co-authored-by: hstdream <33045461+hstdream@users.noreply.github.com>
2022-05-29 16:14:16 +08:00
juzimao
62b85b9cb3
[Fix] Fix the timeout alarm button is invalid (#10260) 2022-05-27 16:39:08 +08:00
songjianet
1ac534be67
[Fix][UI] Fix status statistics card height is inconsistent. (#10268) 2022-05-27 16:27:15 +08:00
songjianet
4c1ef0a89a
[Style][UI] Split multilingual modules. (#10256) 2022-05-26 19:22:27 +08:00
lugela
a0771541e5
[Fix-10181] Fix the logic of judging that the tenant does not exist (#10185)
* [Fix-10181] Fix the logic of judging that the tenant does not exist

Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap :  uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist  in /etc/passwd file and ldap: id: test: no such user

Temporarily unable to test the system for windows and mac

* [Fix-10181] Fix the logic of judging that the tenant does not exist

Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap :  uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist  in /etc/passwd file and ldap: id: test: no such user

Temporarily unable to test the system for windows and mac

* [Fix-10181] Fix the logic of judging that the tenant does not exist

Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap :  uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist  in /etc/passwd file and ldap: id: test: no such user

Temporarily unable to test the system for windows and mac

* [Fix-10181] Fix the logic of judging that the tenant does not exist

The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged.

At present, considering that it is a distributed user, it should not be allowed to create users in linux

Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap :  uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist  in /etc/passwd file and ldap: id: test: no such user

Temporarily unable to test the system for windows and mac

* [Fix-10181] Fix the logic of judging that the tenant does not exist

Add test method

The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged.

At present, considering that it is a distributed user, it should not be allowed to create users in linux

Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap :  uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist  in /etc/passwd file and ldap: id: test: no such user

Temporarily unable to test the system for windows and mac

* [Fix-10181] Fix the logic of judging that the tenant does not exist

Add parameter description to configuration.md

Add test method

The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged.

At present, considering that it is a distributed user, it should not be allowed to create users in linux

Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap :  uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist  in /etc/passwd file and ldap: id: test: no such user

Temporarily unable to test the system for windows and mac

* [Fix-10181] Fix the logic of judging that the tenant does not exist

Add parameter description to configuration.md

Add test method

The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged.

At present, considering that it is a distributed user, it should not be allowed to create users in linux

Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap :  uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist  in /etc/passwd file and ldap: id: test: no such user

Temporarily unable to test the system for windows and mac

* [Fix-10181] Fix the logic of judging that the tenant does not exist

Add parameter description to configuration.md

Add test method

The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged.

At present, considering that it is a distributed user, it should not be allowed to create users in linux

Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user.
for example:
id test
1. exist in /etc/passwd file or ldap :  uid=1030(test) gid=1030(test) groups=1030(test)
2. no exist  in /etc/passwd file and ldap: id: test: no such user

Temporarily unable to test the system for windows and mac

Co-authored-by: ouyangl <ouyangl@tebon.com.cn>
2022-05-26 14:58:07 +08:00
Jiajie Zhong
e3579dd13d
[doc] Correct all setup documents (#10074)
* Correct the login page URL
* change version and database configuration
* change setup and upgrade
2022-05-26 14:53:47 +08:00
caishunfeng
4351148f36
[Bug] init docker compose DATABASE env (#10244)
skip source env if in docker
2022-05-26 13:50:59 +08:00
Jiajie Zhong
58afe5d8b5
[fix] Deploy scp-hosts use fullpath avoid dangling (#10249)
This path fix error modify worker application.yaml when
running `scp-hosts.sh` script in different directory. Currently
setting only work when running `scp-hosts.sh` in path
`<DOLPHINSCHEDULER_HOME>/bin` using command `./scp-hosts.sh`.
And will fail when we run script in directory
`<DOLPHINSCHEDULER_HOME>` using command `./bin/scp-hosts.sh`

ref: #10209 and #10208
2022-05-26 09:59:40 +08:00
Jiajie Zhong
6d9bc0743b
[doc] Add setValue syntax in local param (#10245)
ref: #9576
same as: #9671
2022-05-25 21:53:41 +08:00
Jiajie Zhong
117082154d
[fix][deploy] File overwrite when specific value set to installPath (#10241)
When our `installPath` in file `install_env.sh` set to `/`
or empty or related path to `/` some system specific directory
, like `/bin` and `libs`, will be overwritten, and it is not expected
2022-05-25 21:52:14 +08:00
Devosend
b337eef2e6
[Fix][UI] Set task group name empty of default value (#10243) 2022-05-25 19:22:07 +08:00
Mr.An
c5c68a8893
[Fix#9923] The alarm instance management interface is always in the loading state (#9924)
* fix alert plugin loading bug

* update use-form.ts

* remove unused package

* Update use-form.ts

* Update use-form.ts
2022-05-25 18:13:42 +08:00
Jiajie Zhong
d8db2b57d2
[fix] Task group queue query all list error (#10237)
Add support query all task queue by not given specific groupId

close: #10102
2022-05-25 16:33:23 +08:00
旺阳
aba5f8a40e
[improve] Change Mysql Driver (#10220) 2022-05-25 14:09:15 +08:00
旺阳
87d9ec1dee
[doc] Delete SPRING_DATASOURCE_DRIVER_CLASS_NAME in doc (#10228) 2022-05-25 11:45:16 +08:00
songjianet
abecec3c28
[Fix][UI] Fix issue with treemap depth in workflow relationships. (#10229)
* [Fix][UI] Fix issue with treemap depth in workflow relationships.

* [Fix][UI] Fix issue with treemap depth in workflow relationships.
2022-05-24 18:33:00 +08:00
Mr.An
14e80ab5fd
[fix-10207] When the registered alarm plugin is empty, the error message is not clear (#10224)
* Improve the problem that the error message is not clear when the registered alarm plugin is empty

* update error info

* update error info

* update error info

* Update Status.java

fix typo

Co-authored-by: xiangzihao <460888207@qq.com>
2022-05-24 18:03:04 +08:00
QuakeWang
5998c73aac
[doc] Refactor local parameter docment (#10119) 2022-05-24 17:16:08 +08:00
旺阳
c12848a4ff
[doc] Update kubernetes' FAQ (#10221) 2022-05-24 17:00:57 +08:00
songjianet
6cebdfdf50
[Fix][UI] Fix the problem of multi-language support of workflow instance host in Chinese state. (#10223) 2022-05-24 16:14:56 +08:00
旺阳
de5507fb19
[Fix-10103][k8s]Fix k8s Change DataSource Error (#10128) 2022-05-24 13:59:42 +08:00
Jiajie Zhong
f4b7754952
[doc] Update task DataX document (#10218) 2022-05-24 13:45:26 +08:00
rockfang
7fc3664ec3
[Fix][UI] add assignment of totalPage (#10165) 2022-05-24 10:48:34 +08:00
Jiajie Zhong
56e0ea802d
[python] Fix process definition attr release state not work (#10151)
This patch fix the error release state not work when it set to
offline and submit it to Java gateway, it error because we do
not pass the attribute to Java gateway function
`createOrUpdateProcessDefinition`

close: #9779
2022-05-24 10:25:19 +08:00
Mr.An
edcb7aad23
fix#10214 Delete online workflows in batches, prompt information is accurate (#10215) 2022-05-24 10:18:03 +08:00
Eric Gao
4dbe27bb8f
[Bug][Deploy]Fix worker-server path in script scp-hosts.sh (#10208) (#10209) 2022-05-24 09:53:11 +08:00
JieguangZhou
54ab2651bd
[Feature][MLops] Add MLflow Projects (custom project) component (#10175)
* Add MLflow Projects (custom project) component

* fix something

* update document

* update document

* Supplementary test cases
2022-05-24 09:42:46 +08:00
Mr.An
0e8ed6ebb4
[Fix-10199] [Workflow/Workflow Definition] After deleting messages in batches, the error message is repeated (#10201)
* remove duplicate prompts

* update import package
2022-05-24 09:17:44 +08:00
Mr.An
31cb485312
[doc] Update delete workflow description (#10203) 2022-05-23 20:59:19 +08:00
songjianet
c8a4c694ea
[Fix][UI] Fix data-quality component multi-language support. (#10202)
* [Fix][UI] Fix data-quality component multi-language support.

* [Fix][UI] Fix data-quality component multi-language support.
2022-05-23 18:17:30 +08:00
xiangzihao
41a3183810
[Doc] Add complie supporting system (#10188) 2022-05-23 15:17:37 +08:00
Eric Gao
7a8f3f1810
[doc] Update project directory structure in docs (#10107) 2022-05-23 11:11:45 +08:00
QuakeWang
0abfb5e744
[doc] Refactor global parameter docment (#10045) 2022-05-23 10:46:11 +08:00