Commit Graph

6839 Commits

Author SHA1 Message Date
caishunfeng
d7cf09afd5
Revert "[Improvement][Api] Interface and entity optimization to improve code scalability. (#10483)" (#10534)
This reverts commit f1a9c0d8e9.
2022-06-21 17:39:45 +08:00
Desperado2
4a3dfae006
[FIX] Could not find or load main class org.apache.zookeeper.ZooKeeperMain (#10535)
* Update remove-zk-node.sh

* Update remove-zk-node.sh

* Update remove-zk-node.sh

* Update remove-zk-node.sh
2022-06-21 17:26:52 +08:00
Eric Gao
cc06eaaf54
[Improvement][Metrics] Apply micrometer naming convention to metrics (#10477)
* Apply micrometer naming convention to worker metrics
* Apply micrometer naming convention all current metrics
* Fix remaining metrics names, update English docs and add Chinese docs
* Fix metrics names in grafana-demo dashboards
2022-06-21 14:27:06 +08:00
Wenjun Ruan
b100f6c489
Remove the schedule thread in LowerWeightHostManager (#10310) 2022-06-21 13:30:07 +08:00
JieguangZhou
36e20cdfc8
[Feature][Task Plugin] Add DVC task plugin for MLops scenario (#10372) (#10407) 2022-06-21 13:13:46 +08:00
Wenjun Ruan
117f78ec4b
[Fix-10413] Fix Master startup failure the server still hang (#10500)
* Fix Master startup failure the server still hang
2022-06-20 22:35:06 +08:00
旺阳
6e4b2e6992
[Fix]Recovery Traffic Control Config (#10505)
* recovery traffic config

* run ci

* update
2022-06-20 18:43:48 +08:00
Eric Gao
64cee03fed
[Feature] Enable users to switch and install conda env in jupyter task (#10337) 2022-06-20 14:47:44 +08:00
syyangs799
79ce5d78cd
Modify obsolete swagger parameters in AuditLogController (#10494)
Co-authored-by: syyang <730122+syyang99@user.noreply.gitee.com>
2022-06-19 22:54:14 +08:00
xiangzihao
704e633659
[Doc] Add api test doc (#10499) 2022-06-19 13:55:23 +08:00
Eric Gao
4be3b877c3
[feature][task] Enable zeppelin schedule a whole zeppelin note (#10434) 2022-06-18 13:34:24 +08:00
guodong
2c227ab384
[Feature-10363][server] S3 Resource center supports bucket customization (#10433)
* [Feature-10363][server] S3 Resource center supports bucket customization

* Modify the configuration. Sort out HDFS and S3 configurations to distinguish them
* Modify the configuration comment to clarify the configuration meaning
* Modify official documents to add missing configuration descriptions and clarify configuration meanings and usage
* Modify the configuration file in e2E to the correct definition, dolphinscheduler-e2e/dolphinscheduler-e2e-case/src/test/resources/docker/file-manage/common.properties
* Modified code to support bucket customization
* Check that the bucket on personal permission, Otherwise, the startup fails
* S3 increase support resource. Storage. Upload. Base. The base path path
* Change S3Utils implementation style to be consistent with HadoopUtils

* [Feature-10363][server] S3 Resource center supports bucket customization

* Modify code review comments
2022-06-18 10:20:01 +08:00
liubo1990
b8d5e78994
[Doc] Add how to set the alarm mailbox in faq (#10401) 2022-06-17 21:16:38 +08:00
Wenjun Ruan
00f86da1da
Open checkstyle, change checkstyle severity from info to warning (#10492)
* Open checkstyle, change checkstyle severity from info to warning
2022-06-17 19:01:54 +08:00
Wenjun Ruan
0bdfa0cff9
Fix PeerTaskInstancePriorityQueue cannot contains method use taskInstanceId to check (#10491) 2022-06-17 16:14:56 +08:00
hstdream
f1a9c0d8e9
[Improvement][Api] Interface and entity optimization to improve code scalability. (#10483)
* [Improvement][Api] Interface and entity optimization to improve code scalability (#10466).

* [Improvement][Api] Interface and entity optimization to improve code scalability (#10466).

* [Improvement][Api] Interface and entity optimization to improve code scalability (#10466).

* [Improvement][Api] Interface and entity optimization to improve code scalability (#10466).

* fix ut timezone.

* [Improvement][Api] Interface and entity optimization to improve code scalability.

* [Improvement][Api] Interface and entity optimization to improve code scalability.

Co-authored-by: houshitao <shitaohou@163.com>
2022-06-17 15:22:34 +08:00
旺阳
6515c66208
[Improve] Add LDAP user not exsitst action config (#10451) 2022-06-17 14:18:05 +08:00
chuxing
0dd6f4008e
[fix][master]: fix condition npe (#10478)
* [fix][master]: fix condition npe

* [fix][master]: fix condition npe

Co-authored-by: huaangcg <huangcg@getui.com>
2022-06-17 13:40:11 +08:00
juzimao
062146eecd
[Fix] Fix the JSONUtils tool class time zone problem #10282 (#10284)
* [Fix] Fix the JSONUtils tool class time zone problem #10282

* [Fix] Fix the JSONUtils tool class time zone problem #10282

* Update JSONUtils.java

remove unnessnary log

* Update JSONUtilsTest.java

add timezone import

Co-authored-by: xiangzihao <460888207@qq.com>
2022-06-17 11:08:38 +08:00
Wenjun Ruan
ad2646ff1f
Fix TaskProcessorFactory#getTaskProcessor get common processor is not thread safe (#10479)
* Fix TaskProcessorFactory#getTaskProcessor get common processor is not thread safe
2022-06-16 21:46:18 +08:00
hstdream
f3c647d45e
[Improvement][Api] Interface and entity optimization to improve code scalability (#10466). (#10468)
* [Improvement][Api] Interface and entity optimization to improve code scalability (#10466).

* [Improvement][Api] Interface and entity optimization to improve code scalability (#10466).

* [Improvement][Api] Interface and entity optimization to improve code scalability (#10466).

* [Improvement][Api] Interface and entity optimization to improve code scalability (#10466).

* fix ut timezone.

Co-authored-by: houshitao <shitaohou@163.com>
2022-06-16 18:22:36 +08:00
SmallProgrammer
7aa9fa4965
[imporve] Add index to table t_ds_relation_process_instance (#10461) 2022-06-16 15:24:05 +08:00
Devosend
d1cae6025b
fix rename form not init bug in file manange (#10471) 2022-06-16 13:51:17 +08:00
陈家名
f512e3c31f
[fix][python] Correct variable type of SQL type (#10464) 2022-06-16 09:39:53 +08:00
xiangzihao
720a10a21e
add_some_code_owners (#10462) 2022-06-15 18:54:36 +08:00
syyangs799
d16e0ddb2f
[Bug-10394] [Update Possword] Change password shows error (#10437)
* Add a status code for password verification length to improve user interaction

* Modify the length and null value, verify them separately and return

* Modify the length and null value, verify them separately and return

* remove the outer not empty validate and Modify judgment conditions

* add the outer not empty validate and remove inter empty

Co-authored-by: syyang <730122+syyang99@user.noreply.gitee.com>
2022-06-15 18:44:26 +08:00
xiangzihao
eecc49e70c
add codeowner (#10457) 2022-06-15 17:46:19 +08:00
xiangzihao
e50739465d
[Feature-10411] Add tenant api test (#10442)
* add feature_10411

* add feature_10411

* update README.md

* fix README.md deadlink

* fix error log output

* fix comment
2022-06-15 16:29:36 +08:00
Amy0104
d516369e80
[Fix][UI] Add loading before file modification data is returned. (#10450) 2022-06-15 15:06:06 +08:00
qianli2022
ff065d8e5b
[Feature][Improvement] Support multi cluster environments - k8s type (#10096)
* service code

* [Feature][UI] Add front-end for cluster manage

* fix e2e

* remove comment on cluster controller

* doc

* img

* setting e2e.yaml

* test

* rerun e2e

* fix bug from comment

* Update index.tsx

use Nspace instead of css.

* Update index.tsx

Remove the style.

* Delete index.module.scss

Remove the useless file.

Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
2022-06-15 13:39:20 +08:00
Jiajie Zhong
b655aa9b1f
[doc] Correct resource in HDFS HA cluster (#10445) 2022-06-15 11:08:18 +08:00
旺阳
50846760e5
[fix-10386]LDAP user create with status enable (#10426)
* LDAP user create with status enable

* currect unit test
2022-06-15 10:19:27 +08:00
旺阳
0efcd5c631
[Fix-10425]Recovery LDAP Config (#10429)
* recovery ladp code

* add ldap config in doc
2022-06-15 09:52:37 +08:00
Eric Gao
42d4aba347
[Bug][Tools] Add datasource url for mysql profile in tools application.yaml (#10399) 2022-06-14 20:20:54 +08:00
阿福Chris
8205444e0a
[DolphinScheduler] Fix wrong class name in doc (#10438) 2022-06-14 19:53:33 +08:00
陈家名
b86dc53ad1
[fix][Python] Support same task name in project defferent process definition (#10428)
close: #10431
2022-06-14 13:53:18 +08:00
Kirs
190f253083
[CI] Add OWASP Dependency Check (#10058) 2022-06-13 14:26:59 +08:00
Wenjun Ruan
78c5fcc6ac
Add mysql registry plugin (#10406)
* Add mysql registry plugin
2022-06-13 11:24:42 +08:00
Mr.An
a7e20798cb
Update chart.yaml dependencies version (#10420) 2022-06-13 10:27:34 +08:00
Amy0104
f0131d5b7a
[Feature][UI] Add manual input for scheduling dates. (#10396)
* [Feature][UI] Add manual input for scheduling dates.

* [Fix][UI] Fix singlequote.

* [Feature][UI] Remove check for duplicate scheduling dates.
2022-06-12 19:48:48 +08:00
WangJPLeo
c843e3a315
Fixed the problem of not having permission to modify the allocated resource data. (#10410) 2022-06-12 18:27:49 +08:00
xiangzihao
f4dad689d4
[Fix-10412] [Standalone] Failed to start standalone server according to the official document (#10414)
* fix bug_10412

* fix bug_10412
2022-06-12 16:16:57 +08:00
hstdream
f6fea06f10
[Improve] Enhance complement function transformation (#10376) 2022-06-12 12:35:08 +08:00
Jiajie Zhong
088c5e8ae2
[chore] Remove unnecessary badge total lines (#10405)
total lines badge meaningless to our project and is will cause
doc check failed sometiem

ref: https://github.com/apache/dolphinscheduler/actions/runs/2474962451/attempts/1
2022-06-11 15:14:22 +08:00
Wenjun Ruan
b0d9d3f9ab
Add some warning log in master (#10383)
* Add some warn log in master

* fix may skip sleep
2022-06-10 19:38:20 +08:00
Eric Gao
e6d39910fb
[Feature][Metrics] Enable prometheus to collect metrics in standalone mode demo (#10398) 2022-06-10 13:08:27 +08:00
JieguangZhou
3258438f6e
[Feature] [MLOps] support mlflow deploy with docker compose (#10217)
* [Feature] [MLOps] support mlflow deploy with docker compose

fix doc

Update docs/docs/en/guide/task/mlflow.md

fix doc

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>

revert cancel modification

fix ENV name and docker compose command

* fix doc image link

* fix testModelsDeployDockerCompose

* add docker compose container health check and fix mlflow bug

* update docker compose healthcheck timeout
2022-06-10 10:20:50 +08:00
WangJPLeo
9782fe4e7c
[Fix-10367] Permission check related key adjustment. (#10368)
* Permission check related key adjustment.

* resource create or upload fix.

* Analysis Permission fix.

* Ut coverage add.

* rerun

* source permission fix.

* ut coverage is achieved

* Reference permission package path modification

* k8s path bug fix.

* k8s path bug fix.

* Corrected controller method name and rerun.
2022-06-09 19:10:34 +08:00
xiangzihao
997f0d4bfd
[CI] Add some codeowner (#10385)
* add some codeowner

* add some codeowner
2022-06-09 17:06:27 +08:00
PJ Fanning
f90f0f8490
Upgrade log4j in E2E (#10359) 2022-06-09 16:09:46 +08:00