Commit Graph

6712 Commits

Author SHA1 Message Date
xiangzihao
e50739465d
[Feature-10411] Add tenant api test (#10442)
* add feature_10411

* add feature_10411

* update README.md

* fix README.md deadlink

* fix error log output

* fix comment
2022-06-15 16:29:36 +08:00
Amy0104
d516369e80
[Fix][UI] Add loading before file modification data is returned. (#10450) 2022-06-15 15:06:06 +08:00
qianli2022
ff065d8e5b
[Feature][Improvement] Support multi cluster environments - k8s type (#10096)
* service code

* [Feature][UI] Add front-end for cluster manage

* fix e2e

* remove comment on cluster controller

* doc

* img

* setting e2e.yaml

* test

* rerun e2e

* fix bug from comment

* Update index.tsx

use Nspace instead of css.

* Update index.tsx

Remove the style.

* Delete index.module.scss

Remove the useless file.

Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
2022-06-15 13:39:20 +08:00
Jiajie Zhong
b655aa9b1f
[doc] Correct resource in HDFS HA cluster (#10445) 2022-06-15 11:08:18 +08:00
旺阳
50846760e5
[fix-10386]LDAP user create with status enable (#10426)
* LDAP user create with status enable

* currect unit test
2022-06-15 10:19:27 +08:00
旺阳
0efcd5c631
[Fix-10425]Recovery LDAP Config (#10429)
* recovery ladp code

* add ldap config in doc
2022-06-15 09:52:37 +08:00
Eric Gao
42d4aba347
[Bug][Tools] Add datasource url for mysql profile in tools application.yaml (#10399) 2022-06-14 20:20:54 +08:00
阿福Chris
8205444e0a
[DolphinScheduler] Fix wrong class name in doc (#10438) 2022-06-14 19:53:33 +08:00
陈家名
b86dc53ad1
[fix][Python] Support same task name in project defferent process definition (#10428)
close: #10431
2022-06-14 13:53:18 +08:00
Kirs
190f253083
[CI] Add OWASP Dependency Check (#10058) 2022-06-13 14:26:59 +08:00
Wenjun Ruan
78c5fcc6ac
Add mysql registry plugin (#10406)
* Add mysql registry plugin
2022-06-13 11:24:42 +08:00
Mr.An
a7e20798cb
Update chart.yaml dependencies version (#10420) 2022-06-13 10:27:34 +08:00
Amy0104
f0131d5b7a
[Feature][UI] Add manual input for scheduling dates. (#10396)
* [Feature][UI] Add manual input for scheduling dates.

* [Fix][UI] Fix singlequote.

* [Feature][UI] Remove check for duplicate scheduling dates.
2022-06-12 19:48:48 +08:00
WangJPLeo
c843e3a315
Fixed the problem of not having permission to modify the allocated resource data. (#10410) 2022-06-12 18:27:49 +08:00
xiangzihao
f4dad689d4
[Fix-10412] [Standalone] Failed to start standalone server according to the official document (#10414)
* fix bug_10412

* fix bug_10412
2022-06-12 16:16:57 +08:00
hstdream
f6fea06f10
[Improve] Enhance complement function transformation (#10376) 2022-06-12 12:35:08 +08:00
Jiajie Zhong
088c5e8ae2
[chore] Remove unnecessary badge total lines (#10405)
total lines badge meaningless to our project and is will cause
doc check failed sometiem

ref: https://github.com/apache/dolphinscheduler/actions/runs/2474962451/attempts/1
2022-06-11 15:14:22 +08:00
Wenjun Ruan
b0d9d3f9ab
Add some warning log in master (#10383)
* Add some warn log in master

* fix may skip sleep
2022-06-10 19:38:20 +08:00
Eric Gao
e6d39910fb
[Feature][Metrics] Enable prometheus to collect metrics in standalone mode demo (#10398) 2022-06-10 13:08:27 +08:00
JieguangZhou
3258438f6e
[Feature] [MLOps] support mlflow deploy with docker compose (#10217)
* [Feature] [MLOps] support mlflow deploy with docker compose

fix doc

Update docs/docs/en/guide/task/mlflow.md

fix doc

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>

revert cancel modification

fix ENV name and docker compose command

* fix doc image link

* fix testModelsDeployDockerCompose

* add docker compose container health check and fix mlflow bug

* update docker compose healthcheck timeout
2022-06-10 10:20:50 +08:00
WangJPLeo
9782fe4e7c
[Fix-10367] Permission check related key adjustment. (#10368)
* Permission check related key adjustment.

* resource create or upload fix.

* Analysis Permission fix.

* Ut coverage add.

* rerun

* source permission fix.

* ut coverage is achieved

* Reference permission package path modification

* k8s path bug fix.

* k8s path bug fix.

* Corrected controller method name and rerun.
2022-06-09 19:10:34 +08:00
xiangzihao
997f0d4bfd
[CI] Add some codeowner (#10385)
* add some codeowner

* add some codeowner
2022-06-09 17:06:27 +08:00
PJ Fanning
f90f0f8490
Upgrade log4j in E2E (#10359) 2022-06-09 16:09:46 +08:00
Hwting
5803d5c07c
[fix][deploy]fix run on kubernetes bug (#10379)
* [fix][kubernetes]fix run on kubernetes bug

Fix the problem that the "REGISTRY_ZOOKEEPER_CONNECT_STRING" variable zookeeper port number is "nil"

* [fix][kubernetes]fix run on kubernetes bug

Fix the problem that the "REGISTRY_ZOOKEEPER_CONNECT_STRING" variable zookeeper port number is "nil"
2022-06-09 15:57:20 +08:00
xiangzihao
bbba20d39a
change to common lang3 and fix checkstyle (#10380) 2022-06-09 15:56:42 +08:00
Wenjun Ruan
e21d7b1551
[Feature][metrics] Add master, worker metrics (#10326)
* Add mater metrics

* fix UT

* Add url to mysql profile

* Add worker metrics

* Update grafana config

* Add system metrics doc

* Add process failover counter

* Add metrics image

* Change jpg to png

* Add command insert metrics

* Fix UT

* Revert UT
2022-06-09 10:55:39 +08:00
Wenjun Ruan
3ecbee3885
Optimize MasterServer, add MasterRPCService (#10371)
* Optimize MasterServer, avoid NPE
2022-06-09 10:00:05 +08:00
xiangzihao
b1fb17119b
[Feature-6758][Task] Add limit resource usage for tasks base on cgroup (#10373) 2022-06-08 19:42:05 +08:00
chuxing
7e39e0d48d
[doc] Add switch task demo (#10247)
Co-authored-by: QuakeWang <45645138+QuakeWang@users.noreply.github.com>
2022-06-08 14:17:05 +08:00
songjianet
36bba3fcdf
[Docs] Upgrade license. (#10365) 2022-06-06 11:16:06 +08:00
retime123
67c4f2b259
[Feature][Monitoring] Added disk available capacity monitoring (#10287)
* Added disk available capacity monitoring

* resolve conflict
Added disk available capacity monitoring

* resolve conflict
Added disk available capacity monitoring

* resolve conflict
Added disk available capacity monitoring
2022-06-06 11:06:33 +08:00
Wenjun Ruan
516757cc74
[Fix] [Worker] Fix worker will hang if fails to start (#10342)
* Fix worker will hang if fails to start

* Add .run to ignore
2022-06-06 10:49:23 +08:00
He Zhao
da3c25dc67
[improve] Using create or replace function in sql task (#10170) 2022-06-06 10:33:24 +08:00
WangJPLeo
ffe809b2c5
[Fix-10338] Tenant does not belong to resource permission. (#10339)
* Tenant does not belong to resource permission.

* rerun

* rerun again

* resource create and upload fix.

* func constant clear.
2022-06-05 22:34:25 +08:00
Kirs
0c25d4a3ce
[Docs]Update Slack Invite Link (#10362) 2022-06-04 23:55:23 +08:00
Wenjun Ruan
2d3be6b36c
Add dolphinscheduler-scheduler module (#10360)
* Add dolphinscheduler-scheduler module
2022-06-04 16:39:33 +08:00
Wenjun Ruan
022e4886be
Remove quartz at WorkerServer (#10358)
* Remove quartz at WorkerServer

* move k8s and permission from dolphinscheduler-service to dolphinscheduler-api
2022-06-04 00:18:01 +08:00
PJ Fanning
d044e0479d
issue-10356: upgrade logback to fix cve (#10357) 2022-06-03 19:21:40 +08:00
PJ Fanning
b6350280e6
issues-10354: upgrade commons-io to fix CVE (#10355) 2022-06-03 17:17:52 +08:00
Wenjun Ruan
0bf4043d5f
Move datasource params to datasouce plugin module (#10353)
* Move datasource params to datasouce plugin module
2022-06-03 12:15:53 +08:00
Jiajie Zhong
12fdd9bbd9
[doc] Use related path for img (#10325)
Use related path in our docs for imgs, previous
can not use because website need the absolute path
from root directory, and after we merged
apache/dolphinscheduler-website#789 we have covert
function to do that

close: #9426
2022-06-02 23:28:53 +08:00
Wenjun Ruan
b02243c2f5
Add dolphinscheduler-task-all in api module (#10350) 2022-06-02 22:12:27 +08:00
guodong
96496f7255
[Fix-10318][ui] Fix EMR Task UI custom parameters Is not correct (#10334)
* Modify useCustomParams isSimple: true
2022-06-02 18:51:43 +08:00
xiangzihao
35155cde9a
[CI] Add code owner of .github (#10347)
* add code owner

* add code owner

* add code owner
2022-06-02 18:34:03 +08:00
songjianet
6134e0a628
[Build][UI] Upgrade dependencies. (#10346)
* [Build][UI] Upgrade dependencies.

* [Build][UI] Upgrade dependencies.

* [Build][UI] Upgrade dependencies.
2022-06-02 18:23:57 +08:00
xiangzihao
50e9f2916a
[CI] bumping actions/cache to v3 to fix ci error (#10345)
* bumping actions/cache to v3

* fix JSONUtilsTest.java unit test error
2022-06-02 17:26:52 +08:00
xiangzihao
d1c47c99ad
fix bug_10343 (#10344) 2022-06-02 16:13:51 +08:00
guodong
70dbcb2155
[Fix-10305][common] AWS config Constant definitions are repeated (#10311) 2022-06-02 13:56:36 +08:00
WangJPLeo
e57c2d1663
[Feature] Should not add refresh logic in the e2e case. (#10331)
* Should not add refresh logic in the e2e case.

* When the returned data from paging is empty, it should be an empty collection.

* resource query fix.

* e2e rerun

* timeZone ut fix

* udf resource check fix

* code deduplication

* rerun
2022-06-02 09:48:32 +08:00
songjianet
e8ad62bcd0
[Fix][UI] Fixed the issue that the status statistics on the project overview page were inconsistent. (#10328) 2022-06-01 21:50:43 +08:00