Commit Graph

6801 Commits

Author SHA1 Message Date
WangJPLeo
8f621ff98b
[Optimization] Calculate global parameter and local parameter at master. (#10704)
* Global parameter and local parameter calculation external expansion.

* k8s task ut fix.

* TimePlaceholderUtils import DateUtils fix

* follow the review comments to fix.

* follow the review comments to fix.

* e2e rerun
2022-06-30 22:45:25 +08:00
Stalary
a45fc5b032
[doc] Add doc for pre-sql and post-sql (#10685) 2022-06-30 20:01:23 +08:00
WangJPLeo
fcf4110ed8
resource modules query fix. (#10687) 2022-06-30 19:28:40 +08:00
Wenjun Ruan
1b86394d3c
Optimize sql script use insert ignore (#10700) 2022-06-30 19:04:57 +08:00
caishunfeng
b6a3075a42
[Improvement] heartbeat info improvement (#10699)
* heartbeat info improvement

* import order
2022-06-30 18:44:50 +08:00
Devosend
77fea14461
[Fix][UI] Fix bug where the home page displays no data. (#10697) 2022-06-30 18:32:32 +08:00
caishunfeng
c2f1886306
[doc] Update metadata and design doc (#10600) 2022-06-30 17:48:17 +08:00
Wenjun Ruan
247ca4ae8a
[Improvement-10617] Add comment in slot check (#10618) 2022-06-30 15:58:49 +08:00
Lyle Shaw
5855274b26
[Fix-10652] fix docker-compose.yml (#10653)
* [Fix-10652] fix docker-compose.yml

* [Fix-10652] fix docker-stack.yml

* [Fix-10652] fix python api port in k8s config

* Update deploy/kubernetes/dolphinscheduler/templates/deployment-dolphinscheduler-api.yaml

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>

* [Fix-10652] fix { { to {{

* [Fix-10652] del space between {{ and -

Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-06-30 15:43:19 +08:00
songjianet
a90e5746fc
[Refactor][UI] Refactor k8s namespace manage using NSpace component. (#10682) 2022-06-30 11:28:33 +08:00
songjianet
e6efac6223
[Refactor][UI] Refactor token manage using NSpace component. (#10681) 2022-06-30 11:18:55 +08:00
songjianet
cf7776fb8d
[Refactor][UI] Refactor yarn queue manage using NSpace component. (#10680) 2022-06-30 09:32:52 +08:00
songjianet
3fbfa27f13
[doc] Replace the dag screenshot of the README. (#10662) 2022-06-29 15:03:35 +08:00
sneh-wha
1cdbbc1ba5
[doc] Modified parameter doc files. (#10659) 2022-06-29 14:42:37 +08:00
wjf
75581b7543
[Improvement]Delete the getSession in the Registry interface (#10633) 2022-06-29 11:20:52 +08:00
zhuxt2015
7e7df1d8ff
[Bug] [Task] SQL task no exception stack trace in task log (#10656) 2022-06-29 09:57:05 +08:00
juzimao
e0b0f986f7
[Fix-10641] [Common] Fix the hdfs NPE (#10642)
Fix the hdfs NPE (#10642)
2022-06-28 22:51:09 +08:00
zhuxt2015
5ebd982e92
[Bug] [Api] The copied workflow create time and update time is still copied from the original workflow 2022-06-28 21:33:58 +08:00
Wenjun Ruan
35b25da863
Validate master/worker config (#10649) 2022-06-28 20:17:43 +08:00
Wenjun Ruan
66624c5c86
[Bug] [Master] Worker failover will cause task cannot be failover (#10631)
* fix worker failover may lose event
2022-06-28 16:08:35 +08:00
Wenjun Ruan
cd62de968d
Add JDK11 on unit-test (#10364) 2022-06-28 14:21:51 +08:00
WangJPLeo
b5184138fa
[Feature] Time function analysis extension. (#10624)
* Time function analysis extension.

* param add.

* clear useless logs and update method notes

* permission omission fix.

* extending time functions to optimize static methods

* e2e rerun.
2022-06-28 11:24:51 +08:00
秋天
d021da4dfb
[fix-10632][ui] fix the workflow name with underline cannot be displayed correctly error. (#10636)
- add workflow name span padding-bottom css style to fix this error

This closes #10632

Co-authored-by: jiangkang <jiangkang@cmss.chinamobile.com>
2022-06-28 11:04:18 +08:00
Jiajie Zhong
bbc1e052ab
[ci] mergable do not handle label (#10638)
mergable some time will become crazy and adding
or deleting labels in the PR. This affects the
user experience. I try to solve it in #7099 but
it is seems not affect and we should remove the
label and comment operation and only should the
result in check result.
2022-06-27 20:22:58 +08:00
sneh-wha
1f46078ab8
[doc] Change subprocess dependent (#10637) 2022-06-27 19:30:35 +08:00
liudi1184
56d3db0306
[fix-10596] Workflow relationship cannot be displayed normally (#10625)
Workflow relationship cannot be displayed normally

Closes #10596

Co-authored-by: liudadi <liudi@thinkingdata.cn>
2022-06-27 17:26:41 +08:00
sneh-wha
a14b96b091
[doc] Modify Shell task file (#10634) 2022-06-27 17:22:09 +08:00
Amy0104
a6fc70cdd1
[Fix][UI] Fix bytesToSize function calculation error. (#10627) 2022-06-27 13:55:37 +08:00
Jiajie Zhong
cd51a22940
[doc] Correct installPath when using related path (#10597)
correct the doc and add hint to setting

ref: #10511
2022-06-27 11:02:19 +08:00
pinkhello
b8de9ee752
[Fix-10539] [Bug] [UI] Copy task a to B, change the user-defined para… (#10611)
* fixed 10539: [Bug] [ui]Copy task a to B, change the user-defined parameters of Task B, and change the parameters of task a

* fixed 10539: [Bug] [ui]Copy task a to B, change the user-defined parameters of Task B, and change the parameters of task a

* feat: reactor code

* feat: remove console.info

* fixed: reactor deepclone

* feat: code style
2022-06-27 10:53:13 +08:00
HomminLee
dafed572d1
[Fix][dolphinscheduler-spi] json parse support LocalDateTime (#10440)
* JSONUtils support LocalDateTime

* remove extraneous unit tests

* remove unused classes import.

Co-authored-by: HomminLee <lihongmin@ysstech.com>
2022-06-27 10:19:28 +08:00
pinkhello
719a9d4532
[Improvement][Worker] fixed naming of rpc package (#10614) 2022-06-26 10:30:09 +08:00
pinkhello
628c8ab2a1
[Improvement][Master] batch remove TaskInstaceId and workflowInstanceId (#10620) 2022-06-26 10:07:35 +08:00
Eric Gao
16144a8858
[docs] Add links to metrics docs (#10583) 2022-06-24 17:27:40 +08:00
Stalary
b2df357814
[doc] Add run the task alone doc. (#10581) 2022-06-24 16:59:22 +08:00
xiangzihao
33cc68ed4a
[doc] Add doc about how to use healthcheck endpoints (#10592) 2022-06-24 16:56:26 +08:00
xiangzihao
397e51fa63
dependent node log output optimization and fix checkstyle (#10593) 2022-06-24 16:48:58 +08:00
xiangzihao
b21e211d2c
[doc] Add docs about complement dependent mode (#10587) 2022-06-24 16:33:10 +08:00
旺阳
0b377f72b1
[Fix-10400]Fix K8s deployment bitnami version error (#10567)
* Fix k8s bitnami bug

* add comments
2022-06-24 15:29:26 +08:00
Jiajie Zhong
15a86071d1
[feat] ui build no inherit from maven proxy (#10590)
Users may set in for maven setting.xml. but
frontend-maven-plugin will inherit proxy setting
from it. And pnpm not support both `--proxy` and
`--https-proxy` and will fail ui build. This patch
make pnpm run without inherits maven proxy.

ref: https://github.com/eirslett/frontend-maven-plugin#proxy-settings
and 9f39dbad09/frontend-maven-plugin/src/main/java/com/github/eirslett/maven/plugins/frontend/mojo/PnpmMojo.java (L28)
2022-06-24 13:35:36 +08:00
xiangzihao
1111371c9a
add datasource health check to the healthcheck endpoint (#10588) 2022-06-24 13:29:49 +08:00
陈家名
7970573365
[python] Support using full-name definitions for resources (#10551) 2022-06-23 22:59:59 +08:00
xiangzihao
393cb648f9
fix dependent task re-run params error (#10580) 2022-06-23 20:49:28 +08:00
xiangzihao
7a292cfccf
fix standalone start error (#10577) 2022-06-23 16:35:39 +08:00
xiangzihao
0f38217b12
fix_10514 (#10568) 2022-06-23 16:15:08 +08:00
飞侠美如画
08e2c245a8
Update SparkRuntimeEnvironment.java (#10549)
Add spark support for hive
2022-06-23 14:17:45 +08:00
xiangzihao
773ebc9e52
fix 10513 (#10564) 2022-06-23 13:44:22 +08:00
houshitao
1b1a567fec
[doc] Correct the complement add docs (#10521) 2022-06-23 12:02:28 +08:00
Wenjun Ruan
db595b3eff
Optimize master log, use MDC to inject workflow instance id and task instance id in log (#10516)
* Optimize master log, add workflow instance id and task instance id in log

* Use MDC to set the workflow info in log4j

* Add workflowInstanceId and taskInstanceId in MDC
2022-06-23 11:45:06 +08:00
旺阳
388b214aca
[fix] Change K8s postgresql password key name (#10545) 2022-06-23 11:37:56 +08:00