Commit Graph

7274 Commits

Author SHA1 Message Date
lynn-illumio
234f2e8a40
[Feat][UI] Set up UI setting component in profile page (#11226)
* Set up UI setting component in profile page

* Add UI setting page to the route, remove UI setting section from the profile

* Add log auto refresh timer store

* Add logTimer to pinia store and cookies

* Read logTimer from pinia store, and delay getLogs by passing the logTimer to setInterval in refreshLogs function

* Add log timer to getLogs

* Fine tune view log, add auto refresh based on time interval set in UI setting

* Add useI18n to ui setting

* Set up UI setting component in profile page

* Add UI setting page to the route, remove UI setting section from the profile

* Add log auto refresh timer store

* Add logTimer to pinia store and cookies

* Read logTimer from pinia store, and delay getLogs by passing the logTimer to setInterval in refreshLogs function

* Add log timer to getLogs

* Fine tune view log, add auto refresh based on time interval set in UI setting

* Add useI18n to ui setting

* [Feat][UI] Add UI setting page in the project.

* [Feat][UI] Add UI setting page in the project.

* Remove logTimer in cookies

* Clear timer id, set VITE_APP_DEV_WEB_URL back to default

* Clear time id in dag

* [Feat][UI] Add license header.

* [Feat][UI] Remove console.

* [Fix][UI] Fix log timer types.

Co-authored-by: songjianet <1778651752@qq.com>
2022-10-08 16:35:14 +08:00
David
7bdbd62985
[doc] Update slack invitation link (#12258) 2022-10-08 11:59:53 +08:00
aiwenmo
bd7e761136
[Fix-12254] [Registry] Modify the type of field named data into text (#12256)
Co-authored-by: wenmo <32723967+wenmo@users.noreply.github.com>
2022-10-08 09:47:04 +08:00
FlechazoW
0687697869
[Improvement][Task Plugin] Modify the comment of 'deployMode'. (#12163) 2022-10-07 21:21:13 +08:00
Yann Ann
7beff83e9f
[Doc] Add chmod command after unzip DS tar.gz (#12210) 2022-10-07 13:07:36 +08:00
Yann Ann
60c43d5d32
just add WorkerGroupMapper UT (#12242) 2022-10-06 20:10:48 +08:00
Yann Ann
3c4f9380d1
just correct wrong word (#12174) 2022-10-05 17:08:48 +08:00
Jiajie Zhong
6fc209ab9d
[fix][doc] Correct release export key step (#12228)
We should only add KEY to release/KEYS instead of
dev/KEYS, according to
https://lists.apache.org/thread/2gppxc04n0r87vq4qy4j3n52zwhqd442
2022-10-01 21:58:59 +08:00
Yann Ann
c87f6d89a4
[fix#12195] Change date to timestamp to support cross diff time zones (#12239)
* fix DS support cross time zone, use timestamp replace date
2022-10-01 12:50:42 +08:00
Wenjun Ruan
0a44107bf9
Fix hive datasource connection leak (#12226) 2022-10-01 06:57:12 +08:00
xuhhui
55388be21f
[Improvement][Master] LowerWeightRoundRobin doSelect may be null (#12159) 2022-09-30 20:00:23 +08:00
Eric Gao
585efe3ad5
[Improvement][Test] Remove the usage of powermock in datasource-plugin module (#12194)
* Remove the usage of powermock in datasource-plugin module

* Switch datasource-plugin module to use PropertyUtils in common module
2022-09-30 17:38:24 +08:00
caishunfeng
40090d459e
[Improvement] remove log-server and server module (#12206)
* remove log-server module

* remove dolphinscheduler-server module
2022-09-30 16:41:41 +08:00
Amy0104
64a23cdca2
[Improvement][UI] Set the required to be reactive in the task modal. (#12225) 2022-09-30 14:15:40 +08:00
Wenjun Ruan
aacabc6ec7
Remove workerGroup in registry (#12217) 2022-09-30 13:58:53 +08:00
caishunfeng
a055cf5791
[Release][Doc] add 3.1.0 release (#12227)
* [Release] add 3.1.0 release to doc
2022-09-30 12:14:29 +08:00
JieguangZhou
308f632fcc
[Feature][TASK-PLUGIN] AWS Database Migration Service (DMS) (#11868)
* add aws dms
2022-09-30 10:16:16 +08:00
rickchengx
db9db944a6
[Improvement-11880][Hivecli] Improve the UI of HiveCli (#11882) 2022-09-30 09:56:35 +08:00
HomminLee
1a4d7a8426
[Improvement-11678][API] Improvement the error message when batch delete workflow (#11682)
* [Improvement] Improvement the error message when batch delete workflow
2022-09-29 19:08:26 +08:00
sgw
962fa6dbd5
[DS-12154][worker] Optimize the log printing of the worker module (#12183)
* [DS-12154][worker] Optimize the log printing of the worker module according to the log specification.
2022-09-29 16:01:29 +08:00
fuchanghai
e27c79974d
[fix-#11753] send alert error alert data id (#11774)
* [fix-#11753] send alert error alert data id

Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>
2022-09-29 15:34:40 +08:00
rickchengx
57fafe4256
[Improvement-12144] Remove powermock in dolphinschduler-api (#12169) 2022-09-29 12:00:41 +08:00
fuchanghai
c7d9719e97
[improvement] improve relation between notification strategy and alarm group on ui (#12200)
* [improvement] improve relation between notification strategy and alarm group

* [improvement] change to use ```&&```

Co-authored-by: Jackie <‘2875334588@qq.com’>
2022-09-29 11:22:10 +08:00
Jiajie Zhong
d3f087e29b
[feat][ci] Add pre-commit for easy spotless config (#12192)
* Use pre-commit to handle spotless check
* Migrate exists python pre-commit-config into dir root one
* Change related document
2022-09-29 10:10:53 +08:00
Eric Gao
d1e409e9a2
[Improvement][Test] Remove powermock in service and server modules (#12164)
* Remove powermock and refactor some related code in dolphinscheduler-service and dolphinscheduler-server modules
* Remove redundant comments
* Add null check
2022-09-29 08:16:23 +08:00
darkz
995c1480f9
[Document][Improvement] Polish docs for standalone deployment (#12181)
* Polish docs for standalone deployment
2022-09-28 20:32:22 +08:00
JieguangZhou
856083d591
fix ml group (#12172) 2022-09-28 18:30:52 +08:00
TyrantLucifer
4973b30efb
[Feature][doc] Add a guide to nominate new committer (#12175)
Co-authored-by: Kirs <ACM_China@yeah.net>
2022-09-28 14:23:09 +08:00
Stalary
aa5526ef5d
[Improvement][Test] Remove Powermock in dolphinscheduler-task-plugin (#12153)
* Remove the usage of powermock in task-plugin module
2022-09-28 14:13:23 +08:00
Jiajie Zhong
ad4f344283
[fix][test] Fix flaky test in CI (#12017) 2022-09-28 14:05:26 +08:00
Wenjun Ruan
d526dd89f6
[hotfix][UI] Remove SURVEIL and NEXT_LOOP in ui (#12160)
* Remove SURVEIL and NEXT_LOOP in ui

* Fix UT
2022-09-28 09:17:12 +08:00
Chris
7ed52c3ecb
[improve][python] Validate version of Python API at launch (#11626) 2022-09-27 21:28:20 +08:00
xuhhui
6466cc7c41
[Improvement][Master] Construct processInstance may NPE when master handling command (#12056)
* [Improvement][Master] Construct processInstance may NPE when master handling command

* use an enpty map

Co-authored-by: xuhaihui <xuhaihui@cmss.chinamobile.com>
2022-09-27 09:13:48 +08:00
Jiajie Zhong
b95db44130
[fix][doc] Do not change docsdev.js during releasing (#12151)
ref: https://github.com/apache/dolphinscheduler/pull/12146#discussion_r979708629
and https://github.com/apache/dolphinscheduler-website/pull/829
2022-09-26 21:46:18 +08:00
Devosend
87490a34cc
fix env config space bug (#12147) 2022-09-26 19:06:56 +08:00
Eric Gao
cc82206c33
Remove powermock in dolphinscheduler-master module (#12143)
* Remove powermock related code in dolphinscheduler-master module
* Remove redundant comments, useless code and unnecessary stubbings
2022-09-26 17:02:14 +08:00
Kerwin
4269fa7ea7
[release][doc] Add release 3.0.1 (#12139)
* add release 3.0.1
* add 30x version in the github bug report
2022-09-26 16:18:31 +08:00
冯剑
779a0b9c75
[Improvement-#11608][task-plugin] New time variables are added to facilitate business development (#11667)
Add new time expressions for users' convenience

Co-authored-by: 冯剑 Jian <jian.feng@jiduauto.com>
Co-authored-by: David <dailidong66@gmail.com>
2022-09-26 16:01:32 +08:00
caishunfeng
151c2d2c70
fix upgrade sql (#12141) 2022-09-26 15:21:52 +08:00
Tq
cf5a8894e2
[BUG][BE-12113]fix htrace dependency conflicts (#12126)
* fix htrace dependency conflicts

* replace htrace-core with hbase-noop-htrace
2022-09-26 13:49:08 +08:00
zhuxt2015
e6832220c3
[Improvement][SQL Task]use default sql segment separator (#10869) 2022-09-26 11:08:57 +08:00
labbomb
64f4cb4f3e
refactor: dag-menu refactor (#11965)
* refactor: dag-menu refactor

* feat: add i18n support for the dag-menu

* feat: add e2e class

Co-authored-by: devosend <devosend@gmail.com>
Co-authored-by: Tq <tianqitobethefirst@gmail.com>
2022-09-26 11:06:39 +08:00
Yann Ann
289e1ecdc6
[Bug] [Common] update IPv4 Pattern (#11762)
* [Bug] [Common] IPv4 Pattern is wrong. #11758
2022-09-26 09:10:22 +08:00
Yann Ann
ada7cf71d5
[fix#12000]Cannot remove the WorkerGroup from the master service (#12050)
* [Bug] [Master] Cannot remove the WorkerGroup from the master service. #12000

* remove unnecessary locks

* Update dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/registry/ServerNodeManager.java

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-09-24 18:57:20 +08:00
Eric Gao
064224696f
[Doc][Improvement] Add instructions for process execution type and data complement (#12121)
* Add instructions for process execution type and data complement

* Fix and polish the docs
2022-09-24 09:59:02 +08:00
Jiajie Zhong
82ddd72e4a
[Feature][API] New restful API for workflow and schedule (#11912)
* [feat] New restful API for workflow and schedule

CURD for workflow and schedule, different with exists
API, this new restful api only operate single resource
in each request, and return the latest. For example,
previous workflow should also need to post tasks definition
and tasks relation definition, but this patch will allow
you to create workflow without task relate information

* use checkProjectAndAuthThrowException, and fix CI error

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/ScheduleV2Controller.java

* change method name
from createProcessDefinitionV2 to createSingleProcessDefinition
from updateProcessDefinitionV2 to updateSingleProcessDefinition

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-09-23 22:25:19 +08:00
Jiajie Zhong
a86f4e2693
[fix][python] Task switch branch not show in webui (#12120)
when create task switch in python api, switch branch not show correctly,
due to we add some unnecessary attribute to switch task, this patch we
add `_task_ignore_attr` in class `Task` to ignore those unnecessary
attribute from `_task_default_attr`
2022-09-23 19:41:05 +08:00
Jiajie Zhong
2531c222de
[Fix] Also auto formatter workflow instance if location is null (#12080)
* [fix] Also auto formatter workflow instance if location is null

In #11535(096fae77) and #11681(4dca488c), we already formatter
workflow definition, but I find out we forget formatter workflow
instance with definition's location is null, this patch also
formatter workflow instance.

* remove console log
2022-09-23 18:20:39 +08:00
JieguangZhou
6eb1eb722a
fix python home conflict (#12112) 2022-09-23 09:40:18 +08:00
Amy0104
e11e129cda
[Improvement][UI] Add filterable for src_table and target_table in the data quality task. (#12099) 2022-09-22 20:43:34 +08:00