Commit Graph

7296 Commits

Author SHA1 Message Date
Jiajie Zhong
501119bbb6
[doc] Change release process base on new tool (#12324)
ref: #11478 we already have a new tool for releasing
2022-10-12 09:52:14 +08:00
Jiajie Zhong
2525545a41
[dev] Easier release: cherry-pick, changelog, contributor (#11478)
Add script for  easier release including cherry pick,
generating changelog and contributor list

* Auto cherry-pick: `python release.py cherry-pick`
* Generate changelog: `python release.py changelog`
* Generate contributor: `python release.py contributor`

close: #11289
related: #12222
2022-10-12 09:00:59 +08:00
jegger
04e1b88c1c
[fix] Fix error problem on h2 startup data quality rule management page (#12108)
Co-authored-by: jegger <zhangbq3306@163.com>
2022-10-11 16:52:35 +08:00
rickchengx
05099bd8f7
[Improvement-12296][Test] Close static mock (#12300) 2022-10-11 16:13:05 +08:00
Eric Gao
875682d267
[Improvement][Test] Migrate all UT cases from jUnit4 to jUnit5 in task-plugin module as an example (#12299)
* Migrate all UT cases from jUnit4 to jUnit5 in task-plugin module as an example
2022-10-11 11:54:38 +08:00
jackfanwan
18ef0a66cb
Set the id to null when copying t_ds_schedules (#12280)
Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2022-10-11 10:53:25 +08:00
Ivan
98a8b5383e
[ fix: #11590 ][upgrade] Fix the bugs when I upgrade ds from v1.3.9 to v3.0.0 ,such as file cannot be found or column not found etc (#11619)
* fix the bugs which upgrade ds metabase from v1.3.9 to v3.0.0 with mysql

* [Fix-11590][upgrade] Fix the bugs when I upgrade ds from v1.3.9 to v3.0.0 ,such as file cannot be found or column not found etc

* fix: #11590 add process_instance_code_state_index with table t_ds_process_instance to improve query efficiency for the method of findLastProcessInterval

* Fix the bug  that cannot find the files when upgrade ds version with postgresql

Co-authored-by: fan.wang <fan.wang@jiduauto.com>
2022-10-11 10:20:05 +08:00
chenrj
e1ac0e2605
[python] Add new resource plugin: gitlab, OSS and S3 (#12025)
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-10-10 18:07:57 +08:00
Jiajie Zhong
a973054950
[ci] Milestone and Label are required before the PR merged (#12222)
To make our release process easier, I plan to mark milestone
and label is required before the PR merged, they use for

* label: In this path we required label with at least on with
  'feature|bug|improvement|document|chore' to make our changelog
  more convenient
* milestone: For easier to cherry-pick PR, currently some of
  our milestone only exists in issue and not exists in related
  PR, it may
2022-10-10 15:20:51 +08:00
tuchg
ef328d9cea
Update ZooKeeper minimum version requirements (#12284) (#12288) 2022-10-10 15:08:07 +08:00
Ivan
d9ac1fa0f7
[Fix#12231][scheduler-plugin] fix the bug which some scheduled tasks are not triggered on time (#12233)
Co-authored-by: fan.wang <fan.wang@jiduauto.com>
2022-10-10 14:01:02 +08:00
Chris-Arith
c8bd106604
create oracle help.md (#12218)
* create oracle help.md

* Add files via upload

allow Oracle to choose schema

* move pic under img and add title for oracle.md
2022-10-10 13:53:20 +08:00
Eric Gao
9ab79e064c
[Improvement][Test] Fully remove the usage of powermock from the whole project (#12244)
* Fully remove the usage of powermock from the whole project

* Upgrade org.reflections to 0.10.12
2022-10-10 10:43:38 +08:00
fuchanghai
dec28b5c2e
[improve] Correct some log in scheduler (#12278) 2022-10-10 09:42:57 +08:00
fuchanghai
9b1ee1516f
[doc] Correct descriptions in glossary.md (#12282) 2022-10-10 09:37:15 +08:00
calvin
b4947b471c
fix this issue (#12281) 2022-10-10 09:34:32 +08:00
Tq
7bf49a7179
delete useless exclusions (#12273)
delete software.amazon.awssdk datasync useless dependency exclusions
2022-10-09 14:29:46 +08:00
sgw
165b9a58de
[DS-12131][master] Optimize the log printing of the master module acc… (#12152)
* [DS-12131][master] Optimize the log printing of the master module according to the log specification.
2022-10-09 13:56:50 +08:00
Eric Gao
a865be09b6
Remove powermock from DatasyncTaskTest (#12270) 2022-10-09 12:38:03 +08:00
Tq
c7435a51ac
[Feature][task-plugins] aws datasync task plugins (#11865)
* submit datasync task

* add aws software package license
2022-10-09 10:47:01 +08:00
Wenjun Ruan
2e4a9e6d53
Fix mysql registry doesn't support array (#12255) 2022-10-09 09:36:59 +08:00
TyrantLucifer
61457d1c2f
[Hotfix][Docs] Fix 404 dead links (#12261) 2022-10-08 19:43:35 +08:00
lynn-illumio
234f2e8a40
[Feat][UI] Set up UI setting component in profile page (#11226)
* Set up UI setting component in profile page

* Add UI setting page to the route, remove UI setting section from the profile

* Add log auto refresh timer store

* Add logTimer to pinia store and cookies

* Read logTimer from pinia store, and delay getLogs by passing the logTimer to setInterval in refreshLogs function

* Add log timer to getLogs

* Fine tune view log, add auto refresh based on time interval set in UI setting

* Add useI18n to ui setting

* Set up UI setting component in profile page

* Add UI setting page to the route, remove UI setting section from the profile

* Add log auto refresh timer store

* Add logTimer to pinia store and cookies

* Read logTimer from pinia store, and delay getLogs by passing the logTimer to setInterval in refreshLogs function

* Add log timer to getLogs

* Fine tune view log, add auto refresh based on time interval set in UI setting

* Add useI18n to ui setting

* [Feat][UI] Add UI setting page in the project.

* [Feat][UI] Add UI setting page in the project.

* Remove logTimer in cookies

* Clear timer id, set VITE_APP_DEV_WEB_URL back to default

* Clear time id in dag

* [Feat][UI] Add license header.

* [Feat][UI] Remove console.

* [Fix][UI] Fix log timer types.

Co-authored-by: songjianet <1778651752@qq.com>
2022-10-08 16:35:14 +08:00
David
7bdbd62985
[doc] Update slack invitation link (#12258) 2022-10-08 11:59:53 +08:00
aiwenmo
bd7e761136
[Fix-12254] [Registry] Modify the type of field named data into text (#12256)
Co-authored-by: wenmo <32723967+wenmo@users.noreply.github.com>
2022-10-08 09:47:04 +08:00
FlechazoW
0687697869
[Improvement][Task Plugin] Modify the comment of 'deployMode'. (#12163) 2022-10-07 21:21:13 +08:00
Yann Ann
7beff83e9f
[Doc] Add chmod command after unzip DS tar.gz (#12210) 2022-10-07 13:07:36 +08:00
Yann Ann
60c43d5d32
just add WorkerGroupMapper UT (#12242) 2022-10-06 20:10:48 +08:00
Yann Ann
3c4f9380d1
just correct wrong word (#12174) 2022-10-05 17:08:48 +08:00
Jiajie Zhong
6fc209ab9d
[fix][doc] Correct release export key step (#12228)
We should only add KEY to release/KEYS instead of
dev/KEYS, according to
https://lists.apache.org/thread/2gppxc04n0r87vq4qy4j3n52zwhqd442
2022-10-01 21:58:59 +08:00
Yann Ann
c87f6d89a4
[fix#12195] Change date to timestamp to support cross diff time zones (#12239)
* fix DS support cross time zone, use timestamp replace date
2022-10-01 12:50:42 +08:00
Wenjun Ruan
0a44107bf9
Fix hive datasource connection leak (#12226) 2022-10-01 06:57:12 +08:00
xuhhui
55388be21f
[Improvement][Master] LowerWeightRoundRobin doSelect may be null (#12159) 2022-09-30 20:00:23 +08:00
Eric Gao
585efe3ad5
[Improvement][Test] Remove the usage of powermock in datasource-plugin module (#12194)
* Remove the usage of powermock in datasource-plugin module

* Switch datasource-plugin module to use PropertyUtils in common module
2022-09-30 17:38:24 +08:00
caishunfeng
40090d459e
[Improvement] remove log-server and server module (#12206)
* remove log-server module

* remove dolphinscheduler-server module
2022-09-30 16:41:41 +08:00
Amy0104
64a23cdca2
[Improvement][UI] Set the required to be reactive in the task modal. (#12225) 2022-09-30 14:15:40 +08:00
Wenjun Ruan
aacabc6ec7
Remove workerGroup in registry (#12217) 2022-09-30 13:58:53 +08:00
caishunfeng
a055cf5791
[Release][Doc] add 3.1.0 release (#12227)
* [Release] add 3.1.0 release to doc
2022-09-30 12:14:29 +08:00
JieguangZhou
308f632fcc
[Feature][TASK-PLUGIN] AWS Database Migration Service (DMS) (#11868)
* add aws dms
2022-09-30 10:16:16 +08:00
rickchengx
db9db944a6
[Improvement-11880][Hivecli] Improve the UI of HiveCli (#11882) 2022-09-30 09:56:35 +08:00
HomminLee
1a4d7a8426
[Improvement-11678][API] Improvement the error message when batch delete workflow (#11682)
* [Improvement] Improvement the error message when batch delete workflow
2022-09-29 19:08:26 +08:00
sgw
962fa6dbd5
[DS-12154][worker] Optimize the log printing of the worker module (#12183)
* [DS-12154][worker] Optimize the log printing of the worker module according to the log specification.
2022-09-29 16:01:29 +08:00
fuchanghai
e27c79974d
[fix-#11753] send alert error alert data id (#11774)
* [fix-#11753] send alert error alert data id

Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>
2022-09-29 15:34:40 +08:00
rickchengx
57fafe4256
[Improvement-12144] Remove powermock in dolphinschduler-api (#12169) 2022-09-29 12:00:41 +08:00
fuchanghai
c7d9719e97
[improvement] improve relation between notification strategy and alarm group on ui (#12200)
* [improvement] improve relation between notification strategy and alarm group

* [improvement] change to use ```&&```

Co-authored-by: Jackie <‘2875334588@qq.com’>
2022-09-29 11:22:10 +08:00
Jiajie Zhong
d3f087e29b
[feat][ci] Add pre-commit for easy spotless config (#12192)
* Use pre-commit to handle spotless check
* Migrate exists python pre-commit-config into dir root one
* Change related document
2022-09-29 10:10:53 +08:00
Eric Gao
d1e409e9a2
[Improvement][Test] Remove powermock in service and server modules (#12164)
* Remove powermock and refactor some related code in dolphinscheduler-service and dolphinscheduler-server modules
* Remove redundant comments
* Add null check
2022-09-29 08:16:23 +08:00
darkz
995c1480f9
[Document][Improvement] Polish docs for standalone deployment (#12181)
* Polish docs for standalone deployment
2022-09-28 20:32:22 +08:00
JieguangZhou
856083d591
fix ml group (#12172) 2022-09-28 18:30:52 +08:00
TyrantLucifer
4973b30efb
[Feature][doc] Add a guide to nominate new committer (#12175)
Co-authored-by: Kirs <ACM_China@yeah.net>
2022-09-28 14:23:09 +08:00