Commit Graph

7437 Commits

Author SHA1 Message Date
Kerwin
651588c98d
[BUG-12306][UI]Fix the password item always is disabled (#12437)
* Fix the password item always is disabled
2022-10-21 09:27:50 +08:00
pandong
70aef3ec21
[fix#12364][UI] fix when creating a workflow, click Data Quality or Machine Learning to expand both (#12365)
* [fix#12364][UI] fix when creating a workflow, click Data Quality or Machine Learning to expand both
2022-10-20 16:46:10 +08:00
fuchanghai
f0a34cddec
[improvement-#12416] Use CollectionUtils.isEmpty judge the collection isEmpty to avoid NPE (#12449) 2022-10-20 14:26:56 +08:00
rickchengx
666849abe0
[Improvement-12293] Update the common.properties in api-test-case and e2e-case (#12295) 2022-10-20 12:31:03 +08:00
Eric Gao
0a6e8af864
[Improvement][Style] Update spotless junit4 check scope (#12450) 2022-10-20 12:12:17 +08:00
Yann Ann
0eef2e3e10
[Improvement][Style] Fix code style of ProcessScheduleTask and ProcessServiceImpl (#12447) 2022-10-20 10:31:16 +08:00
rickchengx
a17923a62b
[Improvement-12333][Test] Migrate all UT cases from jUnit 4 to jUnit 5 in microbench and e2e module (#12348) 2022-10-19 16:58:42 +08:00
labbomb
a11892aea0
[Feature] Optimizing data source centers (#12292)
* feat: Optimizing data source centers

* add e2e class

* update datasource e2e

* fix hive e2e

* fix: Modify the source type parameter

Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-10-19 11:22:39 +08:00
Eric Gao
d46e4659d9
[Improvement][Style] Fix remaining style errors and wildcard imports (#12412)
* Fix remaining style errors and wildcard imports

* Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link

* Fix spotless matching scope of markdown files
2022-10-19 11:08:04 +08:00
insist777
1e11034049
[Fix][Task] Fix dependent task can not predicate the status of the corresponding task correctly (#12253)
* [Fix][Task] dependent task can not predicate the status of the corresponding task correctly
2022-10-19 10:47:08 +08:00
rickchengx
97edc7d652
[Fix-12356][k8s] fix the null exception when submitting k8s task plugin (#12358) 2022-10-19 09:49:56 +08:00
Kerwin
a8e23008ac
Fix timing scheduling trigger master service report to get command parameter null pointer exception (#12419) 2022-10-19 09:43:36 +08:00
Yann Ann
38b643f69b
make sure all failed task will save in errorTaskMap (#12424) 2022-10-19 09:36:47 +08:00
simsicon
ba538067f2
[fix] Change the default unix shell executor from sh to bash (#12180)
Co-authored-by: Kerwin <37063904+zhuangchong@users.noreply.github.com>
2022-10-18 12:57:37 +08:00
Yann Ann
3bef85f546
fix datax NPE issue (#12388) 2022-10-18 09:03:16 +08:00
Kerwin
fccbe5593a
When the workflow definition is copied, the operation user of the timed instance is changed to the current user. (#12400) 2022-10-18 08:56:19 +08:00
Eric Gao
c7e6e827bd
Add Spotless step to check and block jUnit4 imports (#12398) 2022-10-17 22:02:01 +08:00
Kerwin
c02e08bb3d
[BUG-12396][Schedule] Fixed that the workflow definition scheduling that has been online after the version upgrade does not execute (#12397)
* Fixed that the workflow definition scheduling that has been online after the version upgrade does not execute.
2022-10-17 19:45:39 +08:00
kezhenxu94
4ea7eec750
Use temurin Java docker images instead of deprecated ones (#12334) 2022-10-17 15:46:21 +08:00
houshitao
934d6d21eb
[Bug] [Service] Use MapUtils to judge globalParamsMap is empty. (#12384) 2022-10-17 14:52:45 +08:00
Yann Ann
1d0d26a416
[fix#12170] If the worker's clock early than master node, will ignore dispatch time. (#12219)
* add doc to guide user configure synchronized clocks.
2022-10-17 10:42:51 +08:00
Kerwin
55004bebe0
[Improvement-12391][API] Workflow definitions that contain logical task nodes support the copy function (#12392)
* Workflow definitions that contain logical task nodes support the copy function.
2022-10-17 10:28:58 +08:00
fuchanghai
b7bd8d7803
[Improvement] add presto in datax (#12371) 2022-10-16 17:19:29 +08:00
Yann Ann
7aa8a77fb2
[Migrate][Test] Migrate other UT cases from jUnit 4 to 5, change @Ignore to @Disable 2022-10-16 12:49:11 +08:00
limaiwang
a725614429
[docs] change optional parameters --jar to --jars for Spark (#12385) (#12386) 2022-10-16 12:40:17 +08:00
Yann Ann
bc80f34056
[Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in master, worker, and remote modules (#12362)
* migrate junit4 -> junit5 in master, worker, and remote modules
2022-10-15 21:58:31 +08:00
chenrj
cd5fb12e46
[Bug][Python] Python class description error (#12360) 2022-10-15 07:43:17 +08:00
司马琦昂
1e792186d0
[Fix][Worker] fix wrong env var name for alert in K8S (#12369) 2022-10-14 16:19:57 +08:00
rickchengx
7b44612f28
[Improvement-12372][k8s] Update the deprecated k8s api (#12373) 2022-10-14 16:18:35 +08:00
Eric Gao
2f37da0dbc
[Improvement][Test] Block the usage of powermock and move mockito dependencies from sub-modules to root pom (#12311)
* move mockito dependencies from sub-modules to root pom

* Add check in CI to block the usage of powermock
2022-10-14 12:06:51 +08:00
Chris-Arith
b953cdc559
update english oracle.md (#12332) 2022-10-14 11:39:06 +08:00
Yann Ann
b357781df2
[Migrate][Test] Migrate junit4 -> junit5 test cases in common, service, and spi modules (#12363) 2022-10-14 11:06:29 +08:00
Eric Gao
c50cc997a8
[Doc][Bug] Fix dead link caused by markdown cross-files anchor (#12357) 2022-10-14 10:57:11 +08:00
Eric Gao
ac845046e7
[Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in datasource, registry and data-quality modules (#12352)
* Migrate all UT cases from jUnit 4 to 5 in datasource, registry and data-quality modules

* Fix etcd registry test
2022-10-14 08:08:20 +08:00
chenrj
9652964c94
[python] Add resource plugin for python, dataX, CustomDataX and Sql (#12135) 2022-10-13 19:14:54 +08:00
fuchanghai
22103f975e
[improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module (#12328)
* [improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module

Co-authored-by: Jackie <‘2875334588@qq.com’>
2022-10-13 15:26:39 +08:00
Eric Gao
224508850e
[Migrate][Test] Migrate all UT cases from jUnit 4 to jUnit 5 in alert and api module (#12337)
* Migrate all UT cases from jUnit 4 to jUnit 5 in alert and api module

* Fix potential problems
2022-10-13 14:40:57 +08:00
kezhenxu94
db1d319159
Reorganize some classes in common module, remove duplicate classes (#12321) 2022-10-13 10:23:27 +08:00
Yann Ann
17cd644506
[Fix-#11669][Workflow Instance Page] Fix the duration in Workflow Instance page. (#12264)
* fix process duration issue

* use processInstance.getState().isFinished() replace new isFinish function

* add WorkflowUtils
2022-10-13 09:50:31 +08:00
Jiajie Zhong
0e1c8d8153
[Feature][API] New restful API task and task relation (#12116) 2022-10-13 09:41:03 +08:00
rickchengx
6332fee2b5
[Improvement-12289][k8s] update the common.properties in values.yaml (#12290) 2022-10-12 15:55:36 +08:00
Jiajie Zhong
501119bbb6
[doc] Change release process base on new tool (#12324)
ref: #11478 we already have a new tool for releasing
2022-10-12 09:52:14 +08:00
Jiajie Zhong
2525545a41
[dev] Easier release: cherry-pick, changelog, contributor (#11478)
Add script for  easier release including cherry pick,
generating changelog and contributor list

* Auto cherry-pick: `python release.py cherry-pick`
* Generate changelog: `python release.py changelog`
* Generate contributor: `python release.py contributor`

close: #11289
related: #12222
2022-10-12 09:00:59 +08:00
jegger
04e1b88c1c
[fix] Fix error problem on h2 startup data quality rule management page (#12108)
Co-authored-by: jegger <zhangbq3306@163.com>
2022-10-11 16:52:35 +08:00
rickchengx
05099bd8f7
[Improvement-12296][Test] Close static mock (#12300) 2022-10-11 16:13:05 +08:00
Eric Gao
875682d267
[Improvement][Test] Migrate all UT cases from jUnit4 to jUnit5 in task-plugin module as an example (#12299)
* Migrate all UT cases from jUnit4 to jUnit5 in task-plugin module as an example
2022-10-11 11:54:38 +08:00
jackfanwan
18ef0a66cb
Set the id to null when copying t_ds_schedules (#12280)
Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2022-10-11 10:53:25 +08:00
Ivan
98a8b5383e
[ fix: #11590 ][upgrade] Fix the bugs when I upgrade ds from v1.3.9 to v3.0.0 ,such as file cannot be found or column not found etc (#11619)
* fix the bugs which upgrade ds metabase from v1.3.9 to v3.0.0 with mysql

* [Fix-11590][upgrade] Fix the bugs when I upgrade ds from v1.3.9 to v3.0.0 ,such as file cannot be found or column not found etc

* fix: #11590 add process_instance_code_state_index with table t_ds_process_instance to improve query efficiency for the method of findLastProcessInterval

* Fix the bug  that cannot find the files when upgrade ds version with postgresql

Co-authored-by: fan.wang <fan.wang@jiduauto.com>
2022-10-11 10:20:05 +08:00
chenrj
e1ac0e2605
[python] Add new resource plugin: gitlab, OSS and S3 (#12025)
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-10-10 18:07:57 +08:00
Jiajie Zhong
a973054950
[ci] Milestone and Label are required before the PR merged (#12222)
To make our release process easier, I plan to mark milestone
and label is required before the PR merged, they use for

* label: In this path we required label with at least on with
  'feature|bug|improvement|document|chore' to make our changelog
  more convenient
* milestone: For easier to cherry-pick PR, currently some of
  our milestone only exists in issue and not exists in related
  PR, it may
2022-10-10 15:20:51 +08:00