Commit Graph

7328 Commits

Author SHA1 Message Date
insist777
1e11034049
[Fix][Task] Fix dependent task can not predicate the status of the corresponding task correctly (#12253)
* [Fix][Task] dependent task can not predicate the status of the corresponding task correctly
2022-10-19 10:47:08 +08:00
rickchengx
97edc7d652
[Fix-12356][k8s] fix the null exception when submitting k8s task plugin (#12358) 2022-10-19 09:49:56 +08:00
Kerwin
a8e23008ac
Fix timing scheduling trigger master service report to get command parameter null pointer exception (#12419) 2022-10-19 09:43:36 +08:00
Yann Ann
38b643f69b
make sure all failed task will save in errorTaskMap (#12424) 2022-10-19 09:36:47 +08:00
simsicon
ba538067f2
[fix] Change the default unix shell executor from sh to bash (#12180)
Co-authored-by: Kerwin <37063904+zhuangchong@users.noreply.github.com>
2022-10-18 12:57:37 +08:00
Yann Ann
3bef85f546
fix datax NPE issue (#12388) 2022-10-18 09:03:16 +08:00
Kerwin
fccbe5593a
When the workflow definition is copied, the operation user of the timed instance is changed to the current user. (#12400) 2022-10-18 08:56:19 +08:00
Eric Gao
c7e6e827bd
Add Spotless step to check and block jUnit4 imports (#12398) 2022-10-17 22:02:01 +08:00
Kerwin
c02e08bb3d
[BUG-12396][Schedule] Fixed that the workflow definition scheduling that has been online after the version upgrade does not execute (#12397)
* Fixed that the workflow definition scheduling that has been online after the version upgrade does not execute.
2022-10-17 19:45:39 +08:00
kezhenxu94
4ea7eec750
Use temurin Java docker images instead of deprecated ones (#12334) 2022-10-17 15:46:21 +08:00
houshitao
934d6d21eb
[Bug] [Service] Use MapUtils to judge globalParamsMap is empty. (#12384) 2022-10-17 14:52:45 +08:00
Yann Ann
1d0d26a416
[fix#12170] If the worker's clock early than master node, will ignore dispatch time. (#12219)
* add doc to guide user configure synchronized clocks.
2022-10-17 10:42:51 +08:00
Kerwin
55004bebe0
[Improvement-12391][API] Workflow definitions that contain logical task nodes support the copy function (#12392)
* Workflow definitions that contain logical task nodes support the copy function.
2022-10-17 10:28:58 +08:00
fuchanghai
b7bd8d7803
[Improvement] add presto in datax (#12371) 2022-10-16 17:19:29 +08:00
Yann Ann
7aa8a77fb2
[Migrate][Test] Migrate other UT cases from jUnit 4 to 5, change @Ignore to @Disable 2022-10-16 12:49:11 +08:00
limaiwang
a725614429
[docs] change optional parameters --jar to --jars for Spark (#12385) (#12386) 2022-10-16 12:40:17 +08:00
Yann Ann
bc80f34056
[Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in master, worker, and remote modules (#12362)
* migrate junit4 -> junit5 in master, worker, and remote modules
2022-10-15 21:58:31 +08:00
chenrj
cd5fb12e46
[Bug][Python] Python class description error (#12360) 2022-10-15 07:43:17 +08:00
司马琦昂
1e792186d0
[Fix][Worker] fix wrong env var name for alert in K8S (#12369) 2022-10-14 16:19:57 +08:00
rickchengx
7b44612f28
[Improvement-12372][k8s] Update the deprecated k8s api (#12373) 2022-10-14 16:18:35 +08:00
Eric Gao
2f37da0dbc
[Improvement][Test] Block the usage of powermock and move mockito dependencies from sub-modules to root pom (#12311)
* move mockito dependencies from sub-modules to root pom

* Add check in CI to block the usage of powermock
2022-10-14 12:06:51 +08:00
Chris-Arith
b953cdc559
update english oracle.md (#12332) 2022-10-14 11:39:06 +08:00
Yann Ann
b357781df2
[Migrate][Test] Migrate junit4 -> junit5 test cases in common, service, and spi modules (#12363) 2022-10-14 11:06:29 +08:00
Eric Gao
c50cc997a8
[Doc][Bug] Fix dead link caused by markdown cross-files anchor (#12357) 2022-10-14 10:57:11 +08:00
Eric Gao
ac845046e7
[Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in datasource, registry and data-quality modules (#12352)
* Migrate all UT cases from jUnit 4 to 5 in datasource, registry and data-quality modules

* Fix etcd registry test
2022-10-14 08:08:20 +08:00
chenrj
9652964c94
[python] Add resource plugin for python, dataX, CustomDataX and Sql (#12135) 2022-10-13 19:14:54 +08:00
fuchanghai
22103f975e
[improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module (#12328)
* [improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module

Co-authored-by: Jackie <‘2875334588@qq.com’>
2022-10-13 15:26:39 +08:00
Eric Gao
224508850e
[Migrate][Test] Migrate all UT cases from jUnit 4 to jUnit 5 in alert and api module (#12337)
* Migrate all UT cases from jUnit 4 to jUnit 5 in alert and api module

* Fix potential problems
2022-10-13 14:40:57 +08:00
kezhenxu94
db1d319159
Reorganize some classes in common module, remove duplicate classes (#12321) 2022-10-13 10:23:27 +08:00
Yann Ann
17cd644506
[Fix-#11669][Workflow Instance Page] Fix the duration in Workflow Instance page. (#12264)
* fix process duration issue

* use processInstance.getState().isFinished() replace new isFinish function

* add WorkflowUtils
2022-10-13 09:50:31 +08:00
Jiajie Zhong
0e1c8d8153
[Feature][API] New restful API task and task relation (#12116) 2022-10-13 09:41:03 +08:00
rickchengx
6332fee2b5
[Improvement-12289][k8s] update the common.properties in values.yaml (#12290) 2022-10-12 15:55:36 +08:00
Jiajie Zhong
501119bbb6
[doc] Change release process base on new tool (#12324)
ref: #11478 we already have a new tool for releasing
2022-10-12 09:52:14 +08:00
Jiajie Zhong
2525545a41
[dev] Easier release: cherry-pick, changelog, contributor (#11478)
Add script for  easier release including cherry pick,
generating changelog and contributor list

* Auto cherry-pick: `python release.py cherry-pick`
* Generate changelog: `python release.py changelog`
* Generate contributor: `python release.py contributor`

close: #11289
related: #12222
2022-10-12 09:00:59 +08:00
jegger
04e1b88c1c
[fix] Fix error problem on h2 startup data quality rule management page (#12108)
Co-authored-by: jegger <zhangbq3306@163.com>
2022-10-11 16:52:35 +08:00
rickchengx
05099bd8f7
[Improvement-12296][Test] Close static mock (#12300) 2022-10-11 16:13:05 +08:00
Eric Gao
875682d267
[Improvement][Test] Migrate all UT cases from jUnit4 to jUnit5 in task-plugin module as an example (#12299)
* Migrate all UT cases from jUnit4 to jUnit5 in task-plugin module as an example
2022-10-11 11:54:38 +08:00
jackfanwan
18ef0a66cb
Set the id to null when copying t_ds_schedules (#12280)
Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2022-10-11 10:53:25 +08:00
Ivan
98a8b5383e
[ fix: #11590 ][upgrade] Fix the bugs when I upgrade ds from v1.3.9 to v3.0.0 ,such as file cannot be found or column not found etc (#11619)
* fix the bugs which upgrade ds metabase from v1.3.9 to v3.0.0 with mysql

* [Fix-11590][upgrade] Fix the bugs when I upgrade ds from v1.3.9 to v3.0.0 ,such as file cannot be found or column not found etc

* fix: #11590 add process_instance_code_state_index with table t_ds_process_instance to improve query efficiency for the method of findLastProcessInterval

* Fix the bug  that cannot find the files when upgrade ds version with postgresql

Co-authored-by: fan.wang <fan.wang@jiduauto.com>
2022-10-11 10:20:05 +08:00
chenrj
e1ac0e2605
[python] Add new resource plugin: gitlab, OSS and S3 (#12025)
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2022-10-10 18:07:57 +08:00
Jiajie Zhong
a973054950
[ci] Milestone and Label are required before the PR merged (#12222)
To make our release process easier, I plan to mark milestone
and label is required before the PR merged, they use for

* label: In this path we required label with at least on with
  'feature|bug|improvement|document|chore' to make our changelog
  more convenient
* milestone: For easier to cherry-pick PR, currently some of
  our milestone only exists in issue and not exists in related
  PR, it may
2022-10-10 15:20:51 +08:00
tuchg
ef328d9cea
Update ZooKeeper minimum version requirements (#12284) (#12288) 2022-10-10 15:08:07 +08:00
Ivan
d9ac1fa0f7
[Fix#12231][scheduler-plugin] fix the bug which some scheduled tasks are not triggered on time (#12233)
Co-authored-by: fan.wang <fan.wang@jiduauto.com>
2022-10-10 14:01:02 +08:00
Chris-Arith
c8bd106604
create oracle help.md (#12218)
* create oracle help.md

* Add files via upload

allow Oracle to choose schema

* move pic under img and add title for oracle.md
2022-10-10 13:53:20 +08:00
Eric Gao
9ab79e064c
[Improvement][Test] Fully remove the usage of powermock from the whole project (#12244)
* Fully remove the usage of powermock from the whole project

* Upgrade org.reflections to 0.10.12
2022-10-10 10:43:38 +08:00
fuchanghai
dec28b5c2e
[improve] Correct some log in scheduler (#12278) 2022-10-10 09:42:57 +08:00
fuchanghai
9b1ee1516f
[doc] Correct descriptions in glossary.md (#12282) 2022-10-10 09:37:15 +08:00
calvin
b4947b471c
fix this issue (#12281) 2022-10-10 09:34:32 +08:00
Tq
7bf49a7179
delete useless exclusions (#12273)
delete software.amazon.awssdk datasync useless dependency exclusions
2022-10-09 14:29:46 +08:00
sgw
165b9a58de
[DS-12131][master] Optimize the log printing of the master module acc… (#12152)
* [DS-12131][master] Optimize the log printing of the master module according to the log specification.
2022-10-09 13:56:50 +08:00