Commit Graph

457 Commits

Author SHA1 Message Date
xiangzihao
bec678a8b9
[DSIP-78][Data Quality] Remove data quality module (#16794) 2024-11-20 09:20:41 +08:00
Binit Shrestha
54a31a76ce
[Improvement-16507] Remove spring-boot-starter-cache (#16593) 2024-10-21 17:14:41 +08:00
xiangzihao
4e853024ea
[Chore] Fix publish docker error in CI due to deploy failed (#16667) 2024-09-27 15:38:11 +08:00
xiangzihao
c0f70b88cc
[DSIP-38] Support upload/download plugins from maven repo (#16654) 2024-09-26 14:39:14 +08:00
xiangzihao
d67ea805f9
[DSIP-38] Add plugin directory in binary package (#16613) 2024-09-23 09:59:34 +08:00
Wenjun Ruan
62d33a799a
[DSIP-75] Support auto add license header by spotless (#16643) 2024-09-22 16:27:29 +08:00
Wenjun Ruan
c989973f21
[Chore] Remove maven-javadoc-plugin (#16639) 2024-09-21 16:09:29 +08:00
Wenjun Ruan
9448806af0
[DSIP-61][Master] Refactor thread pool and state event orchestration in master (#16327) 2024-08-26 15:19:39 +08:00
chenss
b47732c140
[Fix][pom] Fix jacoco-maven-plugin error config . (#16463) 2024-08-15 11:25:00 +08:00
Wenjun Ruan
af83c14298
Fix sonar cannot work (#16307) 2024-07-14 22:52:46 +08:00
xiangzihao
d13abe6b26
[Chore] Improve owasp dependency check (#16305)
* improve owasp dependency check
2024-07-12 16:13:06 +08:00
xiangzihao
bc256a18e6
[Chore] Improve ci check (#16294)
* improve ci check
2024-07-11 16:55:54 +08:00
xiangzihao
565a91790a
[Chore] [CI] Add api-test and e2e-test to spotless check (#16242) 2024-06-30 22:39:12 +08:00
xiangzihao
9a823c4b98
bump up owasp version (#16187) 2024-06-24 15:08:51 +08:00
Wenjun Ruan
3bc88e32c7
Rename dolphinscheduler-aop to dolphinscheduler-yarn-aop (#16095) 2024-05-31 17:12:22 +08:00
Wenjun Ruan
f754611509
[DSIP-42] Add dolphinscheduler-aws-authentication module (#16043) 2024-05-24 14:15:03 +08:00
Wenjun Ruan
7c8fa9b48c
Add IntegretionTest for registry module (#15981) 2024-05-13 16:35:37 +08:00
Wenjun Ruan
e9d85914d7
Fix queryByTypeAndJobId might error due to multiple result (#15883) 2024-04-22 17:41:17 +08:00
Wenjun Ruan
04a6b0d281
Fix task mighe be dispatched even if it has been killed (#15662) 2024-03-04 17:30:43 +08:00
Gallardot
1c1d4bd592
[Improvement][Helm] using helm-docs to generate docs automatically (#15299) 2023-12-29 11:24:37 +08:00
Wenjun Ruan
b750db3c37
Add IT for dolphinscheduler-tools module (#15043) 2023-10-20 15:39:42 +08:00
imp2002
8f16fd7975
[Fix-14885][pom] fix spotless format file path (#14889)
* fix: fix `spotless` format file path

* fix: remove duplicate dependencies

---------

Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
Co-authored-by: xiangzihao <460888207@qq.com>
2023-10-17 06:20:23 -05:00
Wenjun Ruan
33084d281f
Add dolphinscheduler-dao-plugin module (#15019) 2023-10-14 17:58:40 +08:00
Wenjun Ruan
55cc77226f
[RPC] Refactor the remote module. (#14776)
* Add dolphinscheduler-extract-base
* Add dolphinscheduler-extract-master
* Add dolphinscheduler-extract-worker
* Add dolphinscheduler-extract-alert
2023-08-23 09:43:17 +08:00
Aaron Wang
ca760aabd4
[Fix-14512][BOM] kubernetes-client version conflict (#14561) 2023-07-21 18:17:53 +08:00
Jay Chung
0f190ae3da
chore: Add new step skip for ui build and spotless (#14427) 2023-07-03 20:41:12 +08:00
NoSuchField
41801663fd
[Improvement] Remove duplicate dependencies (#13773) 2023-03-22 15:09:31 +08:00
Wenjun Ruan
e660f7fc2d
Use spotless upToDateChecking (#13394) 2023-01-13 21:59:05 +08:00
Wenjun Ruan
14ec4a2398
Remove dao module in worker (#13242) 2022-12-22 12:25:29 +08:00
Wenjun Ruan
169168ef34
Add plugin-all module (#13079) 2022-12-02 23:19:08 +08:00
Eric Gao
c2ae76c0bd
Expand all static imports and add CI check to block wildcard static imports (#13067) 2022-12-01 14:15:28 +08:00
fuchanghai
feb077035e
[fix-#12875] command line that -Dmaven.test.skip=true have no effect (#12876) 2022-11-13 09:48:07 +08:00
Jay Chung
1347a8f94c
[chore] Separate Python API into another repository (#12779)
Currently, our Python API code is a module in apache/dolphinscheduler codebase,
each time users change Python API code, they need to run all requests CI check
for dolphinscheduler and Python API, But if the user does only change Python
code, it could be merged if Python API CI pass and do not dependent on others CI.

Besides, we release Python API as the same version of dolphinscheduler. It is
easy for user to match Python API version. But when Python API does not change
any code, but dolphinscheduler release a bugfix version, Python API has to
release the new version to match dolphinscheduler. This happened when we
released Python API 2.0.6 and 2.0.7. 2.0.6 and 2.0.7 is bugfix version, and
Python API does not change any code, so the PyPI package is the same.

Separate Python API also makes our code more sense, we will have more
distinguished code in dolphinscheduler and Python API new repository.
Have separate issue tracker and changelog for information to users.

ref PR in other repository: apache/dolphinscheduler-sdk-python#1

see more detail in mail thread: https://lists.apache.org/thread/4z7l5l54c4d81smjlk1n8nq380p9f0oo
2022-11-09 21:20:15 +08:00
Aaron Wang
6c5ab3fb5c
[Bug] [dolphinscheduler-aop] aspectj-maven-plugin version undefined (#12756)
* Update pom.xml
2022-11-07 15:07:07 +08:00
Aaron Wang
08335b1032
[Improvement][Task] Improved way to collect yarn job's appIds (#12197)
* Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code.
* Add user property `appId.collect` for user to decide how to collect applicationId.
* Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh`
* Update docs to declare how to use aop way.
* Update `LogUtils` to support fetch applicationId in different ways based on the user property.

Co-authored-by: gabrywu <gabrywu@apache.com>
2022-10-31 16:52:53 +08:00
Eric Gao
0a6e8af864
[Improvement][Style] Update spotless junit4 check scope (#12450) 2022-10-20 12:12:17 +08:00
Eric Gao
d46e4659d9
[Improvement][Style] Fix remaining style errors and wildcard imports (#12412)
* Fix remaining style errors and wildcard imports

* Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link

* Fix spotless matching scope of markdown files
2022-10-19 11:08:04 +08:00
Eric Gao
c7e6e827bd
Add Spotless step to check and block jUnit4 imports (#12398) 2022-10-17 22:02:01 +08:00
Eric Gao
2f37da0dbc
[Improvement][Test] Block the usage of powermock and move mockito dependencies from sub-modules to root pom (#12311)
* move mockito dependencies from sub-modules to root pom

* Add check in CI to block the usage of powermock
2022-10-14 12:06:51 +08:00
Eric Gao
9ab79e064c
[Improvement][Test] Fully remove the usage of powermock from the whole project (#12244)
* Fully remove the usage of powermock from the whole project

* Upgrade org.reflections to 0.10.12
2022-10-10 10:43:38 +08:00
caishunfeng
40090d459e
[Improvement] remove log-server and server module (#12206)
* remove log-server module

* remove dolphinscheduler-server module
2022-09-30 16:41:41 +08:00
Eric Gao
b52da64001
[Improvement][UT] Upgrade jUnit to 5.+ (#10976) (#11332)
* [Improvement][UT] Upgrade jUnit to 5.+ (#10976)

* Refactor AlertServerTest with jUnit-5 as an example
2022-09-21 10:15:21 +08:00
limfff
c24ad9adb6
[Fix] Fixed an error importing project Maven (#12026) 2022-09-18 10:11:20 +08:00
dependabot[bot]
5d73a6863b
Bump junit from 4.12 to 4.13.1 (#11891) 2022-09-10 23:41:41 +08:00
kezhenxu94
105773f54d
Remove htrace dependencies (#11881)
* Remove htrace dependencies

* Update pom.xml
2022-09-10 22:54:38 +08:00
kezhenxu94
13e4720aa2
Upgrade spring boot and swagger (#11574) 2022-08-22 10:27:40 +08:00
Eric Gao
277c78010f
Enable spotless to fix markdown checkstyle and refactor faq.md as an example (#11384) 2022-08-18 16:48:22 +08:00
kezhenxu94
f6ef628030
Support reading application properties from kubernetes config map (#11402) 2022-08-16 20:25:17 +08:00
Eric Gao
896fef6c98
[Feature][Style] Enable spotless to manage imports (#11458) 2022-08-13 10:05:03 +08:00
Eric Gao
6a02870926
[Feature][style] Add spotless maven plugin for automatic style fix. (#11272)
* [Feature][style] Add spotless maven plugin for automatic style fix (#10963)

* Fix spotless ratchet configuration

* Remove license-check and decrease line length threshold value

* Update related docs

* Remove checkstyle and add pre-commit hook

* Test updated pre-commit hook

* Replace checkstyle with spotless in CI

* Remove reviewdog
2022-08-06 19:29:23 +08:00