Commit Graph

7430 Commits

Author SHA1 Message Date
Jay Chung
1347a8f94c
[chore] Separate Python API into another repository (#12779)
Currently, our Python API code is a module in apache/dolphinscheduler codebase,
each time users change Python API code, they need to run all requests CI check
for dolphinscheduler and Python API, But if the user does only change Python
code, it could be merged if Python API CI pass and do not dependent on others CI.

Besides, we release Python API as the same version of dolphinscheduler. It is
easy for user to match Python API version. But when Python API does not change
any code, but dolphinscheduler release a bugfix version, Python API has to
release the new version to match dolphinscheduler. This happened when we
released Python API 2.0.6 and 2.0.7. 2.0.6 and 2.0.7 is bugfix version, and
Python API does not change any code, so the PyPI package is the same.

Separate Python API also makes our code more sense, we will have more
distinguished code in dolphinscheduler and Python API new repository.
Have separate issue tracker and changelog for information to users.

ref PR in other repository: apache/dolphinscheduler-sdk-python#1

see more detail in mail thread: https://lists.apache.org/thread/4z7l5l54c4d81smjlk1n8nq380p9f0oo
2022-11-09 21:20:15 +08:00
muggleChen
72e50b25f1
[Improvement][script] Add installPath verification for install.sh (#12523) 2022-11-09 11:50:11 +08:00
jackfanwan
641a2559ea
[fix-12687]when timeout_notify_strategy is null, modify timeout_notify_strategy (#12689)
* According to timeoutFlag, assign timeoutNotifyStrategy value

Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2022-11-09 11:48:12 +08:00
houshitao
04c6b5e413
[Bug][Api] Added param description. (#12813)
Co-authored-by: houshitao <shitaohou@163.com>
2022-11-08 21:17:40 +08:00
jackfanwan
23ead4f0e8
[Bug] [dolphinscheduler-api] in the task define list, when edit task, should show pre node list (#12695)
* backend : add pre node list

* resolve workflow error

Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2022-11-08 13:31:20 +08:00
moonkop
11b1433080
Update use-dependent.ts typo (#12462) 2022-11-08 10:05:09 +08:00
songjianet
0793d1a14e
[Feature][UI] Added form stadio parser. (#12801) 2022-11-08 08:52:03 +08:00
labbomb
d6fb46b682
fix: Fix some mistakes in the datasource (#12775)
* fix: Fix some mistakes in the datasource

* fix: delete useless console
2022-11-07 18:12:11 +08:00
rickchengx
58721ba855
[Improvement-12335][ui] Make the resources to be reactive in hivecli task (#12336) 2022-11-07 18:05:51 +08:00
Tq
9bba4b105c
[fix][doc] Fix sql-hive and hive-cli doc (#12765) 2022-11-07 17:39:02 +08:00
Aaron Wang
6c5ab3fb5c
[Bug] [dolphinscheduler-aop] aspectj-maven-plugin version undefined (#12756)
* Update pom.xml
2022-11-07 15:07:07 +08:00
songjianet
0e099037bf
[Feature][UI] Added form select parser. (#12753)
* [Feature][UI] Added form select parser.

* [Feature][UI] Added form select parser.
2022-11-07 14:41:41 +08:00
calvin
4c714cf9c9
adjust the args of router in the dag (#12759) 2022-11-07 14:26:12 +08:00
Kerwin
c4fb555883
Modify shell env to bash (#12742) 2022-11-07 11:21:11 +08:00
Eric Gao
6d79414491
Add instructions on how to configure logging level for debugging purpose (#12699) 2022-11-07 10:30:56 +08:00
XCL
00b18ed422
[Improve]Remove the code logger.isDebugEnabled() #5918 #10542 (#12738)
Co-authored-by: chunlai.xu <chunlai.xu@zhaopin.com.cn>
2022-11-07 09:58:19 +08:00
JiPeng Wang
606a5aeee5
[Bug] Resource default auth function disabled false. (#12467)
* resource function disable check fix

Co-authored-by: Kerwin <37063904+zhuangchong@users.noreply.github.com>
2022-11-06 21:15:27 +08:00
jackfanwan
f249f2b257
[fix-12675]edit workflow related task, workflow's task version change (#12692)
* edit workflow related task, workflow's task version change

* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/enums/Status.java

Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2022-11-06 20:49:07 +08:00
calvin
27eada79e4
beautify the dag (#12728) 2022-11-06 20:04:27 +08:00
songjianet
169cbe3267
[Feature][UI] Added form input parser. (#12701)
* [Feature][UI] Added form input parser.

* [Feature][UI] Added form input parser.
2022-11-06 18:16:03 +08:00
jackfanwan
913525343e
modify sql error (#12717) 2022-11-05 21:44:01 +08:00
Aaron Wang
04e23ed88f
Update Status.java (#12724) 2022-11-05 21:09:17 +08:00
旺阳
23e9d2698c
fix and enhance helm db config (#12707) 2022-11-05 18:20:03 +08:00
Wenjun Ruan
2c3cc31a4c
Fix flink sql cannot run due to missing main jar (#12705) 2022-11-04 23:02:00 +08:00
jackfanwan
7d0e2cbbb9
when delete workflow, delete related task (#12681)
* when delete workflow, delete related task

Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2022-11-04 14:40:15 +08:00
songjianet
e702beced5
[Feature][UI] Added form request parser. (#12691) 2022-11-04 13:38:40 +08:00
Wenjun Ruan
eaef68856b
Change command file permission to 755 (#12678)
(cherry picked from commit 95484d930762712f4ab68ece27ca3b65a2073ab2)
2022-11-03 22:51:37 +08:00
songjianet
fdb02d486c
[Feature][UI] Added form structure parser. (#12686) 2022-11-03 20:01:39 +08:00
旺阳
6766ec04df
Add pythonNodePort in config file (#12685) 2022-11-03 17:47:06 +08:00
JieguangZhou
a47b4d0672
[Feature][Task] Transfer files between tasks (#12552)
* add data transfer between tasks

* add delete DATA_TRANSFER API

* convert Result to DeleteDataTransferResponse

* add api UT

* fix final

* fix doc
2022-11-03 16:33:39 +08:00
songjianet
7cc4d053d0
[Feature][UI] Added form validate parser. (#12682) 2022-11-03 16:04:36 +08:00
rickchengx
c69376e74c
[Improvement-12658][Permission] Improve the readability of setPerm() in grantProjectbyCode() (#12660) 2022-11-03 09:29:04 +08:00
ZhenjiLiu
7cdb926a5f
[Improvement][Batch Query] Batch query ProcessDefinitions belongs to need failover ProcessInstance. (#12506) 2022-11-03 09:15:19 +08:00
rickchengx
44e0935f56
[Improvement-12650][Permission] Improve the check of resourcePermissionCheck() (#12652) 2022-11-03 09:12:56 +08:00
songjianet
1d0f9a7d04
[Feature][UI] Added form value parser. (#12669)
* [Feature][UI] Added form value parser.

* [Feature][UI] Added form value parser.

* [Feature][UI] Added form value parser.

* [Feature][UI] Added form value parser.
2022-11-03 08:41:10 +08:00
calvin
f889d855fb
support to use the clearable button of components to search (#12668) 2022-11-02 21:40:39 +08:00
Wenjun Ruan
ff59acd02f
Splite cpu/memory info in OSUtils#isOverload (#12663) 2022-11-02 21:15:03 +08:00
songjianet
aeb861fa15
[Feat][UI] Add language parser. (#12666) 2022-11-02 19:32:00 +08:00
Wenjun Ruan
9e0c9af1a5
Fix the waiting strategy cannot recovery if the serverstate is already in running (#12651) 2022-11-02 14:06:01 +08:00
rickchengx
3ff328c961
[Improvement-12623][Permission]Remove the unused projectIds in operationPermissionCheck() (#12624) 2022-11-02 11:20:00 +08:00
songjianet
dcb8070a0e
[Feature][UI] Add a popup component based on dynamic form. (#12645) 2022-11-01 22:26:29 +08:00
songjianet
4f95f639c9
[Fix][UI] Fix the line break problem in navbar. (#12647) 2022-11-01 22:26:16 +08:00
rickchengx
fd18e37da7
[Fix-12109]Fix the errors when starting 2 times with dolphinscheduler-daemon.sh (#12118) 2022-11-01 16:59:27 +08:00
Tq
4e2701b57e
[doc][fix] Add new alert doc Slack (#12567) 2022-11-01 09:49:05 +08:00
songjianet
883c754951
[Feature][UI] Add a method for adding a single node to the dag. (#12628) 2022-11-01 09:07:28 +08:00
Yann Ann
0391d40315
[Improvement][Install] Add ${zkRoot} description. (#12596)
* just add comments.
2022-10-31 22:58:34 +08:00
amao
b71d4983dd
[Feature-6586][Server]add some ds process definition demo when init (#11759)
* [Feature-6586][Server]add some ds process definition demo when init
1.add some ds process definition demo when init, to display what task type can run and make user easy to
use ds.
2.need configure the JVM parameters (-Ddemo=true) to turn on the StandaloneServer service
3.need modify the tenant information in it
2022-10-31 22:35:11 +08:00
rickchengx
3c31ddfd9f
[Improvement-12536][k8s] Support the command for the container in k8s task plugin (#12538) 2022-10-31 19:06:41 +08:00
Aaron Wang
08335b1032
[Improvement][Task] Improved way to collect yarn job's appIds (#12197)
* Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code.
* Add user property `appId.collect` for user to decide how to collect applicationId.
* Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh`
* Update docs to declare how to use aop way.
* Update `LogUtils` to support fetch applicationId in different ways based on the user property.

Co-authored-by: gabrywu <gabrywu@apache.com>
2022-10-31 16:52:53 +08:00
Wenjun Ruan
e6da1ccf81
Add worker-group-refresh-interval in master config (#12601)
* Add worker-group-refresh-interval in master config

* Set interval cannot smaller than 10s

* Update dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/config/MasterConfig.java

Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2022-10-31 09:37:26 +08:00