Commit Graph

188 Commits

Author SHA1 Message Date
Wenjun Ruan
3ab9ee13fc Optimize master log, use MDC to inject workflow instance id and task instance id in log (#10516)
* Optimize master log, add workflow instance id and task instance id in log

* Use MDC to set the workflow info in log4j

* Add workflowInstanceId and taskInstanceId in MDC

(cherry picked from commit db595b3eff)
2022-07-19 11:29:41 +08:00
Wenjun Ruan
318a8e3ae0 [Feature][metrics] Add master, worker metrics (#10326)
* Add mater metrics

* fix UT

* Add url to mysql profile

* Add worker metrics

* Update grafana config

* Add system metrics doc

* Add process failover counter

* Add metrics image

* Change jpg to png

* Add command insert metrics

* Fix UT

* Revert UT

(cherry picked from commit e21d7b1551)
2022-07-19 11:12:28 +08:00
pinkhello
bc690501c4 [FIX-10784][Bug] [ALERT-SERVER] FEISHU Plugin might block the whole alert process loop (#10888)
* closed 10784 [Bug] [ALERT-SERVER] FEISHU Plugin might block the whole alert process loop
2022-07-18 17:36:54 +08:00
Eric Gao
23cd3e85e2 [Improvement] [Alert Server] Add default datasource url in alert server application.yaml for consistency (#10790)
* [Improvement] [Alert Server] Add default datasource url in alert server application.yaml for consistency (#10788)

* [Improvement] [Alert Server] Add newline at end of file (#10788)
2022-07-18 16:51:52 +08:00
devosend
7ddaa2f47d [maven-release-plugin] prepare for next development iteration 2022-06-28 16:41:31 +08:00
devosend
0a1b9bdd52 [maven-release-plugin] prepare release 3.0.0-beta-2 2022-06-28 16:41:30 +08:00
devosend
d68dcda2bb [chore] pre-release change pom.xml 2022-06-28 08:24:21 +08:00
juzimao
093cd4627a [Fix] Fix the line.separator problem for alert-plugin' test case #10277 (#10278)
* [Fix] Fix the line.separator problem for alert-plugin' test case

* [Fix] Fix the line.separator problem for alert-plugin' test case

(cherry picked from commit 62bd9d2c4c)
2022-06-16 18:15:00 +08:00
Jiajie Zhong
57ade38939 [maven-release-plugin] prepare release 3.0.0-beta-1 2022-05-26 20:26:32 +08:00
旺阳
e08b08efdd [improve] Change Mysql Driver (#10220)
(cherry picked from commit aba5f8a40e)
2022-05-25 23:42:28 +08:00
旺阳
4c62ee76e4 Fix alert server curator health check not work (#10111)
(cherry picked from commit 844ae42ee4)
2022-05-23 14:46:55 +08:00
Jiajie Zhong
a9fa6b33a4
[chore] Change release version to 3.0.0-beta-1 (#9957) 2022-05-12 21:49:21 +08:00
Paul Zhang
8562f6a878
[Feature][Log]Add timezone information in log output (#9913) 2022-05-06 17:31:44 +08:00
Tq
69810a8a36
[BUG][ALERT-SERVER]validate script before alert script (#9834)
* validate script before alert script

* fix validate script before alert script
2022-04-28 18:16:37 +08:00
Tq
7b0b4c126e
[Bug] [Website-9764]add http alert doc and change body param to unnecessary (#9792)
* add http alert doc and change body param to unnecessary

* submit http en doc and fix doc

* fix http doc
2022-04-27 17:26:58 +08:00
Tq
6788c99578
[Bug] [Alert-9786] Http alert Get method not working (#9787)
* fix http alert issues encode before get request

* add hint to http alert
2022-04-26 17:55:34 +08:00
Jiajie Zhong
de50f43de6
[common] Make dolphinscheduler_env.sh work when start server (#9726)
* [common] Make dolphinscheduler_env.sh work

* Change dist tarball `dolphinscheduler_env.sh` location
  from `bin/` to `conf/`, which users could finish their
  change configuration operation in one single directory.
  and we only need to add `$DOLPHINSCHEDULER_HOME/conf`
  when we start our sever instead of adding both
  `$DOLPHINSCHEDULER_HOME/conf` and `$DOLPHINSCHEDULER_HOME/bin`
* Change the `start.sh`'s path of `dolphinscheduler_env.sh`
* Change the setting order of `dolphinscheduler_env.sh`
* `bin/env/dolphinscheduler_env.sh` will overwrite the `<server>/conf/dolphinscheduler_env.sh`
when start the server using `bin/dolphinsceduler_daemon.sh` or `bin/install.sh`
* Change the related docs
2022-04-25 15:35:43 +08:00
worry
ecf13a8c90
[Improvement][style]add comment and clear warn (#9247) 2022-04-21 11:42:08 +08:00
Tq
51d47de6de
[Bug] [ALERT-9487] change email attachment filename to add random string to avoid issues (#9498)
* change email attachment filename to add random string to avoid always use same file

* change email attachment filename to add random string to avoid always use same file
2022-04-15 10:13:13 +08:00
czeming
706cdb6a8e
[Fix-9174] [Alert] Fix deduplication of alarm information (#9371)
* feat(issue #9174):

Fix-9174
2022-04-14 10:30:25 +08:00
Tq
df791a374e
[FIX][WEBSITE-9224]fix wechat doc and wechat form display (#9439)
Co-authored-by: Jiajie Zhong <zhongjiajie955@hotmail.com>
2022-04-13 23:35:05 +08:00
guoshupei
ca95d2f928
[Fix-9221] [alert-server] optimization and gracefully close (#9246)
* [Fix-9221] [alert-server] optimization and gracefully close

This closes #9221

* [Fix-9221] [alert-server] remove unused mock data

This closes #9221

* [Fix-9221] [alert-server] remove unused mock data

This closes #9221

* [Fix-9221] [alert-server] remove unnecessary Mockito stubbings

* [Fix-9221] [alert-server] init AlertPluginManager in AlertServer

* [Fix-9221] [alert-server] AlertServerTest add AlertPluginManager installPlugin

* [Fix-9221] [alert-server] replace @Eventlistener with @PostConstruct

* [Fix-9221] [alert-server] sonar check solution

* [Improvement-9221] [alert] update constructor injection and replace IStoppable with Closeable

Co-authored-by: guoshupei <guoshupei@lixiang.com>
2022-04-08 10:02:10 +08:00
Eric Gao
fd6b43bc81
[Dev] Switch version in pom.xml to dev-SNAPSHOT (#9223) (#9299) 2022-04-07 18:15:19 +08:00
Tq
c294979e2f
[Bug-9235][Alert]Fix wechat markdown message and change wechat form structure (#9367)
* fix wechat issues:
1. change table msg type to markdown.
2. change userId to not required and enrich hints
3. change 'app id' to 'app id and chat id'

* fix wechat issues:
1. revert table showtype and add markdown showtype.
2. enrich hints.
3. delete 'chatid', rename agentid to weChatAgentIdChatId.
4. modify code to send markdown message.

* fix wechat issues: Change the language pack of agentId to agentId/chatId.

* fix format

* fix param name

Co-authored-by: Amy <amywang0104@163.com>
2022-04-06 20:29:30 +08:00
worry
2bab12f2c8
[Feature-9204][alert] Implement alert send status (#9208)
* [DS-9204][feat][alert,dao] Implement alert send status
- implement alert send status
- add alert send status entity、mapper
- modify alert dao
- modify alert sender
- add test
- add sql

This closes #9204

* [DS-9204][feat][alert,dao] Implement alert send status
- add license header

This closes #9204
2022-04-06 18:08:00 +08:00
worry
b4b5241797
[DS-9266][feat][server]Implement show dolphinscheduler banner at launch (#9273)
- add banner.txt
- modify application.yaml

This closes #9266
2022-03-30 16:45:24 +08:00
Tq
03a0c9f544
[Bug] [ALERT-9224] fix wechat alert functions: app and group chat (#9225)
* fix wechat alert with app and group chat

* add apache header and fix imports

* delete wechat alert 'userSendMsg' property code

* delete wechat alert 'userSendMsg' property code in Test

* delete wechat alert 'userSendMsg' property code in factory Test

* change `getSubWorkFlowParam` from private to protected
2022-03-28 20:33:14 +08:00
caishunfeng
263791a63e
[Bug-9137][Server] fix timezone init (#9219)
Co-authored-by: caishunfeng <534328519@qq.com>
2022-03-28 09:38:51 +08:00
Tq
97807390a2
fix alert instance proxy configs when no username and password (#9171) 2022-03-25 09:43:59 +08:00
Tq
b9448c3f6f
fix email alert session configs (#9142) 2022-03-24 09:50:50 +08:00
wangyang
0d8079a816
[DS-7992][feat] Alert module judging strategy (#8636) 2022-03-14 14:25:27 +08:00
caishunfeng
84f2cfec39
[Feature][Server] Custom timezone - Add timezone handler unified (#8477)
* date convert of timezone

* remove @JsonFormat

* add unit test

* fix time preview in scheduler

* optimization & add env config

Co-authored-by: caishunfeng <534328519@qq.com>
2022-02-24 18:20:34 +08:00
kezhenxu94
fa19006a18
Add a property to enable/disable metrics module (#8484) 2022-02-24 10:21:47 +08:00
Kerwin
36d526d3a8
[Improvement-8284][Alert] Dingtalk alert plugin supports markdown message type (#8285)
* add msgtype in the dingtalk alert plugin

* update markdown msgtype 'at persion'
2022-02-07 22:07:37 +08:00
pinkhello
84b004d960
[Feature-8245][Alert] Add Alert Plugin Telegram (#8246) 2022-02-07 09:51:18 +08:00
wangyang
49d581d72e
[DS-8215][feat] Support WebexTeams Plugin (#8217)
Co-authored-by: qingwli <qingwli@cisco.com>
2022-01-29 11:36:38 +08:00
wind
128ede3ee9
Fix start standalone fail because db not init yet (#8191) 2022-01-25 18:10:02 +08:00
Kerwin
103ccb01da
change version to 2.0.4-SNAPSHOT (#8188) 2022-01-25 15:17:17 +08:00
wangyang
14908a25e8
[Feature-7992][Alert] Support PagerDuty Plugin (#8120)
Co-authored-by: qingwli <qingwli@cisco.com>
2022-01-25 10:04:21 +08:00
Kerwin
1fd748f376
[Feature-8138][Task] add at@ msg in the dingtalk task plugin (#8139) 2022-01-21 17:09:39 +08:00
Kerwin
cb8c875fa8
[Feature-7804][Task] DingTalk alert plugin adds signature. (#7805)
* DingTalk alarm component adds signature.

* fix code style.

* fix code style.

* add dingtalk document link

* fix DingTalkAlertChannelFactoryTest

* update NAME_DING_TALK_SECRET
2022-01-12 15:24:25 +08:00
springmonster
4f4d9d12ce
[Bug-7849] Add unit test for alert server, fix #7849 (#7850) 2022-01-11 12:46:21 +08:00
kezhenxu94
68906f1b31
Remove fast return for alert plugins (#7723) 2021-12-30 15:02:03 +08:00
springmonster
2b05ebf47e
[Refactor] Canonical enum naming (#7676)
* [Refactor] Refactor comments
2021-12-28 19:07:53 +08:00
Jiezhi.G
6562bc9145
fix http alarm msg ignored (#7523)
See https://github.com/apache/dolphinscheduler/issues/7522
2021-12-21 16:04:12 +08:00
SbloodyS
86b476a160
[Feature-7460][Alert] Wechat alert add send to group chat (#7465)
* feature_7460

* feature_7460

Co-authored-by: SbloodyS <sbloodys@qq.com>
2021-12-18 10:26:16 +08:00
kezhenxu94
67cc260d52
Split the components into individual package, refactor configurations to use Spring properties (#7160)
* Split the components into individual package

A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.

* Split the components into individual package

A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.

* Split the components into individual package

A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.
2021-12-10 11:28:53 +08:00
Zonglei Dong
fa8ccd3855
Refactor code, add class import, keep ‘logger’ variable names uniform. (#7164) 2021-12-04 21:18:43 +08:00
kezhenxu94
2ed3c0c3a7
Recover unit tests that have not been run for some time (#7054) 2021-12-01 13:55:26 +08:00
Sunny Lei
0dcff1425a
[DS-5229][feat] Implement server port custom config (#6947)
* [DS-5229][fix] server port custom config
This closes #5229

* [DS-5229][feat] Implement server port custom config
This closes #5229

* [Bug] [readme] Error link to Docker and k8s in readme apache#6802 (#6862)

* [Bug] [readme] Error link to Docker and k8s in readme #6802
1、modify the error link

* [Bug] [readme] Error link to Docker and k8s in readme #6802
1、modify the error link in readme_zh_cn.md

* [DS-6829][WorkerServer] skip create log dir and print log in dryRun model (#6852)

Co-authored-by: caishunfeng <534328519@qq.com>

* [DS-5229][feat] Implement server port custom config
Modify review suggestion
This closes #5229

Co-authored-by: GaoTianDuo <gaotianduo_yewu@cmss.chinamobile.com>
Co-authored-by: wind <caishunfeng@users.noreply.github.com>
Co-authored-by: caishunfeng <534328519@qq.com>
2021-12-01 00:21:03 +08:00