Commit Graph

54 Commits

Author SHA1 Message Date
godchen
51b353b52c
Add msgstream reader (#12130)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-19 15:57:12 +08:00
godchen
f91e9c6dda
Add pulsar reader implementation (#11990)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-17 23:47:11 +08:00
godchen
a1d1b3d0b6
Add reader interface (#11973)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-17 14:11:11 +08:00
congqixia
304bbd3e71
Add ConsumeAfterSeek interface (#11818)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-15 18:17:10 +08:00
yukun
2c215a0be3
[skip ci]Add rmq_producer comment (#11346)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-05 21:59:10 +08:00
yukun
ab00fe90de
[skip ci]Add rmq_producer comment (#11345)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-05 21:57:21 +08:00
Xiaofan
a4715996ef
Fix Pulsar seek to latest may block forever (#11128)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-05 14:55:44 +08:00
yukun
872f6f8a04
[skip ci]Add rmq client comments (#11271)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-04 20:49:20 +08:00
yukun
eda65381c2
[skip ci]Add rmq producer comments (#11272)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-04 20:45:17 +08:00
yukun
e817cfbae6
[skip ci]Add pulsar client comments (#11197)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-03 23:20:46 +08:00
congqixia
dddf84b194
Add unit test for pulsarClient Seek (#11107)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-03 16:34:12 +08:00
godchen
a0a3a889e7
Add common endian for global use (#11092)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-02 18:16:32 +08:00
congqixia
390fad4eb7
Fix LatestPosition option conflict with earliest patch (#10907)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-29 21:30:49 +08:00
Xiangyu Wang
cd6a4a6704
[skip ci]Improve error message in mqclient (#10241)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-20 10:56:35 +08:00
Xiangyu Wang
a2b8add4e2
[skip ci]Improve error message in mqclient (#10240)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-20 10:54:43 +08:00
Xiangyu Wang
1493aa1f65
[skip ci]Improve comments in mqclient (#10242)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-20 10:52:35 +08:00
Xiaofan
d845153de4
Add Buffer for consumer channel (#9578)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-15 20:31:16 +08:00
godchen
31c3942ca7
[skip ci]Fix mqclient producer fmt (#9774)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-13 12:44:33 +08:00
jingkl
66e8583f86
[skip ci] Add producer.go description (#8748)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-10-13 11:14:39 +08:00
yukun
97a6bde82a
[skip ci]Add comments for StringToMsgID (#9518)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-09 00:07:52 +08:00
yukun
1ec153ad9b
[skip ci]Add comments for CreateProducer (#9517)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-09 00:03:51 +08:00
yukun
f89f2ded88
[skip ci]Add comments for rmq client subscribe (#9422)
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-10-07 21:21:05 +08:00
yukun
3dcfff3a70
[skip ci]Add comments for rmq client method (#9423)
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-10-07 21:18:52 +08:00
yukun
a4cffb7f1c
[skip ci]Add comments for rmqMessage (#9420)
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-10-07 21:10:55 +08:00
yukun
24bf834fe8
[skip ci]Add comments for rmqID (#9419)
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-10-07 21:09:02 +08:00
Xiangyu Wang
b6617a295a
[skip ci]Fix golint warnings in mqclient (#9239)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-04 23:48:10 +08:00
zhenshan.cao
057317f8b2
[skip ci] Fix golint error in pulsar_client.go (#9155)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-03 20:54:13 +08:00
yukun
c486007796
Rocksmq support SubscriptionPositionLatest (#8947)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-30 20:51:40 +08:00
congqixia
788844698e
Add implementation check for ConsumerMessage interface (#8781)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-28 19:24:04 +08:00
congqixia
01b4253a74
Fix mqconsumer data race (#8752)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-28 17:04:04 +08:00
yukun
dcf1c27d66
Fix go lint in mqclient (#8685)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-27 20:32:13 +08:00
congqixia
353eeab8b9
Add MessageID return value in producers (#8586)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-26 17:38:07 +08:00
groot
6168c0b9c7
Reduce go unittest time cost (#8555)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-26 12:42:14 +08:00
jingkl
12fb8290b9
add log to produce.go (#8489)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-09-24 20:48:22 +08:00
yukun
06c9f03c59
Refactor rocksmq close logic and improve codecov (#8278)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-22 17:21:00 +08:00
congqixia
bdfb8768d4
Enable gosec (#8202)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-18 14:45:50 +08:00
XuanYang-cn
ff8fef6ad0
Upgrade pulsar-client-go to 0.6.0 (#7909)
MessageID interface of pulsar-client-go adds
4 more methods. So I add these methods into
`MessageID` interface.

Resolves: #7770

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-15 18:13:49 +08:00
godchen
3c2821e5e2
Add rmq consumer close (#7596)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-08 21:49:59 +08:00
groot
618fef0a43
Add unittest for mqclient (#7578)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-08 16:52:35 +08:00
congqixia
fb22d122e5
Add EarliestMessageID patch logic (#7119)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-16 19:08:09 +08:00
yukun
847586eb95
Add rocksmq retention (#6617)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-08-16 18:46:10 +08:00
congqixia
9eb35996b5
Fix pulsar consumer goroutine leakage (#7004)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-06 09:45:24 +08:00
yukun
0f409da136
Fix standalone seek hang after restart (#6073)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-24 16:44:07 +08:00
godchen
c2ecce61c0
Make pulsar client singleton (#5782)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-15 19:03:56 +08:00
neza2017
ac9dde7352 fix seek on pulsar msgstream (#5726)
* fix seek on pulsar msgstream

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* test seek on pulsar msgstream

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* msg-seek test test

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add pure pulsar client seek test

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-15 16:14:29 +08:00
godchen
91ef35bad4 Change receive msg logic (#5605)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-15 16:04:48 +08:00
neza2017
cb6ae3678a fix master service ut (#5555)
* fix master unitttest

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* tt

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* fix master ut

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-15 15:59:04 +08:00
godchen
d189bf4d33
Change pulsar version (#5352)
Change pulsar version.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-22 03:36:49 +00:00
XuanYang-cn
9151e13480
Remove not using dependence and proto (#5226)
- FlushMsg proto message is no longer in use

- We don't depend on "github.com/prometheus/common/log"

Signed-off-by: yangxuan xuan.yang@zilliz.com
2021-05-14 08:50:55 +00:00
Cai Yudong
6f3a460b4e
Add pulsar seek example in pulsar_client_test.go (#5154)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-10 02:32:10 +00:00