aoiasd
9e6da45497
fix: Use uber atomic instead sync/atomic which only supported after go v1.20 ( #29377 )
...
relate: https://github.com/milvus-io/milvus/issues/29376
---------
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-12-26 16:06:49 +08:00
yah01
a0e1a1eb31
feat: support enable/disable mmap for index ( #29005 )
...
support enable/disable mmap for index, the user could alter the index's
mode by `AlterIndex` method
related: https://github.com/milvus-io/milvus/issues/21866
---------
Signed-off-by: yah01 <yah2er0ne@outlook.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-12-21 18:07:24 +08:00
XuanYang-cn
48f506b077
fix: Seperate msgstream initctx with lifecycle ctx ( #29308 )
...
The close of msgstream should be controlled by Close() not ctx from
outside when init clients
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-12-21 11:56:45 +08:00
aoiasd
46a937ac43
fix: msgstream memory leak caused by config event don't deregister ( #29266 )
...
relate: https://github.com/milvus-io/milvus/issues/28620
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-12-20 20:32:44 +08:00
SimFG
de13865769
enhance: Add load/release partitions to replicate msg stream ( #28399 )
...
/kind improvement
issue: #25655
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-11-23 15:38:24 +08:00
Enwei Jiao
3c3a57cb92
fix: Fix kafka config type error ( #28642 )
...
issue https://github.com/milvus-io/milvus/issues/28588
---------
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-11-23 14:36:22 +08:00
congqixia
371875f650
Fix MQ Factory timeout unit test ( #28395 )
...
This PR change timeout case to a longer duration in case of slow runner
Also change timeout case behavior of using timeout deadline instead of waiting
See also #28394
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-11-13 21:44:18 +08:00
jaime
6749957e71
Refine RPC call in unwatch drop channel ( #27864 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-10-24 17:46:15 +08:00
SimFG
086220dd15
Add the mock factory of msg stream ( #27834 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-10-20 20:14:08 +08:00
SimFG
9b0ecbdca7
Support to replicate the mq message ( #27240 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-10-20 14:26:09 +08:00
zhenshan.cao
2b13078b14
Refine insert when send message ( #27491 )
...
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
Co-authored-by: Cai Zhang <cai.zhang@zilliz.com>
2023-10-18 21:12:08 +08:00
smellthemoon
a9982aa7c6
Remove topic empty restriction when preCreated topic ( #27351 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-10-10 18:53:32 +08:00
congqixia
5d558623fe
Add revive sub-lints and fix existing problems ( #27495 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-10-07 20:53:38 +08:00
yihao.dai
f962fc186f
Fix panic due to return nil pulsar client ( #27429 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-09-28 16:19:26 +08:00
SimFG
c9653b1683
Add some log and improve TestSessionProcessActiveStandBy test case ( #27403 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-09-28 09:35:27 +08:00
jaime
7119cb29ca
Fix kafka consumer connection leak ( #27224 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-09-26 10:31:27 +08:00
SimFG
26f06dd732
Format the code ( #27275 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-09-21 09:45:27 +08:00
yihao.dai
fe01d54eca
Set kafka read timeout to 10s and make it configurable ( #27238 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-09-20 22:01:27 +08:00
congqixia
cc9974979f
Add staticcheck linter and fix existing problems ( #27174 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-09-19 10:05:22 +08:00
chyezh
791e6ef6c6
[Improvement] add pulsar metrics and fix timeout ( #26907 )
...
Signed-off-by: chyezh <ye.zhen@zilliz.com>
2023-09-13 12:03:19 +08:00
yah01
45d9fb5929
Fix wrong error codes & names ( #26904 )
...
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-09-12 14:41:18 +08:00
congqixia
1aa3a1e067
Refine NewNmqClient
logic with nats.ConsumeDialer option ( #26987 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-09-11 20:17:17 +08:00
XuanYang-cn
7f1ae35e72
Add timeout in dispatcher, AsConsumer and Seek ( #26686 )
...
See also: #25309
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-09-08 09:51:17 +08:00
Enwei Jiao
fb0705df1b
Decouple basetable and componentparam ( #26725 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-09-05 10:31:48 +08:00
congqixia
1a8cf5c415
Organize all mockery generation commands in Makefile ( #26826 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-09-04 21:19:48 +08:00
congqixia
d343888f3c
Fix pkg codecov & static-check script ( #26720 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-08-31 09:59:01 +08:00
congqixia
ee7aef9272
Make pulsar request timeout configurable ( #26525 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-08-23 20:46:23 +08:00
chyezh
85886f039e
[Fixup] msg context access data race when msgdispatcher ( #26463 )
...
Signed-off-by: chyezh <ye.zhen@zilliz.com>
2023-08-21 19:16:22 +08:00
Enwei Jiao
78bc688d16
Remove QueryMsgStream in MqFactory interface ( #26374 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-16 10:29:33 +08:00
congqixia
a12e45f693
Use map&mutex for dispatcher client ( #26380 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-08-16 09:09:34 +08:00
chyezh
4c4b2903f9
[Fixup] nats log configuration, open nats log at info level by deafult ( #26168 )
...
Signed-off-by: chyezh <ye.zhen@zilliz.com>
2023-08-14 14:21:32 +08:00
Enwei Jiao
a3c176045d
Fix kafka producer init many times ( #26314 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-13 16:59:30 +08:00
congqixia
767955ec6b
Reduce MQ buffer length and flowgraph wait queue length to 16 ( #26179 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-08-09 10:05:14 +08:00
congqixia
241117dd6d
Use last end position in pursuit mode ( #26144 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-08-05 16:55:06 +08:00
congqixia
fcde5b8d7f
Add pursuit mode for mqtt msgstream ( #26098 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-08-04 12:33:06 +08:00
congqixia
33cfb2ba2f
Fix MsgPack from mq msgstream ts not set ( #25926 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-07-27 13:57:12 +08:00
chyezh
e24a8b3606
[Feature] Add benchmark and retention configuration for nmq ( #25768 )
...
Signed-off-by: chyezh <ye.zhen@zilliz.com>
2023-07-25 19:33:01 +08:00
congqixia
3c503afe7c
Use typeutil.ConcurrentMap instead of sync.Map ( #25846 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-07-24 10:23:01 +08:00
Enwei Jiao
9fe62cb5f3
Fix kafka producer panic by nil ( #25691 )
...
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-07-18 18:24:57 +08:00
wei liu
51c348158b
fix use pChannel in seek position ( #25611 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-07-17 09:18:33 +08:00
Bingyi Sun
c51922eb0b
Use sync.Map to reduce lock granularity to make create collection faster ( #25485 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2023-07-13 21:46:31 +08:00
SimFG
f9e2d00f91
Prevent exclusive consumer
exception in pulsar ( #25376 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-07-12 17:26:30 +08:00
wei liu
3a222e976d
fix consumer close may block forever ( #25120 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-06-27 14:04:45 +08:00
SimFG
a1e6428bc7
Fix the kafka panic when sending the message to a closed channel ( #25116 ) ( #25117 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-06-27 10:42:44 +08:00
xige-16
33c2012675
Add more metrics ( #25081 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-06-26 17:52:44 +08:00
congqixia
6a1eff3487
Fix kafka consumer double close ( #25051 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-25 14:16:44 +08:00
congqixia
00f8f236d7
Revert close kafka internal producer ( #25072 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-25 12:38:43 +08:00
congqixia
4fda4f3951
Close kafka internal consumer&producer properly ( #24998 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-20 21:14:41 +08:00
congqixia
41af0a98fa
Use go-api/v2 for milvus-proto ( #24770 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-09 01:28:37 +08:00
yah01
ebd0279d3f
Check error by Error() and NoError() for better report message ( #24736 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-06-08 15:36:36 +08:00
chyezh
f97127ae55
add nats mq wrappers ( #24445 )
...
bug fixup, configurable natsmq, add unittest, pass e2e.
move natsmq to pkg project
Signed-off-by: chyezh <ye.zhen@zilliz.com>
Co-authored-by: yiwangdr <yiwangdr@gmail.com>
2023-06-07 10:00:37 +08:00
xige-16
732fe54775
Support partition Key ( #24047 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-06-06 10:24:34 +08:00
congqixia
eb690ef033
Fix querynodev2 stop logic ( #23487 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-18 17:56:30 +08:00
congqixia
5276529524
Make pkg code change trigger ci workflow ( #23312 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-11 10:32:31 +08:00
jaime
c9d0c157ec
Move some modules from internal to public package ( #22572 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-04-06 19:14:32 +08:00