test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-02 11:59:00 +08:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity
20,042 Commits 94 Branches 105 Tags 184 MiB
0ecd694305
Commit Graph

70 Commits

Author SHA1 Message Date
wayblink
a1232fafda
feat: Major compaction (#33620) 
#30633

Signed-off-by: wayblink <anyang.wang@zilliz.com>
Co-authored-by: MrPresent-Han <chun.han@zilliz.com>
 2024-06-10 21:34:08 +08:00
Aldrin
8a4ef1b836
fix: Masked kafka credentials getting printed in logs (#33730) 
issue: https://github.com/milvus-io/milvus/issues/33727

Signed-off-by: Aldrin <imagesai32@gmail.com>
 2024-06-10 00:05:54 +08:00
XuanYang-cn
1629833060
enhance: Add consts of MsgDispatcher to configs (#33679) 
See also: #33676

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-06-07 14:21:59 +08:00
SimFG
cb99e3db34
enhance: add the includeCurrentMsg param for the Seek method (#33326) 
/kind improvement
- issue: #33325

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-05-27 10:31:41 +08:00
congqixia
12e8c6c583
enhance: Try LatestMessageID when checkpoint unmarshal fails (#33158) 
See also #33122

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-05-21 16:59:39 +08:00
congqixia
c2ac692008
enhance: Add param item to ignore bad message id in checkpoint (#33123) 
See also #33122

This pr add param item `mq.ignoreBadPosition` to control behavior when
mq failed to parse message id from checkpoint

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-05-20 11:29:37 +08:00
XuanYang-cn
39337e09b8
fix: Using zero serverID for metrics (#31518) 
Fixes: #31516

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-04-01 16:55:19 +08:00
Xiaofan
b6fefee0cf
fix: etcd not connectable when auth enabled (#31633) 
Fix etcd config source didn't respect auth enabled
Also removed pulsar recoverable error when pulsar return ConsumerBusy.
It could happen that pulsar didn't find the original consumer is dead
and recover takes some time.
fix #31631

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
 2024-04-01 15:23:19 +08:00
groot
ba6d33cd57
fix: Support TLS for kafka connection (#30468) 
#27977

Add extra configurations in milvus.yaml to pass certificates for kafka.

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2024-02-28 18:43:07 +08:00
XuanYang-cn
e0f371c99b
fix: [skip e2e]use unique topic name for test pulsarCtl (#30364) 
See also: #30363

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-02-01 11:05:04 +08:00
smellthemoon
e52ce370b6
enhance:don't store logPath in meta to reduce memory (#28873) 
don't store logPath in meta to reduce memory, when service get
segmentinfo, generate logpath from logid.
#28885

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-01-18 22:06:31 +08:00
XuanYang-cn
f9508a4851
fix: Remove logging data when logging skip msg (#29707) 
See also: #29696

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-01-15 11:40:51 +08:00
yihao.dai
8febbc79bb
fix: Fix unstable msg dispatcher ut (#29925) 
This fix will not augment the execution time of unit tests, but solely
enhances tolerance for waiting for failure.

issue: https://github.com/milvus-io/milvus/issues/29921

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-01-14 10:40:52 +08:00
wei liu
1f759837c4
fix: remove Unnecessary lock in config manager (#29836) 
issue: #29709 #291712
to avoid concurrent recursive RLock and Lock cause deadlock, This PR
remove the unnecessary lock in config manager

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-01-11 13:48:49 +08:00
smellthemoon
1c1f2a1371
enhance:change some logs (#29579) 
related #29588

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-01-05 16:12:48 +08:00
aoiasd
9e6da45497
fix: Use uber atomic instead sync/atomic which only supported after go v1.20 (#29377) 
relate: https://github.com/milvus-io/milvus/issues/29376

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-12-26 16:06:49 +08:00
yah01
a0e1a1eb31
feat: support enable/disable mmap for index (#29005) 
support enable/disable mmap for index, the user could alter the index's
mode by `AlterIndex` method
related: https://github.com/milvus-io/milvus/issues/21866

---------

Signed-off-by: yah01 <yah2er0ne@outlook.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-12-21 18:07:24 +08:00
XuanYang-cn
48f506b077
fix: Seperate msgstream initctx with lifecycle ctx (#29308) 
The close of msgstream should be controlled by Close() not ctx from
outside when init clients

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-12-21 11:56:45 +08:00
aoiasd
46a937ac43
fix: msgstream memory leak caused by config event don't deregister (#29266) 
relate: https://github.com/milvus-io/milvus/issues/28620

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-12-20 20:32:44 +08:00
SimFG
de13865769
enhance: Add load/release partitions to replicate msg stream (#28399) 
/kind improvement
issue: #25655

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-11-23 15:38:24 +08:00
Enwei Jiao
3c3a57cb92
fix: Fix kafka config type error (#28642) 
issue https://github.com/milvus-io/milvus/issues/28588

---------

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-11-23 14:36:22 +08:00
congqixia
371875f650
Fix MQ Factory timeout unit test (#28395) 
This PR change timeout case to a longer duration in case of slow runner
Also change timeout case behavior of using timeout deadline instead of waiting
See also #28394

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-11-13 21:44:18 +08:00
jaime
6749957e71
Refine RPC call in unwatch drop channel (#27864) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-10-24 17:46:15 +08:00
SimFG
086220dd15
Add the mock factory of msg stream (#27834) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-10-20 20:14:08 +08:00
SimFG
9b0ecbdca7
Support to replicate the mq message (#27240) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-10-20 14:26:09 +08:00
zhenshan.cao
2b13078b14
Refine insert when send message (#27491) 
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
Co-authored-by: Cai Zhang <cai.zhang@zilliz.com>
 2023-10-18 21:12:08 +08:00
smellthemoon
a9982aa7c6
Remove topic empty restriction when preCreated topic (#27351) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-10-10 18:53:32 +08:00
congqixia
5d558623fe
Add revive sub-lints and fix existing problems (#27495) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-10-07 20:53:38 +08:00
yihao.dai
f962fc186f
Fix panic due to return nil pulsar client (#27429) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-09-28 16:19:26 +08:00
SimFG
c9653b1683
Add some log and improve TestSessionProcessActiveStandBy test case (#27403) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-09-28 09:35:27 +08:00
jaime
7119cb29ca
Fix kafka consumer connection leak (#27224) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-09-26 10:31:27 +08:00
SimFG
26f06dd732
Format the code (#27275) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-09-21 09:45:27 +08:00
yihao.dai
fe01d54eca
Set kafka read timeout to 10s and make it configurable (#27238) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-09-20 22:01:27 +08:00
congqixia
cc9974979f
Add staticcheck linter and fix existing problems (#27174) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-19 10:05:22 +08:00
chyezh
791e6ef6c6
[Improvement] add pulsar metrics and fix timeout (#26907) 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-09-13 12:03:19 +08:00
yah01
45d9fb5929
Fix wrong error codes & names (#26904) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-12 14:41:18 +08:00
congqixia
1aa3a1e067
Refine NewNmqClient logic with nats.ConsumeDialer option (#26987) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-11 20:17:17 +08:00
XuanYang-cn
7f1ae35e72
Add timeout in dispatcher, AsConsumer and Seek (#26686) 
See also: #25309

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-09-08 09:51:17 +08:00
Enwei Jiao
fb0705df1b
Decouple basetable and componentparam (#26725) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-09-05 10:31:48 +08:00
congqixia
1a8cf5c415
Organize all mockery generation commands in Makefile (#26826) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-04 21:19:48 +08:00
congqixia
d343888f3c
Fix pkg codecov & static-check script (#26720) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-31 09:59:01 +08:00
congqixia
ee7aef9272
Make pulsar request timeout configurable (#26525) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-23 20:46:23 +08:00
chyezh
85886f039e
[Fixup] msg context access data race when msgdispatcher (#26463) 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-08-21 19:16:22 +08:00
Enwei Jiao
78bc688d16
Remove QueryMsgStream in MqFactory interface (#26374) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-08-16 10:29:33 +08:00
congqixia
a12e45f693
Use map&mutex for dispatcher client (#26380) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-16 09:09:34 +08:00
chyezh
4c4b2903f9
[Fixup] nats log configuration, open nats log at info level by deafult (#26168) 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-08-14 14:21:32 +08:00
Enwei Jiao
a3c176045d
Fix kafka producer init many times (#26314) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-08-13 16:59:30 +08:00
congqixia
767955ec6b
Reduce MQ buffer length and flowgraph wait queue length to 16 (#26179) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-09 10:05:14 +08:00
congqixia
241117dd6d
Use last end position in pursuit mode (#26144) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-05 16:55:06 +08:00
congqixia
fcde5b8d7f
Add pursuit mode for mqtt msgstream (#26098) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-04 12:33:06 +08:00