test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-11-30 02:48:45 +08:00
Code Issues Actions 11 Packages Projects Releases Wiki Activity
20,188 Commits 94 Branches 105 Tags 184 MiB
32c943f1bc
Commit Graph

20188 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Patrick Weizhi Xu
32c943f1bc
enhance: [skip e2e] update the version of MV (#34378) 
issue: #29892

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
 2024-07-03 14:28:16 +08:00
wayblink
fb61344dc9
fix: Revert a optimize in clustering compaction (#34299) 
#30633

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2024-07-03 10:32:08 +08:00
Chun Han
34bec2ea5e
enhance: add metrics for segment prune latnecy(#30376) (#34094) 
related: #30376

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-07-03 10:04:07 +08:00
Buqian Zheng
fa8d641ce6
fix: update check for sparse hnsw index (#33713) 
issue: #29419

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-07-02 21:56:09 +08:00
Gao
ec5db7a57d
enhance: update knowhere version (#34361) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2024-07-02 19:18:24 +08:00
chyezh
3563136c2a
enhance: timetick interceptor implementation (#34238) 
issue: #33285

- optimize the message package
- add interceptor package to achieve append operation intercepting.
- add timetick interceptor to attach timetick properties for message.
- add timetick background task to send timetick message.

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-07-02 14:42:08 +08:00
cai.zhang
a5be322ab2
enhance: Don't set the timeout for SyncSegments (#34226) 
issue: #32809

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-07-02 14:28:07 +08:00
congqixia
87bccb1a6b
enhance: [GoSDK] Sync IndexType supported from v1 (#34310) 
See also #31293

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-07-01 23:54:06 +08:00
cai.zhang
4cf1a358ba
fix: Sync the sealed and flushed segments to datanode (#34301) 
issue: #33696

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-07-01 22:42:08 +08:00
congqixia
b32dae1883
enhance: Refine max length exceeded error message (#34300) 
This PR make varchar & string array field max length exceeded error
message clearer. Also fixed a minor issue that error string format and
argument number not match.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-07-01 21:16:07 +08:00
congqixia
e083d99dd9
enhance: Use channel name map finding channel watcher (#34294) 
See also #33235

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-07-01 18:46:07 +08:00
yihao.dai
734415b8a2
fix: Reduce duplicate PKs in segcore (#34267) 
issue: https://github.com/milvus-io/milvus/issues/34247

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-07-01 17:42:06 +08:00
congqixia
b284b81a47
fix: Check partition in current target when observing partition load status (#34282) 
See also #34234

`LoadPartitions` does not guarantee the current target has loading
partitions if there are some partitions already loaded before.

This PR check current target contains the partition to load when
advancing loading percentage to 100.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-07-01 17:40:07 +08:00
smellthemoon
ef3ced8138
fix: descriptor event in previous version not has nullable to parse error (#34235) 
#34176

---------

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-07-01 16:38:06 +08:00
yihao.dai
ff51c7e628
fix: Fix panic due to failed to seek (#34229) 
Converting the same msgposition's vchannel to a pchannel multiple times
would result in an invalid pchannel, leading to seek failure and panic.
This PR:
1. Make a copy of msgposition in msgdispatcher.
2. Check if channel is already a pchannel, no further channel conversion
is performed.

issue: https://github.com/milvus-io/milvus/issues/34221

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-07-01 16:08:12 +08:00
wei liu
b49862d4f3
enhance: Optimize grow slice cost during query (#34253) 
issue: #32252 

This PR try to pre-allocate FieldData for Reduce operations in the Query
chain using typeutil.PrepareResultFieldData to avoid the overhead of
dynamically growing the slice during appendFieldData process.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-07-01 15:18:11 +08:00
aoiasd
186757e622
enhance: support mark error as user error (#33498) 
relate: https://github.com/milvus-io/milvus/issues/33492

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-07-01 14:56:12 +08:00
jaime
d6afb31b94
enhance: make subfunctions of datanode component modular (#33992) 
issue: #33994

also remove deprecated channel manager based on the etcd implementation

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-07-01 14:46:07 +08:00
congqixia
14e827dc6c
fix: Implement singleflight for segcore ChunkCache (#34250) 
See also #34249

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-07-01 11:46:06 +08:00
wei liu
f7ecafe77d
enhance: Skip update index for L0 segment (#34099) 
try to update index for l0 segment, will failed by `index not found`

This PR skip update index for l0 segment

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-07-01 10:26:06 +08:00
jaime
0426390f06
enhance: improve check health (#33800) 
issue: #34264

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-07-01 10:16:06 +08:00
wayblink
e5d691d854
Use new stream segment reader in clustering compaction (#34232) 
#32939

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2024-06-30 20:26:07 +08:00
wayblink
73ffc1b424
Refine clustering_compaction_task retry mechanism (#34194) 
#32939

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2024-06-30 20:22:09 +08:00
zhagnlu
3030e4625e
enhance: refactor variable column to reduce memory cost (#33875) 
#33874

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-06-30 20:16:06 +08:00
zhagnlu
cc1bc07bfd
enhance: add log to bitmap index (#34197) 
#32900

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-06-30 20:02:06 +08:00
Chun Han
96dcee5dff
fix:load major compaction partial result(#34051) (#34052) 
related: #34051

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-06-28 14:04:05 +08:00
zhuwenxing
00e5a406d4
test: remove dup code (#34242) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-06-28 10:46:04 +08:00
congqixia
97db7be505
fix: [GoSDK] Allocate correct bytes for bf16 vector (#34233) 
See also #33848

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-27 21:20:06 +08:00
sammy.huang
b14482baa6
enhance: [skip e2e] use disk ann when os is ubuntu (#34236) 
issue: https://github.com/milvus-io/milvus/issues/34222

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-06-27 20:50:13 +08:00
XuanYang-cn
dda70aa81b
fix: LegacyVersionWithoutRPCWatch default value to 2.4.1 (#34184) 
See also: #31933

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-06-27 19:36:06 +08:00
wei liu
8123bea1ae
enhance: Avoid assign too much segment/channels to new querynode (#34096) 
issue: #34095

When a new query node comes online, the segment_checker,
channel_checker, and balance_checker simultaneously attempt to allocate
segments to it. If this occurs during the execution of a load task and
the distribution of the new query node hasn't been updated, the query
coordinator may mistakenly view the new query node as empty. As a
result, it assigns segments or channels to it, potentially overloading
the new query node with more segments or channels than expected.

This PR measures the workload of the executing tasks on the target query
node to prevent assigning an excessive number of segments to it.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-06-27 19:06:05 +08:00
Cai Yudong
ad90360162
enhance: Update knowhere commit (#34223) 
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2024-06-27 18:20:06 +08:00
nico
f2107ad263
test: update test cases about autoindex (#34224) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-06-27 17:06:05 +08:00
chyezh
d2bc4a53be
enhance: implement rmq and pulsar as wal (#34046) 
issue: #33285

- use reader but not consumer for pulsar
- advanced test framework
- move some streaming related package into pkg

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-06-27 15:11:05 +08:00
ThreadDao
be23495233
test: add cases got gosdk v2 search and databases (#34204) 
issue: #33952 #33627 #33419

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-06-27 09:40:08 +08:00
jaime
9c2eeff427
enhance: refine error message for invalid limit parameter (#34178) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-06-26 22:14:04 +08:00
cqy123456
51ebe95be5
enhance: remove CheckVecIndexWithDataTypeExist function in pkg and remove some cgo call (#34102) 
issue: https://github.com/milvus-io/milvus/issues/22837
related pr: https://github.com/milvus-io/milvus/pull/34104

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2024-06-26 21:13:44 +08:00
sre-ci-robot
006f75304a Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2024-06-26 12:01:23 +00:00
congqixia
948bfba93a
fix: Pass otlpSecure config when setup segcore tracing (#34193) 
See also #34192

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-26 19:18:04 +08:00
sammy.huang
e43c558071
enhance: [skip e2e] fix mergify (#34209) 
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-06-26 18:50:04 +08:00
sammy.huang
0565b70ff1
enhance: [skip e2e] make mergify back-forward compatible with old check (#34183) 
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-06-26 17:54:05 +08:00
congqixia
e04f1f9748
enhance: Add unittest for storage.DeleteLog (#34190) 
See also #33787
Backport unit test part in #34188

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-26 17:14:04 +08:00
zhuwenxing
a08000cfbf
enhance:[skip e2e]update one pod mode resource (#34196) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-06-26 16:54:05 +08:00
xige-16
f8bf6909c6
fix: Fix datacoord's properties overwriten (#34146) 
issue: #34144 
/kind bug

Signed-off-by: xige-16 <xige2016@gmail.com>
 2024-06-26 11:56:04 +08:00
wei liu
45203425fd
enhance: Avoid search querynode return nil status in response (#34100) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-06-26 11:50:11 +08:00
Gao
a933f6731b
fix: centroids file not removed when data skew in major compaction (#34050) 
issue: https://github.com/milvus-io/milvus/issues/30633

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2024-06-26 10:48:04 +08:00
wayblink
fbe3231b1f
fix: fix error ignore in compactor (#34169) 
#34170

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2024-06-26 10:24:03 +08:00
ThreadDao
a77e2951af
test: add cases for go milvusclient query (#33884) 
issue: #33419

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-06-26 09:52:04 +08:00
sre-ci-robot
cc54ab2e47
[automated] Update Knowhere Commit (#34172) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-06-26 02:20:03 +08:00
cqy123456
381d43717d
enhance: update new mmap config parmeters version (#34143) 
issue: https://github.com/milvus-io/milvus/issues/32984
related pr: https://github.com/milvus-io/milvus/pull/34145

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2024-06-25 21:20:05 +08:00