test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-11-30 10:59:32 +08:00
Code Issues Actions 11 Packages Projects Releases Wiki Activity
20,112 Commits 94 Branches 105 Tags 184 MiB
78885a44c4
Commit Graph

20112 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ted Xu
78885a44c4
fix: turn on compression on stream writers (#34067) 
See #31679

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-06-24 10:08:02 +08:00
zhagnlu
03a3f50892
enhance: add skip using array index when some situation (#33947) 
#32900

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-06-23 21:26:02 +08:00
zhagnlu
0d7ea8ec42
enhance: Enhance and correct exception module (#33705) 
#33704

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-06-23 21:22:01 +08:00
yihao.dai
6c1d815894
enhance: Remove the unused compaction logic from shard (#33932) 
1. Remove the `compactTo` field in `SegmentInfo`.
2. Remove the target segment not match and its retry logic in
`SyncManager`.

issue: https://github.com/milvus-io/milvus/issues/32809

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-06-23 21:12:01 +08:00
sammy.huang
b77ab76d74
enhance: get environment variable from .env (#34081) 
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-06-23 09:34:07 +08:00
sre-ci-robot
e1b64e2318 Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2024-06-22 12:00:53 +00:00
yihao.dai
fb870d2426
fix: Do compressBinlog to fix logID 0 (#34060) 
issue: https://github.com/milvus-io/milvus/issues/34059

Do compressBinlog to ensure that reloadFromKV will fill binlogs' logID
after datacoord restarts.

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-06-22 16:14:01 +08:00
zhikunyao
e0e06fc9e0
enhance: [skip e2e] Update mergify.yml to skip cov checker (#34072) 2024-06-22 16:12:00 +08:00
chyezh
259a682673
enhance: async search and retrieve in cgo (#33228) 
issue: #30926, #33132
related pr: #33133

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-06-22 09:38:02 +08:00
nico
c85644e1b3
test: modify test case about upsert partition (#33919) 
issue: #33902

Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-06-21 18:50:00 +08:00
yanliang567
f3f390ea43
test: Update tests for range search and add test for query with dup ids (#34057) 
related issue: #33883

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2024-06-21 18:48:02 +08:00
wayblink
380d3f4469
fix: Fix memory buffer error & some renaming (#33850) 
#30633

---------

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2024-06-21 17:30:01 +08:00
congqixia
2f691f1e67
enhance: Unify DeleteLog parsing code (#34009) 
See also #33787

The parsing delete log is distributed in lots of places, which is not
recommended and hard to maintain.

This PR abstract common parsing logic into `DeleteLog.Parse` method to
unify implementation and make it easier to replace json parsing lib.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-21 16:54:01 +08:00
Bingyi Sun
622be36ad7
fix: fix l0 compaction may miss some sealed segments (#33980) 
issue: https://github.com/milvus-io/milvus/issues/33955

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-06-21 16:52:15 +08:00
Ted Xu
958ecd500b
feat: adding grouped virtual resource allocator (#33669) 
See #33559

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-06-21 15:58:01 +08:00
zhuwenxing
03a5f7e6c0
test: update the lib of bf16 (#34043) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-06-21 14:20:08 +08:00
jaime
e653ad27e2
fix: metrics database_num is 0 after restarting rootcoord (#34011) 
issue: #34041

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-06-21 11:36:00 +08:00
coldWater
66710008d6
enhance: Support queryOption WithLimit for milvusclient (#33978) 
See also #31293

---------

Signed-off-by: coldWater <254244460@qq.com>
 2024-06-21 10:52:02 +08:00
congqixia
35ea775c14
enhance: Add rules and fix for go_client e2e code style (#34033) 
See also #31293

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-21 10:32:02 +08:00
elstic
4e414fb7fc
test: optimizing variable names (#34035) 
Signed-off-by: elstic <hao.wang@zilliz.com>
 2024-06-21 10:14:00 +08:00
sre-ci-robot
d9f986439d
[automated] Update Knowhere Commit (#34040) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-06-21 01:50:01 +08:00
presburger
dac20d41c0
fix: fix milvus gpu compile error (#33995) 
NVIDIA RAFT uses customized versions of spdlog and fmt, which conflict
with the versions provided by Conan. Therefore, it is necessary to
isolate the build environment for knowhere to avoid these conflicts.
issue: https://github.com/milvus-io/milvus/issues/33991

Signed-off-by: yusheng.ma <yusheng.ma@zilliz.com>
 2024-06-20 20:30:01 +08:00
XuanYang-cn
04edb07d82
enhance: Add deltaRowCount in l0 compaction (#33997) 
See also: #33998

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-06-20 17:46:01 +08:00
cqy123456
dc4437ff82
enhance: use segment id and type to register in MmapChunkManager and opt malloc in variableChunk (#33993) 
issue: https://github.com/milvus-io/milvus/issues/32984

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2024-06-20 17:42:02 +08:00
sammy.huang
5be9929d64
enhance: upgrade build-env to ubuntu 22.04 and gcc12 (#33959) 
issue: #33960

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-06-20 15:22:02 +08:00
wei liu
935bc1fb71
fix: Fix GetReplicas API return nil status (#33715) 
issue: #33702

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-06-20 14:40:15 +08:00
elstic
ce3d7070ac
test: change the number of insertion vectors (#34014) 
pr: https://github.com/milvus-io/milvus/pull/33916 

1. Fix case: test_collection_multi_sparse_vectors 
2. Reduce the amount of data generated

Signed-off-by: elstic <hao.wang@zilliz.com>
 2024-06-20 13:58:05 +08:00
shaoting-huang
5f02e52561
enhance: Refactor data codec deserialize (#33923) 
#33922

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2024-06-20 11:17:59 +08:00
wei liu
31ef0a1fe8
enhance: Add trace for bf cost in l0 compactor (#33860) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-06-20 10:10:05 +08:00
zhuwenxing
f3d902cf16
test: add test case for bulkwriter (#33879) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-06-20 09:24:04 +08:00
nico
0264588df9
enhance: update pymilvus version (#33905) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-06-20 09:22:18 +08:00
congqixia
cc77363b66
enhance: Set maxPartitionNum default value to 1024 (#33949) 
See also #30059

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-20 09:11:59 +08:00
congqixia
6a15b6e2be
fix: Remove loopclosure issue in ChannelManagerImplV2 (#33989) 
See also #33987

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-19 21:25:59 +08:00
smellthemoon
2a1356985d
enhance: support null in go payload (#32296) 
#31728

---------

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-06-19 17:08:00 +08:00
shaoting-huang
eb3197eb1e
enhance: update amazonlinux2023 image builder (#33948) 
#32982

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2024-06-19 16:44:01 +08:00
elstic
1216a4bcd8
test: Add more sparse test cases (#33916) 
issue: https://github.com/milvus-io/milvus/issues/31483

Signed-off-by: elstic <hao.wang@zilliz.com>
 2024-06-19 15:24:09 +08:00
Ted Xu
6d5747cb3e
feat: adding deltalog stream reader and writer (#33844) 
See #31679

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-06-19 14:42:01 +08:00
Jiquan Long
7b9462c0d3
enhance: fix copying hits of inverted index twice (#33968) 
issue: https://github.com/milvus-io/milvus/issues/29793
The custom `VecCollector` have already transformed the results into
vector of offsets, no need to copy them twice.

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-06-19 12:40:01 +08:00
wayblink
5fac2fa1d2
fix: Panic if ProcessActiveStandBy returns error (#33369) 
#33368

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2024-06-19 11:16:00 +08:00
wei liu
02945959d9
enhance: Avoid to iterate whole segment list for each task's process (#33943) 
when querycoord process segment task, it will try to iterate whole
segment list to checke whether segment is loaded, which cost too much
cpu if there has thousands of segments.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-06-19 10:19:58 +08:00
cqy123456
298e50b834
enhance: check index with data type (#33880) 
issue: https://github.com/milvus-io/milvus/issues/22837
related: https://github.com/milvus-io/milvus/pull/33878

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2024-06-19 10:15:59 +08:00
chyezh
2f6f964bc8
enhance: [skip e2e] modify gc configuration document (#33946) 
issue: #31740

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-06-19 09:57:59 +08:00
Gao
0d20303e54
fix: fix binary vector data size (#33750) 
issue: https://github.com/milvus-io/milvus/issues/22837

- fix byte size wrong for binary vectors
- fix the expect/actual error msg

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2024-06-18 21:39:59 +08:00
Gao
a789c60380
enhance: autoindex for multi data type (#33868) 
issue: #22837 

contain https://github.com/milvus-io/milvus/pull/33625
https://github.com/milvus-io/milvus/pull/33867
https://github.com/milvus-io/milvus/pull/33911 which already merged to
2.4 branch

Signed-off-by: chasingegg <chao.gao@zilliz.com>
Co-authored-by: foxspy <xianliang.li@zilliz.com>
 2024-06-18 21:34:01 +08:00
sre-ci-robot
74186091d4 Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2024-06-18 12:00:57 +00:00
cqy123456
b460862537
fix: can't find Chunk struct after growing support mmap (#33951) 
issue: https://github.com/milvus-io/milvus/issues/32984

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2024-06-18 18:37:58 +08:00
wayblink
5cb0760187
fix: Small fixs of major compaction (#33929) 
#30633

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2024-06-18 16:53:58 +08:00
congqixia
3fdaae8792
fix: Return record with largest timestamp for entires with same PK (#33936) 
See also #33883

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-18 15:55:59 +08:00
congqixia
5772123ca2
fix: Check the correct return error in MultiRemove (#33926) 
See also #33925

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-18 15:23:59 +08:00
wei liu
5e906fd17f
enhance: Force to reset coord connection for unavailable error (#33908) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-06-18 14:53:59 +08:00