test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-02 11:59:00 +08:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity
20,183 Commits 94 Branches 105 Tags 184 MiB
3563136c2a
Commit Graph

20183 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
yihao.dai
940a0ac0a3
fix: Prevent import from generating orphaned files (#34070) 
When import failed, mark the import segment as dropped instead of drop
it directly to prevent generating orphaned files.

issue: https://github.com/milvus-io/milvus/issues/34068

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-06-25 16:58:02 +08:00
pingliu
b12c34a8ba
doc: [skip e2e] change milvus docker image version to v2.4.5 (#34135) 
Signed-off-by: ping.liu <ping.liu@zilliz.com>
 2024-06-25 14:30:04 +08:00
congqixia
962a5446f8
enhance: Add ctx in SyncTask.Run to be cancellable (#34042) 
Related to #33716

This PR add context param in SyncTask.Run execution functions to make it
cancellable from the caller.

This make it possible to cancel task when datanode/data sync service is
beeing shut down.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-25 14:22:04 +08:00
chyezh
93291c0dca
fix: add build-tags at golangci-lint (#34084) 
issue: #33132

caused by introducing conditional compile file in async cgo.

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-06-25 11:55:07 +08:00
sammy.huang
ac2840243a
enhance: revert dead try on uploading codecov (#34130) 
This reverts commit 19936d9994.

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-06-25 11:51:30 +08:00
congqixia
a21c0865de
enhance: [skip e2e] Check 'Build and Test' steps success for mergify (#34125) 
Since 'Build and test' action is separated into several steps, each
failure/success status shall cause different behavior for mergify rule

This PR check cpp/go ut and intergration tests for 'Build & test'
actions to add or remove labels.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-25 10:58:01 +08:00
sammy.huang
2cc9df5c50
[automated] Update cpu Builder image changes (#34078) 
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-06-25 10:56:10 +08:00
zhenshan.cao
d18c49013b
enhance: Refine compaction (#33982) 
issue : https://github.com/milvus-io/milvus/issues/32939

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2024-06-25 10:08:03 +08:00
congqixia
506a915272
fix: Deep copy ImportTask.segmentsInfo to prevent data race (#34090) 
See also #34089

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-25 10:06:02 +08:00
sre-ci-robot
254b555d53
[automated] Update Knowhere Commit (#34119) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-06-25 01:22:02 +08:00
congqixia
07c25a19d9
fix: Make querycoord panick when rg metastore sync fail (#34106) 
See also #34047

When `unassignNode` sync resource group with node removed failed

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-24 21:38:02 +08:00
zhikunyao
68fe6f9a0e
enhance: [skip e2e]Update mergify.yml to skip code check workflow (#34113) 
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
Co-authored-by: Zhikun Yao <zhikun.yao@zilliz.com>
 2024-06-24 21:16:02 +08:00
congqixia
fd922d921a
enhance: Add nilness linter and fix some small issues (#34049) 
Add `nilness` for govet linter and fixed some detected issues

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-24 14:52:03 +08:00
GenkenWei
a1248a19f8
fix: update ubuntu base image version (#33944) 
related to #33945
FIX CVEs of milvus base image: MEDIUM: 8, **Total FIX: 8** for master
branch

![image](https://github.com/milvus-io/milvus/assets/27683687/71708028-265e-4f20-8732-56b7e76864fc)

Signed-off-by: weizhenkun <zhenkun.wei@qq.com>
Co-authored-by: weizhenkun <zhenkun.wei@qq.com>
 2024-06-24 14:12:02 +08:00
Jiquan Long
aa36f9feed
fix: [ut] regex query under unsupported index (#34087) 
/kind improvement
issue: https://github.com/milvus-io/milvus/issues/29988

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-06-24 14:08:03 +08:00
jaime
d08cb885ca
enhance: enable flush rate limiter of collection level (#33837) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-06-24 10:52:03 +08:00
zhuwenxing
4c6f6c54dc
test: refine restful testcases trace (#34066) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-06-24 10:36:25 +08:00
chyezh
b9237280c2
enhance: wal interface definition (#33745) 
issue: #33285

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-06-24 10:34:12 +08:00
Patrick Weizhi Xu
b961767005
enhance: support integral type for MV and skip MV if there is only one category (#33161) 
issue: #29892

---------

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
 2024-06-24 10:20:01 +08:00
congqixia
b5c9a7364b
fix: Prevent remove new growing L1 segment when SyncSegments (#34056) 
Related to #34018

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-24 10:18:01 +08:00
Chun Han
ca7ef26e4b
fix: sync part stats task cannot be finished(#30376) (#34027) 
related: #30376
also: refine log output for query_coord task by rephrasing action string

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-06-24 10:16:02 +08:00
Ted Xu
78885a44c4
fix: turn on compression on stream writers (#34067) 
See #31679

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-06-24 10:08:02 +08:00
zhagnlu
03a3f50892
enhance: add skip using array index when some situation (#33947) 
#32900

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-06-23 21:26:02 +08:00
zhagnlu
0d7ea8ec42
enhance: Enhance and correct exception module (#33705) 
#33704

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-06-23 21:22:01 +08:00
yihao.dai
6c1d815894
enhance: Remove the unused compaction logic from shard (#33932) 
1. Remove the `compactTo` field in `SegmentInfo`.
2. Remove the target segment not match and its retry logic in
`SyncManager`.

issue: https://github.com/milvus-io/milvus/issues/32809

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-06-23 21:12:01 +08:00
sammy.huang
b77ab76d74
enhance: get environment variable from .env (#34081) 
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-06-23 09:34:07 +08:00
sre-ci-robot
e1b64e2318 Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2024-06-22 12:00:53 +00:00
yihao.dai
fb870d2426
fix: Do compressBinlog to fix logID 0 (#34060) 
issue: https://github.com/milvus-io/milvus/issues/34059

Do compressBinlog to ensure that reloadFromKV will fill binlogs' logID
after datacoord restarts.

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-06-22 16:14:01 +08:00
zhikunyao
e0e06fc9e0
enhance: [skip e2e] Update mergify.yml to skip cov checker (#34072) 2024-06-22 16:12:00 +08:00
chyezh
259a682673
enhance: async search and retrieve in cgo (#33228) 
issue: #30926, #33132
related pr: #33133

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-06-22 09:38:02 +08:00
nico
c85644e1b3
test: modify test case about upsert partition (#33919) 
issue: #33902

Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-06-21 18:50:00 +08:00
yanliang567
f3f390ea43
test: Update tests for range search and add test for query with dup ids (#34057) 
related issue: #33883

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2024-06-21 18:48:02 +08:00
wayblink
380d3f4469
fix: Fix memory buffer error & some renaming (#33850) 
#30633

---------

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2024-06-21 17:30:01 +08:00
congqixia
2f691f1e67
enhance: Unify DeleteLog parsing code (#34009) 
See also #33787

The parsing delete log is distributed in lots of places, which is not
recommended and hard to maintain.

This PR abstract common parsing logic into `DeleteLog.Parse` method to
unify implementation and make it easier to replace json parsing lib.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-21 16:54:01 +08:00
Bingyi Sun
622be36ad7
fix: fix l0 compaction may miss some sealed segments (#33980) 
issue: https://github.com/milvus-io/milvus/issues/33955

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-06-21 16:52:15 +08:00
Ted Xu
958ecd500b
feat: adding grouped virtual resource allocator (#33669) 
See #33559

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-06-21 15:58:01 +08:00
zhuwenxing
03a5f7e6c0
test: update the lib of bf16 (#34043) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-06-21 14:20:08 +08:00
jaime
e653ad27e2
fix: metrics database_num is 0 after restarting rootcoord (#34011) 
issue: #34041

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-06-21 11:36:00 +08:00
coldWater
66710008d6
enhance: Support queryOption WithLimit for milvusclient (#33978) 
See also #31293

---------

Signed-off-by: coldWater <254244460@qq.com>
 2024-06-21 10:52:02 +08:00
congqixia
35ea775c14
enhance: Add rules and fix for go_client e2e code style (#34033) 
See also #31293

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-21 10:32:02 +08:00
elstic
4e414fb7fc
test: optimizing variable names (#34035) 
Signed-off-by: elstic <hao.wang@zilliz.com>
 2024-06-21 10:14:00 +08:00
sre-ci-robot
d9f986439d
[automated] Update Knowhere Commit (#34040) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-06-21 01:50:01 +08:00
presburger
dac20d41c0
fix: fix milvus gpu compile error (#33995) 
NVIDIA RAFT uses customized versions of spdlog and fmt, which conflict
with the versions provided by Conan. Therefore, it is necessary to
isolate the build environment for knowhere to avoid these conflicts.
issue: https://github.com/milvus-io/milvus/issues/33991

Signed-off-by: yusheng.ma <yusheng.ma@zilliz.com>
 2024-06-20 20:30:01 +08:00
XuanYang-cn
04edb07d82
enhance: Add deltaRowCount in l0 compaction (#33997) 
See also: #33998

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-06-20 17:46:01 +08:00
cqy123456
dc4437ff82
enhance: use segment id and type to register in MmapChunkManager and opt malloc in variableChunk (#33993) 
issue: https://github.com/milvus-io/milvus/issues/32984

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2024-06-20 17:42:02 +08:00
sammy.huang
5be9929d64
enhance: upgrade build-env to ubuntu 22.04 and gcc12 (#33959) 
issue: #33960

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-06-20 15:22:02 +08:00
wei liu
935bc1fb71
fix: Fix GetReplicas API return nil status (#33715) 
issue: #33702

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-06-20 14:40:15 +08:00
elstic
ce3d7070ac
test: change the number of insertion vectors (#34014) 
pr: https://github.com/milvus-io/milvus/pull/33916 

1. Fix case: test_collection_multi_sparse_vectors 
2. Reduce the amount of data generated

Signed-off-by: elstic <hao.wang@zilliz.com>
 2024-06-20 13:58:05 +08:00
shaoting-huang
5f02e52561
enhance: Refactor data codec deserialize (#33923) 
#33922

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
 2024-06-20 11:17:59 +08:00
wei liu
31ef0a1fe8
enhance: Add trace for bf cost in l0 compactor (#33860) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-06-20 10:10:05 +08:00