test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-02 11:59:00 +08:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity
20,162 Commits 94 Branches 105 Tags 184 MiB
00e5a406d4
Commit Graph

20162 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
zhuwenxing
00e5a406d4
test: remove dup code (#34242) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-06-28 10:46:04 +08:00
congqixia
97db7be505
fix: [GoSDK] Allocate correct bytes for bf16 vector (#34233) 
See also #33848

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-27 21:20:06 +08:00
sammy.huang
b14482baa6
enhance: [skip e2e] use disk ann when os is ubuntu (#34236) 
issue: https://github.com/milvus-io/milvus/issues/34222

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-06-27 20:50:13 +08:00
XuanYang-cn
dda70aa81b
fix: LegacyVersionWithoutRPCWatch default value to 2.4.1 (#34184) 
See also: #31933

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-06-27 19:36:06 +08:00
wei liu
8123bea1ae
enhance: Avoid assign too much segment/channels to new querynode (#34096) 
issue: #34095

When a new query node comes online, the segment_checker,
channel_checker, and balance_checker simultaneously attempt to allocate
segments to it. If this occurs during the execution of a load task and
the distribution of the new query node hasn't been updated, the query
coordinator may mistakenly view the new query node as empty. As a
result, it assigns segments or channels to it, potentially overloading
the new query node with more segments or channels than expected.

This PR measures the workload of the executing tasks on the target query
node to prevent assigning an excessive number of segments to it.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-06-27 19:06:05 +08:00
Cai Yudong
ad90360162
enhance: Update knowhere commit (#34223) 
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2024-06-27 18:20:06 +08:00
nico
f2107ad263
test: update test cases about autoindex (#34224) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-06-27 17:06:05 +08:00
chyezh
d2bc4a53be
enhance: implement rmq and pulsar as wal (#34046) 
issue: #33285

- use reader but not consumer for pulsar
- advanced test framework
- move some streaming related package into pkg

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-06-27 15:11:05 +08:00
ThreadDao
be23495233
test: add cases got gosdk v2 search and databases (#34204) 
issue: #33952 #33627 #33419

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-06-27 09:40:08 +08:00
jaime
9c2eeff427
enhance: refine error message for invalid limit parameter (#34178) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-06-26 22:14:04 +08:00
cqy123456
51ebe95be5
enhance: remove CheckVecIndexWithDataTypeExist function in pkg and remove some cgo call (#34102) 
issue: https://github.com/milvus-io/milvus/issues/22837
related pr: https://github.com/milvus-io/milvus/pull/34104

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2024-06-26 21:13:44 +08:00
sre-ci-robot
006f75304a Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2024-06-26 12:01:23 +00:00
congqixia
948bfba93a
fix: Pass otlpSecure config when setup segcore tracing (#34193) 
See also #34192

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-26 19:18:04 +08:00
sammy.huang
e43c558071
enhance: [skip e2e] fix mergify (#34209) 
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-06-26 18:50:04 +08:00
sammy.huang
0565b70ff1
enhance: [skip e2e] make mergify back-forward compatible with old check (#34183) 
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-06-26 17:54:05 +08:00
congqixia
e04f1f9748
enhance: Add unittest for storage.DeleteLog (#34190) 
See also #33787
Backport unit test part in #34188

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-26 17:14:04 +08:00
zhuwenxing
a08000cfbf
enhance:[skip e2e]update one pod mode resource (#34196) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-06-26 16:54:05 +08:00
xige-16
f8bf6909c6
fix: Fix datacoord's properties overwriten (#34146) 
issue: #34144 
/kind bug

Signed-off-by: xige-16 <xige2016@gmail.com>
 2024-06-26 11:56:04 +08:00
wei liu
45203425fd
enhance: Avoid search querynode return nil status in response (#34100) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-06-26 11:50:11 +08:00
Gao
a933f6731b
fix: centroids file not removed when data skew in major compaction (#34050) 
issue: https://github.com/milvus-io/milvus/issues/30633

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2024-06-26 10:48:04 +08:00
wayblink
fbe3231b1f
fix: fix error ignore in compactor (#34169) 
#34170

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2024-06-26 10:24:03 +08:00
ThreadDao
a77e2951af
test: add cases for go milvusclient query (#33884) 
issue: #33419

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-06-26 09:52:04 +08:00
sre-ci-robot
cc54ab2e47
[automated] Update Knowhere Commit (#34172) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-06-26 02:20:03 +08:00
cqy123456
381d43717d
enhance: update new mmap config parmeters version (#34143) 
issue: https://github.com/milvus-io/milvus/issues/32984
related pr: https://github.com/milvus-io/milvus/pull/34145

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2024-06-25 21:20:05 +08:00
jaime
9630974fbb
enhance: move rocksmq from internal to pkg module (#33881) 
issue: #33956

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-06-25 21:18:15 +08:00
cai.zhang
c65f41dc60
fix: Only sync flushed segments to datanode (#34156) 
issue: #33540

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-06-25 20:46:07 +08:00
congqixia
b1a34732b1
fix: [GoSDK] Compose result set for result zero hit case (#34129) 
See also #33952

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-25 19:06:02 +08:00
wayblink
f9a0f7bb25
Add an option to enable/disable vector field clustering key (#34097) 
#30633

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2024-06-25 18:52:04 +08:00
congqixia
c8c423e972
enhance: [skip e2e] Sync mergify Build & test job name to 22.04 (#34158) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-25 18:50:04 +08:00
yihao.dai
940a0ac0a3
fix: Prevent import from generating orphaned files (#34070) 
When import failed, mark the import segment as dropped instead of drop
it directly to prevent generating orphaned files.

issue: https://github.com/milvus-io/milvus/issues/34068

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-06-25 16:58:02 +08:00
pingliu
b12c34a8ba
doc: [skip e2e] change milvus docker image version to v2.4.5 (#34135) 
Signed-off-by: ping.liu <ping.liu@zilliz.com>
 2024-06-25 14:30:04 +08:00
congqixia
962a5446f8
enhance: Add ctx in SyncTask.Run to be cancellable (#34042) 
Related to #33716

This PR add context param in SyncTask.Run execution functions to make it
cancellable from the caller.

This make it possible to cancel task when datanode/data sync service is
beeing shut down.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-25 14:22:04 +08:00
chyezh
93291c0dca
fix: add build-tags at golangci-lint (#34084) 
issue: #33132

caused by introducing conditional compile file in async cgo.

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-06-25 11:55:07 +08:00
sammy.huang
ac2840243a
enhance: revert dead try on uploading codecov (#34130) 
This reverts commit 19936d9994.

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-06-25 11:51:30 +08:00
congqixia
a21c0865de
enhance: [skip e2e] Check 'Build and Test' steps success for mergify (#34125) 
Since 'Build and test' action is separated into several steps, each
failure/success status shall cause different behavior for mergify rule

This PR check cpp/go ut and intergration tests for 'Build & test'
actions to add or remove labels.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-25 10:58:01 +08:00
sammy.huang
2cc9df5c50
[automated] Update cpu Builder image changes (#34078) 
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-06-25 10:56:10 +08:00
zhenshan.cao
d18c49013b
enhance: Refine compaction (#33982) 
issue : https://github.com/milvus-io/milvus/issues/32939

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2024-06-25 10:08:03 +08:00
congqixia
506a915272
fix: Deep copy ImportTask.segmentsInfo to prevent data race (#34090) 
See also #34089

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-25 10:06:02 +08:00
sre-ci-robot
254b555d53
[automated] Update Knowhere Commit (#34119) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-06-25 01:22:02 +08:00
congqixia
07c25a19d9
fix: Make querycoord panick when rg metastore sync fail (#34106) 
See also #34047

When `unassignNode` sync resource group with node removed failed

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-24 21:38:02 +08:00
zhikunyao
68fe6f9a0e
enhance: [skip e2e]Update mergify.yml to skip code check workflow (#34113) 
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
Co-authored-by: Zhikun Yao <zhikun.yao@zilliz.com>
 2024-06-24 21:16:02 +08:00
congqixia
fd922d921a
enhance: Add nilness linter and fix some small issues (#34049) 
Add `nilness` for govet linter and fixed some detected issues

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-24 14:52:03 +08:00
GenkenWei
a1248a19f8
fix: update ubuntu base image version (#33944) 
related to #33945
FIX CVEs of milvus base image: MEDIUM: 8, **Total FIX: 8** for master
branch

![image](https://github.com/milvus-io/milvus/assets/27683687/71708028-265e-4f20-8732-56b7e76864fc)

Signed-off-by: weizhenkun <zhenkun.wei@qq.com>
Co-authored-by: weizhenkun <zhenkun.wei@qq.com>
 2024-06-24 14:12:02 +08:00
Jiquan Long
aa36f9feed
fix: [ut] regex query under unsupported index (#34087) 
/kind improvement
issue: https://github.com/milvus-io/milvus/issues/29988

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-06-24 14:08:03 +08:00
jaime
d08cb885ca
enhance: enable flush rate limiter of collection level (#33837) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-06-24 10:52:03 +08:00
zhuwenxing
4c6f6c54dc
test: refine restful testcases trace (#34066) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-06-24 10:36:25 +08:00
chyezh
b9237280c2
enhance: wal interface definition (#33745) 
issue: #33285

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-06-24 10:34:12 +08:00
Patrick Weizhi Xu
b961767005
enhance: support integral type for MV and skip MV if there is only one category (#33161) 
issue: #29892

---------

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
 2024-06-24 10:20:01 +08:00
congqixia
b5c9a7364b
fix: Prevent remove new growing L1 segment when SyncSegments (#34056) 
Related to #34018

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-06-24 10:18:01 +08:00
Chun Han
ca7ef26e4b
fix: sync part stats task cannot be finished(#30376) (#34027) 
related: #30376
also: refine log output for query_coord task by rephrasing action string

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-06-24 10:16:02 +08:00