test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-02 03:48:37 +08:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity
20,978 Commits 94 Branches 105 Tags 184 MiB
5a1f752272
Commit Graph

20978 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
aoiasd
72dc07ba48
fix: bm25 search failed when nq > 1 and remove idf oracle when no bm25 field exist. (#36886) 
relate: https://github.com/milvus-io/milvus/issues/35853

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-10-16 12:51:23 +08:00
Bingyi Sun
b2037c95a8
fix: use chunk_row_nums to iterate (#36882) 
Fix segmentation fault error and remove useless codes.
https://github.com/milvus-io/milvus/issues/36834

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-10-16 11:15:25 +08:00
Buqian Zheng
9997c5de34
fix: remove excessive logging (#36859) 
issue: https://github.com/milvus-io/milvus/issues/35853

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-10-16 10:47:22 +08:00
yihao.dai
f3b6792a25
enhance: Enhance segment log (#36848) 
/kind improvement

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-10-15 20:43:30 +08:00
congqixia
ba25320aea
fix: Unify loaded partition check to delegator (#36879) 
Related to #36370

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-10-15 19:15:23 +08:00
nico
2291d0c9f5
test: update test cases (#36878) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-10-15 19:13:24 +08:00
yellow-shine
e43af16e93
enhance: [ci] separate ccache by branch for e2e pipeline (#36870) 
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-10-15 17:21:22 +08:00
yihao.dai
1bd3228635
enhance: Ignore db not found error in quota center (#36821) 
In quota center, ignore the "DB not found error" to prevent it from
affecting the rate limiting of other databases.

/kind improvement

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-10-15 15:55:22 +08:00
liliu-z
b0d5866507
enhance: add checkers for Faiss-based HNSW (#36857) 
Knowhere introduced FAISS-based HNSQ Flat/SQ/PQ/PRQ. This PR adds param
check in Milvus side.

This PR actually do nothing but let the check pass, since:
1. All indexes param check will be moved to Knowhere recently. @foxspy 
2. The index name will be changed from `FAISS_HNSW_xx` to `HNSW_xx`
after QA test. @alexanderguzhva

Signed-off-by: Li Liu <li.liu@zilliz.com>
 2024-10-15 12:29:22 +08:00
cqy123456
aa904be6ec
enhance: support sparse vector mmap in growing segment type (#36566) 
issue: https://github.com/milvus-io/milvus/issues/32984
related pr: https://github.com/milvus-io/milvus/pull/36565

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2024-10-15 10:59:23 +08:00
SimFG
bb3ef5349f
enhance: update the expr version to support automatic conversion of variable types (#36832) 
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-10-15 10:53:22 +08:00
yellow-shine
65608ca8d9
enhance: able to upload pytest logs when test is done (#36842) 
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-10-15 10:39:22 +08:00
congqixia
744a36c287
enhance: [GoSDK] support unmarshal result set into orm receiver (#36789) 
Related to milvus-io/milvus-sdk-go#800

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-10-15 10:37:23 +08:00
yanliang567
0ec92513a5
test: Update Diskann supporting group by (#36853) 
related issue: #36813 

milvus diskann does not support group_search before, it supports now.

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2024-10-15 10:35:23 +08:00
smellthemoon
c9752bd2e6
enhance: refactor createCollection in RESTful API (#36790) 
1.  support isClusteringKey in restful api;
2. throw err if passed invalid 'enableDynamicField' params
3. parameters in indexparams are not processed properly, related with
#36365

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-10-15 10:29:22 +08:00
ThreadDao
d566b0ceff
test: add stats task feature cases and DefaultVectorSearchParams (#36768) 
issue: #36767

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-10-14 19:15:23 +08:00
nico
937ebec2ce
test: update test cases (#36841) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-10-14 19:13:23 +08:00
sre-ci-robot
af2da8d8d6
[automated] Update Pytest image changes (#36845) 
Update Pytest image changes
See changes:
c96bbe19ba
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-10-14 19:11:23 +08:00
Zhen Ye
f46c3acea9
fix: heap buffer overflow when unittest at index wrapper (#36838) 
issue: #35852

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-10-14 18:13:22 +08:00
aoiasd
5ec4163d0f
feat: support bm25 logs mixcompaction (#36072) 
relate: https://github.com/milvus-io/milvus/issues/35853

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-10-14 16:57:22 +08:00
yanliang567
c96bbe19ba
test: Add upsert in rows tests (#36820) 
related issue: #36710

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2024-10-14 16:41:22 +08:00
Zhen Ye
f0f5147aef
fix: streaming consumer may get stucked when handler is un-consumed (#36818) 
issue: #36378

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-10-14 15:23:23 +08:00
Zhen Ye
8905b042f1
fix: add proportion for capacity seal policy in streaming flusher (#36761) 
issue: #36760

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-10-14 14:47:22 +08:00
yellow-shine
00e7e8c661
enhance: enable macos checker (#36833) 
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-10-14 14:09:21 +08:00
Bingyi Sun
3a09b438c2
fix: fix macos code checker (#36817) 
https://github.com/milvus-io/milvus/issues/36829

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-10-14 11:11:51 +08:00
yihao.dai
d230b91bd1
enhance: Add PreallocatedSegmentIDs for the compaction task (#36734) 
Add `PreallocatedSegmentIDs` field to the compaction task, allowing the
`ResultSegments` in the compaction task to represent the final segments
produced by the compaction.

issue: https://github.com/milvus-io/milvus/issues/36733

also related: https://github.com/milvus-io/milvus/issues/36686

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-10-13 17:59:21 +08:00
Buqian Zheng
383350c120
feat: added more checks for function creation check (#36766) 
issue: https://github.com/milvus-io/milvus/issues/35853

* BM25 Function now takes no params, k1, b should be passed via index
params
* support BM25 full text search when metric type is not present in
search request
* add more strict validation with functions at collection creation time

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-10-13 17:43:22 +08:00
Buqian Zheng
16b533cbf0
feat: Restful support for BM25 function (#36713) 
issue: https://github.com/milvus-io/milvus/issues/35853

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-10-13 17:41:21 +08:00
sre-ci-robot
e170991a10
[automated] Update Knowhere Commit (#36823) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-10-13 01:21:20 +08:00
Min Tian
ef0c649bda
enhance: update knowhere version to support diskann iterator (#36813) 
issue: #36812

Signed-off-by: min.tian <min.tian.cn@gmail.com>
 2024-10-12 18:05:22 +08:00
Buqian Zheng
82c5cf2fa2
feat: add bulk insert support for Functions (#36715) 
issue: https://github.com/milvus-io/milvus/issues/35853 and
https://github.com/milvus-io/milvus/issues/35856

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-10-12 17:19:20 +08:00
sre-ci-robot
d45e2677b9
[automated] Bump milvus version to v2.4.13 (#36801) 
Bump milvus version to v2.4.13
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-10-12 15:07:24 +08:00
Bingyi Sun
a75bb85f3a
feat: support chunked column for sealed segment (#35764) 
This PR splits sealed segment to chunked data to avoid unnecessary
memory copy and save memory usage when loading segments so that loading
can be accelerated.

To support rollback to previous version, we add an option
`multipleChunkedEnable` which is false by default.

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-10-12 15:04:52 +08:00
jaime
5713620825
enhance: skip alter operation when no change are detected (#36785) 
issue: #36784

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-10-12 11:25:20 +08:00
yellow-shine
5b2658327d
enhance: change way to bump milvus bersion (#36776) 
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-10-12 10:41:25 +08:00
SimFG
03a78ecc3d
enhance: gc in the snapshot kv (#36792) 
issue: #36770

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-10-12 04:03:20 +08:00
SimFG
7acf724185
enhance: support to execute the method which contains the ctx param (#36797) 
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-10-12 00:01:20 +08:00
congqixia
bfe5c651d6
doc: Update go version in DEVELOPMENT.md (#36796) 
go 1.22 is needed for master branch. Update document for developer guide
markdown.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-10-11 21:25:20 +08:00
smellthemoon
5e1c392243
enhance: support null and default value in restful api (#35825) 
#31728

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-10-11 21:23:20 +08:00
congqixia
116d7c18cc
fix: Use metrics values instead of hardcode mock values (#36782) 
Resolves #36781

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-10-11 20:09:20 +08:00
XuanYang-cn
794e3ab7e5
fix: fail to init fg clears flushTs so that slows flush (#36740) 
See also: #36709

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-10-11 17:37:04 +08:00
yihao.dai
0751c508de
enhance: Support new RESTful URL to describe import job (#36753) 
Support the new RESTful URL for retrieving/describing import progress:
`/v2/vectordb/jobs/import/describe`.
Deprecate the old URL: `/v2/vectordb/jobs/import/get_progress`.

issue: https://github.com/milvus-io/milvus/issues/36752

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-10-11 16:07:21 +08:00
CharlesFeng
7c8b71e26c
fix: BinlogDeserializeReader leak in mix_compactor.go (#36270) 
https://github.com/milvus-io/milvus/issues/36269

Signed-off-by: fengjun2016 <jornfeng@gmail.com>
 2024-10-11 15:41:20 +08:00
yanliang567
621dbc9107
test: Add json key in [] test to verify issue 36718 (#36738) 
related issue: #36718

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2024-10-11 14:29:21 +08:00
cai.zhang
d1060c0e05
enhance: Update antlr version and refine parsing not in (#36745) 
issue: #36672

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-10-11 14:03:21 +08:00
congqixia
3fe0f82923
enhance: Add balance report log for qc balancer (#36747) 
Related to #36746

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-10-11 10:25:24 +08:00
aoiasd
db34572c56
feat: support load and query with bm25 metric (#36071) 
relate: https://github.com/milvus-io/milvus/issues/35853

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-10-11 10:23:20 +08:00
sre-ci-robot
90285830de
[automated] Update Pytest image changes (#36755) 
Update Pytest image changes
See changes:
f7b811450d
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-10-11 09:29:19 +08:00
zhagnlu
b1e678dcba
fix: fix json in [] expr bug (#36721) 
#36718

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-10-11 01:11:20 +08:00
Buqian Zheng
f7b811450d
feat: add enable_tokenizer params to VarChar field (#36480) 
issue: #35922

add an enable_tokenizer param to varchar field: must be set to true so
that a varchar field can enable_match or used as input of BM25 function

---------

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-10-10 20:33:21 +08:00