wei liu
108434969f
enhance: Add collection id to search request count metrics ( #38069 )
...
Code Checker / Code Checker AMD64 Ubuntu 22.04 (push) Waiting to run
Code Checker / Code Checker Amazonlinux 2023 (push) Waiting to run
Code Checker / Code Checker rockylinux8 (push) Waiting to run
Mac Code Checker / Code Checker MacOS 13 (push) Waiting to run
Build and test / Build and test AMD64 Ubuntu 22.04 (push) Waiting to run
Build and test / UT for Cpp (push) Blocked by required conditions
Build and test / UT for Go (push) Blocked by required conditions
Build and test / Integration Test (push) Blocked by required conditions
Build and test / Upload Code Coverage (push) Blocked by required conditions
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-11-29 17:28:38 +08:00
congqixia
fdea7a7898
enhance: [GoSDK] Refine float point conversion precision loss ut ( #38097 )
...
Previous PR: #37978
This unit test is unable due to dim is a random number. When dim is
large enough precision loss will be greater than 0.04
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-29 16:54:36 +08:00
congqixia
61f73d552f
fix: Return thread watcher goroutine after closed ( #38091 )
...
Resolves #38090
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-29 15:10:36 +08:00
Linkwei
80c62f8c11
enhance: add windows startup script for milvus docker deployment ( #38089 )
...
[enhance：add window bat milvus standalone ](enhance: add windows startup
script for milvus docker deployment)
issue：https://github.com/milvus-io/milvus/issues/38098
Signed-off-by: zilliz <zilliz@zillizdeMacBook-Pro-6.local>
Co-authored-by: zilliz <zilliz@zillizdeMacBook-Pro-6.local>
2024-11-29 15:06:37 +08:00
jaime
a9080d8d96
enhance: the actual number of databases should equal the config value ( #38006 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-11-29 14:44:36 +08:00
smellthemoon
48ed586167
enhance: pre allocate space to prevent slice grow ( #38065 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-11-29 14:26:43 +08:00
congqixia
9d3035c8ab
enhance: Fix conflict complication error ( #38087 )
...
Related to #37957 #37989
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-29 12:00:36 +08:00
cai.zhang
5e152767a3
fix: Handle the error of the compaction queue being full ( #37989 )
...
issue: #37988
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-11-29 11:10:36 +08:00
congqixia
fd94f12fb9
enhance: [GoSDK] Support nullable generic column ( #38076 )
...
Related to #31728 #31293
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-29 10:40:37 +08:00
Zhen Ye
c6dcef7b84
enhance: move segcore codes of segment into one package ( #37722 )
...
Code Checker / Code Checker AMD64 Ubuntu 22.04 (push) Waiting to run
Code Checker / Code Checker Amazonlinux 2023 (push) Waiting to run
Code Checker / Code Checker rockylinux8 (push) Waiting to run
Mac Code Checker / Code Checker MacOS 13 (push) Waiting to run
Build and test / Build and test AMD64 Ubuntu 22.04 (push) Waiting to run
Build and test / UT for Cpp (push) Blocked by required conditions
Build and test / UT for Go (push) Blocked by required conditions
Build and test / Integration Test (push) Blocked by required conditions
Build and test / Upload Code Coverage (push) Blocked by required conditions
issue: #33285
- move most cgo opeartions related to search/query into segcore package
for reusing for streamingnode.
- add go unittest for segcore operations.
Signed-off-by: chyezh <chyezh@outlook.com>
2024-11-29 10:22:36 +08:00
sre-ci-robot
843c1f506f
Update all contributors
...
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2024-11-29 00:01:35 +00:00
Yinzuo Jiang
1ce609834a
feat: [GoSDK] fp32 <-> fp16/bf16 vector conversion ( #37978 )
...
Add the following methods for convenient fp32 vector <-> fp16/bf16
vector conversion
fp32 <-> fp16/bf16 vector conversion:
- `func (fv FloatVector) ToFloat16Vector() Float16Vector`
- `func (fv FloatVector) ToBFloat16Vector() BFloat16Vector`
- `func (fv Float16Vector) ToFloat32Vector() FloatVector`
- `func (fv BFloat16Vector) ToFloat32Vector() FloatVector`
`columnBasedDataOption`:
- `func (opt *columnBasedDataOption) WithFloat16VectorColumn(colName
string, dim int, data [][]float32) *columnBasedDataOption`
- `func (opt *columnBasedDataOption) WithBFloat16VectorColumn(colName
string, dim int, data [][]float32) *columnBasedDataOption`
`ColumnFloat16Vector`/`ColumnBFloat16Vector`:
- `func NewColumnFloat16VectorFromFp32Vector(fieldName string, dim int,
data [][]float32) *ColumnFloat16Vector`
- `func NewColumnBFloat16VectorFromFp32Vector(fieldName string, dim int,
data [][]float32) *ColumnBFloat16Vector`
- support []float32 or `entity.FloatVector` in
- `func (c *ColumnFloat16Vector) AppendValue(i interface{}) error`
- `func (c *ColumnFloat16Vector) AppendValue(i interface{}) error`
issue: #37448
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
2024-11-29 08:00:37 +08:00
sre-ci-robot
0894ed0016
[automated] Update Knowhere Commit ( #38082 )
...
Code Checker / Code Checker AMD64 Ubuntu 22.04 (push) Waiting to run
Code Checker / Code Checker Amazonlinux 2023 (push) Waiting to run
Code Checker / Code Checker rockylinux8 (push) Waiting to run
Mac Code Checker / Code Checker MacOS 13 (push) Waiting to run
Build and test / Build and test AMD64 Ubuntu 22.04 (push) Waiting to run
Build and test / UT for Cpp (push) Blocked by required conditions
Build and test / UT for Go (push) Blocked by required conditions
Build and test / Integration Test (push) Blocked by required conditions
Build and test / Upload Code Coverage (push) Blocked by required conditions
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-11-29 01:08:36 +08:00
Bingyi Sun
e6af806a0d
enhance: optimize self defined rust error ( #37975 )
...
Prepare for issue: https://github.com/milvus-io/milvus/issues/37930
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-11-28 20:30:36 +08:00
sre-ci-robot
84698c072a
Update all contributors
...
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2024-11-28 12:00:40 +00:00
zhuwenxing
5e807c3649
test:[skip e2e] update pulsar labelSelectors to v3 in chaos test ( #38049 )
...
Code Checker / Code Checker AMD64 Ubuntu 22.04 (push) Waiting to run
Code Checker / Code Checker Amazonlinux 2023 (push) Waiting to run
Code Checker / Code Checker rockylinux8 (push) Waiting to run
Mac Code Checker / Code Checker MacOS 13 (push) Waiting to run
After upgrading pulsar from v2 to v3, the labels of the helm deployed
pulsar were changed from app=pulsarv to app=pulsarv3.
Therefore, it is necessary to modify this part of the labelSelector so
that chaos mesh can correctly inject faults
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-28 14:18:35 +08:00
HuaSheng2000
6aaa926483
fix: Modify the documentation of the Demos and Tutorials chapter ( #38054 ) ( #38057 )
...
issue: #38054
- Delete the table about tutorials in the English document, use link to
replace the existing table, and add corresponding descriptions (the
table content is outdated, and using link can reduce maintenance costs).
- Add link and corresponding descriptions of tutorials in Chinese
documentation.
---------
Signed-off-by: HuaSheng2000 <34791273+HuaSheng2000@users.noreply.github.com>
2024-11-28 10:00:36 +08:00
zhuwenxing
864ed1a3be
test: update python requirements in test dir ( #38047 )
...
Code Checker / Code Checker AMD64 Ubuntu 22.04 (push) Waiting to run
Code Checker / Code Checker Amazonlinux 2023 (push) Waiting to run
Code Checker / Code Checker rockylinux8 (push) Waiting to run
Mac Code Checker / Code Checker MacOS 13 (push) Waiting to run
Publish Test Images / PyTest (push) Waiting to run
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-27 19:34:35 +08:00
zhuwenxing
e5775a71af
test: add bulk import testcases for full text search ( #37197 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-27 19:32:42 +08:00
zhuwenxing
8188e1472d
test: add custom analyzer testcases ( #37781 )
...
Code Checker / Code Checker AMD64 Ubuntu 22.04 (push) Waiting to run
Code Checker / Code Checker Amazonlinux 2023 (push) Waiting to run
Code Checker / Code Checker rockylinux8 (push) Waiting to run
Mac Code Checker / Code Checker MacOS 13 (push) Waiting to run
Publish Test Images / PyTest (push) Waiting to run
Build and test / Build and test AMD64 Ubuntu 22.04 (push) Has been cancelled
Build and test / UT for Cpp (push) Has been cancelled
Build and test / UT for Go (push) Has been cancelled
Build and test / Integration Test (push) Has been cancelled
Build and test / Upload Code Coverage (push) Has been cancelled
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-27 16:08:36 +08:00
SimFG
302650ae0e
fix: use the default partition for the limit quota when the request partition name is empty ( #38005 )
...
- issue: #37685
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-11-27 11:00:36 +08:00
SimFG
49ee46ec1d
enhance: support to config the default db properties ( #38035 )
...
- issue: #38034
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-11-27 10:04:34 +08:00
SimFG
971b4f17ae
fix: add the db information in the dml message ( #37969 )
...
- issue: #37966
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-11-27 10:02:35 +08:00
sre-ci-robot
24a0b05745
Update all contributors
...
Code Checker / Code Checker AMD64 Ubuntu 22.04 (push) Waiting to run
Code Checker / Code Checker Amazonlinux 2023 (push) Waiting to run
Code Checker / Code Checker rockylinux8 (push) Waiting to run
Mac Code Checker / Code Checker MacOS 13 (push) Waiting to run
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2024-11-27 00:01:35 +00:00
tinswzy
1dbb6cd7cb
enhance: refine the datacoord meta related interfaces ( #37957 )
...
Code Checker / Code Checker AMD64 Ubuntu 22.04 (push) Waiting to run
Code Checker / Code Checker Amazonlinux 2023 (push) Waiting to run
Code Checker / Code Checker rockylinux8 (push) Waiting to run
Mac Code Checker / Code Checker MacOS 13 (push) Waiting to run
Build and test / Build and test AMD64 Ubuntu 22.04 (push) Waiting to run
Build and test / UT for Cpp (push) Blocked by required conditions
Build and test / UT for Go (push) Blocked by required conditions
Build and test / Integration Test (push) Blocked by required conditions
Build and test / Upload Code Coverage (push) Blocked by required conditions
issue: #35917
This PR refines the meta-related APIs in datacoord to allow the ctx to
be passed down to the catalog operation interfaces
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2024-11-26 19:46:34 +08:00
SimFG
2208b7c2ef
fix: the too long default root password does not take effect ( #37983 )
...
- issue: #36987
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-11-26 17:24:35 +08:00
yellow-shine
858eaa668d
enhance: select node ( #37998 )
...
Code Checker / Code Checker AMD64 Ubuntu 22.04 (push) Waiting to run
Code Checker / Code Checker Amazonlinux 2023 (push) Waiting to run
Code Checker / Code Checker rockylinux8 (push) Waiting to run
Mac Code Checker / Code Checker MacOS 13 (push) Waiting to run
Build and test / Build and test AMD64 Ubuntu 22.04 (push) Waiting to run
Build and test / UT for Cpp (push) Blocked by required conditions
Build and test / UT for Go (push) Blocked by required conditions
Build and test / Integration Test (push) Blocked by required conditions
Build and test / Upload Code Coverage (push) Blocked by required conditions
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-11-26 17:02:41 +08:00
Zhen Ye
2b4f211d84
enhance: add switch for local rpc enabled ( #37985 )
...
issue: #33285
- Add switch for local rpc
---------
Signed-off-by: chyezh <chyezh@outlook.com>
2024-11-26 17:00:54 +08:00
aoiasd
db3c002788
fix:wrong warning log when idf oracle find L0 segment lacks ( #37873 )
...
relate: https://github.com/milvus-io/milvus/issues/35853
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-11-26 16:26:41 +08:00
ThreadDao
c5327ff150
test: add cases for gosdk v2 partial load ( #37924 )
...
issue: #33419
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-11-26 15:08:34 +08:00
congqixia
cb6542339e
enhance: Mark cgo thread with tag name ( #38000 )
...
Related to #37999
This PR add `SetThreadName` API for marking cgo thread and utilize it
when initializing cgo worker.
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-26 11:22:35 +08:00
congqixia
6b23e668b0
test: Update go_client version & update latest changes ( #37793 )
...
Related to #37768
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-26 10:26:40 +08:00
zhuwenxing
27c22d1166
test: remove sparse embedding in output fields for fts cases ( #37980 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-25 19:14:33 +08:00
qixuan
4cd79323bf
test: Add cases for restful about default and none ( #37943 )
...
Code Checker / Code Checker AMD64 Ubuntu 22.04 (push) Waiting to run
Code Checker / Code Checker Amazonlinux 2023 (push) Waiting to run
Code Checker / Code Checker rockylinux8 (push) Waiting to run
Mac Code Checker / Code Checker MacOS 13 (push) Waiting to run
Build and test / Build and test AMD64 Ubuntu 22.04 (push) Waiting to run
Build and test / UT for Cpp (push) Blocked by required conditions
Build and test / UT for Go (push) Blocked by required conditions
Build and test / Integration Test (push) Blocked by required conditions
Build and test / Upload Code Coverage (push) Blocked by required conditions
Weekly Release / Run Weekly Release (push) Has been cancelled
issue: #36129
Signed-off-by: qixuan <673771573@qq.com>
2024-11-25 14:06:33 +08:00
tinswzy
e76802f910
enhance: refine querycoord meta/catalog related interfaces to ensure that each method includes a ctx parameter ( #37916 )
...
issue: #35917
This PR refine the querycoord meta related interfaces to ensure that
each method includes a ctx parameter.
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2024-11-25 11:14:34 +08:00
zhuwenxing
0b9edb62a9
test: add testcases contain growing segments ( #37262 )
...
Code Checker / Code Checker AMD64 Ubuntu 22.04 (push) Waiting to run
Code Checker / Code Checker Amazonlinux 2023 (push) Waiting to run
Code Checker / Code Checker rockylinux8 (push) Waiting to run
Mac Code Checker / Code Checker MacOS 13 (push) Waiting to run
Build and test / Build and test AMD64 Ubuntu 22.04 (push) Waiting to run
Build and test / UT for Cpp (push) Blocked by required conditions
Build and test / UT for Go (push) Blocked by required conditions
Build and test / Integration Test (push) Blocked by required conditions
Build and test / Upload Code Coverage (push) Blocked by required conditions
all-contributors / contributor (push) Has been cancelled
Update Knowhere Commit / update-knowhere-commit (push) Has been cancelled
/kind improvement
---------
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-11-25 10:40:34 +08:00
Zhen Ye
fbb68ca370
enhance: make all index operation async scheduled by tokio ( #37946 )
...
issue: #37851
related pr: https://github.com/milvus-io/tantivy/pull/3
Signed-off-by: chyezh <chyezh@outlook.com>
2024-11-25 10:12:34 +08:00
sre-ci-robot
ed73dfca3f
[automated] Update Knowhere Commit ( #37965 )
...
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-11-25 01:28:32 +08:00
Yinzuo Jiang
5a06faca39
feat: fp32 vector to fp16/bf16 vector conversion for RESTful API ( #37556 )
...
RESTful API. The influenced API are as follows:
- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search
We do not modify search API in Handler/HandlerV1 because they do not
support fp16/bf16 vectors.
module github.com/milvus-io/milvus/pkg:
Add `Float32ArrayToBFloat16Bytes()`, `Float32ArrayToFloat16Bytes()` and
`Float32ArrayToBytes()`. These method will be used in GoSDK in the
future.
issue: #37448
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
2024-11-24 17:46:33 +08:00
zhagnlu
62af24c1a1
fix: change search latency metric from us unit to ms unit ( #37806 )
...
#37805
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-11-24 17:26:33 +08:00
congqixia
1e76d2b9f1
fix: Use correct policy merging growing&l0 and add unit tests ( #37950 )
...
Related to #37574
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-24 17:10:33 +08:00
congqixia
8c9dab5cf7
enhance: [GoSDK] Add Slice method for Vector Columns ( #37951 )
...
Related to #37768
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-24 14:48:33 +08:00
sre-ci-robot
930112e55e
[automated] Bump milvus version to v2.5.0-beta ( #37961 )
...
Bump milvus version to v2.5.0-beta
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-11-23 21:48:32 +08:00
Zhen Ye
b9a10a2f68
enhance: remove the rpc layer of coordinator when enabling standalone or mixcoord ( #37815 )
...
issue: #37764
- add a local client to call local server directly for
querycoord/rootcoord/datacoord.
- enable local client if milvus is running mixcoord or standalone mode.
---------
Signed-off-by: chyezh <chyezh@outlook.com>
2024-11-23 21:36:33 +08:00
sre-ci-robot
74752f2ec7
[automated] Bump milvus version to v2.5.0-beta ( #37954 )
...
Bump milvus version to v2.5.0-beta
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-11-22 23:16:41 +08:00
sthuang
bd0811434b
fix: fix grant v2 service ( #37945 )
...
issue: https://github.com/milvus-io/milvus/issues/37031
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-11-22 19:42:32 +08:00
smellthemoon
df08d91c0f
enhance: error msg ( #37901 )
...
#37900
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-11-22 18:40:32 +08:00
sre-ci-robot
efce709152
[automated] Bump milvus version to v2.4.17 ( #37937 )
...
Bump milvus version to v2.4.17
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-11-22 17:56:32 +08:00
jaime
8187fb7d19
enhance: set the maximum database configuration to be refreshable ( #37931 )
...
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-11-22 17:46:31 +08:00
jaime
7bbfe86bcd
enhance: add list index and segment index retrieval API for WebUI ( #37861 )
...
issue: #36621
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-11-22 16:58:34 +08:00
