test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-02 20:09:57 +08:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity
20,542 Commits 94 Branches 105 Tags 184 MiB
41646c8439
Commit Graph

20542 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ted Xu
41646c8439
feat: integrate new deltalog format (#35522) 
See #34123

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-08-20 19:06:56 +08:00
aoiasd
bc2bbdc82f
enhance: Forbid access log print error message with line break (#34491) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-08-20 17:36:55 +08:00
smellthemoon
80a7c78f28
enhance: import supports null in parquet and json formats (#35558) 
#31728

---------

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-08-20 16:50:55 +08:00
congqixia
2fbc628994
feat: Support field partial load collection (#35416) 
Related to #35415

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-20 16:49:02 +08:00
Chun Han
031ee6f155
enhance: support httpv1/v2 throttle and add it for httpV2(#35350) (#35470) 
related: #35350

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-08-20 16:16:55 +08:00
congqixia
3491608256
fix: Match int8_t and int16_t in Array::get_data (#35579) 
Related to #35578

Previously int16/int8 bitmap index may read int32 array as int16, which
may cause build index with half of the data(if array is full) and half
zeros. This causes BITMAP index lost information.

This PR matches int8_t & int16_t while `get_data` when building index.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-20 16:10:56 +08:00
yanliang567
249dc4d9eb
test: Add tests for upsert with auto id (#35556) 
Related issue: #34668

---------

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2024-08-20 14:20:56 +08:00
wei liu
e09dc3be58
enhance: Mark query node as read only after suspend (#35492) 
issue: #34985 #35493
after querynode has been suspended, it's not allow to load
segment/channel on it, which means the node is read only. to be
compatible with resource group design, after query node has been
suspend, we remove it from it's original resource group, make it a read
only query node in replica. then two things will happens:
1. it's original resource group will be lacking of query nodes, query
coord will assign new node to it.
2. querycoord will try to move out all segments/channels after querynode
has been suspended

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-20 14:02:54 +08:00
nish112022
3948bd4e79
fix: Added check for validating varchar,array max length (#35499) 
issue : https://github.com/milvus-io/milvus/issues/34150

This is for numpy,parquet,json readers.

---------

Signed-off-by: Nischay Yadav <nischay.yadav@ibm.com>
 2024-08-20 11:42:55 +08:00
wei liu
22ced010cd
enhance: make configure load param feature be compatible with old sdk (#35520) 
issue: #31570 #35521

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-20 10:30:55 +08:00
yellow-shine
6e29d713b3
enhance: [skip e2e]dockerfile for milvus-sdk-go test (#35426) 
https://github.com/milvus-io/milvus/issues/35567

---------

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-20 09:48:55 +08:00
Zhen Ye
4d69898cb2
enhance: support single pchannel level transaction (#35289) 
issue: #33285

- support transaction on single wal.
- last confirmed message id can still be used when enable transaction.
- add fence operation for segment allocation interceptor.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-08-19 21:22:56 +08:00
wei liu
853d2f33e0
enhance: Trim space during parsing string list from string (#35546) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-19 20:48:55 +08:00
yihao.dai
227ecd3901
enhance: Remove the check for channel cp lag when generating compaction plan (#35383) 
issue: https://github.com/milvus-io/milvus/issues/35382

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-08-19 19:40:55 +08:00
CharlesFeng
795339ecbc
enhance: using timer instead of ticker in client/index.go (#35552) 
https://github.com/milvus-io/milvus/issues/35551

Signed-off-by: fengjun2016 <jornfeng@gmail.com>
 2024-08-19 18:56:54 +08:00
congqixia
b4743b4ca8
enhance: [GoSDK] Sync latest milvus proto and mockery (#35511) 
Related to #35443

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-19 16:22:55 +08:00
CharlesFeng
b96db798b9
enhance: using timer instead of tickers for need to be executed successfully once (#35534) 
https://github.com/milvus-io/milvus/issues/35533

Signed-off-by: fengjun2016 <jornfeng@gmail.com>
 2024-08-19 16:16:55 +08:00
Chun Han
337e065902
fix: querynode hang when failing to allocate disk space for mmap(#35184) (#35187) 
related: #35184

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-08-19 15:30:55 +08:00
wei liu
14ef88f423
fix: Fix proxy panic after Import related api failed (#35540) 
issue: #35539

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-19 15:22:55 +08:00
XuanYang-cn
967f38672a
enhance: Add integration tests for l0 (#35429) 
See also: #34796

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-08-19 10:56:54 +08:00
sre-ci-robot
719c5f793a
[automated] Update cpu Builder image changes (#35508) 
Update cpu Builder image changes
See changes:
1275005fc1
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-08-16 20:34:58 +08:00
ThreadDao
635e9ddb0e
test: fix go sdk cases parallel context deadline (#35519) 
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-08-16 20:32:53 +08:00
congqixia
2736a8b88c
enhance: Update Makefile to generate mockery (#35517) 
Some mockery cmd is out-of-date and fail to work. This PR update these
commands to match current pkg.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-16 18:44:53 +08:00
wei liu
ead37326f0
enhance: Add backup/restore privilege to admin group (#35515) 
issue: #35443

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-16 18:42:54 +08:00
smellthemoon
80dbe87759
enhance: support null value in index (#35238) 
#31728

---------

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-08-16 15:30:54 +08:00
congqixia
f87af9bc54
enhance: Exclude L0 segment from readable snapshot (#35507) 
L0 segments now do not contain insert data and may cause confusion for
query hook optimizer if counted as sealed segment number.

This PR add segment level flag in segment entry and exclude L0 segments
while get readable segment snaphsot

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-16 15:28:53 +08:00
CharlesFeng
5e9097c2dd
fix: err degenerated to a new variable (#35413) 
https://github.com/milvus-io/milvus/issues/35412

Signed-off-by: fengjun2016 <jornfeng@gmail.com>
 2024-08-16 14:24:54 +08:00
wei liu
a570567644
enhance: Enable ReadOnly/ReadWrite/Admin Privilege Group to simplify RBAC grant progress (#35472) 
issue: #35471

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-16 14:18:54 +08:00
Buqian Zheng
f4a91e135b
enhance: Allow empty sparse row (#34700) 
issue: #29419

* If a sparse vector with 0 non-zero value is inserted, no ANN search on
this sparse vector field will return it as a result. User may retrieve
this row via scalar query or ANN search on another vector field though.
* If the user uses an empty sparse vector as the query vector for a ANN
search, no neighbor will be returned.

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-08-16 14:14:54 +08:00
wei liu
1d49358f82
enhance: Add BackupRBAC/RestoreRBAC API to enable rbac backup (#35444) 
issue: #35443

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-16 10:10:53 +08:00
yellow-shine
1275005fc1
enhance: [skip e2e] enable ubuntu20.04 os (#35482) 
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-16 10:06:58 +08:00
Alexander Guzhva
b896143965
enhance: Improve bitset performance for AVX512 (#35479) 
see #35478

optimized functions take 20%+ less time to run

Signed-off-by: Alexandr Guzhva <alexanderguzhva@gmail.com>
 2024-08-16 07:44:53 +08:00
cai.zhang
1bbf7a3c0e
enhance: Optimize the use of locks and avoid double flush clustering buffer writer (#35486) 
issue: #35436

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-08-16 02:24:58 +08:00
sre-ci-robot
aaaffc6d53 Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2024-08-15 12:01:10 +00:00
congqixia
fe20366b5c
enhance: Remove duplicated schema helper creation in proxy (#35489) 
Related to PRs of #35415

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-15 19:18:53 +08:00
wei liu
c0200eec39
enhance: limit getSegmentInfo batch size to avoid excced grpc message limit (#35394) 
issue: #35395

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-15 19:17:00 +08:00
wei liu
f6aaf3fef2
fix: force update next target if target can't be loaded (#35365) 
issue: #35361

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-15 19:15:00 +08:00
CharlesFeng
b4b1ed6910
fix: before exiting, make sure the goroutine has exited (#35411) 
https://github.com/milvus-io/milvus/issues/35409

Signed-off-by: fengjun2016 <jornfeng@gmail.com>
 2024-08-15 18:16:53 +08:00
Abdullah Ahmed
d20d6ea551
fix: Functional-notation casting vulnerability fix (#35252) 
Fix for issue: https://github.com/milvus-io/milvus/issues/35200
 2024-08-15 16:20:53 +08:00
SimFG
b2cc4b0776
feat: add the rbac msg and send them to the replicate channel (#35392) 
- issue: #35391

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-08-15 12:06:52 +08:00
wayblink
35cc7dde63
enhance: Add clustering compaction user guide doc (#35427) 
#30633

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2024-08-15 10:30:59 +08:00
sre-ci-robot
b1ea645390
[automated] Update Knowhere Commit (#35474) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-08-15 01:14:53 +08:00
Ted Xu
c6ae7d4d56
enhance: adding the msgchannel section in generated yaml (#35466) 
See #32168

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-08-14 18:32:53 +08:00
congqixia
f99a761d87
enhance: Support dynamic field in SchemaHelper (#35461) 
Related to #35415

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-14 18:04:59 +08:00
SimFG
0400eb91c1
enhance: remove the invalid log (#35465) 
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-08-14 18:00:53 +08:00
chyezh
0868a978d1
fix: streaming service stat manager crash when pv stat is empty (#35439) 
issue: #33285

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-08-14 12:04:52 +08:00
CharlesFeng
36d59867f3
fix: err cannot be captured in defer in data_sync_service (#35448) 
https://github.com/milvus-io/milvus/issues/35447

Signed-off-by: fengjun2016 <jornfeng@gmail.com>
 2024-08-14 10:26:52 +08:00
XuanYang-cn
c42976ee6f
enhance: Init ChannelCP when creating a channel (#35387) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-08-14 10:16:58 +08:00
CharlesFeng
a690e6e004
fix: panic in timetick_sender (#35451) 
https://github.com/milvus-io/milvus/issues/35450

Signed-off-by: fengjun2016 <jornfeng@gmail.com>
 2024-08-14 10:10:53 +08:00
sre-ci-robot
6f3fcdc810 Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2024-08-14 00:01:57 +00:00