test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-04 04:49:08 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
20,650 Commits 96 Branches 105 Tags 185 MiB
919e96ac22
Commit Graph

20650 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
congqixia
c5c9ef9876
fix: Check response size before add to counter (#35778) 
Related to #35767

prometheus counter cannot add negative value
when response is not written(say timeout/network broken) panicking may
happen if not check

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-29 00:05:00 +08:00
sre-ci-robot
1cd9123a6c Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2024-08-28 12:00:44 +00:00
Zhen Ye
9b96841ae9
fix: wrong construction in evalctx (#35772) 
issue: #35771

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-08-28 19:21:00 +08:00
congqixia
91223deb91
fix: Use SafeChan as TxnManager.closed (#35763) 
Resolves: #35762

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-28 19:06:59 +08:00
congqixia
b75b25794b
enhance: [skip e2e] Fix test script always skip pip install (#35766) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-28 17:01:00 +08:00
yellow-shine
709666b88f
enhance: fix new nightly pipeline (#35747) 
https://github.com/milvus-io/milvus/issues/35704

---------

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-28 16:56:59 +08:00
yihao.dai
56b3490a98
fix: Fix rate wasn't limited to the expected value (#35699) 
Each time the rate is reset, the token bucket is fully refilled, causing
the rate wasn't limited to the expected value. This PR addresses the
issue by preventing the token reset.

issue: https://github.com/milvus-io/milvus/issues/35675,
https://github.com/milvus-io/milvus/issues/35702

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-08-28 14:13:00 +08:00
Jiquan Long
a52ba3d09d
enhance: allow many segments for inverted index (#35616) 
fix: https://github.com/milvus-io/milvus/issues/35615

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-08-28 11:30:59 +08:00
jaime
d8aa01bc1a
fix: inconsistent meta view causes rate limit invalid (#35665) 
issue: #35663

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-08-28 11:21:04 +08:00
jaime
b7ea1defd3
fix: mistaken deletions may occur during GC channel checkpoints (#35707) 
issue: #35706

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-08-28 10:11:05 +08:00
yellow-shine
7de210ff28
enhance: nightly pipeline (#35730) 
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-27 17:51:05 +08:00
Zhen Ye
98866205fa
fix: munmap deallocate too much memory (#35725) 
issue: #35693

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-08-27 17:18:59 +08:00
yihao.dai
9868fe4e6c
fix: Fix panic due to empty candidate import segments (#35673) 
issue: https://github.com/milvus-io/milvus/issues/35662

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-08-27 17:08:59 +08:00
zhagnlu
4d2f96c760
enhance: support bitmap mmap (#35399) 
#32900

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-08-27 16:34:59 +08:00
yellow-shine
3a0c61a455
fix: [skip e2e]change conflict key (#35733) 
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-27 15:40:59 +08:00
yellow-shine
bb9bed64a3
enhance: new nightly ci to support testing distributed-streaming (#35672) 
issue: https://github.com/milvus-io/milvus/issues/35704

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-27 14:24:59 +08:00
yellow-shine
7cea9f641b
enhance: refine go-sdk pipeline (#35647) 
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-27 14:23:05 +08:00
Chun Han
bfd9d86fe9
feat: support groupby size on go-layer(#33544) (#33845) 
related: #33544

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-08-27 14:21:00 +08:00
aoiasd
fe83805d56
fix: loss data bug for deprecated querynode DoubleBuffer (#35128) 
relate: https://github.com/milvus-io/milvus/issues/31548

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-08-27 14:10:59 +08:00
yellow-shine
e373687a07
enhance: turnoff USE_ASAN in ci (#35721) 
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-27 14:01:11 +08:00
XuanYang-cn
f12e368a76
fix: Fill nil schema so that Milvus can watch channel for those upgraded from 2.2 to 2.4 #35695 (#35694) 
See also: [#35701 ](https://github.com/milvus-io/milvus/issues/35701)

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-08-27 10:36:59 +08:00
SimFG
3e1052f889
enhance: use the msg position obj when getting replicate channel position (#35606) 
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-08-27 10:28:59 +08:00
XuanYang-cn
0e7877d413
fix: [skip e2e]unstable l0 it (#35612) 
See also: #35617

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-08-26 18:53:04 +08:00
jaime
7d3c0d748c
fix: the incorrect number of partitions in rootcoord meta (#35600) 
issue: #35698

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-08-26 15:20:58 +08:00
ThreadDao
a90133cdf5
test: Optimize sparse vector case (#35661) 
/kind improvement

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-08-26 14:54:57 +08:00
XuanYang-cn
82743c5c50
fix: Clear channelcp meta and metrics ASAP (#35658) 
See also: #35588

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-08-26 12:22:57 +08:00
nico
f756f01445
test: update test cases (#35640) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-08-26 12:00:58 +08:00
sre-ci-robot
6ddfd02f01
[automated] Update Knowhere Commit (#35688) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-08-26 01:04:57 +08:00
Zhen Ye
4b7357ee80
fix: fix typo in milvus spec (#35684) 
issue: #35611

introduced by #35610

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-08-25 16:28:57 +08:00
Patrick Weizhi Xu
4236c3bafb
enhance: enable MV on binary vectors (#35668) 
Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
 2024-08-25 16:27:09 +08:00
Ashwin Krishna Kumar
cfa434086a
doc: improve VSCode setup in dev docs (#35677) 
The developer documentation contains instructions for setting up a dev
environment in VSCode. This PR improves on the below two issues:

1. With the current settings, you cannot run and debug Go unit tests
through the VSCode UI. The `tags` and `ldflags` parameters need to be
modified slightly to make this work.

<img width="436" alt="Screenshot 2024-08-23 at 4 37 37 PM"
src="https://github.com/user-attachments/assets/78bae0b9-5abe-4e48-90cf-e844ad9ef292">

2. Users need to replace all occurrences of
`/Users/zilliz/workspace/milvus` with the actual folder path where
they've cloned Milvus. This is not necessary when using the
`${workspaceFolder}` variable, which VSCode will substitute
automatically.

Signed-off-by: Ashwin Krishna Kumar <ashwin.kumar6@ibm.com>
 2024-08-25 16:25:04 +08:00
smellthemoon
098c10922b
enhance: add some check when create collection (#35629) 
not support nullable==true in vector type. check it when create
collection.

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-08-25 16:23:05 +08:00
Xiaofan
0dc5e89007
enhance: reduce the log level of frequent log (#35652) 
fix #35651

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
 2024-08-25 16:20:57 +08:00
cai.zhang
615a653988
fix: Fix offset out of range for creating Trie index (#35553) 
issue: #35550

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-08-25 15:50:57 +08:00
yihao.dai
f2b83d316b
enhance: Support memory mode chunk cache (#35347) 
Chunk cache supports loading raw vectors into memory.

issue: https://github.com/milvus-io/milvus/issues/35273

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-08-25 15:42:58 +08:00
Xiaofan
50fcfe8ef1
enhance: add nan and inf check (#35683) 
fix #35594
add float check on files

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
 2024-08-25 15:22:57 +08:00
zhagnlu
42f7800b5b
enhance: add bitmap offset cache to speed up retrieve raw data (#35498) 
#35458

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-08-24 01:40:58 +08:00
Zhen Ye
75da36d1aa
enhance: enable asan for milvus (#35627) 
issue: #35626

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-08-23 21:06:58 +08:00
SimFG
9dc1311f38
enhance: add the param to control whether to include the current msg (#35656) 
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-08-23 15:56:57 +08:00
congqixia
59387f0b3a
fix: Use correct release func when datanode unwatch a channel (#35655) 
See also #35654

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-23 14:09:03 +08:00
Gao
e8e3544a11
enhance: add hit segment num metrics for queryHook (#35577) 
issue: #35576

Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2024-08-23 12:49:02 +08:00
Zhen Ye
a773836b89
enhance: optimize milvus core building (#35610) 
issue: #35549,#35611,#35633

- remove milvus_segcore milvus_indexbuilder..., add libmilvus_core
- core building only link once
- move opendal compilation into cmake
- fix odr

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-08-23 12:35:02 +08:00
congqixia
ab532ae199
enhance: Add back BF lazy load logic for datanode watch channel (#35646) 
Add back lazy loading statslog when watch dml channel on datanode.

Related to #22994 #27675

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-22 19:42:57 +08:00
wei liu
5c245d51c4
enhance: Refresh proxy cache after restore rbac meta (#35635) 
issue: #35443

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-22 19:09:01 +08:00
congqixia
9fff07936a
fix: Re-read value after once initialization (#35642) 
Related to #35641
See also #35271

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-22 17:24:58 +08:00
congqixia
582d2eec79
enhance: Move datanode/indexnode manager to session pkg (#35634) 
Related to #28861

Move session manager, worker manager to session package. Also renaming
each manager to corresponding node name(datanode, indexnode).

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-22 16:02:56 +08:00
zhagnlu
3107701fe8
enhance: optimize retrieve on dynamic field (#35580) 
#35514

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
Co-authored-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2024-08-22 14:24:56 +08:00
ThreadDao
570a8879e7
test: update gosdk case for valid empty sparse vector (#35621) 
/kind improvement

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-08-22 10:54:56 +08:00
congqixia
c992a61a23
enhance: Separate allocator pkg in datacoord (#35622) 
Related to #28861

Move allocator interface and implementation into separate package. Also
update some unittest logic.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-22 10:06:56 +08:00
presburger
024eccbde0
enhance: add pkg-config for knowhere (#35433) 
Signed-off-by: yusheng.ma <yusheng.ma@zilliz.com>
 2024-08-22 09:56:56 +08:00