test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-04 21:09:06 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
20,862 Commits 96 Branches 105 Tags 186 MiB
2ec6e602d6
Commit Graph

20862 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
congqixia
c61eea737b
enhance: Fix trace.cpp lint format issue (#36004) 
Introduced by #35928

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-05 16:33:04 +08:00
Ted Xu
d9a40784a2
fix: fallback params may be overridden (#35972) 
See #35756

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-09-05 16:19:04 +08:00
wei liu
32e55a02ea
fix: Fix privilege group hasn't been register for validate (#35937) 
issue: #35471

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-09-05 15:35:04 +08:00
congqixia
7b21032d19
fix: Check all values for trie.predictive_search (#35943) 
Related to #35941

For marisa trie `predictive_search` default behavior, it value iterated
is not in lexicographic order.

This PR is a brute force fix to make range operator returns correct
values.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-05 15:01:04 +08:00
congqixia
9e96ed4873
fix: Fix tracing config update logic (#35928) 
Related to #35927

There are serveral issue this PR addresses:
- Use `ResetTraceConfig` method instead init one in update event handler
- Implement dynamic stats.Handler to receive tracing config update event
- Update `enable_trace` flag when `ResetTraceConfig` is invoked
- Change `enable_trace` to `std::atomic<bool>` in case of data race

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-05 14:27:04 +08:00
XuanYang-cn
5e3f700e5d
enhance: Remove too frequent logs in Delete (#35980) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-09-05 14:25:03 +08:00
congqixia
8593c4580a
enhance: Add delete buffer related quota logic (#35918) 
See also #35303

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-05 11:39:03 +08:00
smellthemoon
80a9efd96d
fix: not check nullable and default value in pk field (#35987) 
#35926

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-09-05 11:27:04 +08:00
congqixia
66ed289a85
enhance: Fix typo of clustering key not loaded msg (#35948) 
Related to #35415

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-05 10:49:03 +08:00
cai.zhang
90bdb171ab
fix: Fix data race for clustering compaction writer (#35957) 
issue: #35950

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-09-05 04:07:10 +08:00
CharlesFeng
6eb8b3f745
fix: err degenerated to a new variable (#35891) 
https://github.com/milvus-io/milvus/issues/35890

Signed-off-by: fengjun2016 <jornfeng@gmail.com>
 2024-09-04 14:57:04 +08:00
jaime
24fb10114b
enhance: remove cooling off in rate limiter for read requests (#35935) 
issue: #35934

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-09-04 14:39:10 +08:00
jaime
919e96ac22
enhance: add IT for rate limit using db properties (#35930) 
issue: #35929

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-09-04 14:37:04 +08:00
SimFG
ea36d13ab0
feat: add static view for the expr (#35887) 
- issue: #35886
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-09-04 11:09:04 +08:00
nico
40d34f711e
test: update test cases (#35867) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-09-04 10:37:03 +08:00
Abdullah Ahmed
cc02dc0a55
fix: Handle Input/Output Errors in vsnprintf and snprintf (#35898) 
Fix for Issue: #35897
 2024-09-04 08:15:04 +08:00
congqixia
69b1eea6f2
enhance: [GoSDK] Add load option for field partial load (#35920) 
Related to #35415

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-03 19:27:04 +08:00
foxspy
9da86529a7
enhance: Add disk filemananger parallel load control to reduce the memory consumption (#35281) 
issue: #35280 
add parallel control to limit the memory consumption during index file
loading

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2024-09-03 18:01:03 +08:00
Zhen Ye
f68df9a11e
fix: SkipIndex cause segment fault (#35907) 
issue: #35882

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-09-03 17:15:03 +08:00
ThreadDao
f068729a26
test: fix repeated random partition name (#35805) 
/kind improvement

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2024-09-03 17:13:12 +08:00
wt
cb49b32358
test: add bitmap index cases (#35909) 
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2024-09-03 16:49:03 +08:00
zhagnlu
74048ce34f
fix:rename mmap file path to avoid directory conflict (#35810) 
#35784

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-09-03 16:05:03 +08:00
wei liu
c84ea5465c
fix: Fix some replicas don't participate in the query after the failure recovery (#35850) 
issue: #35846
querycoord will notify proxy to update shard leader cache after
delegator location changes, but during querynode's failure recovery,
some delegator may become unserviceable due to lacking of segments, and
back to serviceable after segment loaded, so we also need to notify
proxy to invalidate shard leader cache when delegator serviceable state
changes.

This PR will maintain querynode's serviceable state during heartbeat,
and notify proxy to invalidate shard leader cache if serviceable state
changes.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-09-03 15:39:03 +08:00
yihao.dai
6130a85444
enhance: Remove bf from streaming node (#35902) 
Remove bf from streaming node:
1. When watching vchannels, skip loading bloom filters for segments.
2. Bypass bloom filter checks for delete messages, directly writing to
L0 segments.
3. Remove flushed segments proactively after flush.

issue: https://github.com/milvus-io/milvus/issues/33285,
https://github.com/milvus-io/milvus/issues/34585

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-09-03 14:17:02 +08:00
zhagnlu
325f1987d9
enhance: rewrite index params for compatibility (#35788) 
#32900

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-09-02 19:41:03 +08:00
congqixia
3698c53a72
enhance: Check load fields for previous loaded collection (#35905) 
Related to #35415

This PR make querycoord report error when load request tries to update
load fields list, which is currently not supported.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-02 18:39:03 +08:00
Chun Han
4641fd9195
enhance: make search groupby stop when reaching topk groups (#35814) 
related: #33544

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-09-02 18:25:03 +08:00
zhuwenxing
57422cb2ed
test: add array inverted index function test (#35874) 
/kind improvement

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-09-02 17:49:02 +08:00
Zhen Ye
b2eb9fe2a7
fix: memory leak in unittest and open the USE_ASAN option when build unittest (#35855) 
issue: #35854

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-09-02 15:59:04 +08:00
yihao.dai
6fd33285e1
fix: Fix compile error (#35901) 
/kind improvement

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-09-02 14:50:35 +08:00
cai.zhang
2c9bb4dfa3
feat: Support stats task to sort segment by PK (#35054) 
issue: #33744 

This PR includes the following changes:
1. Added a new task type to the task scheduler in datacoord: stats task,
which sorts segments by primary key.
2. Implemented segment sorting in indexnode.
3. Added a new field `FieldStatsLog` to SegmentInfo to store token index
information.

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-09-02 14:19:03 +08:00
congqixia
9d80137698
fix: Check clustering key skip load behavior (#35865) 
feature issue: #35415
See also #35861

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-02 11:17:02 +08:00
zhagnlu
576ac2bbed
fix: Fix the reference to a variable after it has been moved (#35875) 
#35607

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-09-02 10:05:02 +08:00
Jiquan Long
5ea2454fdf
feat: tantivy tokenizer binding (#35801) 
fix: #35800

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-09-01 17:13:03 +08:00
yihao.dai
1413ffe9b1
enhance: Rename preAllocatedSegments (#35871) 
Rename `preAllocatedSegments` to `preAllocatedSegmentIDs` to avoid
confusion.

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-09-01 17:09:01 +08:00
yihao.dai
2e090b2426
enhance: Refine flusher channel management (#35870) 
Change the ChannelTask to ChannelLifetime, only removing it upon
unregistering.

issue: https://github.com/milvus-io/milvus/issues/33285

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-09-01 17:07:10 +08:00
yihao.dai
ef451f5e1f
enhance: Add build-go target (#35844) 
Add a `build-go` target to the Makefile that only compiles Go.

issue: https://github.com/milvus-io/milvus/issues/35611

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-09-01 17:05:09 +08:00
Yinzuo Jiang
407fc933e7
fix: bump bytedance/sonic to v1.12.2 to fix compilation error with go 1.23.0 (#35879) 
fixes: #35878

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
 2024-09-01 13:43:01 +08:00
SimFG
311f860676
enhance: support to drop the role which is related the privilege list (#35727) 
- issue: #35545

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-08-30 15:17:00 +08:00
yellow-shine
1e3e34d149
enhance: [ci] organize values file in the form of milvus deployment options (#35832) 
https://github.com/milvus-io/milvus/issues/35842

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-30 13:07:15 +08:00
yellow-shine
ac736ad472
enhance: friendly for docker cache (#35789) 
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-08-30 13:05:34 +08:00
XuanYang-cn
323400c190
enhance: Enable to write multiple segments in mix compactor (#35705) 
Prevent segments to be written larger than maxSize * expansionRate

See also: #35584

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-08-30 11:29:01 +08:00
yihao.dai
1c3abd1aea
fix: Fix unstable TestFlusher ut (#35831) 
issue: https://github.com/milvus-io/milvus/issues/35830

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-08-30 10:25:01 +08:00
Zhen Ye
f9be01ce89
fix: mockery config (#35834) 
issue: #33285

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-08-30 09:49:00 +08:00
SimFG
07bb071aaf
enhance: add the unmarshal method for the rbac msg (#35692) 
/kind improvement
- issue: #35391

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-08-30 07:23:00 +08:00
zhagnlu
671112d17b
enhance: add more info to hybrid index log (#35808) 
#32900

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-08-29 21:07:04 +08:00
smellthemoon
a3f2f044d6
fix: not set nullable when stream writer write headers (#35799) 
#35802

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-08-29 20:59:00 +08:00
zhenshan.cao
d10aa4626f
enhance: [skip e2e] add make run-test-cpp with support for filter gtest (#35829) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2024-08-29 20:03:02 +08:00
congqixia
4373c6994f
fix: [GoSDK] reset cache after UsingDatabase (#35638) 
Related to milvus-io/milvus-sdk-go#809

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-08-29 19:41:02 +08:00
yihao.dai
69265978bf
fix: Fix arrow go client (#35819) 
issue: https://github.com/milvus-io/milvus/issues/35662

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-08-29 17:53:01 +08:00