Commit Graph

20253 Commits

Author SHA1 Message Date
jaime
9c2eeff427
enhance: refine error message for invalid limit parameter (#34178)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-06-26 22:14:04 +08:00
cqy123456
51ebe95be5
enhance: remove CheckVecIndexWithDataTypeExist function in pkg and remove some cgo call (#34102)
issue: https://github.com/milvus-io/milvus/issues/22837
related pr: https://github.com/milvus-io/milvus/pull/34104

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2024-06-26 21:13:44 +08:00
sre-ci-robot
006f75304a Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2024-06-26 12:01:23 +00:00
congqixia
948bfba93a
fix: Pass otlpSecure config when setup segcore tracing (#34193)
See also #34192

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-26 19:18:04 +08:00
sammy.huang
e43c558071
enhance: [skip e2e] fix mergify (#34209)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-26 18:50:04 +08:00
sammy.huang
0565b70ff1
enhance: [skip e2e] make mergify back-forward compatible with old check (#34183)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-26 17:54:05 +08:00
congqixia
e04f1f9748
enhance: Add unittest for storage.DeleteLog (#34190)
See also #33787
Backport unit test part in #34188

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-26 17:14:04 +08:00
zhuwenxing
a08000cfbf
enhance:[skip e2e]update one pod mode resource (#34196)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-06-26 16:54:05 +08:00
xige-16
f8bf6909c6
fix: Fix datacoord's properties overwriten (#34146)
issue: #34144 
/kind bug

Signed-off-by: xige-16 <xige2016@gmail.com>
2024-06-26 11:56:04 +08:00
wei liu
45203425fd
enhance: Avoid search querynode return nil status in response (#34100)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-06-26 11:50:11 +08:00
Gao
a933f6731b
fix: centroids file not removed when data skew in major compaction (#34050)
issue: https://github.com/milvus-io/milvus/issues/30633

Signed-off-by: chasingegg <chao.gao@zilliz.com>
2024-06-26 10:48:04 +08:00
wayblink
fbe3231b1f
fix: fix error ignore in compactor (#34169)
#34170

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2024-06-26 10:24:03 +08:00
ThreadDao
a77e2951af
test: add cases for go milvusclient query (#33884)
issue: #33419

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-06-26 09:52:04 +08:00
sre-ci-robot
cc54ab2e47
[automated] Update Knowhere Commit (#34172)
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-06-26 02:20:03 +08:00
cqy123456
381d43717d
enhance: update new mmap config parmeters version (#34143)
issue: https://github.com/milvus-io/milvus/issues/32984
related pr: https://github.com/milvus-io/milvus/pull/34145

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2024-06-25 21:20:05 +08:00
jaime
9630974fbb
enhance: move rocksmq from internal to pkg module (#33881)
issue: #33956

Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-06-25 21:18:15 +08:00
cai.zhang
c65f41dc60
fix: Only sync flushed segments to datanode (#34156)
issue: #33540

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-06-25 20:46:07 +08:00
congqixia
b1a34732b1
fix: [GoSDK] Compose result set for result zero hit case (#34129)
See also #33952

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-25 19:06:02 +08:00
wayblink
f9a0f7bb25
Add an option to enable/disable vector field clustering key (#34097)
#30633

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2024-06-25 18:52:04 +08:00
congqixia
c8c423e972
enhance: [skip e2e] Sync mergify Build & test job name to 22.04 (#34158)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-25 18:50:04 +08:00
yihao.dai
940a0ac0a3
fix: Prevent import from generating orphaned files (#34070)
When import failed, mark the import segment as dropped instead of drop
it directly to prevent generating orphaned files.

issue: https://github.com/milvus-io/milvus/issues/34068

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-06-25 16:58:02 +08:00
pingliu
b12c34a8ba
doc: [skip e2e] change milvus docker image version to v2.4.5 (#34135)
Signed-off-by: ping.liu <ping.liu@zilliz.com>
2024-06-25 14:30:04 +08:00
congqixia
962a5446f8
enhance: Add ctx in SyncTask.Run to be cancellable (#34042)
Related to #33716

This PR add context param in SyncTask.Run execution functions to make it
cancellable from the caller.

This make it possible to cancel task when datanode/data sync service is
beeing shut down.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-25 14:22:04 +08:00
chyezh
93291c0dca
fix: add build-tags at golangci-lint (#34084)
issue: #33132

caused by introducing conditional compile file in async cgo.

Signed-off-by: chyezh <chyezh@outlook.com>
2024-06-25 11:55:07 +08:00
sammy.huang
ac2840243a
enhance: revert dead try on uploading codecov (#34130)
This reverts commit 19936d9994.

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-25 11:51:30 +08:00
congqixia
a21c0865de
enhance: [skip e2e] Check 'Build and Test' steps success for mergify (#34125)
Since 'Build and test' action is separated into several steps, each
failure/success status shall cause different behavior for mergify rule

This PR check cpp/go ut and intergration tests for 'Build & test'
actions to add or remove labels.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-25 10:58:01 +08:00
sammy.huang
2cc9df5c50
[automated] Update cpu Builder image changes (#34078)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-25 10:56:10 +08:00
zhenshan.cao
d18c49013b
enhance: Refine compaction (#33982)
issue : https://github.com/milvus-io/milvus/issues/32939

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2024-06-25 10:08:03 +08:00
congqixia
506a915272
fix: Deep copy ImportTask.segmentsInfo to prevent data race (#34090)
See also #34089

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-25 10:06:02 +08:00
sre-ci-robot
254b555d53
[automated] Update Knowhere Commit (#34119)
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-06-25 01:22:02 +08:00
congqixia
07c25a19d9
fix: Make querycoord panick when rg metastore sync fail (#34106)
See also #34047

When `unassignNode` sync resource group with node removed failed

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-24 21:38:02 +08:00
zhikunyao
68fe6f9a0e
enhance: [skip e2e]Update mergify.yml to skip code check workflow (#34113)
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
Co-authored-by: Zhikun Yao <zhikun.yao@zilliz.com>
2024-06-24 21:16:02 +08:00
congqixia
fd922d921a
enhance: Add nilness linter and fix some small issues (#34049)
Add `nilness` for govet linter and fixed some detected issues

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-24 14:52:03 +08:00
GenkenWei
a1248a19f8
fix: update ubuntu base image version (#33944)
related to #33945
FIX CVEs of milvus base image: MEDIUM: 8, **Total FIX: 8** for master
branch

![image](https://github.com/milvus-io/milvus/assets/27683687/71708028-265e-4f20-8732-56b7e76864fc)

Signed-off-by: weizhenkun <zhenkun.wei@qq.com>
Co-authored-by: weizhenkun <zhenkun.wei@qq.com>
2024-06-24 14:12:02 +08:00
Jiquan Long
aa36f9feed
fix: [ut] regex query under unsupported index (#34087)
/kind improvement
issue: https://github.com/milvus-io/milvus/issues/29988

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2024-06-24 14:08:03 +08:00
jaime
d08cb885ca
enhance: enable flush rate limiter of collection level (#33837)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-06-24 10:52:03 +08:00
zhuwenxing
4c6f6c54dc
test: refine restful testcases trace (#34066)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-06-24 10:36:25 +08:00
chyezh
b9237280c2
enhance: wal interface definition (#33745)
issue: #33285

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2024-06-24 10:34:12 +08:00
Patrick Weizhi Xu
b961767005
enhance: support integral type for MV and skip MV if there is only one category (#33161)
issue: #29892

---------

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
2024-06-24 10:20:01 +08:00
congqixia
b5c9a7364b
fix: Prevent remove new growing L1 segment when SyncSegments (#34056)
Related to #34018

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-24 10:18:01 +08:00
Chun Han
ca7ef26e4b
fix: sync part stats task cannot be finished(#30376) (#34027)
related: #30376
also: refine log output for query_coord task by rephrasing action string

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2024-06-24 10:16:02 +08:00
Ted Xu
78885a44c4
fix: turn on compression on stream writers (#34067)
See #31679

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2024-06-24 10:08:02 +08:00
zhagnlu
03a3f50892
enhance: add skip using array index when some situation (#33947)
#32900

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-06-23 21:26:02 +08:00
zhagnlu
0d7ea8ec42
enhance: Enhance and correct exception module (#33705)
#33704

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-06-23 21:22:01 +08:00
yihao.dai
6c1d815894
enhance: Remove the unused compaction logic from shard (#33932)
1. Remove the `compactTo` field in `SegmentInfo`.
2. Remove the target segment not match and its retry logic in
`SyncManager`.

issue: https://github.com/milvus-io/milvus/issues/32809

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-06-23 21:12:01 +08:00
sammy.huang
b77ab76d74
enhance: get environment variable from .env (#34081)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-23 09:34:07 +08:00
sre-ci-robot
e1b64e2318 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2024-06-22 12:00:53 +00:00
yihao.dai
fb870d2426
fix: Do compressBinlog to fix logID 0 (#34060)
issue: https://github.com/milvus-io/milvus/issues/34059

Do compressBinlog to ensure that reloadFromKV will fill binlogs' logID
after datacoord restarts.

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-06-22 16:14:01 +08:00
zhikunyao
e0e06fc9e0
enhance: [skip e2e] Update mergify.yml to skip cov checker (#34072) 2024-06-22 16:12:00 +08:00
chyezh
259a682673
enhance: async search and retrieve in cgo (#33228)
issue: #30926, #33132
related pr: #33133

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2024-06-22 09:38:02 +08:00