Commit Graph

379 Commits

Author SHA1 Message Date
congqixia
9f8eb0e527
enhance: make integration test case timeout configurable (#30073)
currently integration test may timeout if any case run time is above 3
minutes. This duration was hard coded.

This PR change this duration into a customized parameter and could be
passed via test running commands.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-18 12:22:54 +08:00
yah01
031243fee7
feat: support mmap for marisa trie (#29613)
this supports mmap for marisa trie index
related https://github.com/milvus-io/milvus/issues/21866

Signed-off-by: yah01 <yang.cen@zilliz.com>
2024-01-11 10:22:50 +08:00
Jiquan Long
4b3de64733
enhance: add rust to install_dep.sh (#29586)
fix: #29585

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2024-01-07 20:04:12 +08:00
yihao.dai
3561586edf
feat: Add import reader for binlog (#28910)
This PR defines the new import reader interfaces and implement a binlog
reader for import.

issue: https://github.com/milvus-io/milvus/issues/28521

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-01-05 11:48:47 +08:00
PowderLi
5f00bad4b8
fix: link with install path's libblob-chunk-manager (#29496)
issue: #29494

1. link with install path's libblob-chunk-manager
2. performance of `ShouldBindWith` is better than `ShouldBindBodyWith`
3. the middleware shouldn't read the unrefreshed parameter repeatly

Signed-off-by: PowderLi <min.li@zilliz.com>
2023-12-31 20:02:48 +08:00
wei liu
e41fd6fbde
enhance: Move proxy client manager to util package (#28955)
issue:  #28898

This PR move the `ProxyClientManager` to util package, in case of
reusing it's implementation in querycoord

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-12-20 19:22:42 +08:00
zhagnlu
56d7225673
fix: Add LD_LIBRARY_PATH when local start milvus (#29287)
#28165

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2023-12-19 10:08:41 +08:00
zhagnlu
a602171d06
enhance: Refactor runtime and expr framework (#28166)
#28165

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2023-12-18 12:04:42 +08:00
Jiquan Long
ed79505d31
enhance: use specific rust version to compile opendal (#29106)
/kind improvement

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-13 16:34:38 +08:00
XuanYang-cn
d2207cac27
fix: Fix rustup update (#29093)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-12-11 11:36:37 +08:00
Bingyi Sun
36f69ea031
feat: integrate storagev2 in building index of segcore (#28768)
issue: https://github.com/milvus-io/milvus/issues/28655

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
2023-12-05 16:48:54 +08:00
congqixia
e79c3eaa90
enhance: [skip e2e] Update install_deps.sh cmake version (#28946)
cmake version needs to be greater or equal than 3.26.4, sync
`install_deps.sh` scripts version to 3.26.5

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-12-04 18:26:34 +08:00
PowderLi
cac802ef7f
enhance: use already installed vcpkg (#28703)
issue #28686
1. Update Builder gpu image changes, see changes #28505
2. update azure-identity-cpp from beta to release

Signed-off-by: PowderLi <min.li@zilliz.com>
2023-11-30 15:58:32 +08:00
Xiaofan
f13ef1665a
fix : macos clean compilation fail, brew install some missed library (#28717)
fix macOS compilation fail, related #28715
1) install_deps.sh missed to install some dependencies 
2) llvm can not be found without a soft link

Signed-off-by: xiaofan luan <xiaofanluan@xiaofandeMacBook-Pro.local>
Co-authored-by: xiaofan luan <xiaofanluan@xiaofandeMacBook-Pro.local>
2023-11-27 10:06:26 +08:00
yah01
da03feb79a
enhance: upgrade OpenDAL to v0.42.0 and optimize the building (#28556)
- Upgrade OpenDAL to v0.42.0
- Clone OpenDAL with depth 1
- Add build log for OpenDAL

---------

Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-11-20 14:58:20 +08:00
yah01
6f59510723
Upgrade go to 1.20 (#24390)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-11-10 07:46:18 +08:00
Enwei Jiao
cbf25f8585
Use OpenDAL 0.42 (#28258)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-11-09 11:26:21 +08:00
PowderLi
9f9726f8b7
print azure sdk log (#28240)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-11-08 17:50:18 +08:00
PowderLi
7bb0fa9c70
reduce useless ObjectExists (#28156)
replace ListBlobs() with GetProperties()
unified style std::string& / char*
config azure requestTimeoutMs

Signed-off-by: PowderLi <min.li@zilliz.com>
2023-11-07 16:32:20 +08:00
wei liu
0c69f48ba4
refine stop order (#28016)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-11-01 11:40:15 +08:00
Enwei Jiao
8ae9c947ae
Use OpenDAL to access object store (#25642)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-11-01 09:00:14 +08:00
XuanYang-cn
6ce98cf542
Fix sript stop unable to find milvus process (#27957)
/kind improvement

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-10-26 20:44:14 +08:00
Enwei Jiao
4faba61647
Upgrade conan to 1.61.0 (#27870)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-10-24 17:50:10 +08:00
jaime
ac2d1bb5c2
Support receive signals from parent process (#27756)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-10-18 20:20:11 +08:00
chen
a66d1cf4ff
remove unused code (#27134)
Signed-off-by: xiedeyantu <czjourney@163.com>
2023-10-16 23:06:08 +08:00
jaime
ec1fe3549e
Add a stop hook to clean session (#27564)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-10-16 10:24:10 +08:00
BUPTAnderson
ff19cb2719
Fix cannot find -latomic (#27598)
Signed-off-by: hg.anderson <yunlongkong@126.com>
2023-10-15 20:08:04 +08:00
zhagnlu
2efc4ec703
Remove deprecated cmake parameter (#27695)
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2023-10-14 02:57:35 +08:00
Sheldon
fc1d59f64b
only build cpu in default devcontainer (#27570)
now the default devcontainer will use gpubuilder, which is so big,
almost >8G

Signed-off-by: Sheldon <chuanfeng.liu@zilliz.com>
2023-10-13 14:23:36 +08:00
xige-16
bf46ffd6c4
Fix build with diskann failed (#27672)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-10-12 19:25:35 +08:00
Enwei Jiao
0f2f4a0a75
Remove useless parameters for Makefile (#27622)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-10-11 20:45:35 +08:00
PowderLi
07809880b2
fix vcpkg install path (#27635)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-10-11 17:27:33 +08:00
PowderLi
11b521392e
install ninja in advance for arm64 (#27579)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-10-11 11:51:32 +08:00
Enwei Jiao
42db013a7b
Support llvm17 on MacOS (#27582)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-10-11 02:47:33 +08:00
foxspy
370b6fde58
milvus support multi index engine (#27178)
Co-authored-by: longjiquan <jiquan.long@zilliz.com>
2023-09-22 09:59:26 +08:00
PowderLi
4feb3fa7c6
support azure (#26398)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-09-19 10:01:23 +08:00
Jiquan Long
36e29ef859
Auto generate parser code (#26716)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-08-31 11:13:01 +08:00
congqixia
d343888f3c
Fix pkg codecov & static-check script (#26720)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-08-31 09:59:01 +08:00
PowderLi
30ca45868d
install zip because we want to use vcpkg (#26664)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-08-30 14:19:00 +08:00
Enwei Jiao
a73eb1c831
Sync pb files (#26643)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-29 12:36:26 +08:00
Xiaofan
7b3a1dc93f
Fix load index panic (#26457)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-08-21 09:56:20 +08:00
Enwei Jiao
533f0ddf6d
Add amazonlinux image, prepare to remove Centos7 image, remove openblas image (#26368)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-18 18:32:19 +08:00
aoiasd
54d6f0ea23
Add rpath ldflag for unittest (#26269)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-08-11 11:25:32 +08:00
chen
703f0a187c
optimise install_deps.sh (#25942)
Signed-off-by: xiedeyantu <czjourney@163.com>
2023-08-08 11:15:14 +08:00
Enwei Jiao
f97d5a7d08
Fix compile failed with llvm16 (#26112)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-03 17:29:07 +08:00
zhagnlu
65cb52d06b
Support dynamic simd framework and using term expr as example (#25260)
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2023-07-13 16:22:30 +08:00
Enwei Jiao
4aed32ff61
Use librdkafka for all platform (#25538)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-07-13 15:34:33 +08:00
congqixia
549c4a0e1b
Enlarge integration test timeout (#25283)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-07-03 17:40:25 +08:00
wei liu
a3437e0ab5
refactor replica selection and retry policy on channel (#24367)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-06-13 10:20:37 +08:00
congqixia
dacf8b305d
Fix list milvus-proto go.mod when try to parse API_VERSION (#24788)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-10 19:30:36 +08:00