test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-11 09:46:26 +08:00
Code Issues Actions 16 Packages Projects Releases Wiki Activity
bd8ad106b9
milvus/scripts
History
Jiquan Long 22e6807e9a
feat: support inverted index for array (#33452) (#34053) 
pr: https://github.com/milvus-io/milvus/pull/33184
pr: https://github.com/milvus-io/milvus/pull/33452
pr: https://github.com/milvus-io/milvus/pull/33633
issue: https://github.com/milvus-io/milvus/issues/27704
Co-authored-by: xiaocai2333 <cai.zhang@zilliz.com>

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
2024-06-24 10:50:03 +08:00
..
sql Replace segment index file path with index file id within segment index meta (#19866) 2022-10-19 16:55:27 +08:00
3rdparty_build.sh enhance: change opendal as compile configurable (#30384) 2024-02-20 19:16:52 +08:00
antlr-4.9-complete.jar Auto generate parser code (#26716) 2023-08-31 11:13:01 +08:00
azure_build.sh fix: link with install path's libblob-chunk-manager (#29496) 2023-12-31 20:02:48 +08:00
check_cpp_fmt.sh fix: cpp format check not work (#30767) 2024-02-22 19:40:53 +08:00
check_proto_product.sh OTEL integration in cpp (#22175) 2023-03-21 16:31:57 +08:00
collect_arrow_dep.sh Add offline build logic for arrow dependency (#17266) 2022-05-30 14:54:02 +08:00
core_build.sh enhance: change opendal as compile configurable (#30384) 2024-02-20 19:16:52 +08:00
devcontainer.sh fix: [skip e2e] dev container yaml indentation error (#32601) 2024-04-26 10:15:27 +08:00
docker_image_find_tag.sh [skip ci] Update the comments (#9633) 2021-10-11 19:19:02 +08:00
download_milvus_proto.sh Fix list milvus-proto go.mod when try to parse API_VERSION (#24788) 2023-06-10 19:30:36 +08:00
generate_proto.sh feat: support inverted index for array (#33452) (#34053) 2024-06-24 10:50:03 +08:00
gofmt.sh Add amazonlinux image, prepare to remove Centos7 image, remove openblas image (#26368) 2023-08-18 18:32:19 +08:00
install_deps_embd.sh Remove Ubuntu18.04 support (#24666) 2023-06-06 14:06:36 +08:00
install_deps_msys.sh Upgrade conan to 1.61.0 (#27870) 2023-10-24 17:50:10 +08:00
install_deps.sh fix: [Cherry-pick][2.4] Download and install cmake for the current platform, not x86_64 only (#33439) 2024-05-29 16:16:00 +08:00
OWNERS [skip ci]Update OWNERS files (#11898) 2021-11-16 15:41:11 +08:00
package_windows.sh Support compile under windows (#15786) 2022-03-17 17:17:22 +08:00
README.md enhance: Upgrade go version from 1.20 to 1.21 (#33940) 2024-06-20 14:52:00 +08:00
run_cpp_codecov.sh enhance: [skip e2e]revert back to original way to archive, upload and download (#30248) 2024-02-01 10:15:04 +08:00
run_cpp_unittest.sh Support dynamic simd framework and using term expr as example (#25260) 2023-07-13 16:22:30 +08:00
run_docker.sh [skip ci]Add LF AI&Data foundation license (#9507) 2021-10-09 18:01:27 +08:00
run_go_codecov.sh feat: Add milvusclient package and migrate GoSDK (#32907) 2024-05-10 18:01:30 +08:00
run_go_unittest.sh enhance: Support dynamic config for opentelemetry trace (#32169) 2024-05-09 17:43:30 +08:00
run_intergration_test.sh test: support segment release in integration test (#31190) 2024-04-09 11:39:17 +08:00
setenv.sh Support llvm17 on MacOS (#27582) 2023-10-11 02:47:33 +08:00
standalone_embed.sh doc: change milvus docker image version to v2.4.0 (#32489) 2024-04-23 09:47:23 +08:00
start_cluster.sh fix: Add LD_LIBRARY_PATH when local start milvus (#29287) 2023-12-19 10:08:41 +08:00
start_standalone.sh fix: Add LD_LIBRARY_PATH when local start milvus (#29287) 2023-12-19 10:08:41 +08:00
stop_graceful.sh refine stop order (#28016) 2023-11-01 11:40:15 +08:00
stop.sh Fix sript stop unable to find milvus process (#27957) 2023-10-26 20:44:14 +08:00
update-api-version.sh Fix update-api-version.sh for master branch (#24773) 2023-06-09 13:10:35 +08:00

README.md

Compile and install milvus cluster

Environment

OS: Ubuntu 20.04
go：1.21
cmake: >=3.18
gcc： 7.5

Install dependencies

Install compile dependencies

$ sudo apt install -y g++ gcc make libssl-dev zlib1g-dev libboost-regex-dev \
    libboost-program-options-dev libboost-system-dev libboost-filesystem-dev \
    libboost-serialization-dev python3-dev libboost-python-dev libcurl4-openssl-dev gfortran libtbb-dev
$ export GO111MODULE=on
$ go get github.com/golang/protobuf/protoc-gen-go@v1.3.2

Install OpenBlas library

$ wget https://github.com/xianyi/OpenBLAS/archive/v0.3.9.tar.gz && \
$ tar zxvf v0.3.9.tar.gz && cd OpenBLAS-0.3.9 && \
$ make TARGET=CORE2 DYNAMIC_ARCH=1 DYNAMIC_OLDER=1 USE_THREAD=0 USE_OPENMP=0 FC=gfortran CC=gcc COMMON_OPT="-O3 -g -fPIC" FCOMMON_OPT="-O3 -g -fPIC -frecursive" NMAX="NUM_THREADS=128" LIBPREFIX="libopenblas" INTERFACE64=0 NO_STATIC=1 && \
$ make PREFIX=/usr install

Compile

Generate the go files from proto file

$ make check-proto-product

Check code specifications

$ make verifiers

Compile milvus

$ make milvus

Install docker-compose

refer: https://docs.docker.com/compose/install/

$ sudo curl -L "https://github.com/docker/compose/releases/download/1.27.4/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
$ sudo chmod +x /usr/local/bin/docker-compose
$ sudo ln -s /usr/local/bin/docker-compose /usr/bin/docker-compose
$ docker-compose --version

Start service

Start third-party service:

$ cd [milvus project path]/deployments/docker/cluster
$ docker-compose up -d

Start milvus cluster:

$ cd [milvus project path]
$ ./scripts/start_cluster.sh

Run unittest

Run all unittest including go and cpp cases:

$ make unittest

You also can run go unittest only:

$ make test-go

Run cpp unittest only:

$ make test-cpp

Run code coverage

Run code coverage including go and cpp:

$ make codecov

You also can run go code coverage only:

$ make codecov-go

Run cpp code coverage only:

$ make codecov-cpp