milvus/scripts
edward.zeng d278fffca1
[skip ci] Refine scripts readme (#9408)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-10-07 18:34:42 +08:00
..
check_proto_product.sh Add the check of C++ code in the CI progress 2020-11-18 10:07:05 +08:00
core_build.sh Support to get nproc on macOS in the compilation (#8281) 2021-09-22 17:09:53 +08:00
cwrapper_build.sh Add cache for thirdparty files cache 2020-12-08 18:51:07 +08:00
cwrapper_dablooms_build.sh Add dablooms (#5440) 2021-05-28 10:23:30 +08:00
cwrapper_rocksdb_build.sh Fix compile error on CentOS (#6359) 2021-07-08 15:43:45 +08:00
devcontainer.sh Update main.yaml for Github Action (#6381) 2021-07-09 11:59:09 +08:00
docker_image_find_tag.sh Add daily release (#7626) 2021-09-09 16:05:56 +08:00
gofmt.sh Fix go format bug 2021-01-05 14:20:45 +08:00
install_deps.sh [skip ci] Update DEVELOPMENT.md for compile on CentOS (#6407) 2021-07-09 16:24:39 +08:00
OWNERS [skip ci] Update OWNERS files (#8211) 2021-09-18 15:30:37 +08:00
proto_gen_go.sh Fix compile protocol buffer files error (#8045) (#8833) 2021-09-29 20:44:09 +08:00
README.md [skip ci] Refine scripts readme (#9408) 2021-10-07 18:34:42 +08:00
run_cpp_codecov.sh [skip ci] Modify description of script (#9255) 2021-10-05 12:28:13 +08:00
run_cpp_unittest.sh [skip ci] Modify description of script (#9254) 2021-10-05 12:26:02 +08:00
run_docker.sh rename service to coord (#6020) 2021-06-23 16:14:08 +08:00
run_go_codecov.sh [skip ci] Modify script description (#9337) 2021-10-06 19:26:54 +08:00
run_go_unittest.sh [skip ci] Modify script description (#9338) 2021-10-06 19:28:47 +08:00
start_cluster.sh [skip ci] Modify script description (#9401) 2021-10-07 18:01:28 +08:00
start_standalone.sh [skip ci] Modify script description (#9400) 2021-10-07 17:42:49 +08:00
stop.sh [skip ci] Fix script comment (#9062) 2021-10-02 11:21:56 +08:00

Compile and install milvus-distributed

Environment

    OS: Ubuntu 18.04
    go1.15
    cmake: >=3.18
    gcc 7.5

Install dependencies

Install compile dependencies

    sudo apt install -y g++ gcc make libssl-dev zlib1g-dev libboost-regex-dev \
    libboost-program-options-dev libboost-system-dev libboost-filesystem-dev \
    libboost-serialization-dev python3-dev libboost-python-dev libcurl4-openssl-dev gfortran libtbb-dev

    export GO111MODULE=on
    go get github.com/golang/protobuf/protoc-gen-go@v1.3.2

Install OpenBlas library

    wget https://github.com/xianyi/OpenBLAS/archive/v0.3.9.tar.gz && \
    tar zxvf v0.3.9.tar.gz && cd OpenBLAS-0.3.9 && \
    make TARGET=CORE2 DYNAMIC_ARCH=1 DYNAMIC_OLDER=1 USE_THREAD=0 USE_OPENMP=0 FC=gfortran CC=gcc COMMON_OPT="-O3 -g -fPIC" FCOMMON_OPT="-O3 -g -fPIC -frecursive" NMAX="NUM_THREADS=128" LIBPREFIX="libopenblas" LAPACKE="NO_LAPACKE=1" INTERFACE64=0 NO_STATIC=1 && \
    make PREFIX=/usr install

Compile

Generate the go files from proto file

    make check-proto-product

Check code specifications

    make verifiers

Compile milvus

    make all

Install docker-compose

refer: https://docs.docker.com/compose/install/

    sudo curl -L "https://github.com/docker/compose/releases/download/1.27.4/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
    sudo chmod +x /usr/local/bin/docker-compose
    sudo ln -s /usr/local/bin/docker-compose /usr/bin/docker-compose
    docker-compose --version

Start service

Start third-party service:

    cd [milvus project path]/deployments/docker/cluster
    docker-compose up -d

Start milvus cluster:

    cd [milvus project path]/scripts
    start_cluster.sh

Run unittest

Run all unittest including go and cpp cases:

    make unittest

You also can run go unittest only:

    make test-go

Run cpp unittest only:

    make test-cpp

Run code coverage

Run code coverage including go and cpp:

    make codecov

You also can run go code coverage only:

    make codecov-go

Run cpp code coverage only:

    make codecov-cpp