Go to file
JinHai-CN eeb503f7c5 Update faiss link
Former-commit-id: 22febba9b19f8de8422eae922ec75d7106e37e7a
2019-10-31 14:07:23 +08:00
.github/ISSUE_TEMPLATE
ci Merge remote-tracking branch 'gitlab/0.5.1' into upgrade_faiss 2019-10-29 11:18:56 +08:00
core Update faiss link 2019-10-31 14:07:23 +08:00
docker update libboost in build environment Dockerfile 2019-10-17 15:06:30 +08:00
tests Disble mysql-version test 2019-10-28 11:07:34 +08:00
.clang-format
.clang-tidy format code by clang-tidy 2019-09-28 15:00:26 +08:00
.clang-tidy-ignore rename some compile virables 2019-10-15 17:06:05 +08:00
.gitignore re-organize project 2019-10-14 09:51:48 +08:00
CHANGELOG.md New config opion use_gpu_threshold 2019-10-30 19:57:55 +08:00
CODE_OF_CONDUCT.md Update Documents 2019-10-15 18:43:51 +08:00
codecov.yaml update codecov.yaml 2019-10-21 17:25:37 +08:00
CONTRIBUTING.md update README and CONTRIBUTING 2019-10-16 16:17:04 +08:00
LICENSE
NOTICE.md Improvement dump function in scheduler 2019-10-21 19:32:38 +08:00
README.md [skip ci] Move Roadmap section ahead 2019-10-29 09:32:36 +08:00

Milvuslogo

LICENSE Language codebeat badge Release Release_date

Welcome to Milvus

What is Milvus

Milvus is an open source similarity search engine for massive-scale feature vectors. Built with heterogeneous computing architecture for the best cost efficiency. Searches over billion-scale vectors take only milliseconds with minimum computing resources.

Milvus provides stable Python, Java and C++ APIs.

Keep up-to-date with newest releases and latest updates by reading Milvus release notes.

  • Heterogeneous computing

    Milvus is built with heterogeneous computing architecture for the best performance and cost efficiency.

  • Multiple indexes

    Milvus supports a variety of indexing types that employs quantization, tree-based, and graph indexing techniques.

  • Intelligent resource management

    Milvus automatically adapts search computation and index building processes based on your datasets and available resources.

  • Horizontal scalability

    Milvus supports online / offline expansion to scale both storage and computation resources with simple commands.

  • High availability

    Milvus is integrated with Kubernetes framework so that all single point of failures could be avoided.

  • High compatibility

    Milvus is compatible with almost all deep learning models and major programming languages such as Python, Java and C++, etc.

  • Ease of use

    Milvus can be easily installed in a few steps and enables you to exclusively focus on feature vectors.

  • Visualized monitor

    You can track system performance on Prometheus-based GUI monitor dashboards.

Architecture

Milvus_arch

Get started

Hardware requirements

Component Recommended configuration
CPU Intel CPU Haswell or higher
GPU NVIDIA Pascal series or higher
RAM 8 GB or more (depends on data size)
Hard drive SATA 3.0 SSD or higher

Install using docker

Use Docker to install Milvus is a breeze. See the Milvus install guide for details.

Build from source

Software requirements

  • Ubuntu 18.04 or higher
  • CMake 3.14 or higher
  • CUDA 10.0 or higher
  • NVIDIA driver 418 or higher

Compilation

Step 1 Install dependencies
$ cd [Milvus sourcecode path]/core
$ ./ubuntu_build_deps.sh
Step 2 Build
$ cd [Milvus sourcecode path]/core
$ ./build.sh -t Debug
or 
$ ./build.sh -t Release

When the build is completed, all the stuff that you need in order to run Milvus will be installed under [Milvus root path]/core/milvus.

Launch Milvus server

$ cd [Milvus root path]/core/milvus

Add lib/ directory to LD_LIBRARY_PATH

$ export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/path/to/milvus/lib

Then start Milvus server:

$ cd scripts
$ ./start_server.sh

To stop Milvus server, run:

$ ./stop_server.sh

To edit Milvus settings in conf/server_config.yaml and conf/log_config.conf, please read Milvus Configuration.

Try your first Milvus program

Run Python example code

Make sure Python 3.5 or higher is already installed and in use.

Install Milvus Python SDK.

# Install Milvus Python SDK
$ pip install pymilvus==0.2.3

Create a new file example.py, and add Python example code to it.

Run the example code.

# Run Milvus Python example
$ python3 example.py

Run C++ example code

 # Run Milvus C++ example
 $ cd [Milvus root path]/core/milvus/bin
 $ ./sdk_simple

Run Java example code

Make sure Java 8 or higher is already installed.

Refer to this link for the example code.

Milvus roadmap

Please read our roadmap to learn about upcoming features.

Contribution guidelines

Contributions are welcomed and greatly appreciated. Please read our contribution guidelines for detailed contribution workflow. This project adheres to the code of conduct of Milvus. By participating, you are expected to uphold this code.

We use GitHub issues to track issues and bugs. For general questions and public discussions, please join our community.

Join the Milvus community

To connect with other users and contributors, welcome to join our slack channel.

Thanks

We greatly appreciate the help of the following people.

  • akihoni found a broken link and a small typo in the README file.

Resources

Milvus official website

Milvus docs

Milvus bootcamp

Milvus blog

Milvus CSDN

Milvus roadmap

License

Apache License 2.0