What is Milvus?

Milvus is an open-source vector database built to power AI applications and embedding similarity search. Milvus makes unstructured data search more accessible, and provides a consistent user experience regardless of the deployment environment.

Both Milvus Standalone and Milvus Cluster are available.

Milvus was released under the open-source Apache License 2.0 in October 2019. It is currently a graduate project under LF AI & Data Foundation.

Key features

Millisecond search on trillion vector datasets

Average latency measured in milliseconds on trillion vector datasets.

Simplified unstructured data management

Rich APIs designed for data science workflows.

Consistent user experience across laptop, local cluster, and cloud.

Embed real-time search and analytics into virtually any application.

Reliable, always on vector database

Milvus’ built-in replication and failover/failback features ensure data and applications can maintain business continuity in the event of a disruption.

Highly scalable and elastic

Component-level scalability makes it possible to scale up and down on demand. Milvus can autoscale at a component level according to the load type, making resource scheduling much more efficient.

Hybrid search

In addition to vectors, Milvus supports data types such as Boolean, integers, floating-point numbers, and more. A collection in Milvus can hold multiple fields for accommodating different data features or properties. Milvus pairs scalar filtering with powerful vector similarity search to offer a modern, flexible platform for analyzing unstructured data.

Unified Lambda structure

Milvus combines stream and batch processing for data storage to balance timeliness and efficiency. Its unified interface makes vector similarity search a breeze.

Community supported, industry recognized

With over 1,000 enterprise users, 6,000+ stars on GitHub, and an active open-source community, you’re not alone when you use Milvus. As a graduate project under the LF AI & Data Foundation, Milvus has institutional support.

Installation

Install Milvus Standalone

Install with Docker-Compose

Coming soon.

Install with Helm

Coming soon.

Build from source code

# Clone github repository.
$ cd /home/$USER/
$ git clone https://github.com/milvus-io/milvus.git

# Install third-party dependencies.
$ cd /home/$USER/milvus/
$ ./scripts/install_deps.sh

# Compile Milvus standalone.
$ make milvus

Install Milvus Cluster

Install with Docker-Compose

Coming soon.

Install with Helm

Coming soon.

Build from source code

# Clone github repository.
$ cd /home/$USER
$ git clone https://github.com/milvus-io/milvus.git

# Install third-party dependencies.
$ cd milvus
$ ./scripts/install_deps.sh

# Compile Milvus Cluster.
$ make milvus

Important

The master branch is for the development of Milvus v2.0. On March 9th, 2021, we released Milvus v1.0, the first stable version of Milvus with long-term support. To use Milvus v1.0, switch to branch 1.0.

Milvus 2.0 vs. 1.x: Cloud-native, distributed architecture, highly scalable, and more

See Milvus 2.0 vs. 1.x for more information.

Getting Started

Demos

Image search	Chatbots	Chemical structure search

Image Search

Images made searchable. Instantaneously return the most similar images from a massive database.

Chatbots

Interactive digital customer service that saves users time and businesses money.

Chemical Structure Search

Blazing fast similarity search, substructure search, or superstructure search for a specified molecule.

Bootcamps

Milvus bootcamp are designed to expose users to both the simplicity and depth of the vector database. Discover how to run benchmark tests as well as build similarity search applications spanning chatbots, recommendation systems, reverse image search, molecular search, and much more.

Contributing

Contributions to Milvus are welcome from everyone. See Guidelines for Contributing for details on submitting patches and the contribution workflow. See our community repository to learn about our governance and access more community resources.

Documentation

SDK

The implemented SDK and its API documentation are listed below:

• PyMilvus-ORM

Community

Join the Milvus community on Slack to share your suggestions, advice, and questions with our engineering team.

You can also check out our FAQ page to discover solutions or answers to your issues or questions.

Subscribe to Milvus mailing lists:

• Technical Steering Committee
• Technical Discussions
• Announcement

Follow Milvus on social media:

• Medium
• Twitter

Join Us

Zilliz, the company behind Milvus, is actively hiring full-stack developers and solution engineers to build the next-generation open-source data fabric.

Reference

Reference to cite when you use Milvus in a research paper:

@inproceedings{2021milvus,
  title={Milvus: A Purpose-Built Vector Data Management System},
  author={Wang, Jianguo and Yi, Xiaomeng and Guo, Rentong and Jin, Hai and Xu, Peng and Li, Shengjun and Wang, Xiangyu and Guo, Xiangzhou and Li, Chengming and Xu, Xiaohai and others},
  booktitle={Proceedings of the 2021 International Conference on Management of Data},
  pages={2614--2627},
  year={2021}
}

Acknowledgments

Milvus adopts dependencies from the following:

• Thanks to FAISS for the excellent search library.
• Thanks to etcd for providing great open-source key-value store tools.
• Thanks to Pulsar for its wonderful distributed pub-sub messaging system.
• Thanks to RocksDB for the powerful storage engines.