test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-04 12:59:23 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
5,203 Commits 96 Branches 105 Tags 185 MiB
8a63d27612
Commit Graph

5203 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Cai Yudong
ac443e37ac
Caiyd 1689 gpu out of memory (#1776) 
* #1689 update cache stragegy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1689 add lock when change cache capacity

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry CI

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1689 update cache

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry CI

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-27 19:24:10 +08:00
Jin Hai
d92bcd2e54
Update CHANGLOG.md (#1771) 
* Update CHANGLOG.md

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Update

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Update

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-03-27 14:02:54 +08:00
op-hunter
4b996cd622
fix commpile error because of interface changed (#1773) 
* fix commpile error because of interface changed

Signed-off-by: lichengming <chengming.li@zilliz.com>

* fix comiple error

Signed-off-by: lichengming <chengming.li@zilliz.com>

Co-authored-by: lichengming <chengming.li@zilliz.com>
 2020-03-27 13:07:57 +08:00
groot
e4264d8461
Server is not forbidden to create new partition which tag is _default (#1770) 
* HasTable with a not exist table name, return error status

Signed-off-by: groot <yihua.mo@zilliz.com>

* Server is not forbidden to create new partition which tag is _default

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-27 10:00:51 +08:00
op-hunter
310d5d70bc
Annoy support (#1746) 
* add annoy source code

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* add annoy knowhere

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* annoy local gtest passed

Signed-off-by: lichengming <chengming.li@zilliz.com>

* fix lint error and update changelog

Signed-off-by: lichengming <chengming.li@zilliz.com>

* fix compile error

Signed-off-by: cmli <chengming.li@zilliz.com>

* Update connect timeout in test cases

Signed-off-by: zw <zw@milvus.io>

* fix some potential bugs

Signed-off-by: cmli <chengming.li@zilliz.com>

* retry ci

Signed-off-by: cmli <chengming.li@zilliz.com>

* rerun ci!

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix errors tested by c++ sdk

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix lint error

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: lichengming <chengming.li@zilliz.com>
Co-authored-by: zw <zw@milvus.io>
 2020-03-27 09:52:31 +08:00
JinHai-CN
7763caef09 Update CHANGLOG.md 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-03-26 23:45:00 +08:00
del-zhenwu
23e2780309
add delete case for hnsw/pq in cpu-version (#1741) 
* add delete case for hnsw/pq in cpu-version

Signed-off-by: lizhenxiang <lizhenxiang@lianjia.com>

* Update compact timeout

Signed-off-by: zw <zw@milvus.io>

* add case: search with tag not existed

Signed-off-by: zw <zw@milvus.io>

* update compact timeout

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: lizhenxiang <lizhenxiang@lianjia.com>
Co-authored-by: zw <zw@milvus.io>
 2020-03-26 23:17:04 +08:00
Cai Yudong
207b854c3f
Caiyd 1655 gpu ivfflat delete (#1767) 
* update sdk

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update segment interfaces

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update some interfaces

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-26 21:58:48 +08:00
quicksilver
792538734b
Set helm deploy timeout to 600s (#1769) 2020-03-26 20:22:20 +08:00
groot
0da3c712ec
HasTable with a not exist table name, return error status (#1761) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-26 19:59:49 +08:00
Xiaohai Xu
f93b464172
#1654 GPU Index Flat Delete (#1736) 
* Add Flat Index Delete

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* Fix log

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* Fix bitset

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* Fix reference

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix bug

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix bug

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix bug

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
 2020-03-26 18:36:46 +08:00
JinHai-CN
65ffaedae3 Update CHANGLOG.md 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-03-26 18:35:49 +08:00
Tinkerrr
243e843aac
fix #1747 (#1757) 
* fix

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update.

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* lint pass

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* UPDATE CASE: search with tag not exist

Signed-off-by: zw <zw@zilliz.com>

Co-authored-by: zw <zw@zilliz.com>
 2020-03-26 18:28:24 +08:00
shengjun.li
e9f7422bc5
fix binary flat may retruns wrong distance when nq larger than 1 (#1760) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-03-26 16:45:49 +08:00
groot
c4b7be8ed6
#1728 Optimize request handler to combine similar query (#1743) 
* modify changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* improve search qps

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix hang bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix combine request result bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* add unittest for combine request

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failure

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-26 14:26:02 +08:00
Cai Yudong
578d2633eb
#1756 fix memory exhausted during searching (#1758) 
* #1756 fix memory exhausted during searching

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1756 update const names

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-26 13:55:11 +08:00
BossZou
5a83ba4e49
Optimize behavior to get file ids from metadata in mishards (#1754) (#1755) 
* update mishards get file ids

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update behaviour for getting file ids

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* check default partition

Signed-off-by: yhz <413554850@qq.com>

* remove exception when file id not found

Signed-off-by: yhz <413554850@qq.com>

* Optimize behavior to get file ids from metadata in mishards (fix #1754)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* [skip ci] Update changlog

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-03-26 12:28:20 +08:00
Cai Yudong
d34bd505ba
#1735 fix search fail with gpu out of memory using ivf_flag (#1748) 
* #1735 fix search fail with gpu out of memory using ivf_flag

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1735 add lock for each GpuCacheMgr instance

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1735 optimize cache debug info

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1735 set smaller cache threshold

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1735 update cache debug log

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1735 fix cache issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-25 19:54:50 +08:00
Tinkerrr
cda57cf77f
Update NSG (#1744) 
* enable IP and fix crash

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update.

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* lint pass

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
 2020-03-25 16:24:18 +08:00
groot
e865e9c893
modify changelog (#1739) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-24 17:48:13 +08:00
groot
0e914949e8
#1734 Opentracing for combined search request (#1737) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-24 14:44:01 +08:00
quicksilver
13c8d55fbd
#1656 Limit the resources of publish docker container (#1732) 
* Increase memory limit in Jenkins CI

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Add pod tolerations to slave pods

* Refactor ci/scripts/build.sh

* Refactor ci/scripts/build.sh

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Add timeout for whole Jenkins job

* cuda yum repository temporarily disabled

* Update ccache script file

* Update ccache script file

* Update ccache script file

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update ccache script file

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update ccache script file

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update ccache script file

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update ci/jenkins/pod/docker-pod.yaml
 2020-03-24 10:47:41 +08:00
Jin Hai
f4d7dd6c93
#1724 Remove unused unittests (#1725) 
* #1724 Remove unused unittests

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* #1724 Remove unused unittests - part2

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* #1724 Remove unused unittests - part3

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* #1724 Remove unused unittests - part4

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* #1724 Remove unused unittests - part5

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-03-24 10:11:10 +08:00
shengjun.li
5fc875a020
#1603 modify substructure/superstructure to perfect match (#1718) 
* modify substructure/superstructure to perfect match

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* Update cases

Signed-off-by: zw <zw@zilliz.com>

* Fix case bug

Signed-off-by: zw <zw@zilliz.com>

* set invalid distance infinite

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* Add distance cases

Signed-off-by: zw <zw@zilliz.com>

* Fix test cases

Signed-off-by: zw <zw@zilliz.com>

* Re-trigger ci

Signed-off-by: zw <zw@zilliz.com>

* fix wrong code

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* Fix test case

Signed-off-by: zw <zw@zilliz.com>

* Fix case

Signed-off-by: zw <zw@zilliz.com>

* Fix cases

Signed-off-by: zw <zw@zilliz.com>

Co-authored-by: zw <zw@zilliz.com>
 2020-03-24 10:10:56 +08:00
quicksilver
02cfbf31c5
#1656 Update ccache script file (#1716) 
* Increase memory limit in Jenkins CI

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Add pod tolerations to slave pods

* Refactor ci/scripts/build.sh

* Refactor ci/scripts/build.sh

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Add timeout for whole Jenkins job

* cuda yum repository temporarily disabled

* Update ccache script file

* Update ccache script file

* Update ccache script file

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update ccache script file

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update ccache script file

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update ccache script file

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-03-23 19:55:39 +08:00
groot
99470b4dfa
#1702 Optimize request handler to combine similar query (#1727) 
* #1686 API search_in_files cannot work correctly when vectors is stored in certain non-default partition

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #1686 API search_in_files cannot work correctly when vectors is stored in certain non-default partition

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine request code

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* combine search request

Signed-off-by: groot <yihua.mo@zilliz.com>

* combine search request

Signed-off-by: groot <yihua.mo@zilliz.com>

* #1728 Optimize request handler to combine similar query

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* remove some log
 2020-03-23 18:26:18 +08:00
op-hunter
4fa45dc754
#1661 support HNSW deletion on nmslib (#1729) 
* support HNSW deletion on nmslib

Signed-off-by: lichengming <chengming.li@zilliz.com>

* update changelog

Signed-off-by: lichengming <chengming.li@zilliz.com>

* fix lint error on test_hnsw.cpp

Signed-off-by: lichengming <chengming.li@zilliz.com>

Co-authored-by: lichengming <chengming.li@zilliz.com>
 2020-03-23 18:04:46 +08:00
shengjun.li
e3786a24f4
IVFPQ has supported to delete vectors (#1722) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-03-23 13:50:27 +08:00
Cai Yudong
538c377e65
Caiyd 1689 fix sq8h fail (#1723) 
* #1689 fix SQ8H search fail on SIFT-1B dataset

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix bug

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix gpu search fail

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix db_test

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* revert segment back

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_gpuresource

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_gpuresource

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-23 10:48:15 +08:00
Jin Hai
450573849b
#267 Improve search performance: reduce delay (#1717) 
* #267 Improve search performance: reduce delay

Signed-off-by: jinhai <haijin.chn@gmail.com>

* #267 Improve search performance: reduce delay - update CHANGELOG

Signed-off-by: jinhai <haijin.chn@gmail.com>

* #267 Update

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #267 Update

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #267 Update

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #267 Update format

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-03-23 09:26:58 +08:00
Jin Hai
9443af3e87
#1719 Remove unused log (#1720) 
Signed-off-by: jinhai <hai.jin@zilliz.com>
 2020-03-21 12:48:41 +08:00
BossZou
3c3617fd81
Mishards 070 (#1699) 
* update mishards to 0.7.0

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update mishards to 0.7.0

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix search bug and example pass

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add new api

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add segment stat

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix table info issue

Signed-off-by: yhz <413554850@qq.com>

* fix mishards api issue

Signed-off-by: yhz <413554850@qq.com>

* update mishards

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update all_in_one docker images

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix delete_by_id param parser & remove some comments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update yaml config file

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update all_in_one config

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove delete_by_range comments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update cmd api

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add warning when search

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update service_handler

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update shrads requiremtns

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* [skip ci] remove surplus log info

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-03-20 20:21:11 +08:00
groot
fe2595fa38
#1686 API search_in_files cannot work correctly when vectors is store… (#1701) 
* #1686 API search_in_files cannot work correctly when vectors is stored in certain non-default partition

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #1686 API search_in_files cannot work correctly when vectors is stored in certain non-default partition

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-20 12:14:07 +08:00
Cai Yudong
5950deddfc
#1678 remove CUSTOMIZATION macro (#1707) 
* #1678 remove CUSTOMIZATION macro

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* disable faiss_benchmark

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-20 10:24:27 +08:00
Cai Yudong
588ef95d76
Caiyd refactor knowhere (#1687) 
* add new knowhere

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* build pass

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* update

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* rename algo

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update...

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* add archive

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* add new APIs: GetVectorById/SearchVectorById/SetBlacklist/GetBlacklist

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* all unittest pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* test_binary pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move knowhere into namespace milvus

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update hnsw

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ConfAdapterMgr

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ExecutionEngineImpl

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move SetBlacklist/GetBlacklist to VecIndex

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update VectorAdapter and rename SearchById to QueryById

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update interface in ExecutionEngineImpl

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* milvus build pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* milvus IDMAP sdk_simple pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_server

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_schedule

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix CPU version Milvus build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update BinaryIVF BuildAll

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update VecIndexFactory

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ConfAdapter

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix knowhere unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix SPTAG unittest

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix CPU version unittest build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix db_test

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_engine

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_delete

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix CPU version build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change BinarySet key back

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change IndexType to string, and add compatible API for 0.7.0

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix IndexHNSW build warning

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_cache

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix write_index error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code clean

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Co-authored-by: Nicky <nicky.xj.lin@gmail.com>
Co-authored-by: xiaojun.lin <xiaojun.lin@zilliz.com>
 2020-03-19 19:24:20 +08:00
shengjun.li
72ad100a90
modify bitset from deque to vector (#1696) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-03-19 16:16:14 +08:00
op-hunter
fdd51400d2
#1660 support IVFPQ CPU delete (#1695) 
* support IVFPQ CPU delete

Signed-off-by: lichengming <chengming.li@zilliz.com>

* update CHANGELOG.md

Signed-off-by: lichengming <chengming.li@zilliz.com>

Co-authored-by: lichengming <chengming.li@zilliz.com>
 2020-03-19 12:26:03 +08:00
BossZou
504a9e30ab
Optimize config cpu_cache_capacity / gpu_cache_capacity setter (#1572) (#1629) 
* add gpu cache config handler

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove cpu/gpu cache mgr from Config class by using cache config handler (fix #1572)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove 0.8.0 from config version map

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* clean config header reference

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix bug in web readme

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* reduce gpu config handler to gpu resources handler

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add engine config

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* modify handler hook(fix #1572)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update changlog

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* initalize value in handler by config default

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code style format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix compile error in release mode

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* resolve faiss blas threshold init in DBWrapper

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* modify cache header

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove comments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* order headers

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* convert gpu res config to lower case

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* CI retry

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* adjust header order in cpu cache mar file

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* improve config test case

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-03-19 10:17:53 +08:00
Lutkin Wang
616fd13612
Add more information to INSTALL.md (#1694) 
* [skip ci] Update README_CN.md

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>

* [skip ci] Update INSTALL.md.

Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
 2020-03-19 10:17:31 +08:00
Xiaohai Xu
1543f8dc37
#1653 IndexFlat performance improvement for NQ < thread_number (#1690) 
* optimize sse

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* optimizer BinaryDistance

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix superstructure

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-03-18 18:27:57 +08:00
groot
55ecfd5930
#1663 PQ index parameter m validation (#1677) 
* #1663 PQ index parameter m validation

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failure

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-18 18:26:38 +08:00
Lutkin Wang
400446351c
[skip ci] Update README_CN.md (#1684) 
Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
 2020-03-17 18:45:55 +08:00
XuPeng-SH
b520e60b8a
[skip ci](shards): fix #1679 (#1681) 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-03-17 11:06:51 +08:00
quicksilver
8644d341c4
#1656 Add timeout for whole Jenkins job (#1676) 
* Increase memory limit in Jenkins CI

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Add pod tolerations to slave pods

* Refactor ci/scripts/build.sh

* Refactor ci/scripts/build.sh

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Add timeout for whole Jenkins job

* cuda yum repository temporarily disabled
 2020-03-17 10:36:24 +08:00
Snyk bot
bb6ce0abe1
fix: shards/requirements.txt to reduce vulnerabilities (#1680) 
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-URLLIB3-559452
 2020-03-17 10:30:31 +08:00
XuPeng-SH
4173626088
[skip ci](shards): fix low concurrency issue (#1672) 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-03-17 09:57:36 +08:00
del-zhenwu
21c7b8f09c
Add structure cases (#1675) 
* enable nsg case

Signed-off-by: zhenwu <zw@zilliz.com>

* enable sub/superstructure

Signed-off-by: zhenwu <zw@zilliz.com>
 2020-03-16 21:33:25 +08:00
Xiaohai Xu
59dab6cb84
#1653 IndexFlat performance improvement for NQ < thread_number (#1674) 
* Optimize index flat L2/IP for SSE

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* parallel optimization

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix threshold

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* add changelog

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* add changelog

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

Co-authored-by: sahuang <xiaohai.xu@zilliz.com>
 2020-03-16 21:32:05 +08:00
Zhiru Zhu
3de34d3831
#1619 (#1620) 
* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-16 19:33:28 +08:00
del-zhenwu
51cfc8978a
enable nsg case (#1670) 
Signed-off-by: zhenwu <zw@zilliz.com>
 2020-03-16 19:32:14 +08:00