test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-02 20:09:57 +08:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity
5,034 Commits 94 Branches 105 Tags 184 MiB
e865e9c893
Commit Graph

395 Commits

Author SHA1 Message Date
groot
e865e9c893
modify changelog (#1739) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-24 17:48:13 +08:00
Jin Hai
f4d7dd6c93
#1724 Remove unused unittests (#1725) 
* #1724 Remove unused unittests

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* #1724 Remove unused unittests - part2

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* #1724 Remove unused unittests - part3

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* #1724 Remove unused unittests - part4

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* #1724 Remove unused unittests - part5

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-03-24 10:11:10 +08:00
op-hunter
4fa45dc754
#1661 support HNSW deletion on nmslib (#1729) 
* support HNSW deletion on nmslib

Signed-off-by: lichengming <chengming.li@zilliz.com>

* update changelog

Signed-off-by: lichengming <chengming.li@zilliz.com>

* fix lint error on test_hnsw.cpp

Signed-off-by: lichengming <chengming.li@zilliz.com>

Co-authored-by: lichengming <chengming.li@zilliz.com>
 2020-03-23 18:04:46 +08:00
Cai Yudong
538c377e65
Caiyd 1689 fix sq8h fail (#1723) 
* #1689 fix SQ8H search fail on SIFT-1B dataset

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix bug

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix gpu search fail

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix db_test

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* revert segment back

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_gpuresource

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_gpuresource

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-23 10:48:15 +08:00
Jin Hai
450573849b
#267 Improve search performance: reduce delay (#1717) 
* #267 Improve search performance: reduce delay

Signed-off-by: jinhai <haijin.chn@gmail.com>

* #267 Improve search performance: reduce delay - update CHANGELOG

Signed-off-by: jinhai <haijin.chn@gmail.com>

* #267 Update

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #267 Update

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #267 Update

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #267 Update format

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-03-23 09:26:58 +08:00
Jin Hai
9443af3e87
#1719 Remove unused log (#1720) 
Signed-off-by: jinhai <hai.jin@zilliz.com>
 2020-03-21 12:48:41 +08:00
BossZou
3c3617fd81
Mishards 070 (#1699) 
* update mishards to 0.7.0

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update mishards to 0.7.0

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix search bug and example pass

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add new api

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add segment stat

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix table info issue

Signed-off-by: yhz <413554850@qq.com>

* fix mishards api issue

Signed-off-by: yhz <413554850@qq.com>

* update mishards

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update all_in_one docker images

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix delete_by_id param parser & remove some comments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update yaml config file

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update all_in_one config

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove delete_by_range comments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update cmd api

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add warning when search

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update service_handler

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update shrads requiremtns

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* [skip ci] remove surplus log info

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-03-20 20:21:11 +08:00
groot
fe2595fa38
#1686 API search_in_files cannot work correctly when vectors is store… (#1701) 
* #1686 API search_in_files cannot work correctly when vectors is stored in certain non-default partition

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #1686 API search_in_files cannot work correctly when vectors is stored in certain non-default partition

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-20 12:14:07 +08:00
Cai Yudong
5950deddfc
#1678 remove CUSTOMIZATION macro (#1707) 
* #1678 remove CUSTOMIZATION macro

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* disable faiss_benchmark

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-20 10:24:27 +08:00
Cai Yudong
588ef95d76
Caiyd refactor knowhere (#1687) 
* add new knowhere

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* build pass

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* update

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* rename algo

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update...

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* add archive

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* add new APIs: GetVectorById/SearchVectorById/SetBlacklist/GetBlacklist

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* all unittest pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* test_binary pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move knowhere into namespace milvus

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update hnsw

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ConfAdapterMgr

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ExecutionEngineImpl

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move SetBlacklist/GetBlacklist to VecIndex

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update VectorAdapter and rename SearchById to QueryById

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update interface in ExecutionEngineImpl

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* milvus build pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* milvus IDMAP sdk_simple pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_server

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_schedule

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix CPU version Milvus build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update BinaryIVF BuildAll

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update VecIndexFactory

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ConfAdapter

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix knowhere unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix SPTAG unittest

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix CPU version unittest build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix db_test

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_engine

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_delete

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix CPU version build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change BinarySet key back

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change IndexType to string, and add compatible API for 0.7.0

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix IndexHNSW build warning

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix test_cache

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix write_index error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code clean

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Co-authored-by: Nicky <nicky.xj.lin@gmail.com>
Co-authored-by: xiaojun.lin <xiaojun.lin@zilliz.com>
 2020-03-19 19:24:20 +08:00
op-hunter
fdd51400d2
#1660 support IVFPQ CPU delete (#1695) 
* support IVFPQ CPU delete

Signed-off-by: lichengming <chengming.li@zilliz.com>

* update CHANGELOG.md

Signed-off-by: lichengming <chengming.li@zilliz.com>

Co-authored-by: lichengming <chengming.li@zilliz.com>
 2020-03-19 12:26:03 +08:00
BossZou
504a9e30ab
Optimize config cpu_cache_capacity / gpu_cache_capacity setter (#1572) (#1629) 
* add gpu cache config handler

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove cpu/gpu cache mgr from Config class by using cache config handler (fix #1572)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove 0.8.0 from config version map

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* clean config header reference

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix bug in web readme

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* reduce gpu config handler to gpu resources handler

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add engine config

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* modify handler hook(fix #1572)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update changlog

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* initalize value in handler by config default

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code style format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix compile error in release mode

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* resolve faiss blas threshold init in DBWrapper

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* modify cache header

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove comments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* order headers

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* convert gpu res config to lower case

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* CI retry

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* adjust header order in cpu cache mar file

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* improve config test case

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-03-19 10:17:53 +08:00
Xiaohai Xu
1543f8dc37
#1653 IndexFlat performance improvement for NQ < thread_number (#1690) 
* optimize sse

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* optimizer BinaryDistance

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix superstructure

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-03-18 18:27:57 +08:00
groot
55ecfd5930
#1663 PQ index parameter m validation (#1677) 
* #1663 PQ index parameter m validation

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failure

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-18 18:26:38 +08:00
Xiaohai Xu
59dab6cb84
#1653 IndexFlat performance improvement for NQ < thread_number (#1674) 
* Optimize index flat L2/IP for SSE

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* parallel optimization

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix threshold

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* add changelog

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* add changelog

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

Co-authored-by: sahuang <xiaohai.xu@zilliz.com>
 2020-03-16 21:32:05 +08:00
Zhiru Zhu
3de34d3831
#1619 (#1620) 
* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-16 19:33:28 +08:00
groot
802d62eb24
#1651 Check validity of dimension when collection metric type is binary one (#1666) 
* #1648 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>

* #1646 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>

* #1646 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>

* #1651 Check validity of dimension when collection metric type is binary one

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-03-16 16:26:12 +08:00
groot
6c826c1308
#1648 The cache cannot be used all when the type is binary (#1648) 
* #1648 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>

* #1646 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>

* #1646 The cache cannot be used all when the type is binary

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-15 20:45:11 +08:00
Cai Yudong
512fe6233c
#1649 fix Milvus crash on old cpu (#1652) 
* #1649 fix Milvus crash on old cpu

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1649 update debug log

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry CI

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-14 18:03:23 +08:00
shengjun.li
4088f5e9a2
#1603 BinaryFlat add 2 Metrics: Substructure and Superstructure (#1647) 
* add substructure & superstructure

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* support c++sdk by lin.xiaojun

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* optimizer omp for BinaryFlat; add tutorial

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-03-14 10:03:00 +08:00
shengjun.li
7c3a673bfe
check table lsn (#1622) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-03-13 11:56:12 +08:00
BossZou
dfa25f88e2
fix demo bug in HTTP doc (fix #1634) (#1640) 
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-03-13 11:16:55 +08:00
yudong.cai
4cf2b2b392 Merge remote-tracking branch 'main/master' into caiyd_1548_move_store 2020-03-12 20:05:57 +08:00
Zhiru Zhu
7ec0444dc0
update 
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-12 16:57:52 +08:00
Zhiru Zhu
7ac4e95e86
update 
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-12 16:44:43 +08:00
yudong.cai
7fc237f4bd retry CI 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-12 14:49:11 +08:00
yudong.cai
acfd6415a8 retry CI 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-12 14:36:12 +08:00
yudong.cai
a279da832e #1548 move store/Directory to storage and add FSHandler 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-12 11:43:50 +08:00
yudong.cai
68ba8baa4e #1547 update changelog 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-12 09:37:14 +08:00
yudong.cai
41db1d7a5c update changelog 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-11 23:56:05 +08:00
yudong.cai
16aa46f6af #1547 update changelog 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-11 21:05:00 +08:00
yudong.cai
4707493026 #1547 update changelog 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-03-11 18:48:12 +08:00
Jin Hai
87214f742b
Merge pull request #1550 from cydrain/caiyd_1546_move_config 
Caiyd 1546 move config
 2020-03-11 18:41:35 +08:00
Jin Hai
ad0f26f98e
Merge pull request #1538 from cydrain/caiyd_codec_opt 
Caiyd codec opt
 2020-03-11 18:41:17 +08:00
JinHai-CN
87b6ee6aa8 Update CHANGELOG 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-03-11 15:54:50 +08:00
JinHai-CN
2f815a7d83 Update Changelog 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-03-11 15:02:26 +08:00
yudong.cai
49db61ea50 Merge remote-tracking branch 'main/master' into caiyd_1546_move_config 2020-03-11 00:10:22 +08:00
yudong.cai
b50f23d4d6 Merge remote-tracking branch 'main/master' into caiyd_1546_move_config 2020-03-10 22:09:27 +08:00
groot
17ec3d5e21 #1609 Refine Compact function 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-10 18:58:50 +08:00
Jin Hai
2a6e70d5f0
Merge branch 'master' into fix#1598 2020-03-10 18:10:23 +08:00
Zhiru Zhu
4625bf3710
update 
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-10 16:40:17 +08:00
Yhz
84689fdac5 [skip ci] update changlog 
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-03-10 14:09:19 +08:00
Jin Hai
0bac06a50d
Merge pull request #1589 from tinkerlin/fix_1517 
fix 1517
 2020-03-10 11:28:13 +08:00
Jin Hai
0be8bec09b
Merge branch 'master' into fix#1590 2020-03-10 11:13:33 +08:00
Jin Hai
ff0aad8123
Merge branch 'master' into fix_1517 2020-03-10 09:34:16 +08:00
JinHai-CN
d466f3d447 Update CHANGELOG.md 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-03-10 01:05:07 +08:00
JinHai-CN
66a14e16e8 Update CHANGELOG.md 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-03-10 01:03:32 +08:00
Zhiru Zhu
f811753c62
update 
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-09 23:33:12 +08:00
groot
13d3cff9b7 #1580 Old segment folder not removed after merge / compact if create_index is called before adding data 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-03-09 20:52:10 +08:00
Zhiru Zhu
593077e85b
update 
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
 2020-03-09 20:40:40 +08:00