test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-05 05:18:52 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
5,484 Commits 96 Branches 105 Tags 186 MiB
83cbe0f490
Commit Graph

1148 Commits

Author SHA1 Message Date
shengjun.li
83cbe0f490
fix hamming (#3338) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-08-20 09:42:04 +08:00
MXDA
1962b6e78b
Specifying distance type at runtime for Flat index (#3273) 
* modfied IndexIDMAP.cpp && SearchTask.cpp

Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>

* Specifying distance type at runtime for Flat index(CPU)

Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>

* Specifying distance type at runtime for Flat index(GPU)

Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>

Co-authored-by: Zhengda Wu <wuzhengda55@gmail.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
 2020-08-17 17:05:59 +08:00
shengjun.li
5f830293f9
rm find faiss (#3269) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-08-15 19:18:03 +08:00
jinhai
f59c240457 Update to 0.10.3 
Signed-off-by: jinhai <hai.jin@zilliz.com>
 2020-08-15 16:21:43 +08:00
shengjun.li
43c272fd13
fix annoy l2 (#3232) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-08-12 19:11:13 +08:00
Xiaohai Xu
058cdf03bb
Add ivf index nprobe logging (#3070) 
* add nprobe logging

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* add all cases

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
 2020-08-01 09:46:53 +08:00
shengjun.li
09cf1b323e
fix crash when GPU search (#3074) 
* fix crash when GPU search

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-07-31 09:46:55 +08:00
shengjun.li
b1b1165c56
Opt faiss builder (#3067) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-07-31 09:35:31 +08:00
shengjun.li
1c36e6d83d
optimizer parallel policy (#3014) 
* optimizer parallel policy

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* modify parallel policy

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-07-26 01:37:23 +08:00
BossZou
c394608d4f
[skip ci] Up to v0.10.2 (#3006) 
Signed-off-by: yhz <413554850@qq.com>
 2020-07-25 10:02:09 +08:00
cqy123456
91d3fe5cbc
Improve IVF search performance when NQ and nProbe are both large (#2984) 
* fix indexflat  search

Signed-off-by: cqy <yaya645@126.com>

* add parallel_policy_threshold

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
 2020-07-24 15:56:47 +08:00
Tinkerrr
dd938878ea
fix (#2981) 
Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>
 2020-07-23 17:02:28 +08:00
shengjun.li
3908d10498
Fix the result merging of IVF_PQ IP (#2953) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-07-22 10:08:05 +08:00
shengjun.li
a88f5b6cbb
Fix index size (#2941) 
* add virtual IF UpdateIndexSize

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* update ivf index size

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix PQ logic

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix index size of index hnsw, annoy and nsg

Signed-off-by: cmli <chengming.li@zilliz.com>

* add GetSize() interface 4 SPTAG

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix binary ivf

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: sahuang <xiaohai.xu@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
 2020-07-21 14:26:08 +08:00
groot
f31a81ab16
add error log for empty result (#2923) 
* add error log for empty result

Signed-off-by: groot <yihua.mo@zilliz.com>

* add error log for empty result

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-07-18 19:30:29 +08:00
godchen0212
c083556189
add web_impl util unittest (#2886) 
* add testcase of empty vector insert

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format python code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* add web_impl util unittest

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-07-18 10:38:46 +08:00
Tinkerrr
8046f2946e
Hotfix 2487 (#2892) 
* update.

Signed-off-by: Tinkerrr <linxiaojun.cn@outlook.com>

* update.

Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>

* add fd check

Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>

* fix

Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>
 2020-07-17 21:00:42 +08:00
Wang XiangYu
283e087a78
add config value gpu.cache.enable (#2899) 
* add config value gpu.cache.enable

Signed-off-by: wxyu <xy.wang@zilliz.com>

* clang-format

Signed-off-by: wxyu <xy.wang@zilliz.com>

* clang-format

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix ut

Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-07-17 20:59:31 +08:00
XuanYang-cn
8135cee414
Add some cpp unittests about scheduler algorithm (#2888) 
* add some testcases

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* reformat code

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
 2020-07-16 19:46:21 +08:00
XuanYang-cn
ea58edc128
Add python functional tests about timeout (#2793) 
* Add python tests about param timeout

Signed-off-by: yangxuan <jumpthepig@gmail.com>

* add faiss configure args msg print

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* change assertion conditions

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
 2020-07-15 14:32:40 +08:00
yukun
a474ff269a
Server down during loading data (#2807) 
* Server down during loading data

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_config.cpp

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* ci retry

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change limit_in_bytes init value to max

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-07-14 00:40:20 +08:00
cqy123456
585c8ea018
fix rnsg ip (#2827) 
Signed-off-by: cqy <yaya645@126.com>
 2020-07-13 14:05:28 +08:00
groot
5447abec5b
fix #2768 (#2809) 
* fix #2752

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix #2768

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo again

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-07-12 15:41:45 +08:00
cqy123456
bdebffa73c
fix search error (#2806) 
* fix search error

Signed-off-by: cqy <yaya645@126.com>

* fix search in test_web

Signed-off-by: cqy <yaya645@126.com>
 2020-07-11 13:34:15 +08:00
groot
d7c47a7905
fix #2752 (#2789) 
* fix #2752

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-07-10 16:49:47 +08:00
BossZou
a970c7f2fd
Add log to check search result structure (#2786) 
* Add log to check search result structure

Signed-off-by: yhz <413554850@qq.com>

* CI retry

Signed-off-by: yhz <413554850@qq.com>

* Retry

Signed-off-by: yhz <413554850@qq.com>
 2020-07-10 09:46:21 +08:00
op-hunter
4922c9532f
fix a bug of getting wrong nprobe limitation in knowhere on GPU version (#2788) 
* fix a bug of getting wrong nprobe limitation in knowhere on GPU version

Signed-off-by: cmli <chengming.li@zilliz.com>

* update changelog and fix build error

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
 2020-07-09 23:15:07 +08:00
shengjun.li
4038b0653e
fix too many data copies (#2784) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-07-09 09:23:49 +08:00
Wang XiangYu
cf47007545
update config gpu_search_threshold description (#2748) 
Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>
 2020-07-06 12:59:44 +08:00
BossZou
5bd75f9381 Web fix 2690 (#2691) 
* Remove body parser in show partitions endpoints (fix #2690)

Signed-off-by: yhz <413554850@qq.com>

* Remove surplus output and comments

Signed-off-by: yhz <413554850@qq.com>

* Remove surplus output and comments

Signed-off-by: yhz <413554850@qq.com>

* Remove space line

Signed-off-by: yhz <413554850@qq.com>

* Remove surplus ut

Signed-off-by: yhz <413554850@qq.com>

* laten sleep time in case test_delete_vector_collection_count_no_flush

Signed-off-by: yhz <413554850@qq.com>
 2020-07-04 16:31:03 +08:00
groot
367c72675c
#2692 Milvus hangs during multi-thread concurrent search (#2715) 
* #2642 Create index failed caused by server crashed.

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #2692 Milvus hangs during multi-thread concurrent search

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-07-02 19:03:24 +08:00
groot
714b777d05
#2642 Create index failed caused by server crashed. (#2701) 
* #2642 Create index failed caused by server crashed.

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-07-02 09:37:15 +08:00
shengjun.li
36db2f4da4
fix vectors format (#2677) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-06-28 17:50:55 +08:00
Jin Hai
0b16c92ccc
Increase GRPC concurrency (#2671) 
* Increase GRPC concurrency

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix lint

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Add limitation

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compilation error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compilation error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compilation error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-06-26 12:16:44 +08:00
shengjun.li
0fb88f733a
fix too many copies (#2660) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-06-24 09:46:48 +08:00
groot
ed012f2980
Flush data when insert buffer is full (#2659) 
* fix potential problem

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* insert buffer full trigger flush

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* cleanup files if no collection flushed

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* format

Signed-off-by: yhmo <yihua.mo@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-06-24 09:23:20 +08:00
op-hunter
3b38f7f198
#2649 Remove annoy search parameter validation (#2650) 
* remove annoy search parameter validation

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix test failed

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix lint error

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix lint error again

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
 2020-06-23 23:41:04 +08:00
Xiaohai Xu
d4fc48bfa7
Fix naming inconsistency (#2654) 
* fix naming

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix clang-format

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
 2020-06-23 20:23:14 +08:00
groot
d15487656c
fix potential problem (#2657) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-06-23 15:30:21 +08:00
shengjun.li
cd04f3fc9f
Suit the range of HNSW parameters (#2638) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-06-22 16:42:15 +08:00
groot
0500d26ce2
Merge pull request #2644 from yhmo/v101 
Add internal switch to enable/disable search combine
 2020-06-22 14:36:53 +08:00
groot
cb09380c6c typo 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-06-21 21:33:05 +08:00
groot
ac7403f00b search combine configable 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-06-21 19:03:21 +08:00
groot
6e8fc976f3
#2640 (#2641) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-06-20 20:31:35 +08:00
groot
69eb1d254e #2640 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-06-20 17:47:10 +08:00
shengjun.li
48e8cd36c2
Fix HNSW and RNSG index files size (#2618) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-06-20 14:06:05 +08:00
Cai Yudong
6ac3d2bd08 fix Milvus docker image report illegal instruction (#2598) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-06-19 10:44:23 +08:00
shengjun.li
290ff2e439 Support IVF_PQ on GPU with using metric_type IP (#2593) 
* Support IVF_PQ on GPU with using metric_type IP

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* remove useless code

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-06-19 10:42:23 +08:00
groot
508da260ca fix #2578 (#2591) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-06-19 10:35:07 +08:00
groot
36d2214fc9 fix random crash of INSERT_DUPLICATE_ID case (#2557) 
* fix random crash of INSERT_DUPLICATE_ID case

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* cahnge ver

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* sdk readme

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut failure

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-06-19 10:33:08 +08:00