test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-05 05:18:52 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
5,491 Commits 96 Branches 105 Tags 186 MiB
996c591088
Commit Graph

1151 Commits

Author SHA1 Message Date
FluorineDog
996c591088 Enable Segment Naive and Base, support Collection 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-08-26 16:49:03 +08:00
become-nice
b8f012d8f0 Add interface of writenode 
Signed-off-by: become-nice <995581097@qq.com>
 2020-08-24 11:58:51 +08:00
yefu.chen
49058d5dfb start 2.0 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-04-21 11:37:21 +08:00
shengjun.li
83cbe0f490
fix hamming (#3338) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-08-20 09:42:04 +08:00
MXDA
1962b6e78b
Specifying distance type at runtime for Flat index (#3273) 
* modfied IndexIDMAP.cpp && SearchTask.cpp

Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>

* Specifying distance type at runtime for Flat index(CPU)

Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>

* Specifying distance type at runtime for Flat index(GPU)

Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>

Co-authored-by: Zhengda Wu <wuzhengda55@gmail.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
 2020-08-17 17:05:59 +08:00
shengjun.li
5f830293f9
rm find faiss (#3269) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-08-15 19:18:03 +08:00
jinhai
f59c240457 Update to 0.10.3 
Signed-off-by: jinhai <hai.jin@zilliz.com>
 2020-08-15 16:21:43 +08:00
shengjun.li
43c272fd13
fix annoy l2 (#3232) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-08-12 19:11:13 +08:00
Xiaohai Xu
058cdf03bb
Add ivf index nprobe logging (#3070) 
* add nprobe logging

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* add all cases

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
 2020-08-01 09:46:53 +08:00
shengjun.li
09cf1b323e
fix crash when GPU search (#3074) 
* fix crash when GPU search

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-07-31 09:46:55 +08:00
shengjun.li
b1b1165c56
Opt faiss builder (#3067) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-07-31 09:35:31 +08:00
shengjun.li
1c36e6d83d
optimizer parallel policy (#3014) 
* optimizer parallel policy

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* modify parallel policy

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-07-26 01:37:23 +08:00
BossZou
c394608d4f
[skip ci] Up to v0.10.2 (#3006) 
Signed-off-by: yhz <413554850@qq.com>
 2020-07-25 10:02:09 +08:00
cqy123456
91d3fe5cbc
Improve IVF search performance when NQ and nProbe are both large (#2984) 
* fix indexflat  search

Signed-off-by: cqy <yaya645@126.com>

* add parallel_policy_threshold

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
 2020-07-24 15:56:47 +08:00
Tinkerrr
dd938878ea
fix (#2981) 
Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>
 2020-07-23 17:02:28 +08:00
shengjun.li
3908d10498
Fix the result merging of IVF_PQ IP (#2953) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-07-22 10:08:05 +08:00
shengjun.li
a88f5b6cbb
Fix index size (#2941) 
* add virtual IF UpdateIndexSize

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* update ivf index size

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix PQ logic

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix index size of index hnsw, annoy and nsg

Signed-off-by: cmli <chengming.li@zilliz.com>

* add GetSize() interface 4 SPTAG

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix binary ivf

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: sahuang <xiaohai.xu@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
 2020-07-21 14:26:08 +08:00
groot
f31a81ab16
add error log for empty result (#2923) 
* add error log for empty result

Signed-off-by: groot <yihua.mo@zilliz.com>

* add error log for empty result

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-07-18 19:30:29 +08:00
godchen0212
c083556189
add web_impl util unittest (#2886) 
* add testcase of empty vector insert

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format python code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* add web_impl util unittest

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>

* format code

Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2020-07-18 10:38:46 +08:00
Tinkerrr
8046f2946e
Hotfix 2487 (#2892) 
* update.

Signed-off-by: Tinkerrr <linxiaojun.cn@outlook.com>

* update.

Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>

* add fd check

Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>

* fix

Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>
 2020-07-17 21:00:42 +08:00
Wang XiangYu
283e087a78
add config value gpu.cache.enable (#2899) 
* add config value gpu.cache.enable

Signed-off-by: wxyu <xy.wang@zilliz.com>

* clang-format

Signed-off-by: wxyu <xy.wang@zilliz.com>

* clang-format

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix ut

Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-07-17 20:59:31 +08:00
XuanYang-cn
8135cee414
Add some cpp unittests about scheduler algorithm (#2888) 
* add some testcases

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* reformat code

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
 2020-07-16 19:46:21 +08:00
XuanYang-cn
ea58edc128
Add python functional tests about timeout (#2793) 
* Add python tests about param timeout

Signed-off-by: yangxuan <jumpthepig@gmail.com>

* add faiss configure args msg print

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* change assertion conditions

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
 2020-07-15 14:32:40 +08:00
yukun
a474ff269a
Server down during loading data (#2807) 
* Server down during loading data

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_config.cpp

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* ci retry

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change limit_in_bytes init value to max

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-07-14 00:40:20 +08:00
cqy123456
585c8ea018
fix rnsg ip (#2827) 
Signed-off-by: cqy <yaya645@126.com>
 2020-07-13 14:05:28 +08:00
groot
5447abec5b
fix #2768 (#2809) 
* fix #2752

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix #2768

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo again

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-07-12 15:41:45 +08:00
cqy123456
bdebffa73c
fix search error (#2806) 
* fix search error

Signed-off-by: cqy <yaya645@126.com>

* fix search in test_web

Signed-off-by: cqy <yaya645@126.com>
 2020-07-11 13:34:15 +08:00
groot
d7c47a7905
fix #2752 (#2789) 
* fix #2752

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-07-10 16:49:47 +08:00
BossZou
a970c7f2fd
Add log to check search result structure (#2786) 
* Add log to check search result structure

Signed-off-by: yhz <413554850@qq.com>

* CI retry

Signed-off-by: yhz <413554850@qq.com>

* Retry

Signed-off-by: yhz <413554850@qq.com>
 2020-07-10 09:46:21 +08:00
op-hunter
4922c9532f
fix a bug of getting wrong nprobe limitation in knowhere on GPU version (#2788) 
* fix a bug of getting wrong nprobe limitation in knowhere on GPU version

Signed-off-by: cmli <chengming.li@zilliz.com>

* update changelog and fix build error

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
 2020-07-09 23:15:07 +08:00
shengjun.li
4038b0653e
fix too many data copies (#2784) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-07-09 09:23:49 +08:00
Wang XiangYu
cf47007545
update config gpu_search_threshold description (#2748) 
Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>
 2020-07-06 12:59:44 +08:00
BossZou
5bd75f9381 Web fix 2690 (#2691) 
* Remove body parser in show partitions endpoints (fix #2690)

Signed-off-by: yhz <413554850@qq.com>

* Remove surplus output and comments

Signed-off-by: yhz <413554850@qq.com>

* Remove surplus output and comments

Signed-off-by: yhz <413554850@qq.com>

* Remove space line

Signed-off-by: yhz <413554850@qq.com>

* Remove surplus ut

Signed-off-by: yhz <413554850@qq.com>

* laten sleep time in case test_delete_vector_collection_count_no_flush

Signed-off-by: yhz <413554850@qq.com>
 2020-07-04 16:31:03 +08:00
groot
367c72675c
#2692 Milvus hangs during multi-thread concurrent search (#2715) 
* #2642 Create index failed caused by server crashed.

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #2692 Milvus hangs during multi-thread concurrent search

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-07-02 19:03:24 +08:00
groot
714b777d05
#2642 Create index failed caused by server crashed. (#2701) 
* #2642 Create index failed caused by server crashed.

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-07-02 09:37:15 +08:00
shengjun.li
36db2f4da4
fix vectors format (#2677) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-06-28 17:50:55 +08:00
Jin Hai
0b16c92ccc
Increase GRPC concurrency (#2671) 
* Increase GRPC concurrency

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix lint

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Add limitation

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compilation error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compilation error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compilation error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-06-26 12:16:44 +08:00
shengjun.li
0fb88f733a
fix too many copies (#2660) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-06-24 09:46:48 +08:00
groot
ed012f2980
Flush data when insert buffer is full (#2659) 
* fix potential problem

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* insert buffer full trigger flush

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* cleanup files if no collection flushed

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* format

Signed-off-by: yhmo <yihua.mo@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-06-24 09:23:20 +08:00
op-hunter
3b38f7f198
#2649 Remove annoy search parameter validation (#2650) 
* remove annoy search parameter validation

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix test failed

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix lint error

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix lint error again

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
 2020-06-23 23:41:04 +08:00
Xiaohai Xu
d4fc48bfa7
Fix naming inconsistency (#2654) 
* fix naming

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix clang-format

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
 2020-06-23 20:23:14 +08:00
groot
d15487656c
fix potential problem (#2657) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-06-23 15:30:21 +08:00
shengjun.li
cd04f3fc9f
Suit the range of HNSW parameters (#2638) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-06-22 16:42:15 +08:00
groot
0500d26ce2
Merge pull request #2644 from yhmo/v101 
Add internal switch to enable/disable search combine
 2020-06-22 14:36:53 +08:00
groot
cb09380c6c typo 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-06-21 21:33:05 +08:00
groot
ac7403f00b search combine configable 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-06-21 19:03:21 +08:00
groot
6e8fc976f3
#2640 (#2641) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-06-20 20:31:35 +08:00
groot
69eb1d254e #2640 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-06-20 17:47:10 +08:00
shengjun.li
48e8cd36c2
Fix HNSW and RNSG index files size (#2618) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-06-20 14:06:05 +08:00
Cai Yudong
6ac3d2bd08 fix Milvus docker image report illegal instruction (#2598) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-06-19 10:44:23 +08:00