test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-11 01:16:09 +08:00
Code Issues Actions 16 Packages Projects Releases Wiki Activity
5,593 Commits 97 Branches 105 Tags 189 MiB
6bc7e6d372
Commit Graph

1205 Commits

Author SHA1 Message Date
groot
6e8fc976f3
#2640 (#2641) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-06-20 20:31:35 +08:00
groot
69eb1d254e #2640 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-06-20 17:47:10 +08:00
shengjun.li
48e8cd36c2
Fix HNSW and RNSG index files size (#2618) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-06-20 14:06:05 +08:00
Cai Yudong
6ac3d2bd08 fix Milvus docker image report illegal instruction (#2598) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-06-19 10:44:23 +08:00
shengjun.li
290ff2e439 Support IVF_PQ on GPU with using metric_type IP (#2593) 
* Support IVF_PQ on GPU with using metric_type IP

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* remove useless code

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-06-19 10:42:23 +08:00
groot
508da260ca fix #2578 (#2591) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-06-19 10:35:07 +08:00
groot
36d2214fc9 fix random crash of INSERT_DUPLICATE_ID case (#2557) 
* fix random crash of INSERT_DUPLICATE_ID case

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* cahnge ver

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* sdk readme

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut failure

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-06-19 10:33:08 +08:00
JinHai-CN
bd7e0ee5c9 Update code due to 0.10.1 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-06-19 10:07:55 +08:00
Wang XiangYu
5f3c005247
fix cache.cache_size range check error (#2565) 
* fix cache.cache_size range check error

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update ci

Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-06-15 22:44:58 +08:00
BossZou
1f443acb3b
Mishards 010 upgrade & Add config unit in demo config (#2550) 
* Update mishards config

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Update mishards config

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Upgrade mishards for milvus v0.10.0 (fix #2548)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Launch server fail using demo config (#2549)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* [skip ci] Remove surplus config yaml

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-06-13 19:45:31 +08:00
Wang XiangYu
bcd3de2b41
[skip ci]update comments in config file (#2542) 
* update comments in config file

Signed-off-by: wxyu <xy.wang@zilliz.com>

* Update config

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
 2020-06-13 14:06:10 +08:00
Wang XiangYu
83cc812935
Upgrade config (#2511) 
* enable cron test on 0.10.0

Signed-off-by: zw <zw@milvus.io>

* fix merge result

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* import test_during_creating_index_restart

Signed-off-by: zw <zw@milvus.io>

* config cluster

Signed-off-by: wxyu <xy.wang@zilliz.com>

* config general

Signed-off-by: wxyu <xy.wang@zilliz.com>

* config network

Signed-off-by: wxyu <xy.wang@zilliz.com>

* config storage

Signed-off-by: wxyu <xy.wang@zilliz.com>

* config wal

Signed-off-by: wxyu <xy.wang@zilliz.com>

* config cache

Signed-off-by: wxyu <xy.wang@zilliz.com>

* config gpu and metrics

Signed-off-by: wxyu <xy.wang@zilliz.com>

* config logs

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update server_config.template

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update changelog

Signed-off-by: wxyu <xy.wang@zilliz.com>

* config with unit

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix clang-format

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update unittests

Signed-off-by: wxyu <xy.wang@zilliz.com>

* disable restart case

Signed-off-by: zw <zw@milvus.io>

* fix gpu compile failed

Signed-off-by: wxyu <xy.wang@zilliz.com>

* Fix lint and comments

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* fix wal unittest failed

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix some unittests

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update config test cases

Signed-off-by: zw <zw@milvus.io>

* Fix config error

Signed-off-by: yhz <413554850@qq.com>

* remove unused code

Signed-off-by: wxyu <xy.wang@zilliz.com>

* Update CHANGELOG

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* [skip-ci] fix test cases

Signed-off-by: zw <zw@milvus.io>

* fix config storage

Signed-off-by: wxyu <xy.wang@zilliz.com>

* make -j3 on ci

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update python test

Signed-off-by: wxyu <xy.wang@zilliz.com>

* remove unused code

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix ut

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix ut

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update status message

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix set config bug

Signed-off-by: wxyu <xy.wang@zilliz.com>

Co-authored-by: zw <zw@milvus.io>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
Co-authored-by: yhz <413554850@qq.com>
 2020-06-12 09:22:26 +08:00
yukun
a9629951e4
Improve ut coverage (#2516) (#2522) 
* Improve ut coverage

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Delete unused code

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add fiu in HybridSearchRequest

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Update helm config

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Change BinaryQuery validation check

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* code format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* code format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* code format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
 2020-06-11 18:45:14 +08:00
BossZou
551be85d83
Improve ut coverage (#2516) (#2517) 
* Improve ut coverage (#2516)

Signed-off-by: yhz <413554850@qq.com>

* Improve ut coverage

Signed-off-by: yhz <413554850@qq.com>

* CI retry

Signed-off-by: yhz <413554850@qq.com>

* Update helm config

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* CI retry

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* CI retry

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
 2020-06-11 01:25:55 +00:00
groot
19a9d0d1f3
revert code (#2525) 
* revert code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-06-10 19:27:36 +08:00
Jin Hai
34b4d72517
Add exception throw on mysql meta error (#2490) 
* Add exception throw on mysql meta error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix lint

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* [skip ci] update changelog

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Update

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Update

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix Unit test

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-06-08 21:16:22 +08:00
groot
bd0049ff14
return hnsw name (#2501) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-06-07 12:03:01 +00:00
Cai Yudong
8254e9ed67
fix performance (#2499) 
* optimize sq_get_distance_computer

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add sq_select_inverted_list_scanner_ref

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add sq_select_inverted_list_scanner_avx

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add sq_select_inverted_list_scanner_avx512

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize Codec

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize ScalarQuantizerCodec_avx.h

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize ScalarQuantizerCodec_avx512.h

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* clean code

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-06-06 07:41:57 +00:00
groot
9f7995cbba
default nlist 2048 (#2498) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-06-06 05:03:06 +00:00
Jin Hai
4b5eff3672
Fix 2495: Add more reason of creating lock file failed (#2496) 
* Fix 2495: Add more reason of creating lock file failed

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix 2495: Update changelog

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix lint

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix lint

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compile error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-06-05 01:58:17 +00:00
BossZou
167743c993
read_only node detect delete vector operation using mishards #2368 (#2473) 
* Add new request ReLoadSegments

Signed-off-by: yhz <413554850@qq.com>

* Finish load segments functionality

Signed-off-by: yhz <413554850@qq.com>

* Add api in grpc

Signed-off-by: yhz <413554850@qq.com>

* update Reloadsegments

Signed-off-by: yhz <413554850@qq.com>

* .

Signed-off-by: yhz <413554850@qq.com>

* create new blacklist if not exists

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update api names

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Finish mishard for support api reloadsegments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update changlog

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add more details when failed in search task

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Fix compile issue

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update mishards requirements

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Code format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* modify docker images in mysql all_in_one

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update shards code

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Move updatedeldocs function to dbimpl

Signed-off-by: yhz <413554850@qq.com>

* Move reload segment del docs function to dbimpl

Signed-off-by: yhz <413554850@qq.com>

* [skip ci] correct shards requirements

Signed-off-by: yhz <413554850@qq.com>
 2020-06-02 14:34:19 +08:00
groot
0710ececae
#2373 Build index for small segment waste time on waiting background index thread finish (#2482) 
* #2349 Drop collection timeout if too many partitions created on collection

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #2373 Build index for small segment waste time on waiting background index thread finish

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-06-01 10:16:37 +00:00
shengjun.li
257ea7782f
fix merge result (#2463) 
* fix merge result

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix tests

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-06-01 07:31:58 +00:00
groot
1daf00dcf7
#2394 Drop collection timeout if too many partitions created on colle… (#2477) 
* #2349 Drop collection timeout if too many partitions created on collection

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-06-01 11:19:50 +08:00
op-hunter
9de7f710e6
optimize the implemention of k-selection on faiss gpu version (#2467) 
* optimize the implemention of k-selection on faiss gpu version

Signed-off-by: cmli <chengming.li@zilliz.com>

* update change log, re-classified the pr from feature to improvement

Signed-off-by: cmli <chengming.li@zilliz.com>

* update change log

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
 2020-05-30 04:27:59 +00:00
groot
ae98a92fc9 merge before index 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-05-29 20:00:57 +08:00
op-hunter
cab9e5c2a6 fix bug of openblas library install fail (#2457) 
* fix bug of openblas library install fail

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix openblas install cmakelist error

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
 2020-05-29 20:00:24 +08:00
BossZou
0e25bab619
Fix inconsistent reading and writing when using mishards (# 2367) (#2442) 
* Fix inconsistent reading and writing when using mishards (# 2367)

Signed-off-by: yhz <413554850@qq.com>

* CI retry

Signed-off-by: yhz <413554850@qq.com>
 2020-05-29 13:32:49 +08:00
shengjun.li
7c72dcf4d3
fix search by GPU (#2453) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-05-28 15:39:16 +00:00
Cai Yudong
f4aeca2988
improve knowhere coverage (#2444) 
* increase nb for NSG code coverage

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* test more APIs in test_annoy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* disable get_vector_by_id and search_by_id

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* improve code coverage

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* improve code coverage

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* install test_instructionset

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-05-28 10:22:14 +08:00
groot
dcb60f3021
performance issues (#2438) 
* performance issues

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix bugs

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* preload collection issue

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* uncomment boring log

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* reduce unittest time

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* reduce metric test time cost

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-05-28 00:19:08 +08:00
Cai Yudong
ce4dcf69ae
add debug APIs and update GPU temp memory size (#2420) 
* add debug APIs and update GPU temp memory size

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update thread name

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update DESIGN.md

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-05-26 14:39:44 +08:00
groot
2d9b358e16
optimize merge process (#2419) 
* optimize merge process

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* drop collecion issue

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-05-25 14:19:25 +08:00
shengjun.li
2982004e2b
midify Binary IVF in faiss 1.6.3 (#2416) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-05-23 11:01:54 +00:00
Xiaohai Xu
6809150b1d
#2395 Fix large nq cudaMalloc (#2409) 
* fix large nq cuda malloc issue

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix clang format

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* Change log

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
 2020-05-23 08:23:05 +00:00
groot
077dfa4092
Wal lsn issue (#2412) 
* set wal lsn after all mem files serialized

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* return status

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-05-23 06:51:18 +00:00
groot
4ce3e2c03c
#2366 Reduce SQL execution times (#2383) 
* #2366

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-05-23 11:13:09 +08:00
groot
4f6fe96550
mysql meta connection pool issue (#2413) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-05-23 01:26:15 +00:00
Wang XiangYu
e40f0b3939
logging build index progress (#2411) 
Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-05-22 13:10:24 +00:00
Cai Yudong
344ae823b2
#2353 remove log_config (#2406) 
* remove log_config from code and script

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update script

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-05-22 10:57:16 +00:00
Jin Hai
2c2e1bb8f1
#2403 MySQL max_idle_time is 10 by default (#2405) 
* #2403 MySQL max_idle_time is 10 by default

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #2403 MySQL max_idle_time is 10 by default

Signed-off-by: jinhai <hai.jin@zilliz.com>
 2020-05-22 14:35:11 +08:00
shengjun.li
34fdc00d19
fix MatchNlist (#2401) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-05-22 06:20:26 +00:00
Cai Yudong
386e58ce0d
upgrade faiss 1.6.3 (#2400) 
* roll back to original faiss 1.6.0

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update to faiss_1.6.3

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* patch all change to faiss 1.6.3

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* faiss CPU version build pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* faiss GPU version build pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-05-22 01:27:16 +00:00
groot
4c9684366c
#2378 (#2388) 
* return partition lsn

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix wal lsn

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix wal issue

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* all collection include partition

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix build error

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix flush

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
 2020-05-21 02:13:46 +00:00
Cai Yudong
b532a69c8b
clean compile warning (#2380) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-05-19 17:58:23 +00:00
JinHai-CN
b616dcb761 Update branch 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-05-19 11:27:57 +08:00
groot
014a0e860c
QPS decrease (#2372) 
* optimize merge strategy

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #2365

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* optimize search

Signed-off-by: groot <yihua.mo@zilliz.com>

* code format

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-05-19 11:21:53 +08:00
Cai Yudong
b9e8acb5b2
#2370 clean compile warning (#2371) 
* #2370 clean compile warning

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-05-18 02:35:14 +00:00
Cai Yudong
42f751047e
update branch version to 0.9.1 (#2364) 
* update branch version to 0.9.1

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update test version

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-05-17 04:36:42 +00:00
Cai Yudong
eba33cc46d
Caiyd 090 rename config (#2340) 
* rename config items

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update config unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update config unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update log rotate default value

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update parameter usage in LogUtil.cpp (#3)

Signed-off-by: wxyu <xy.wang@zilliz.com>

* retry ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix ut

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
Co-authored-by: Wang XiangYu <scsven@qq.com>
 2020-05-14 17:57:18 +00:00
BossZou
860cc97a06
[skip ci] Update http document for v0.9.0 (#2347) (#2348) 
Signed-off-by: yhz <413554850@qq.com>
 2020-05-14 23:42:01 +08:00
BossZou
3c7c9ad645
Change url for behavior 'get_entities_by_id' (#2330) (#2336) 
Signed-off-by: yhz <413554850@qq.com>
 2020-05-14 21:01:20 +08:00
groot
b7f410e43f
#2338 (#2345) 
* fix #2264

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* Remove unnecessary memcpy

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* remove SearchByID from C++SDK

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #2338

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-05-14 20:50:26 +08:00
groot
244d0e3405
Remove unnecessary memcpy (#2337) 
* fix #2264

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* Remove unnecessary memcpy

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-05-14 18:00:23 +08:00
groot
b351c63cce
fix #2264 (#2323) 
* fix #2264

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-05-13 18:55:58 +08:00
BossZou
1b7aeaffdf
Fix server start failed when mode is 'read_only' (#2294) 
* fix deploy bug

Signed-off-by: yhz <413554850@qq.com>

* fix unittest fail

Signed-off-by: yhz <413554850@qq.com>

* remove unused yml

Signed-off-by: yhz <413554850@qq.com>

* change to readonly

Signed-off-by: yhz <413554850@qq.com>
 2020-05-12 09:28:10 +08:00
groot
fb49e580c5
rewrite HasPartition (#2289) 
* rewrite HasPartition

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* miss file

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* use layered merge

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* sdk HasPartition

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* rename sdk api

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
 2020-05-12 09:27:58 +08:00
shengjun.li
bc74d16376
#2283 Suspend the building tasks when any query command arrives (#2285) 
* add builder suspend

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* IndexIVF builder check wait

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* Build suspend for all IVF

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* HNSW suspend

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* HNSW suspend

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* HNSW suspend

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* HNSW suspend

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* HNSW suspend

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* cpubuilder

Signed-off-by: wxyu <xy.wang@zilliz.com>

* add suspend check during annoy build index

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix hnsw

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix changelog

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix clang format

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* suspend nsg

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: sahuang <xiaohai.xu@zilliz.com>
Co-authored-by: wxyu <xy.wang@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
 2020-05-12 09:27:45 +08:00
op-hunter
b6e16af8f8
update unittest config version (#2299) 
Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
 2020-05-11 22:00:21 +08:00
groot
f32cba6111
Merge strategy (#2277) 
* merge manager

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix build error

Signed-off-by: groot <yihua.mo@zilliz.com>

* layered merge strategy

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

* use simple

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix parallel multi collections query crashissue

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-05-11 01:38:50 +00:00
Wang XiangYu
369743c10d
Config upgrade (#2281) 
* upgrade config to 0.4

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update milvus version in cmakelists.txt

Signed-off-by: wxyu <xy.wang@zilliz.com>

* disable make VERBOSE

Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-05-10 22:55:46 +08:00
BossZou
8d732656a7
Fix show partitions failed in http module (fix #2228) (#2234) 
* Fix show partitions failed in http module (fix #2228)

Signed-off-by: yhz <413554850@qq.com>

* catch json string convert error

Signed-off-by: yhz <413554850@qq.com>
 2020-05-10 12:49:26 +00:00
Cai Yudong
e63904867b
update debug log (#2275) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-05-10 00:19:33 +08:00
op-hunter
a37f9b0764
Openblas macro (#2269) 
* save local work 4 add openblas macro to chose compile openblas lib or not

Signed-off-by: cmli <chengming.li@zilliz.com>

* compile openblas by auto detect

Signed-off-by: cmli <chengming.li@zilliz.com>

* Update build environment docker images

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* update changelog

Signed-off-by: cmli <chengming.li@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update CMakeLists.txt

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* set OpenBLAS_SOURCE auto in build.sh

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-05-09 22:47:03 +08:00
groot
aeb9edf5c6
#2261 (#2270) 
* has collection bug

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #2261

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-05-09 18:32:20 +08:00
Wang XiangYu
2c04cc0afe
upgrade config to 0.4 (#2273) 
Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-05-09 18:28:03 +08:00
Cai Yudong
cf6be092ab
code clean (#2265) 
* use macro STATUS_CHECK

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* comment S3 related config APIs

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-05-09 01:51:04 +00:00
shengjun.li
4cea320943
k-means L2 (#2258) 
* k-means L2

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix change log

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-05-08 14:03:50 +00:00
groot
cf68c9918e
#1925 (#2257) 
* write error

Signed-off-by: groot <yihua.mo@zilliz.com>

* out of storage

Signed-off-by: groot <yihua.mo@zilliz.com>

* clang format

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix #1955

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* compact threashold

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* search by id for hnsw/pq/annoy

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* file cleanup timeout config

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #1925\

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-05-08 11:40:41 +00:00
BossZou
1811254de6
Obtain running rpc requests information (#2240) (#2241) 
* add cmd to get requests

Signed-off-by: yhz <413554850@qq.com>

* forward class declaration

Signed-off-by: yhz <413554850@qq.com>

* Obtain running rpc requests information (fix #2240)

Signed-off-by: yhz <413554850@qq.com>

* Fix unittest compile failed issue

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Log error with msg

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-05-08 11:17:48 +00:00
caosiyang
7b0998885c
Fix #2248: use hostname and port as instance label of metrics (#2249) 
Signed-off-by: caosiyang <csy3228@gmail.com>
 2020-05-08 19:08:04 +08:00
Wang XiangYu
104cda1a76
print warning on stdout (#2243) 
* print warning on stdout

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix compile failed

Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-05-08 08:57:08 +00:00
groot
da55622042
file cleanup timeout config (#2250) 
* write error

Signed-off-by: groot <yihua.mo@zilliz.com>

* out of storage

Signed-off-by: groot <yihua.mo@zilliz.com>

* clang format

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix #1955

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* compact threashold

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* search by id for hnsw/pq/annoy

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* file cleanup timeout config

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-05-08 06:24:29 +00:00
Wang XiangYu
ac69f1ab8d
add_dependencies in cmake (#2239) 
* add_dependencies in cmake

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-05-07 14:51:38 +00:00
Wang XiangYu
7e3ba4ddd2
Catch exception and print in stderr (#2238) 
Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-05-07 10:04:35 +00:00
yukun
1516d71a55
Add attributes to mysql and wal (#2229) 
* Add hybrid operation into mysql

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add Hybrid into wal

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add unittest for hybrid wal

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix wal unittest bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix hybrid_insert unittest bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix codacy/PR quality

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change test_rpc port to 19531

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-05-07 06:14:58 +00:00
zhoubo0317
6de141b2af
rm libopenblsa-dev (#2235) 
Signed-off-by: zhoubo <zhoubo@hotmail.com>

Co-authored-by: zhoubo <zhoubo@hotmail.com>
 2020-05-06 21:46:33 +08:00
dyhyfu
882ed76cda
[skip ci] remove 'openblas-devel' (#2208) 
Signed-of-by: yaohong<dyhyfu@126.com>
 2020-05-06 21:39:14 +08:00
Cai Yudong
f218217064
optimize similarity template (#2227) 
* optimize similarity template

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-05-06 08:53:16 +00:00
groot
ac8e9ff020
write error (#2184) 
* write error

Signed-off-by: groot <yihua.mo@zilliz.com>

* out of storage

Signed-off-by: groot <yihua.mo@zilliz.com>

* clang format

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix #1955

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* compact threashold

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* search by id for hnsw/pq/annoy

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2020-05-06 16:52:37 +08:00
BossZou
82ab21aec3
Http update endpoints (#2187) 
* replace table with collection in http module

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add search_by_ids in http module

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add API

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add new API and unittest

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Update endpoint in http module(#2186); change vector id to string format(2185)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* allow filter when show partition

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* move constant variables defination to .cpp

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-05-06 14:07:35 +08:00
jackyu2020
86510aa295
check the return value of fscanf (#2218) 
Signed-off-by: e <ych05zh@163.com>
 2020-05-03 01:49:57 +00:00
Cai Yudong
ed2ee8873b
fix SingleIndexTest.IVFSQHybrid unittest (#2215) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-05-02 10:24:35 +00:00
Wang XiangYu
ff48427911
Log file rotating (#2207) 
* log file rotating

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update changelog

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix compile failed

Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-04-30 23:31:14 +08:00
Cai Yudong
0032c13445
Error out when index SQ8H run in CPU mode (#2204) 
* Error out when index SQ8H run in CPU mode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update cmake

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-04-30 15:22:29 +00:00
BossZou
b458034ad5
Fix Fail to access WAL storage path (#2196) (#2198) 
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-04-30 09:47:12 +00:00
zxf2017
14b3e95960
add head file to fix two build warnings (#2195) 
* add head file to fix two build warnings

Signed-off-by: zxf <zhuxiaofeng07936@hellobike.com>

* fstream.h => fstream

Signed-off-by: zxf <zhuxiaofeng07936@hellobike.com>

Co-authored-by: zxf <zhuxiaofeng07936@hellobike.com>
 2020-04-30 06:10:44 +00:00
Wang XiangYu
be2feb1531
Log with request id (#2192) 
* add function to get request id

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update log in GrpcRequestHandler

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update request id format

Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-04-30 13:39:55 +08:00
feisiyicl
e77fd12286
Feisiyicl 2190 memory usage (#2191) 
* rename MILVUS_ENABLE_PROFILING to ENABLE_CPU_PROFILING, and add ENABLE_MEM_PROFILING

Signed-off-by: feisiyicl <7764126@qq.com>

* optimize ReadOnlyArrayInvertedLists

Signed-off-by: feisiyicl <7764126@qq.com>

* update changelog

Signed-off-by: feisiyicl <7764126@qq.com>

* retry ci

Signed-off-by: feisiyicl <7764126@qq.com>

* fix build issue

Signed-off-by: feisiyicl <7764126@qq.com>
 2020-04-30 02:03:54 +00:00
BossZou
2c889636ab
Check Storage permission (#2174) 
* add class storage checker

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add cpu instruction sets check (#2055)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add more details for storage

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Check storage path permission (fix #2173)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Fix logs path access fail issue

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-04-29 17:23:32 +00:00
feisiyicl
9b2368016c
#1946 fix load index file CPU2GPU fail during searching (#2182) 
Signed-off-by: feisiyicl <7764126@qq.com>
 2020-04-29 20:01:52 +08:00
shengjun.li
a76e705a92
Using elkan K-Means to improve IVF (#2180) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-04-29 19:58:50 +08:00
feisiyicl
b3aa06fce1
add config simd_type (#2179) 
* add config simd_type

Signed-off-by: feisiyicl <7764126@qq.com>

* update changelog

Signed-off-by: feisiyicl <7764126@qq.com>
 2020-04-29 17:46:36 +08:00
BossZou
0a2b77c363
Upgrade http thirdparty oatpp to v1.0.0 (fix #2153) (#2157) 
* Upgrade thirdparty oatpp to v1.0.0 (fix #2153)

Signed-off-by: yhz <413554850@qq.com>

* adjust header order

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-04-28 15:57:51 +00:00
groot
ebb01aa9b2
Fix failed to open file (#2138) 
* file reference

Signed-off-by: groot <yihua.mo@zilliz.com>

* print info

Signed-off-by: groot <yihua.mo@zilliz.com>

* avoid metric crash

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* apply delete bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* has partition check

Signed-off-by: groot <yihua.mo@zilliz.com>

* duplicate id search

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-04-28 21:10:01 +08:00
Wang XiangYu
3be8aad1af
Merge config file (#2168) 
* Using el::Configurations Class init easylog

Signed-off-by: wxyu <xy.wang@zilliz.com>

* add logs config constant

Signed-off-by: wxyu <xy.wang@zilliz.com>

* add config check function

Signed-off-by: wxyu <xy.wang@zilliz.com>

* add config get function

Signed-off-by: wxyu <xy.wang@zilliz.com>

* logs config set function

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update InitLog function

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix clang-format

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update server_config.template

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update changelog

Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-04-28 20:21:21 +08:00
BossZou
4ab92f3032
Add config to switch off web server (#2137) 
* Add a config parameter to switch off http server (fix #2057)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* modify web enable config name

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix cmake bug & output exanption msg

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* rename web enbale config as web_enable

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* optimize code

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* log out errno

Signed-off-by: yhz <413554850@qq.com>
 2020-04-28 17:04:04 +08:00
op-hunter
1b25bacee2
build openblas by source (#2154) 
* build openblas by source

Signed-off-by: cmli <chengming.li@zilliz.com>

* remove openblas md5

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-04-27 22:48:14 +08:00
Wang XiangYu
b65f5072f3
fix server start failed if wal directory exist (#2144) 
* fix server start failed if wal directory exist

Signed-off-by: wxyu <xy.wang@zilliz.com>

* add wal_enable check

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix compile error

Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-04-27 20:05:04 +08:00
BossZou
bf42dbd5b6
Gpu check (#2129) 
* add GpuCheck class

Signed-off-by: yhz <413554850@qq.com>

* Check gpu environment

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add server checker unittest

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-04-27 16:56:12 +08:00
Wang XiangYu
1f0466708f
merge server_cpu_config.template and server_gpu_config.template (#2150) 
Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-04-27 16:27:44 +08:00
Jin Hai
b6d681f458
Merge pull request #2139 from longer-is-better/patch-1 
delete unused file
 2020-04-27 16:17:15 +08:00
AzAz
2a7e116a67
remove uint64_t j from parameters (#2147) 
Signed-off-by: talentAN <adam_an02@163.com>
 2020-04-27 16:15:49 +08:00
AzAz
b3028baed8
Add log for error status (#2148) 
Signed-off-by: talentAN <adam_an02@163.com>
 2020-04-27 16:13:11 +08:00
Cai Yudong
1384484b7d
Caiyd 2039 avx sse (#2136) 
* #2039 clean redundant compile options

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #2039 add distances_avx.h and distances_avx.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #2039 add ScalarQuantizerDC_avx.cpp, ScalarQuantizerDC_avx.h and ScalarQuantizerCodec_avx.h

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #2039 remove -mavx2 from default compile option

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #2039 clean code

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #2039 clean code

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-04-27 15:01:47 +08:00
Gracieeea
509b87f103
replace int with size_t (#2140) 
Signed-off-by: Gracieeea <sly_freesoul@icloud.com>
 2020-04-27 04:52:11 +00:00
JinHai-CN
7b1b75a90d Fix lint error 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-04-27 10:26:05 +08:00
JinHai-CN
adc6dc38bf Fix compiling error 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-04-27 10:25:07 +08:00
dongwei
2c6fcacdbd delete unused file 
Signed-off-by: dongwei <d279617552@gmail.com>
 2020-04-26 23:21:06 +08:00
Cai Yudong
150cca6bbf
Caiyd 1946 cpu2gpu getres (#2124) 
* #1946 use new log format in knowhere

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1946 add more debug info for GPU device initialize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry CI

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry CI

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2020-04-26 18:29:21 +08:00
Wang XiangYu
12b3bf0693
Add instance lock (#2060) 
* Add instance lock

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update message

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update unittest CMakeLists.txt

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix clang-format

Signed-off-by: wxyu <xy.wang@zilliz.com>

* update

Signed-off-by: wxyu <xy.wang@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
 2020-04-26 08:31:18 +00:00
DanielHuang1983
7ecafbd93a
rename the variable name collection_schema (#2126) 
Signed-off-by: DanielHuang1983 <huanghe888@hotmail.com>
 2020-04-26 08:03:52 +00:00
shana0325
53133aafac
train func add catch excetpion (#2096) 
* train func add catch excetpion

Signed-off-by: shana0325 <645842705@qq.com>

* Fix lint error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
 2020-04-26 11:29:20 +08:00
chen lu
d22f3c2c5f
[skip ci] remove useless log (#2119) 
Signed-off-by: yiuluchen 1093633856@qq.com
 2020-04-26 10:19:31 +08:00
BossZou
8edb7b6a09
add cpu instruction sets check (#2055) 
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-04-26 00:59:25 +08:00
groot
777c36a0ac
#1997 index file missed after compact (#2108) 
* #1997 index file missed after compact

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
 2020-04-25 22:06:26 +08:00
JinHai-CN
9db19a9a20 Merge remote-tracking branch 'main/master' 2020-04-25 18:58:59 +08:00
GuoRentong
fed865c7c9
Values of type 'const size_t' may not fit into the receiver type 'int' (#2109) 
Signed-off-by: GuoRentong <rt.guo@outlook.com>

Co-authored-by: guo rentong <grt@guodeMacBook-Pro.local>
 2020-04-25 18:35:04 +08:00
yxm1536
4c108c7578
Rename MemMenagerFactory.cpp/h to MemManagerFactory.cpp/h (#2093) 
* Rename MemMenagerFactory.cpp to MemManagerFactory.cpp

Signed-off-by: yxm1536 <62009483+yxm1536@users.noreply.github.com>

* Rename MemMenagerFactory.h to MemManagerFactory.h

Signed-off-by: yxm1536 <62009483+yxm1536@users.noreply.github.com>

* Fix compilation error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
 2020-04-25 16:57:14 +08:00
czp
b454f462c1
put error when call Flush (#2097) 
Signed-off-by: beautifulpython <2426009680@qq.com>
 2020-04-25 16:13:32 +08:00
grtoverflow
6fe2cf1580
Update ConfAdapter.cpp (#2106) 
Signed-off-by: grtoverflow <grtoverflow@gmail.com>
 2020-04-25 16:12:58 +08:00
xge-zilliz
42b1983625
Delete useless boolean (#2107) 
Signed-off-by: xge-zilliz <xi.ge@zilliz.com>
 2020-04-25 15:49:43 +08:00
dd-He
c33df2ee20
Use emplace_back instead of push_back (#2103) 
Signed-off-by: dd-He <1843757857@qq.com>
 2020-04-25 15:37:23 +08:00
chengpu
6d2c50ac21
Use std::copy to replace forloop assignment (#2087) 
Signed-off-by: chengpu <chengpu@live.com>
 2020-04-25 15:28:31 +08:00
binbin12580
2247d58cc4
Unused variable: ids (#2088) 
Signed-off-by:  binbin12580 <1565196967@qq.com>
 2020-04-25 15:26:16 +08:00
Cross
7deef8029f
Update GrpcRequestHandler.cpp (#2085) 
Signed-off-by: Cross <xinyuanm9@gmail.com>
 2020-04-25 14:53:49 +08:00
groot
82f4c289eb
New api HasPartition, SearchByID, GetVectorsByID (#2056) 
* modify proto

Signed-off-by: groot <yihua.mo@zilliz.com>

* modify c sdk

Signed-off-by: groot <yihua.mo@zilliz.com>

* rewrite search by id

Signed-off-by: groot <yihua.mo@zilliz.com>

* change cases

Signed-off-by: zw <zw@zilliz.com>

* fix cases

Signed-off-by: zw <zw@zilliz.com>

* fix wal case

Signed-off-by: zw <zw@zilliz.com>

* fix search by id

Signed-off-by: groot <yihua.mo@zilliz.com>

* modify sdk

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>

* add search_by_ids case

Signed-off-by: zw <zw@zilliz.com>

* disable test_search)by_ids

Signed-off-by: zw <zw@zilliz.com>

Co-authored-by: zw <zw@zilliz.com>
Co-authored-by: del-zhenwu <56623710+del-zhenwu@users.noreply.github.com>
 2020-04-25 14:49:32 +08:00
lwglgy
7e52815fb6
DBImpl.cpp::ExecWalRecord need to process error status in case wal::MXLogType::Entity (#2083) 
Signed-off-by: lwglgy <1486111482@qq.com>
 2020-04-25 13:24:24 +08:00
yukun
67d8a9b54c
Add http interface for hybrid search (#2079) 
* Add http interface for hybrid search

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add unittest for http hybrid interface

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* clang format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix codacy quality

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-04-25 13:19:17 +08:00
Jin Hai
6d87dc3c72
Merge pull request #2084 from lee-eve/master 
Unused variable: offsets
 2020-04-25 13:18:19 +08:00
water32
420d70dcc5
unused variable, just remove it. (#2082) 
Signed-off-by:  water32 <miaochen@mail.ustc.edu.cn>

unused variable, just remove it.
 2020-04-25 11:58:23 +08:00
lieve
6fea6a17de Unused variable: offsets 
Signed-off-by: lieve <645417202@qq.com>
Signed-off-by: lizhengxie <zhengxie.li@zuolin.com>
 2020-04-25 11:48:27 +08:00
JinHai-CN
fb85d8b3f0 Fix lint error 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-04-25 11:21:58 +08:00
PJZero
fedbb697e3
Update GrpcRequestHandler.cpp (#2069) 
Signed-off-by: pengjian05 <pengjian05@baidu.com>

Co-authored-by: pengjian05 <pengjian05@baidu.com>
 2020-04-25 11:19:30 +08:00
Jin Hai
54c9386bdc
#2076 CheckMetricConfigAddress error message (#2077) 
Signed-off-by: jinhai <hai.jin@zilliz.com>
 2020-04-25 10:04:04 +08:00
Jin Hai
723b10600b
#2073 Fix CheckDBConfigBackendUrl error message (#2074) 
Signed-off-by: jinhai <hai.jin@zilliz.com>
 2020-04-25 09:31:25 +08:00
Wang XiangYu
c0d5a47eba
rename optimizer to selector (#2067) 
* rename

Signed-off-by: wxyu <xy.wang@zilliz.com>

* fix clang-format

Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-04-24 11:42:17 +00:00
格雷大大
bf4cea1d1f
add log 4 annoy if index has been built when BuildAll interface invoked (#2071) 
* add log 4 annoy if index has been built when BuildAll interface invoked

Signed-off-by: grace <yan.gu@zilliz.com>

* fix lint error

Signed-off-by: grace <yan.gu@zilliz.com>
 2020-04-24 19:38:21 +08:00
Wang XiangYu
67819be29b
warn when use sqlite as metadata management (#2065) 
Signed-off-by: wxyu <xy.wang@zilliz.com>
 2020-04-24 15:23:46 +08:00
Yhz
87778052f4 move http parser to http utils 
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-04-23 23:16:04 +08:00
JinHai-CN
a41949f075 Merge remote-tracking branch 'main/master' into AllenYu1987-patch-1 2020-04-23 14:08:28 +08:00
Jin Hai
9a3ae916a2
Merge pull request #2044 from Tlincy/Tlincy-patch-1 
Update LogUtils.cpp: use switch ... case to replace if ... else
 2020-04-23 14:03:54 +08:00
Jin Hai
3267ed406f
Merge pull request #2032 from ggaaooppeenngg/code-clean 
Delete CommandDto class and remove file CmdDto.hpp
 2020-04-23 14:01:48 +08:00
Allen Zhang
f741be0a79 Move http query parser 
Signed-off-by: Allen Zhang <allen.zhangyilun@gmail.com>
 2020-04-23 12:14:11 +08:00
loguo
fc969f73ba
Update DBImpl.cpp: rename flush_tables to flushed_collections (#2043) 
Signed-off-by: loguo <xiangzhouguo@gmail.com>
 2020-04-23 11:27:29 +08:00
Aredcap
b55f249938
Assert cmd reply (#2030) 
* Assert cmd reply

Signed-off-by: Aredcap <zhangleilei19@mails.ucas.ac.cn>

* fix unittest error

Signed-off-by: Aredcap <zhangleilei19@mails.ucas.ac.cn>
 2020-04-23 11:22:58 +08:00
JinHai-CN
58d0fa56de Fix error 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-04-23 11:20:30 +08:00
moe-of-faith
b23beebbfd
Change LogOut("[%s][%d]" ..... ) to LogOut("[%s][%ld]" ......) (#2041) 
Signed-off-by: moe-of-faith <aeon.sym@gmail.com>
 2020-04-23 11:03:10 +08:00
Gxz
ce44da04e1
unused var: s (#2042) 
Signed-off-by: guoxiangzhou <8188755@qq.com>
 2020-04-23 11:02:39 +08:00
JinHai-CN
7d63d15718 Fix lint 
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
 2020-04-23 10:53:33 +08:00