Commit Graph

5521 Commits

Author SHA1 Message Date
shengjun.li
7c72dcf4d3
fix search by GPU (#2453)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-05-28 15:39:16 +00:00
JinHai-CN
3d9cc6967b [skip ci] Update CHANGELOG
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-05-28 10:47:49 +08:00
Cai Yudong
f4aeca2988
improve knowhere coverage (#2444)
* increase nb for NSG code coverage

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* test more APIs in test_annoy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* disable get_vector_by_id and search_by_id

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* improve code coverage

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* improve code coverage

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* install test_instructionset

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-28 10:22:14 +08:00
groot
dcb60f3021
performance issues (#2438)
* performance issues

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix bugs

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* preload collection issue

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* uncomment boring log

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* reduce unittest time

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* reduce metric test time cost

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-28 00:19:08 +08:00
JinHai-CN
4dc0098560 [skip ci] Update working flow
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-05-27 17:56:21 +08:00
Cai Yudong
ce4dcf69ae
add debug APIs and update GPU temp memory size (#2420)
* add debug APIs and update GPU temp memory size

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update thread name

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update DESIGN.md

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-26 14:39:44 +08:00
del-zhenwu
2f94eb655e
update ci cron on 0.10.0 (#2428)
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-05-25 18:32:57 +08:00
groot
2d9b358e16
optimize merge process (#2419)
* optimize merge process

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* drop collecion issue

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-25 14:19:25 +08:00
shengjun.li
2982004e2b
midify Binary IVF in faiss 1.6.3 (#2416)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-05-23 11:01:54 +00:00
Xiaohai Xu
6809150b1d
#2395 Fix large nq cudaMalloc (#2409)
* fix large nq cuda malloc issue

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix clang format

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* Change log

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-05-23 08:23:05 +00:00
groot
077dfa4092
Wal lsn issue (#2412)
* set wal lsn after all mem files serialized

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* return status

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-05-23 06:51:18 +00:00
groot
4ce3e2c03c
#2366 Reduce SQL execution times (#2383)
* #2366

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix python test

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

* changelog

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-05-23 11:13:09 +08:00
groot
4f6fe96550
mysql meta connection pool issue (#2413)
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-05-23 01:26:15 +00:00
Wang XiangYu
e40f0b3939
logging build index progress (#2411)
Signed-off-by: wxyu <xy.wang@zilliz.com>
2020-05-22 13:10:24 +00:00
Cai Yudong
344ae823b2
#2353 remove log_config (#2406)
* remove log_config from code and script

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update script

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-22 10:57:16 +00:00
Jin Hai
2c2e1bb8f1
#2403 MySQL max_idle_time is 10 by default (#2405)
* #2403 MySQL max_idle_time is 10 by default

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #2403 MySQL max_idle_time is 10 by default

Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-05-22 14:35:11 +08:00
shengjun.li
34fdc00d19
fix MatchNlist (#2401)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-05-22 06:20:26 +00:00
Cai Yudong
386e58ce0d
upgrade faiss 1.6.3 (#2400)
* roll back to original faiss 1.6.0

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update to faiss_1.6.3

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* patch all change to faiss 1.6.3

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* faiss CPU version build pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* faiss GPU version build pass

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-22 01:27:16 +00:00
del-zhenwu
5dcd68bb73
Add go test && fix case bug (#2396)
* test level 3: restart

Signed-off-by: zw <zw@milvus.io>

* add namepsace

Signed-off-by: zw <zw@milvus.io>

* update

Signed-off-by: zw <zw@milvus.io>

* update

Signed-off-by: zw <zw@milvus.io>

* Update utils.py

Signed-off-by: zw <zw@milvus.io>

* Update test_level_3.py

Signed-off-by: zw <zw@milvus.io>

* Update Jenkinsfile

Signed-off-by: zw <zw@milvus.io>

* debug

Signed-off-by: zw <zw@milvus.io>

* debug

Signed-off-by: zw <zw@milvus.io>

* debug

Signed-off-by: zw <zw@milvus.io>

* debug

Signed-off-by: zw <zw@milvus.io>

* clean compile warning (#2380)

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: zw <zw@milvus.io>

* delete pod

Signed-off-by: zw <zw@milvus.io>

* update

Signed-off-by: zw <zw@milvus.io>

* debug

Signed-off-by: zw <zw@milvus.io>

* debug

Signed-off-by: zw <zw@milvus.io>

* recover

Signed-off-by: zw <zw@milvus.io>

* add go test

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-05-21 09:58:29 +00:00
groot
4c9684366c
#2378 (#2388)
* return partition lsn

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix wal lsn

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* fix wal issue

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* all collection include partition

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix build error

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix flush

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-05-21 02:13:46 +00:00
del-zhenwu
40055fcaf0
test level 3: restart (#2384)
* test level 3: restart

Signed-off-by: zw <zw@milvus.io>

* add namepsace

Signed-off-by: zw <zw@milvus.io>

* update

Signed-off-by: zw <zw@milvus.io>

* update

Signed-off-by: zw <zw@milvus.io>

* Update utils.py

Signed-off-by: zw <zw@milvus.io>

* Update test_level_3.py

Signed-off-by: zw <zw@milvus.io>

* Update Jenkinsfile

Signed-off-by: zw <zw@milvus.io>

* debug

Signed-off-by: zw <zw@milvus.io>

* debug

Signed-off-by: zw <zw@milvus.io>

* debug

Signed-off-by: zw <zw@milvus.io>

* debug

Signed-off-by: zw <zw@milvus.io>

* clean compile warning (#2380)

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: zw <zw@milvus.io>

* delete pod

Signed-off-by: zw <zw@milvus.io>

* update

Signed-off-by: zw <zw@milvus.io>

* debug

Signed-off-by: zw <zw@milvus.io>

* debug

Signed-off-by: zw <zw@milvus.io>

* recover

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-05-20 18:51:50 +08:00
Cai Yudong
b532a69c8b
clean compile warning (#2380)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-19 17:58:23 +00:00
JinHai-CN
b616dcb761 Update branch
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-05-19 11:27:57 +08:00
groot
014a0e860c
QPS decrease (#2372)
* optimize merge strategy

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #2365

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* optimize search

Signed-off-by: groot <yihua.mo@zilliz.com>

* code format

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-05-19 11:21:53 +08:00
Cai Yudong
b9e8acb5b2
#2370 clean compile warning (#2371)
* #2370 clean compile warning

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-18 02:35:14 +00:00
Cai Yudong
42f751047e
update branch version to 0.9.1 (#2364)
* update branch version to 0.9.1

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update test version

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-05-17 04:36:42 +00:00
del-zhenwu
968eb14ab5
update cron for 0.9.1 (#2360)
Signed-off-by: zw <zw@zilliz.com>
2020-05-15 21:32:00 +08:00
PahudPlus
7d7a67a63a
Issue #2199 (#2355)
Signed-off-by: PahudPlus <haimeng.cai@zilliz.com>
2020-05-15 19:31:57 +08:00
BossZou
ab4bc0747b
[skip ci] Upgrade mishards for v0.9.0 (#2358) (#2359)
Signed-off-by: yhz <413554850@qq.com>
2020-05-15 19:31:42 +08:00
del-zhenwu
2056ffeb42
Tear down in test_collection_add_rows_count_multi_threading (#2356)
* Update test_collection_add_rows_count_multi_threading

Signed-off-by: zw <zw@zilliz.com>

* remove repeat

Signed-off-by: zw <zw@zilliz.com>
2020-05-15 19:31:26 +08:00
del-zhenwu
cb92b10c1d
update cron (#2349)
* update cron

* update
2020-05-15 09:33:50 +08:00
Cai Yudong
eba33cc46d
Caiyd 090 rename config (#2340)
* rename config items

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update config unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update config unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update log rotate default value

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update parameter usage in LogUtil.cpp (#3)

Signed-off-by: wxyu <xy.wang@zilliz.com>

* retry ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix ut

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
Co-authored-by: Wang XiangYu <scsven@qq.com>
2020-05-14 17:57:18 +00:00
BossZou
860cc97a06
[skip ci] Update http document for v0.9.0 (#2347) (#2348)
Signed-off-by: yhz <413554850@qq.com>
2020-05-14 23:42:01 +08:00
del-zhenwu
3c46b22d73
add close cases (#2339)
* add close cases

Signed-off-by: zw <zw@milvus.io>

* fix case bug

Signed-off-by: zw <zw@milvus.io>

* reset case level

Signed-off-by: zw <zw@milvus.io>

* reset case level

Signed-off-by: zw <zw@milvus.io>

* fix case

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-05-14 21:12:35 +08:00
BossZou
3c7c9ad645
Change url for behavior 'get_entities_by_id' (#2330) (#2336)
Signed-off-by: yhz <413554850@qq.com>
2020-05-14 21:01:20 +08:00
groot
b7f410e43f
#2338 (#2345)
* fix #2264

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* Remove unnecessary memcpy

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* remove SearchByID from C++SDK

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #2338

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-14 20:50:26 +08:00
groot
d160b279fc
remove SearchByID (#2341)
* fix #2264

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* Remove unnecessary memcpy

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* remove SearchByID from C++SDK

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-14 18:07:12 +08:00
groot
244d0e3405
Remove unnecessary memcpy (#2337)
* fix #2264

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* Remove unnecessary memcpy

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-14 18:00:23 +08:00
del-zhenwu
312df5af31
fix ci helm params (#2333)
* fix ci helm params

* update cron
2020-05-13 20:49:25 +08:00
groot
b351c63cce
fix #2264 (#2323)
* fix #2264

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-05-13 18:55:58 +08:00
del-zhenwu
23c05bb199
update cron2 (#2326)
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-05-13 17:13:00 +08:00
del-zhenwu
592de137d5
V0.9.0 (#2325)
* [skip ci] update nightly cron

Signed-off-by: zw <zw@milvus.io>

* update cron

Signed-off-by: zw <zw@milvus.io>

* update cron

Signed-off-by: zw <zw@milvus.io>

* update cron

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-05-13 16:57:41 +08:00
del-zhenwu
d21ceeaf12
[skip ci] update nightly cron (#2324)
* [skip ci] update nightly cron

Signed-off-by: zw <zw@milvus.io>

* update cron

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-05-13 16:49:50 +08:00
del-zhenwu
9a29317b91
Merge pull request #2318 from del-zhenwu/v0.9.0
update cron branch
2020-05-12 20:03:36 +08:00
zw
e5298fefa3 update cron branch
Signed-off-by: zw <zw@milvus.io>
2020-05-12 18:54:45 +08:00
del-zhenwu
fae67ee49a
Rename methods (#2312)
* rename interfaces in cases

Signed-off-by: zw <zw@zilliz.com>

* rename search_by_id

Signed-off-by: zw <zw@zilliz.com>

* remove test search_by_id

Signed-off-by: zw <zw@zilliz.com>

* [skip ci] Update CHANGELOG

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* rename methods

Signed-off-by: zw <zw@zilliz.com>

* rename methods

Signed-off-by: zw <zw@milvus.io>

* fix rename issue

Signed-off-by: zw <zw@zilliz.com>

* update hnsw default index param

Signed-off-by: zw <zw@zilliz.com>

* Update CHANGELOG.md

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
Co-authored-by: zw <zw@milvus.io>
2020-05-12 18:13:05 +08:00
BossZou
ff4c1a07fa
[skip ci] Mishards 0.9.0 update (#2317)
* Update docker images and sdk invoke for preparing version 0.9.0 (#2311)

Signed-off-by: yhz <413554850@qq.com>

* [skip ci]Update mishards methods

Signed-off-by: yhz <413554850@qq.com>
2020-05-12 18:12:11 +08:00
JinHai-CN
0d2f1f0508 [skip ci] Update CHANGELOG
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-05-12 11:36:43 +08:00
BossZou
1b7aeaffdf
Fix server start failed when mode is 'read_only' (#2294)
* fix deploy bug

Signed-off-by: yhz <413554850@qq.com>

* fix unittest fail

Signed-off-by: yhz <413554850@qq.com>

* remove unused yml

Signed-off-by: yhz <413554850@qq.com>

* change to readonly

Signed-off-by: yhz <413554850@qq.com>
2020-05-12 09:28:10 +08:00
groot
fb49e580c5
rewrite HasPartition (#2289)
* rewrite HasPartition

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* miss file

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* use layered merge

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* sdk HasPartition

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* rename sdk api

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
2020-05-12 09:27:58 +08:00