Commit Graph

347 Commits

Author SHA1 Message Date
Jin Hai
0bac06a50d
Merge pull request #1589 from tinkerlin/fix_1517
fix 1517
2020-03-10 11:28:13 +08:00
Jin Hai
0be8bec09b
Merge branch 'master' into fix#1590 2020-03-10 11:13:33 +08:00
Jin Hai
ff0aad8123
Merge branch 'master' into fix_1517 2020-03-10 09:34:16 +08:00
JinHai-CN
d466f3d447 Update CHANGELOG.md
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-10 01:05:07 +08:00
JinHai-CN
66a14e16e8 Update CHANGELOG.md
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-10 01:03:32 +08:00
Zhiru Zhu
f811753c62
update
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
2020-03-09 23:33:12 +08:00
groot
13d3cff9b7 #1580 Old segment folder not removed after merge / compact if create_index is called before adding data
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-09 20:52:10 +08:00
Zhiru Zhu
593077e85b
update
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
2020-03-09 20:40:40 +08:00
xiaojun.lin
7b493cb835 fix
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-09 20:08:31 +08:00
Jin Hai
c39ea4fd84
Merge branch 'master' into binary 2020-03-09 18:33:08 +08:00
Jin Hai
694aea22a9
Merge pull request #1579 from tinkerlin/fix_1564
fix
2020-03-09 18:31:37 +08:00
groot
4068c2ac3a merge master branch
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-09 18:17:53 +08:00
xiaojun.lin
95105bfdd1 Merge remote-tracking branch 'official/master' into fix_1564
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-09 15:38:04 +08:00
Zhiru Zhu
281d8ec53f
update
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
2020-03-09 15:16:36 +08:00
Jin Hai
7cd727aaea
Merge pull request #1575 from youny626/fix#1574
Fix#1574
2020-03-09 15:10:59 +08:00
groot
b8b86d77c4 typo
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-09 15:08:54 +08:00
xiaojun.lin
f891a590b5 fix
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-09 15:06:26 +08:00
groot
e9d32dc9de typo
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-09 13:33:57 +08:00
Zhiru Zhu
a267c9a6fc
update
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
2020-03-09 11:46:15 +08:00
groot
37fd79631d #1571 Meta engine type become IDMAP after drop index for BINARY table
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-09 11:14:12 +08:00
Yhz
da469d1b3b Merge branch 'main' into config-bug 2020-03-09 09:23:15 +08:00
Jin Hai
037e4054b6
Merge pull request #1568 from cydrain/caiyd_1567_update_yaml_description
Caiyd 1567 update yaml description
2020-03-08 23:21:27 +08:00
yudong.cai
aedde79f26 #1567 update yaml config description
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-08 19:14:40 +08:00
Yhz
01eb62836e merge main and fix conflict
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-08 16:19:28 +08:00
Yhz
24daade18e fix config wal valid_recovery_error_ignore bug
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-08 14:30:02 +08:00
xiaojun.lin
c7bc4a8a22 update max_support_dim
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-08 14:21:59 +08:00
JinHai-CN
a96a837186 Update CHANGELOG.md
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-08 12:39:00 +08:00
groot
9f7bf032da typo
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-08 12:14:05 +08:00
groot
1829624a43 #1556 Index file not create after table and index create
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-08 11:59:25 +08:00
groot
b78521021b fix typo
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-07 22:48:02 +08:00
groot
9de0dea134 fix typo
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-07 22:34:07 +08:00
groot
b729d04236 Merge remote-tracking branch 'source/master' 2020-03-07 22:26:18 +08:00
BossZou
0fcdc31c7c
Update resources name in HTTP module (#1545)
* set preload_table correctly (fix #1524)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update res name in http module (fix #1544)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add bool convertor function

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix test fail

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* optimize update config method & add boolean conversion comments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove comments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-07 20:56:01 +08:00
Cai Yudong
0fd9bf8e70
#1529 fix server crash when cache_insert_data enabled (#1541)
* #1529 fix server crash when cache_insert_data enabled

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1529 fix bug

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1529 code opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1529 set uids for CopyGpuToCpu()

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-07 20:54:26 +08:00
groot
c2b5b00592 #1532 Search with ivf_flat failed with open-dataset: sift-256-hamming
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-07 19:50:57 +08:00
groot
a08b51c2b6
merge json to master to get docker image (#1500)
* General proto api for NNS libraries

Signed-off-by: groot <yihua.mo@zilliz.com>

* refactor confadapter

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* fix unittest failures

Signed-off-by: groot <yihua.mo@zilliz.com>

* update test_add

Signed-off-by: zhenwu <zw@zilliz.com>

* update knowhere

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update test cases

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* Update cases

* C++ sdk for json parameters

Signed-off-by: groot <yihua.mo@zilliz.com>

* update unittest

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* fix unittest failures

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix case

Signed-off-by: del-zhenwu <zw@zilliz.com>

* modify test_index.py

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* update

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update sptag

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update...

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* Build Pass

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* knowhere/wrapper ut pass

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* update util

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* fix wal case

Signed-off-by: del-zhenwu <zw@zilliz.com>

* modify test_search_vectors

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* update ci

Signed-off-by: del-zhenwu <zw@zilliz.com>

* update util

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* modify test_search_vectoes

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* add hnsw in http module & modify index apis

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* modify search in http module

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix build error

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix typo in test_index and test_search

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* update...

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* index apis in http module done

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix build index bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* search apis unittest pass

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* web test pass

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update confadapter

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update util

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* code format

Signed-off-by: groot <yihua.mo@zilliz.com>

* code format

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix vectors results bug (fix #1476)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* clang format

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update test

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* fix unittest

Signed-off-by: groot <yihua.mo@zilliz.com>

* add test_config

Signed-off-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix a build error

Signed-off-by: groot <yihua.mo@zilliz.com>

* add invalid param search test

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* fix range check

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* cpmpact/flush case passed

Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>

* fix unittest failures

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failures

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest failures

Signed-off-by: groot <yihua.mo@zilliz.com>

* validate json parameters in request

Signed-off-by: groot <yihua.mo@zilliz.com>

* add unittest cases

Signed-off-by: groot <yihua.mo@zilliz.com>

* update test index/search

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* update test_config

Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>

* fix

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* support nsg and ivf-nlist

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* fix validation bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* code format

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix python test failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* remove rnsg cases

Signed-off-by: zhenwu <zw@zilliz.com>

* fix python test failure

Signed-off-by: groot <yihua.mo@zilliz.com>

* Update changelog

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix typo

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* add pq to test_index && multithread test

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* add pq to test_search

Signed-off-by: shengjh <jianghong.sheng@zilliz.com>

* Fix format

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Update CHANGELOG

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compiling error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compiling error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* fix config bug

Signed-off-by: groot <yihua.mo@zilliz.com>

* code format

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix config test

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* Update CHANGELOG.md

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Update CHANGELOG.md

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* disable config test case

Signed-off-by: zhenwu <zw@zilliz.com>

Co-authored-by: Nicky <nicky.xj.lin@gmail.com>
Co-authored-by: zhenwu <zw@zilliz.com>
Co-authored-by: Xiaohai Xu <xiaohaix@student.unimelb.edu.au>
Co-authored-by: shengjh <jianghong.sheng@zilliz.com>
Co-authored-by: xiaojun.lin <xiaojun.lin@zilliz.com>
Co-authored-by: Yhz <yinghao.zou@zilliz.com>
Co-authored-by: del-zhenwu <zhenxiang.li@zilliz.com>
Co-authored-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-07 15:23:34 +08:00
Cai Yudong
2a101eaab1
#1524 update config preload_table description (#1543)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-07 13:18:14 +08:00
BossZou
1963f3b9e9
Make cache_insert_data take effect in-service(# 1521) (#1540)
* make cache_insert_data take effect in-service (fix #1521)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* complete omitted config setter

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* cache_insert_data take effect for MemTable

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add config test

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* rename config handler

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-07 09:34:35 +08:00
Tinkerrr
8cd1ec9819
fix 1507 (#1509)
* fix

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update..

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update...

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update...

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* update...

Signed-off-by: Nicky <nicky.xj.lin@gmail.com>

* comment ut

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* Fix lint error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* update....

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* update....

Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>

* Fix typo

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix typo

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-03-06 22:14:58 +08:00
Tinkerrr
626c9bc593
set size after load (#1539)
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-06 21:10:42 +08:00
Zhiru Zhu
5bb1d001e2
Fix#1530 (#1533)
* update

Signed-off-by: youny626 <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-03-06 15:21:39 +08:00
Cai Yudong
d28d1db907
#1531 remove S3 related config (#1534)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-06 13:33:35 +08:00
BossZou
df47fad78c
Add setter API for config preload_table (#1526)
* update code

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* optimize http module code

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* move gpu res handler to config holder

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add setter API for config preload_table (fix #1525)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add else branch at end of if condition

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-06 13:26:01 +08:00
Zhiru Zhu
b43e0fbada
Update compact (#1522)
* update

Signed-off-by: youny626 <zzhu@fandm.edu>

* update

Signed-off-by: youny626 <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* [skip ci] update CHANGELOG

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
2020-03-06 09:40:29 +08:00
Jin Hai
19b8565748
Fix vectors results bug(#1476) & change vector id type to string(#1511) (#1514)
* add sign-off

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add index HNSW in http module

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-03-05 16:30:30 +08:00
Jin Hai
570ecf4266
Add cfg fun (#1501)
* save work

Signed-off-by: lichengming <chengming.li@zilliz.com>

* wal config&gtest

Signed-off-by: lichengming <chengming.li@zilliz.com>

* fix dco and lint error

Signed-off-by: lichengming <chengming.li@zilliz.com>

* try to fix lint error

Signed-off-by: lichengming <chengming.li@zilliz.com>

* try to fix clang-format issue

Signed-off-by: lichengming <chengming.li@zilliz.com>

* update change log

Signed-off-by: lichengming <chengming.li@zilliz.com>

* ajdjust the code by yudong's advice

Signed-off-by: lichengming <chengming.li@zilliz.com>

* fix error

Signed-off-by: lichengming <chengming.li@zilliz.com>

* recommit pr 1501,local gtest is ok

Signed-off-by: lichengming <chengming.li@zilliz.com>
2020-03-05 14:08:07 +08:00
Jin Hai
8c7ef47f20
Fix duplicate vector ID issue (#1508)
* #1499 Fix duplicated ID number issue

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #1499 Fix duplicated ID number issue - part 1

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* #1499 Fix duplicated ID number issue - part 2

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* #1499 Fix duplicated ID number issue - part 3

Signed-off-by: jinhai <hai.jin@zilliz.com>

* #1499 Fix duplicated ID number issue - part 4

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix format issue

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Update CHANGELOG

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Add return value check

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-03-05 12:38:22 +08:00
Zhiru Zhu
fc8a6e0779
Fix #1491 and #1504 (#1506)
* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* fix centos compile error

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
2020-03-04 21:10:11 +08:00
Cai Yudong
600dac7500
#1463 update config version to 0.2 (#1466)
* #1463 update config version to 0.2

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* #1463 disable config version check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-04 00:02:48 +08:00
Zhiru Zhu
01b6ad3627
Fix#1484 (#1490)
* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* #1426 Support to configure whether to enabled autoflush (#1468)

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* fix cases: test_search_id/test_wal (#1486)

Signed-off-by: del-zhenwu <zw@zilliz.com>
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* #1480 add return code for AVX512 selection (#1482)

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

* update

Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>

Co-authored-by: shengjun.li <49774184+shengjun1985@users.noreply.github.com>
Co-authored-by: del-zhenwu <56623710+del-zhenwu@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-03-03 18:31:49 +08:00