Commit Graph

54 Commits

Author SHA1 Message Date
del-zhenwu
e2fca12239
fix mix case bug (#1208)
* fix mix case bug

Signed-off-by: del.zhenwu <zhenxiang.li@zilliz.com>

* Remove case.md

Signed-off-by: del.zhenwu <zhenxiang.li@zilliz.com>
2020-02-14 23:27:22 +08:00
shiyu22
a7d57d7a82
add Tanimoto ground truth (#1138)
* add milvus ground truth

* add milvus groundtruth

* [skip ci] add milvus ground truth

* [skip ci]add tanimoto ground truth
2020-02-14 12:35:50 +08:00
BossZou
f10f6cd5f4
Support run dev test with http handler in python SDK (#1116)
* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t

* add web server

* [skip ci] add license in web module

* modify header include & comment oatpp environment config

* add port configure & create table in handler

* modify web url

* simple url complation done & add swagger

* make sure web url

* web functionality done. debuging

* add web unittest

* web test pass

* add web server port

* add web server port in template

* update unittest cmake file

* change web server default port to 19121

* rename method in web module & unittest pass

* add search case in unittest for web module

* rename some variables

* fix bug

* unittest pass

* web prepare

* fix cmd bug(check server status)

* update changlog

* add web port validate & default set

* clang-format pass

* add web port test in unittest

* add CORS & redirect root to swagger ui

* add web status

* web table method func cascade test pass

* add config url in web module

* modify thirdparty cmake to avoid building oatpp test

* clang format

* update changlog

* add constants in web module

* reserve Config.cpp

* fix constants reference bug

* replace web server with async module

* modify component to support async

* format

* developing controller & add test clent into unittest

* add web port into demo/server_config

* modify thirdparty cmake to allow build test

* remove  unnecessary comment

* add endpoint info in controller

* finish web test(bug here)

* clang format

* add web test cpp to lint exclusions

* check null field in GetConfig

* add macro RETURN STATUS DTo

* fix cmake conflict

* fix crash when exit server

* remove surplus comments & add http param check

* add uri /docs to direct swagger

* format

* change cmd to system

* add default value & unittest in web module

* add macros to judge if GPU supported

* add macros in unit & add default in index dto & print error message when bind http port fail

* format (fix #788)

* fix cors bug (not completed)

* comment cors

* change web framework to simple api

* comments optimize

* change to simple API

* remove comments in controller.hpp

* remove EP_COMMON_CMAKE_ARGS in oatpp and oatpp-swagger

* add ep cmake args to sqlite

* clang-format

* change a format

* test pass

* change name to

* fix compiler issue(oatpp-swagger depend on oatpp)

* add & in start_server.h

* specify lib location with oatpp and oatpp-swagger

* add comments

* add swagger definition

* [skip ci] change http method options status code

* remove oatpp swagger(fix #970)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* [skip ci] Fix some broken links (#960)

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken links

* fix issue 373 (#964)

* fix issue 373

* Adjustment format

* Adjustment format

* Adjustment format

* change readme

* #966 update NOTICE.md (#967)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* adjust web port cofig place

* rename web_port variable

* change gpu resources invoke way to cmd()

* set advanced config name add DEFAULT

* change config setting to cmd

* modify ..

* optimize code

* assign TableDto' count default value 0 (fix #995)

* check if table exists when show partitions (fix #1028)

* check table exists when drop partition (fix #1029)

* check if partition name is legal (fix #1022)

* modify status code when partition tag is illegal

* update changlog

* add info to /system url

* add binary index and add bin uri & handler method(not completed)

* optimize http insert and search time(fix #1066) | add binary vectors support(fix #1067)

* fix test partition bug

* fix test bug when check insert records

* add binary vectors test

* add default for offset and page_size

* fix uinttest bug

* [skip ci] remove comments

* optimize web code for PR comments

* add new folder named utils

* check offset and pagesize (fix #1082)

* improve error message if offset or page_size is not legal (fix #1075)

* add log into web module

* update changlog

* check gpu sources setting when assign repeated value (fix #990)

* update changlog

* clang-format pass

* add default handler in http handler

* [skip ci] improve error msg when check gpu resources

* change check offset way

* remove func IsIntStr

* add case

* change int32 to int64 when check number str

* add log in we module(doing)

* update test case

* add log in web controller

* remove surplus dot

* add preload into /system/

* change get_milvus() to get_milvus(args['handler'])

* support load table into memory with http server (fix #1115)

* [skip ci] comment surplus dto in VectorDto

Co-authored-by: jielinxu <52057195+jielinxu@users.noreply.github.com>
Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-02-14 11:07:09 +08:00
del-zhenwu
effb934d77
Remove test.template (#1129)
* Update framework

* remove files

* Remove files

* Remove ann-acc cases && Update java-sdk cases

* change cn to en

* [skip ci] remove doc test

* [skip ci] change cn to en

* Case stability

* Add mail notification when test failed

* Add main notification

* Add main notification

* gen milvus instance from utils

* Distable case with multiprocess

* Add mail notification when nightly test failed

* add milvus handler param

* add http handler

* Remove test.template

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-02-08 11:06:01 +08:00
BossZou
015f0352a6 Fix http bug & add binary vectors support (#1073)
* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t

* add web server

* [skip ci] add license in web module

* modify header include & comment oatpp environment config

* add port configure & create table in handler

* modify web url

* simple url complation done & add swagger

* make sure web url

* web functionality done. debuging

* add web unittest

* web test pass

* add web server port

* add web server port in template

* update unittest cmake file

* change web server default port to 19121

* rename method in web module & unittest pass

* add search case in unittest for web module

* rename some variables

* fix bug

* unittest pass

* web prepare

* fix cmd bug(check server status)

* update changlog

* add web port validate & default set

* clang-format pass

* add web port test in unittest

* add CORS & redirect root to swagger ui

* add web status

* web table method func cascade test pass

* add config url in web module

* modify thirdparty cmake to avoid building oatpp test

* clang format

* update changlog

* add constants in web module

* reserve Config.cpp

* fix constants reference bug

* replace web server with async module

* modify component to support async

* format

* developing controller & add test clent into unittest

* add web port into demo/server_config

* modify thirdparty cmake to allow build test

* remove  unnecessary comment

* add endpoint info in controller

* finish web test(bug here)

* clang format

* add web test cpp to lint exclusions

* check null field in GetConfig

* add macro RETURN STATUS DTo

* fix cmake conflict

* fix crash when exit server

* remove surplus comments & add http param check

* add uri /docs to direct swagger

* format

* change cmd to system

* add default value & unittest in web module

* add macros to judge if GPU supported

* add macros in unit & add default in index dto & print error message when bind http port fail

* format (fix #788)

* fix cors bug (not completed)

* comment cors

* change web framework to simple api

* comments optimize

* change to simple API

* remove comments in controller.hpp

* remove EP_COMMON_CMAKE_ARGS in oatpp and oatpp-swagger

* add ep cmake args to sqlite

* clang-format

* change a format

* test pass

* change name to

* fix compiler issue(oatpp-swagger depend on oatpp)

* add & in start_server.h

* specify lib location with oatpp and oatpp-swagger

* add comments

* add swagger definition

* [skip ci] change http method options status code

* remove oatpp swagger(fix #970)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* [skip ci] Fix some broken links (#960)

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken links

* fix issue 373 (#964)

* fix issue 373

* Adjustment format

* Adjustment format

* Adjustment format

* change readme

* #966 update NOTICE.md (#967)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* adjust web port cofig place

* rename web_port variable

* change gpu resources invoke way to cmd()

* set advanced config name add DEFAULT

* change config setting to cmd

* modify ..

* optimize code

* assign TableDto' count default value 0 (fix #995)

* check if table exists when show partitions (fix #1028)

* check table exists when drop partition (fix #1029)

* check if partition name is legal (fix #1022)

* modify status code when partition tag is illegal

* update changlog

* add info to /system url

* add binary index and add bin uri & handler method(not completed)

* optimize http insert and search time(fix #1066) | add binary vectors support(fix #1067)

* fix test partition bug

* fix test bug when check insert records

* add binary vectors test

* add default for offset and page_size

* fix uinttest bug

* [skip ci] remove comments

* optimize web code for PR comments

* add new folder named utils

Co-authored-by: jielinxu <52057195+jielinxu@users.noreply.github.com>
Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-01-18 10:05:49 +08:00
del-zhenwu
8f88529fc1 Add nightly test notification && improve test case stability (#1056)
* Update framework

* remove files

* Remove files

* Remove ann-acc cases && Update java-sdk cases

* change cn to en

* [skip ci] remove doc test

* [skip ci] change cn to en

* Case stability

* Add mail notification when test failed

* Add main notification

* Add main notification

* gen milvus instance from utils

* Distable case with multiprocess

* Add mail notification when nightly test failed

* add milvus handler param

* add http handler

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-01-17 09:59:49 +08:00
quicksilver
5ec1baaede run hadolint with reviewdog (#1060)
* run hadolint with reviewdog

* add LINCENSE in Dockerfile

* run hadolint with reviewdog

* Reporter of reviewdog command is "github-pr-check"

* format Dockerfile

* ignore DL3007 in hadolint
2020-01-16 19:59:26 +08:00
groot
0f1aa5f8bb Tanimoto distance (#1016)
* Add log to debug #678

* Rename nsg_mix to RNSG in C++ sdk #735

* [skip ci] change __function__

* clang-format

* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo

* define interface

* Define interface (#832)

* If partition tag is similar, wrong partition is searched  (#825)

* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo

* define interface Attach files by dragging & dropping, selecting or pasting them. 

Co-authored-by: groot <yihua.mo@zilliz.com>

* faiss & knowhere

* faiss & knowhere (#842)

* Add log to debug #678

* Rename nsg_mix to RNSG in C++ sdk #735

* [skip ci] change __function__

* clang-format

* If partition tag is similar, wrong partition is searched  (#825)

* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo

* faiss & knowhere

Co-authored-by: groot <yihua.mo@zilliz.com>

* support binary input

* code lint

* add wrapper interface

* add knowhere unittest

* sdk support binary

* support using metric tanimoto and hamming

* sdk binary insert/query example

* fix bug

* fix bug

* update wrapper

* format

* Improve unittest and fix bugs

* delete printresult

* fix bug

* #823 Support binary vector tanimoto metric

* fix typo

* dimension limit to 32768

* fix

* dimension limit to 32768

* fix describe index bug

* fix #886

* fix #889

* add jaccard cases

* hamming dev-test case

* change test_connect

* Add tanimoto cases

* change the output type of hamming

* add abs

* merge master

* rearrange changelog id

* modify feature description

Co-authored-by: Yukikaze-CZR <48198922+Yukikaze-CZR@users.noreply.github.com>
Co-authored-by: Tinkerrr <linxiaojun.cn@outlook.com>
2020-01-14 19:22:27 +08:00
del-zhenwu
a5beec86f2 Change lang cn to en in reademe (#971)
* Update framework

* remove files

* Remove files

* Remove ann-acc cases && Update java-sdk cases

* change cn to en

* [skip ci] remove doc test

* [skip ci] change cn to en
2020-01-13 13:56:15 +08:00
shiyu22
bbfb5f8ded add ground truth (#980)
* add milvus ground truth

* add milvus groundtruth

* [skip ci] add milvus ground truth
2020-01-10 19:22:17 +08:00
del-zhenwu
7cad494101 Enhance testing framework based on kubernetes (#935)
* Update framework

* remove files

* Remove files

* Remove ann-acc cases && Update java-sdk cases
2020-01-07 16:20:37 +08:00
del-zhenwu
b140d8259b Update pip source (#822)
* Update pip source

* Update requirements

* Remove query range case
2019-12-26 14:19:52 +08:00
del-zhenwu
beed46f79c Upgrade pyyaml and update tests (#681) 2019-12-04 14:18:20 +08:00
zhenwu
73562e869b fix pq case bug 2019-12-03 19:55:51 +08:00
zhenwu
58c2befa02 Update pq cases 2019-12-03 16:56:46 +08:00
zhenwu
52b58366dc assert failed if create index with pq on ip_table on gpu, assert pass on cpu 2019-12-02 15:30:31 +08:00
zhenwu
ba3625677a assert failed if create index with pq on ip_table 2019-12-01 12:43:19 +08:00
zhenwu
fef2a9f9ae Remove some pq cases 2019-12-01 10:50:01 +08:00
zhenwu
e4c7115b9d Update timeout value 2019-11-30 19:45:47 +08:00
zhenwu
c039d0fdb0 remove multiprocessing case 2019-11-30 11:58:00 +08:00
zhenwu
4f098c121f Update timeout 2019-11-30 11:26:17 +08:00
zhenwu
de560b6be9 Update case 2019-11-29 17:51:28 +08:00
zhenwu
0dababf0eb add pq cases 2019-11-29 17:32:08 +08:00
zhenwu
19b77d1a7c fix case bug 2019-11-27 13:41:45 +08:00
zhenwu
1f725f1ec1 Add regex case for searching partition 2019-11-27 12:39:35 +08:00
yhz
5b23a7c34c fix python sdk test case bug 2019-11-26 10:36:07 +08:00
yhz
67d561dbea comment urlplus uri 2019-11-26 10:28:38 +08:00
yhz
5a27642a51 fix test case bug 2019-11-25 15:02:51 +08:00
zhenwu
a3a8e222aa remove invalid params 2019-11-25 14:53:23 +08:00
zhenwu
5268a1628c Update caser run timeout 2019-11-22 14:18:33 +08:00
zhenwu
54e113ba31 Disable multiprocess cases 2019-11-22 14:12:57 +08:00
zhenwu
29d9ac4954 [skip ci] Add ann-dataset accuracy pipeline 2019-11-22 11:13:43 +08:00
zhenwu
acf4d0459d Add partition case 2019-11-21 17:23:06 +08:00
zhenwu
394b763278 Update case 2019-11-16 18:13:31 +08:00
zhenwu
2306260ba6 Update server_version 2019-11-15 09:47:22 +08:00
zhenwu
c9b2d13619 Disble mysql-version test
Former-commit-id: e1deb82d6ddf2130a945689269c1be9e91f33f5e
2019-10-28 11:07:34 +08:00
zhenwu
5a66b9aa96 remove one case in search
Former-commit-id: 23aa50a7a89d72d1334c9a0a405020aa84004931
2019-10-25 16:42:37 +08:00
zhenwu
408b81f613 fix test case for open-version
Former-commit-id: 16427e4b2bfbe63c2d1bea4aaaa68a41fd8e1622
2019-10-25 16:14:51 +08:00
zhenwu
80682fc766 fix test case
Former-commit-id: 99aef46da1dda4e750f445f1de03d3f3701ebeec
2019-10-24 18:04:34 +08:00
zhenwu
82a271943c Update tests timeout
Former-commit-id: 15c28be882db3cc2fda3bc1520b277c144c44558
2019-10-24 16:05:14 +08:00
zhenwu
c01107e2c7 re-define case level
Former-commit-id: 6c2ae8329c1ea9e22f0cba75d6603987a874b8c8
2019-10-24 01:00:20 +08:00
zhenwu
581c662b61 remove sq8h
Former-commit-id: 31deed25ae121396fe8352efad36609452ac6c01
2019-10-24 00:52:33 +08:00
zhenwu
f410219fc2 update utils.py
Former-commit-id: 837591d04e95503c6e66f3960866949f628224e4
2019-10-23 16:43:08 +08:00
zhenwu
79baa075bc merge confict
Former-commit-id: 3e82d3abfab86d9f64b293a45d4f8f008bfda5ac
2019-10-23 14:55:03 +08:00
zhenwu
c31f60d96e Merge branch '0.5.0' into 0.5.1
Former-commit-id: 350b3c858bee51a234e322d46e0694c43c2ac0d8
2019-10-23 10:01:57 +08:00
zhenwu
13d7b1971a Update test nq size
Former-commit-id: 933de17077aa4027a827f01f30278cab6e8b8434
2019-10-23 09:53:33 +08:00
dependabot[bot]
595ebdb5e3 Bump pyyaml from 3.12 to 5.1 in /tests/milvus_benchmark
Bumps [pyyaml](https://github.com/yaml/pyyaml) from 3.12 to 5.1.
- [Release notes](https://github.com/yaml/pyyaml/releases)
- [Changelog](https://github.com/yaml/pyyaml/blob/master/CHANGES)
- [Commits](https://github.com/yaml/pyyaml/compare/3.12...5.1)

Signed-off-by: dependabot[bot] <support@github.com>
Former-commit-id: 24d3855981565733ad377ba669262fe587444eb4
2019-10-21 15:58:00 +00:00
zhenwu
c6bc56a346 Update test cases #72
Former-commit-id: e92780c6a19bf8741089ebccae828da6720af9db
2019-10-21 20:14:04 +08:00
zhenwu
db9b4e56ee remove delete vectors cases #55
Former-commit-id: fa226ff1a9ee08f0ab034d48c25a6b7fdf2a902c
2019-10-21 11:48:49 +08:00
zhenwu
0101f1ede5 update java-tests and classified python-tests by opensource and internal case #50
Former-commit-id: 944de289a6fca6d41ee8cd3f4fdc85e4cae52e3d
2019-10-19 19:34:46 +08:00