Commit Graph

4700 Commits

Author SHA1 Message Date
allcontributors[bot]
03feed8907 docs: add aaronjin2010 as a contributor (#1089)
* docs: update README.md [skip ci]

* docs: update .all-contributorsrc [skip ci]
2020-01-17 19:03:38 +08:00
del-zhenwu
8f88529fc1 Add nightly test notification && improve test case stability (#1056)
* Update framework

* remove files

* Remove files

* Remove ann-acc cases && Update java-sdk cases

* change cn to en

* [skip ci] remove doc test

* [skip ci] change cn to en

* Case stability

* Add mail notification when test failed

* Add main notification

* Add main notification

* gen milvus instance from utils

* Distable case with multiprocess

* Add mail notification when nightly test failed

* add milvus handler param

* add http handler

Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-01-17 09:59:49 +08:00
quicksilver
5ec1baaede run hadolint with reviewdog (#1060)
* run hadolint with reviewdog

* add LINCENSE in Dockerfile

* run hadolint with reviewdog

* Reporter of reviewdog command is "github-pr-check"

* format Dockerfile

* ignore DL3007 in hadolint
2020-01-16 19:59:26 +08:00
quicksilver
f081276377
Merge pull request #1040 from ZhifengZhang-CN/master
Flag the upload to group coverage metrics
2020-01-15 20:58:14 +08:00
quicksilver
4f364a3826 Fix Failed to upload bug 2020-01-15 20:56:50 +08:00
quicksilver
e70fec4102 Fix Failed to upload bug 2020-01-15 19:20:02 +08:00
quicksilver
1c5f41f615 Fix Failed to upload bug 2020-01-15 16:01:58 +08:00
quicksilver
becc1c4417 Fix bug 2020-01-15 14:29:25 +08:00
quicksilver
3fee1c88bf Format Codecov 2020-01-15 14:00:41 +08:00
quicksilver
cc7b21fba0 Flag the upload to group coverage metrics 2020-01-15 11:19:31 +08:00
quicksilver
cb1a3b35e8 update codecov file 2020-01-15 11:06:48 +08:00
groot
0f1aa5f8bb Tanimoto distance (#1016)
* Add log to debug #678

* Rename nsg_mix to RNSG in C++ sdk #735

* [skip ci] change __function__

* clang-format

* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo

* define interface

* Define interface (#832)

* If partition tag is similar, wrong partition is searched  (#825)

* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo

* define interface Attach files by dragging & dropping, selecting or pasting them. 

Co-authored-by: groot <yihua.mo@zilliz.com>

* faiss & knowhere

* faiss & knowhere (#842)

* Add log to debug #678

* Rename nsg_mix to RNSG in C++ sdk #735

* [skip ci] change __function__

* clang-format

* If partition tag is similar, wrong partition is searched  (#825)

* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo

* faiss & knowhere

Co-authored-by: groot <yihua.mo@zilliz.com>

* support binary input

* code lint

* add wrapper interface

* add knowhere unittest

* sdk support binary

* support using metric tanimoto and hamming

* sdk binary insert/query example

* fix bug

* fix bug

* update wrapper

* format

* Improve unittest and fix bugs

* delete printresult

* fix bug

* #823 Support binary vector tanimoto metric

* fix typo

* dimension limit to 32768

* fix

* dimension limit to 32768

* fix describe index bug

* fix #886

* fix #889

* add jaccard cases

* hamming dev-test case

* change test_connect

* Add tanimoto cases

* change the output type of hamming

* add abs

* merge master

* rearrange changelog id

* modify feature description

Co-authored-by: Yukikaze-CZR <48198922+Yukikaze-CZR@users.noreply.github.com>
Co-authored-by: Tinkerrr <linxiaojun.cn@outlook.com>
2020-01-14 19:22:27 +08:00
quicksilver
297e7e8831
Merge pull request #1025 from ZhifengZhang-CN/master
Fix cleanupSingleDev groovy file bug
2020-01-14 14:10:29 +08:00
quicksilver
d235765875 Fix cleanupSingleDev groovy file bug 2020-01-14 10:58:13 +08:00
groot
f6b72d9605 #977 Server crash when create tables concurrently (#991)
* #766 If partition tag is similar, wrong partition is searched

* #766 If partition tag is similar, wrong partition is searched

* reorder changelog id

* typo

* #977 Server crash when create tables concurrently
2020-01-13 13:59:08 +08:00
Lutkin Wang
a0a5076430 [skip ci] Update C++ SDK readme. (#973)
* Update README.md

Update C++ SDK readme.

* [skip ci] Update C++ SDK readme.
2020-01-13 13:56:59 +08:00
del-zhenwu
a5beec86f2 Change lang cn to en in reademe (#971)
* Update framework

* remove files

* Remove files

* Remove ann-acc cases && Update java-sdk cases

* change cn to en

* [skip ci] remove doc test

* [skip ci] change cn to en
2020-01-13 13:56:15 +08:00
BossZou
a0faf1a786 Add http server (#956)
* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t

* add web server

* [skip ci] add license in web module

* modify header include & comment oatpp environment config

* add port configure & create table in handler

* modify web url

* simple url complation done & add swagger

* make sure web url

* web functionality done. debuging

* add web unittest

* web test pass

* add web server port

* add web server port in template

* update unittest cmake file

* change web server default port to 19121

* rename method in web module & unittest pass

* add search case in unittest for web module

* rename some variables

* fix bug

* unittest pass

* web prepare

* fix cmd bug(check server status)

* update changlog

* add web port validate & default set

* clang-format pass

* add web port test in unittest

* add CORS & redirect root to swagger ui

* add web status

* web table method func cascade test pass

* add config url in web module

* modify thirdparty cmake to avoid building oatpp test

* clang format

* update changlog

* add constants in web module

* reserve Config.cpp

* fix constants reference bug

* replace web server with async module

* modify component to support async

* format

* developing controller & add test clent into unittest

* add web port into demo/server_config

* modify thirdparty cmake to allow build test

* remove  unnecessary comment

* add endpoint info in controller

* finish web test(bug here)

* clang format

* add web test cpp to lint exclusions

* check null field in GetConfig

* add macro RETURN STATUS DTo

* fix cmake conflict

* fix crash when exit server

* remove surplus comments & add http param check

* add uri /docs to direct swagger

* format

* change cmd to system

* add default value & unittest in web module

* add macros to judge if GPU supported

* add macros in unit & add default in index dto & print error message when bind http port fail

* format (fix #788)

* fix cors bug (not completed)

* comment cors

* change web framework to simple api

* comments optimize

* change to simple API

* remove comments in controller.hpp

* remove EP_COMMON_CMAKE_ARGS in oatpp and oatpp-swagger

* add ep cmake args to sqlite

* clang-format

* change a format

* test pass

* change name to

* fix compiler issue(oatpp-swagger depend on oatpp)

* add & in start_server.h

* specify lib location with oatpp and oatpp-swagger

* add comments

* add swagger definition

* [skip ci] change http method options status code

* remove oatpp swagger(fix #970)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* [skip ci] Fix some broken links (#960)

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken links

* fix issue 373 (#964)

* fix issue 373

* Adjustment format

* Adjustment format

* Adjustment format

* change readme

* #966 update NOTICE.md (#967)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* adjust web port cofig place

* rename web_port variable

* set advanced config name add DEFAULT

Co-authored-by: jielinxu <52057195+jielinxu@users.noreply.github.com>
Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-01-13 13:55:48 +08:00
aaronjin2010
c787b84daa refactor code and add error log (#976)
* refactor code and add error log

* remove the space

* refactor

* refactor
2020-01-13 09:30:14 +08:00
れいげん あらたか
5d2d34791d fix #651; use initialized instead of shutting_down_ (#993) 2020-01-11 09:27:21 +08:00
Cai Yudong
fd24d6f96c [skip ci]#966 update NOTICE.md (#969) 2020-01-10 19:25:10 +08:00
milvus
54435fc03b [skip ci] fix broken links (#985)
Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com>
2020-01-10 19:23:30 +08:00
shiyu22
bbfb5f8ded add ground truth (#980)
* add milvus ground truth

* add milvus groundtruth

* [skip ci] add milvus ground truth
2020-01-10 19:22:17 +08:00
quicksilver
8acdb499c4
Merge pull request #989 from ZhifengZhang-CN/master
Setting image pullPolicy to Always on Deploy stage
2020-01-10 15:12:56 +08:00
quicksilver
ec56977d30 Setting image pullPolicy to Always on Deploy stage 2020-01-10 15:10:26 +08:00
quicksilver
283aa7453b Merge remote-tracking branch 'upstream/master' 2020-01-10 15:06:17 +08:00
Cai Yudong
b2f19ace0e #966 update NOTICE.md (#967) 2020-01-09 15:35:13 +08:00
JackLCL
bdd9fc878b fix issue 373 (#964)
* fix issue 373

* Adjustment format

* Adjustment format

* Adjustment format

* change readme
2020-01-09 15:34:25 +08:00
jielinxu
c920ceb65b [skip ci] Fix some broken links (#960)
* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken links
2020-01-09 11:39:33 +08:00
jielinxu
4a116a6018 [skip ci] Create SUPPORT.md and RELEASE.md (#950)
* [skip ci] Create SUPPORT.md

* [skip ci] Create RELEASE.md
2020-01-08 14:51:58 +08:00
jielinxu
95be87026a Create SECURITY.md (#947) 2020-01-08 10:40:30 +08:00
Cai Yudong
3c02b4b581 add s3 mock for unittest (#937)
* #815 change S3 client_ptr_ to shared_ptr

* #815 install test_storage to unittest

* #815 add MockS3Client.h for unittest

* #815 optimize MockS3Client.h

* #815 update unittest

* #815 update unittest

* #815 fix clang-format

* #815 use FIU for unittest

* #815 enable FIU in jenkins

* #815 update unittest

* #815 enable FIU in docker build
2020-01-08 10:39:05 +08:00
Jin Hai
988dc399ac
Add CODEOWNERS file (#945)
* [skip ci]#668 - Update badge of README

* Fix README.md

* Fix README.md

* Merge remote-tracking branch 'upstream/master'

* #910 Change c++ standard to c++17

* Remove unused headers

* #910 Change Milvus c++ standard to c++17

* #910 Change Milvus c++ standard to c++17

* #941 Update CONTRIBUTING.md

* [skip ci] Add CODEOWNERS file #943

* Add bestpractice badge
2020-01-07 18:29:16 +08:00
jielinxu
a1d722a64a Create pull request template (#944)
* Update README.md

* [skip ci] Add IVFLAT links

* [skip ci] Minor

* Create PULL_REQUEST_TEMPLATE.md
2020-01-07 17:57:27 +08:00
Jin Hai
4c2276a91c
Update CONTRIBUTING.md (#942)
* [skip ci]#668 - Update badge of README

* Fix README.md

* Fix README.md

* Merge remote-tracking branch 'upstream/master'

* #910 Change c++ standard to c++17

* Remove unused headers

* #910 Change Milvus c++ standard to c++17

* #910 Change Milvus c++ standard to c++17

* #941 Update CONTRIBUTING.md
2020-01-07 17:04:15 +08:00
del-zhenwu
7cad494101 Enhance testing framework based on kubernetes (#935)
* Update framework

* remove files

* Remove files

* Remove ann-acc cases && Update java-sdk cases
2020-01-07 16:20:37 +08:00
Cai Yudong
69d42a3d70 remove collector from config (#939)
* #931 remove collector from config

* #931 fix test_metrics build error
2020-01-07 16:14:38 +08:00
yukun
a92a43e282 Add push mode for prometheus monitor (#905)
* Add push mode for prometheus monitor

* format code

* fix for comments

* fix test_MetricBase bug

* Change ip to address in config
2020-01-06 18:35:10 +08:00
Jin Hai
28e61ee4ec
[skip ci] Change Milvus c++ standard to c++17 (#932)
* [skip ci]#668 - Update badge of README

* Fix README.md

* Fix README.md

* Merge remote-tracking branch 'upstream/master'

* #910 Change c++ standard to c++17

* Remove unused headers

* #910 Change Milvus c++ standard to c++17

* #910 Change Milvus c++ standard to c++17
2020-01-06 17:40:28 +08:00
quicksilver
c2643317c9 Change milvus helm version to master (#929)
* specify multiple urls on sqlite_orm download stage

* fix bug

* fix bug

* specify multiple urls on opentracing download stage

* fix bug

* specify multiple urls on download stage

* delete jfrog cache

* print jenkins enviroment variables

* print jenkins enviroment variables

* fix check_ccache.sh bug

* debug

* Update Jenkinfile

* Add build enviroment resource limit on Jenkins CI

* remove Jfrog cache build option

* Custom defined name for the upload on Codecov

* change milvus helm version to master
2020-01-06 17:11:55 +08:00
quicksilver
b005e23178 change milvus helm version to master 2020-01-06 15:26:26 +08:00
quicksilver
7af7ebf20c Merge remote-tracking branch 'upstream/master' 2020-01-06 14:57:07 +08:00
jielinxu
3ecfe1d9c3 [skip ci] Update README.md (#896)
* Update README.md

* [skip ci] Add IVFLAT links

* [skip ci] Minor
2020-01-06 11:06:14 +08:00
Jin Hai
a876ae1b64
Change C++ standard to c++17 (#911)
* [skip ci]#668 - Update badge of README

* Fix README.md

* Fix README.md

* Merge remote-tracking branch 'upstream/master'

* #910 Change c++ standard to c++17

* Remove unused headers
2020-01-04 18:48:22 +08:00
李盛俊
82eb69fbed remove redundant checks (#860) (#907)
* delete redundant check (#860)

* add changelog

Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-01-04 15:52:48 +08:00
Cai Yudong
28da6c73d0 #908 move primary_path and secondary_path to storage config (#909) 2020-01-04 15:44:46 +08:00
Cai Yudong
b9d9b8ecc2 support minio storage (#895)
* #815 add S3 client

* #815 update S3 interface

* #815 add bucket_name_ as class field, add StartService() and StopService()

* #815 add FileIOReader and FileIOWriter

* #815 fix unittest test_storage build error

* #815 add GetObjectStr()

* #815 add S3IOReader/S3IOWriter

* #815 add ListObjects(), support put string with \0, launch S3 service when server start

* #815 read/write s3 index file pass

* #815 add MinIO related config

* #815 fix storage config issuegs

* #815 code clean

* #815 use local file or S3 via minio_enable

* #815 add DeleteObjects() for S3

* #815 print out IO rate when read_index & write_index

* #815 clean code

* #815 fix centos build error

* #815 support MinIO storage

* #815 fix typo
2020-01-04 10:39:52 +08:00
shengjh
ba36d18d10 Fix mysqlmetaimpl (#869)
* *fix mysqlMetaImpl Initialize failed create directory

* *style: format code

* *style: format code

* *style: format code

* *style: format code

* *fix: sqliteMetaImpl Initialize failed create directory

* add empty line to trigger CI
2020-01-02 17:32:41 +08:00
Yukikaze-CZR
397a757f6f IVFTest.gpu_seal_test unittest failed #805 (#888)
* Add log to debug #678

* Rename nsg_mix to RNSG in C++ sdk #735

* [skip ci] change __function__

* clang-format

* IVFTest.gpu_seal_test unittest failed #805

* rerun jenkins CI

* fix test_util
2020-01-02 14:03:28 +08:00
quicksilver
62c2c3c7bb Merge remote-tracking branch 'upstream/master' 2019-12-31 15:05:36 +08:00