test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-06 05:49:24 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
12,661 Commits 96 Branches 105 Tags 188 MiB
495e9d566b
Commit Graph

571 Commits

Author SHA1 Message Date
Cai Yudong
a35db8eda0
Optimize retrieve to use batch mode assignment (#11647) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-12 10:06:44 +08:00
Cai Yudong
5fdc6626cb
Change API retrieve return type from CProtoResult to CProto (#11555) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-12 10:04:49 +08:00
dragondriver
daaeb27ee1
Make AdapterMgr.GetAdapter thread-safe (#11674) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-11 20:42:44 +08:00
Cai Yudong
c5f566357a
Remove debug code (#11556) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-10 17:31:37 +08:00
Cai Yudong
4df4dc8f80
Reorder header files for segcore/SealedIndexingRecord.h (#11541) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-10 17:13:41 +08:00
Cai Yudong
87b4fe2220
Remove empty file SealedIndexingRecord.cpp (#11538) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-10 17:11:45 +08:00
Cai Yudong
72340d7c36
Remove duplicated SIMD setting (#11536) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-10 17:09:37 +08:00
congqixia
85af0b571d
Add dropped segment state (#11499) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-09 18:41:37 +08:00
Cai Yudong
993d8ec4d3
Reorder header files for ScalarIndex (#11482) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-09 16:29:04 +08:00
Cai Yudong
64b47ee4b3
Reorder header files for segcore/reduce_c.h (#11481) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-09 16:27:20 +08:00
Cai Yudong
ba49490b04
Reorder header files for segcore/reduce_c.cpp (#11480) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-09 16:25:32 +08:00
Bingyi Sun
50791765d5
Add GetCompactionStateWithPlans rpc interface in milvus.proto (#11491) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-09 15:47:00 +08:00
Cai Yudong
dae65640a7
Remove redundant header file in segcore/Record.h (#11478) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-09 15:03:09 +08:00
Bingyi Sun
c3f0c5a3ff
Add compaction interfaces in proxy (#11431) 
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-09 14:47:02 +08:00
Cai Yudong
14c37058e3
Rename simd configuration valid values for better readability (#11410) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-08 22:07:05 +08:00
Cai Yudong
caf3a2405d
Update KnowhereException (#11425) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-08 22:05:05 +08:00
Cai Yudong
feb7f47faa
Reorder header files for segcore/plan_c.h (#11405) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-08 16:11:16 +08:00
Cai Yudong
f609f3f1c8
Reorder header files for segcore/plan_c.cpp (#11404) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-08 16:09:26 +08:00
Cai Yudong
315aa0aff9
Merge GetResultData and ResetResultData into ReduceResultData (#11396) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-08 15:58:58 +08:00
bigsheeper
38375ee1d3
Add LoadBalance (#9945) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-06 16:54:59 +08:00
Cai Yudong
db2a0a3bd3
Fix reduce panic (#11325) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-05 18:17:00 +08:00
godchen
09f8fa1040
Add query coord watch delta channel (#11218) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-05 14:47:19 +08:00
xige-16
b567a8e5b5
Add SystemInfo msgType for getMetricRequest (#11151) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-04 10:58:11 +08:00
Cai Yudong
f25def79ed
Add debug logs for search results handling (#11186) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-03 19:12:10 +08:00
Ji Bin
68d6839ab0
Improvements: Some adaptation for gcc-10 (#7853) 
Support windows compile with MSYS (partial). This part including:

- CMakeLists.txt using CMAKE_SHARED_LIBRARY_SUFFIX instead .so
- Replace finite() with std::isfinite()
  ref: https://github.com/facebookresearch/faiss/pull/1341
- Replace bzero (deprecated in POSIX 2001) with memset.
  ref: https://github.com/facebookresearch/faiss/pull/1340
- Some int types match.

Signed-off-by: Ji Bin <matrixji@live.com>
 2021-11-03 16:00:16 +08:00
zhenshan.cao
cd79fd07c4
Fix timetravel bug on sealed segment (#11152) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-03 12:40:12 +08:00
Cai Yudong
e059c99ada
Reorder header files for segcore/load_index_c.h (#11143) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-03 12:16:12 +08:00
Cai Yudong
9531fc5adf
Reorder header files for segcore/load_index_c.cpp (#11140) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-03 11:46:12 +08:00
Cai Yudong
40d254d09c
Reorder header files for segcore/InsertRecord.h (#11139) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-03 11:42:12 +08:00
Cai Yudong
885e5f4210
Remove redundant empty lines (#11138) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-03 11:38:15 +08:00
Cai Yudong
dca0f1a463
Reorder header files for segcore/DeletedRecord.h (#11064) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-02 14:16:31 +08:00
Cai Yudong
93339c7f49
Reorder header files for segcore/FieldIndexing.h (#11067) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-02 11:14:33 +08:00
Cai Yudong
5397449f2a
Reorder header files for segcore/FieldIndexing.cpp (#11066) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-02 11:06:30 +08:00
Cai Yudong
623a31ab42
Reorder header files for segcore/ConcurrentVector.h (#11063) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-02 11:02:28 +08:00
Cai Yudong
6d5755998b
Reorder header files for segcore/Collection.h (#11059) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-02 10:46:33 +08:00
Cai Yudong
ca936affac
Reorder header files for segcore/AckResponder.h (#11058) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-02 10:44:34 +08:00
Cai Yudong
4241326524
Update test API CheckSearchResultDuplicate (#11019) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-01 18:31:59 +08:00
yukun
d8044299a0
Add uids and seg_offsets check in segcore (#10983) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-01 15:21:52 +08:00
Cai Yudong
da0cb4a702
Use primary key only to check search result duplicate (#10949) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-01 10:06:03 +08:00
yukun
8153beffb2
[skip ci]Remove unused code in segcore (#10905) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-29 17:26:44 +08:00
yukun
64d5584670
[skip ci]Format segcore comments (#10904) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-29 17:24:51 +08:00
groot
57783827fb
Add cpp coverage (#10801) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-28 18:54:35 +08:00
yukun
36e19ab9cd
[skip ci]Format segcore code (#10815) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-28 17:22:28 +08:00
yukun
1cfafb9ee0
[skip ci]Remove unused code in segcore Search (#10814) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-28 17:20:34 +08:00
yukun
b76c526907
[skip ci]Remove unused code in segcore (#10813) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-28 17:18:41 +08:00
Cai Yudong
4186e785ab
Optimize GetResultData in reduce_c.cpp (#10797) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-28 14:24:22 +08:00
Cai Yudong
5ad4cdda25
Clean search result duplicates removal debug log (#10769) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-27 20:02:26 +08:00
xige-16
80215eb2f0
Retruen segment state when get query segment info (#10730) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-10-27 19:28:21 +08:00
yukun
5cd935729c
Fix bitmap merge in segcore (#10711) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-27 14:34:31 +08:00
Cai Yudong
07fe3758c4
Remove core/src/utils/Log.h (#10675) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 19:34:22 +08:00
Cai Yudong
492dd1a66f
Remove redundant file (#10674) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 19:32:33 +08:00
Cai Yudong
403b41084f
Remove redundant head files for SegmentGrowingImpl.cpp (#10672) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 19:30:44 +08:00
yukun
471ddb07b2
Decide the final offset when repeated keys (#10671) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-26 19:28:52 +08:00
Cai Yudong
1227b9ebae
Rename utils/tools.h to utils/Utils.h (#10665) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 17:28:23 +08:00
Cai Yudong
fa01a888a0
Remove redundant files under internal/core (#10658) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 17:26:30 +08:00
Cai Yudong
04d34bfcd7
Remove redundant code (#10635) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 13:12:21 +08:00
Cai Yudong
4cd83e78ed
Reorder header files for segcore/Collection.cpp (#10634) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 13:10:30 +08:00
Cai Yudong
06dad68f91
Add common/Consts.h (#10631) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-26 13:08:18 +08:00
godchen
6a0a5cf274
Add delete request hash values proto (#10601) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-25 21:20:44 +08:00
yukun
6c13008dc3
Fix sealed segment get deleted bitmap assert (#10572) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-25 21:18:47 +08:00
yukun
b8fd695838
Fix duplicate delete bug in growing segment (#10570) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-25 20:15:49 +08:00
Cai Yudong
e4909c1c0b
Optimize segcore API GetResultData (#10548) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-25 17:53:20 +08:00
Cai Yudong
be57e8fdd8
Remove redundant code (#10343) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-25 14:27:12 +08:00
yukun
7acb48919b
Add Delete func in Segcore SegmentSealed (#10501) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-24 14:19:10 +08:00
yukun
bc083950a8
Add delete in segcore segment sealed (#10470) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-22 23:35:18 +08:00
yukun
0304a8014b
Support delete in query (#10452) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-22 20:05:12 +08:00
yukun
f7c0f5b3da
Add segmentLoadDeletedRecord in querynode (#10449) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-22 18:51:14 +08:00
groot
73c9ab43e0
Simplify cpp (#10413) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-22 14:33:11 +08:00
yukun
fe1927c05d
Support delete in SegmentSealed (#10181) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-22 13:11:11 +08:00
Cai Yudong
824005115a
Remove duplicated search results in proxy (#10355) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-21 19:52:28 +08:00
groot
a91486e966
Fix a compile error (#10358) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-21 19:10:37 +08:00
yukun
ac581c5a38
Fix bitmap bug when delete without expression (#10325) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-21 11:01:07 +08:00
groot
525a85ef06
Remove unused code (#10285) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-20 19:21:18 +08:00
yukun
e91eafd871
Fix Bitsetview bug in segcore (#10272) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-20 16:34:36 +08:00
Cai Yudong
983bd1d473
Reorder header files for LoadInfo.h (#10264) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-20 15:46:47 +08:00
Cai Yudong
597523bf40
Reorder header files for FieldMeta.h (#10263) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-20 15:44:41 +08:00
Cai Yudong
48648c818b
Remove duplicated search results in segcore reduce (#10117) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-20 15:40:49 +08:00
Cai Yudong
ced29480cf
Format CGoHelper.h (#10261) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-20 14:56:35 +08:00
Cai Yudong
56f97aa07b
Move Log out of Milvus namespace (#10178) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-19 17:10:35 +08:00
yukun
e108476601
Support delete in SegmentGrowing (#10154) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-19 11:54:34 +08:00
Cai Yudong
39bf58d8cb
Remove deprecated API get_offset_opt (#10150) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-19 11:46:34 +08:00
Cai Yudong
693220fe0a
Remove dummy structure EntityResult (#10149) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-19 11:28:34 +08:00
Cai Yudong
eda9d550a8
Code clean for test_timestamp_index (#10148) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-19 11:10:34 +08:00
Cai Yudong
d54f3426e8
Reorder header files for test_segcore (#10051) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-18 18:38:47 +08:00
Cai Yudong
027103b4f6
Reorder header files for test_span (#10053) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-18 18:10:57 +08:00
Cai Yudong
3e3f8b825a
Reorder header files for test_sealed (#10049) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-18 18:09:04 +08:00
Cai Yudong
ffd67de9cb
Reorder header files for test_reduce (#9934) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-15 17:00:43 +08:00
Cai Yudong
356b7e36ba
Reorder header files for test_query (#9932) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-15 16:56:51 +08:00
Cai Yudong
bb721f1cf4
Format internal/core/CMakeLists.txt (#9931) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-15 16:52:43 +08:00
XuanYang-cn
ea7abf49c3
Fix protobuf compilation error (#9881) 
resolves:#9876

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-14 18:14:32 +08:00
Cai Yudong
5a8aca01fd
Reorder header files for test_plan_proto (#9871) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-14 16:52:33 +08:00
Cai Yudong
8dbc3db393
Remove dummy test_naive (#9850) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-14 12:52:33 +08:00
Cai Yudong
30661321f2
Remove dummy test_interface (#9848) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-14 12:50:37 +08:00
Cai Yudong
937e59f6c3
Remove dummy test_load (#9847) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-14 11:06:39 +08:00
ZhiShen
6a770e5c38
Make knowhere compile independently (#7606) 
Make knowhere compile independently

1. Make knowhere compile independently
    * Add gtest, arrow, and some other libraries to index.
    * Add cache, log and some other files to knowhere.
    * Add CMakeLists files to index's thirdparty.

2. Modified the compilation content of knowhere
    * Delete some content of compile library.
    * Add IMPORTED_GLOBAL property to faiss.

3.  Change the compilation location of some libraries
    * Make OpenBLas compiled in thirdpartycore.cmake.
    * Make faiss compiled in thirdparty/CMakeLists.

Change the content of knowhere/CMakeLists

1. Change easyloggingpp and nlohmann into index/thirdparty.
2. Change MILVUS_THIRDPARTY_SRC into KNOWHERE_THIRDPARTY_SRC.

Delete FindOpenBLAS

1. Delete Openblas.cmake.

2. The search task for openBlas is assigned to ThirdpartyCore.

3. Some changes were made to build.sh in index.

Fix the openBLas compilation problem

Delete the if-else in compilation of faiss;

Now when complie faiss, it will find the Openblas as we wish.

Fix some problem:

1. delete arrow

2. set openblas_source to AUTO

3. change a include_dir

4. delete MKL

5. delete the CMakeLists in index/utils,cache,log

Change variable build_test to knowhere_build_test in index/build.sh

Change the include location of  GNUInstallDirs

set CMAKE_INSTALL_LIBDIR

Resolves: milvus-io#5183
See also: milvus-io#6604

Signed-off-by: Shen Zhi <m13120163046@163.com>
 2021-10-13 17:06:33 +08:00
yukun
6c88774624
Add get final filtered bitmap in SegmentGrowing (#9780) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-13 16:54:34 +08:00
Cai Yudong
92c7eb5a09
Code clean for test_interface (#9767) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-13 11:06:33 +08:00
Cai Yudong
ca5e3e8644
Code clean for test_indexing (#9765) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-13 11:00:39 +08:00
Cai Yudong
01db5dc6dd
Code clean for test_init (#9766) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-13 10:58:33 +08:00
Cai Yudong
2d8e86692a
Format test_expr.cpp (#9698) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-12 12:48:34 +08:00