test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-04 21:09:06 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
14,633 Commits 96 Branches 105 Tags 186 MiB
64d2793fe9
Commit Graph

264 Commits

Author SHA1 Message Date
XuanYang-cn
6a13386393 Add DataNode package 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-19 11:37:16 +08:00
neza2017
1ce32d8775 Add master service 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-19 09:45:42 +08:00
bigsheeper
aaf8b0ad40 Add sealed segment, segment type and manager, send loadIndexReq to service's buffer 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-19 10:29:16 +08:00
FluorineDog
9ff1bc0f99 Adapt Expr Executor to SegmentInternalInterface, fix row_count consistency 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-01-16 18:12:58 +08:00
XuanYang-cn
37688559f1 Fix multi rowdata writenode crash bug 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-16 15:06:19 +08:00
bigsheeper
46a14da3eb Implement segment manager and loadSegment 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-16 15:04:32 +08:00
FluorineDog
16ff16b212 Renaming and add load index api beta 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-01-16 10:48:01 +08:00
quicksilver
7fe061b846 Raneme init_devcontainer.sh to devcontainer.sh 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-15 14:38:36 +08:00
neza2017
56ab2bda2d Update proto:add partition id 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-15 11:53:22 +08:00
FluorineDog
8fccf7e630 Use bitset_view at search 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-01-15 13:40:51 +08:00
FluorineDog
7d81222550 Support span in SegmentGrowing, refine vector_trait 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-01-15 10:32:50 +08:00
FluorineDog
63ca5f8031 Add span and segment interface, rename segment_growing and use interface as base 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-01-13 18:46:25 +08:00
GuoRentong
1104f059ee Update doc:module interfaces 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2021-01-13 11:08:03 +08:00
quicksilver
8e9d8e36e1 Update run_go_unittest.sh 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-13 10:40:46 +08:00
FluorineDog
4cd42c553f Rename field_name, make field_id strongly typed, skip multithread test 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-01-12 18:31:52 +08:00
sunby
3ae04794f6 Fix bug in describeIndexProgressTask 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-07 15:39:20 +08:00
FluorineDog
34a00aacfa Enable binary index in segcore 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-01-07 15:00:42 +08:00
dragondriver
ced56c84f8 Add support to build binary vector index 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-07 14:56:17 +08:00
godchen
8f1f118b26 Add query opentracing 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-01-07 14:24:35 +08:00
FluorineDog
3bf205d9a8 Fix inner product 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-01-07 09:32:17 +08:00
xige-16
8715cd1f0c Fix key error when loading index 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-01-06 18:19:44 +08:00
bigsheeper
a1e2ff3c26 Add gcNode to write node 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-06 16:44:12 +08:00
neza2017
4015d7245d Merge operation 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-06 14:45:50 +08:00
cai.zhang
1cfc2ff0a5 Add make clean in Makefile 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-06 13:50:48 +08:00
sunby
da6eeddbf8 Add flush timestamp 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-06 13:14:38 +08:00
FluorineDog
5a26f6ef21 Enable sub_query_result 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-01-06 12:01:13 +08:00
godchen
1c87faf8b3 Add insert request opentracing 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-01-06 11:17:35 +08:00
FluorineDog
e16a7478da Add verifier 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-01-05 20:13:54 +08:00
dragondriver
bccf8d2098 Add query support for ivf-flat, nsg 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-05 19:20:55 +08:00
bigsheeper
1ba47ac433 Check system field in segCore 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-04 10:13:01 +08:00
quicksilver
1927eaf88b Add revive linter 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-12-31 16:38:37 +08:00
zhenshan.cao
59878b1dbb Add lazy connect logic for indexbuilder 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-31 15:44:06 +08:00
dragondriver
6cd8c2528d Add parameter check for almost all index type 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-12-31 15:16:03 +08:00
xige-16
29b21b4bf2 Refactor reduce strategy in query node 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-12-31 14:49:27 +08:00
dragondriver
2e198e2783 Add support for idmap, nsg, sq8 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-12-30 19:37:45 +08:00
zhenshan.cao
adf77c423c Update knowhere 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-30 18:30:51 +08:00
bigsheeper
4835d82060 Add index builder test cases 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-12-30 18:16:34 +08:00
dragondriver
243346247b Add unittest case which used in regression to index builder 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-12-29 16:31:03 +08:00
xige-16
be32a33eff Refactor loadIndexTest to test diffrent index params 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-12-29 14:43:40 +08:00
cai.zhang
f80536ed77 Update the logic of running go unittest 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-29 11:56:37 +08:00
XuanYang-cn
9577da9fce Add writenode main 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-12-28 18:52:34 +08:00
FluorineDog
eb8717188e Enable load index 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-12-28 17:55:48 +08:00
dragondriver
f67aae9596 Fix the codec bug of cgo wrapper of index builder 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-12-28 16:55:50 +08:00
dragondriver
11cef6e978 Add support to build binary index 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-12-28 10:00:02 +08:00
xige-16
d599407e2b Add unittest for loadIndex service 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-12-26 14:16:51 +08:00
dragondriver
84a0cf7097 Add unittest to c index wrapper 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-12-25 11:10:31 +08:00
XuanYang-cn
c0797333ce Add ddl binlog metaTable in writenode 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-12-24 20:55:40 +08:00
neza2017
4dbf4ade41 Add test for master 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-24 16:19:42 +08:00
xige-16
f5198bcaee Add LoadIndexService in query node 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-12-24 14:51:55 +08:00
FluorineDog
342f4cb741 Support dynamic chunk size 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-12-23 19:02:37 +08:00
FluorineDog
d5daa18392 Enable most DSL-related cases 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-12-21 14:45:00 +08:00
sunby
c71cd40f68 Refactor segment manager 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-12-19 12:55:24 +08:00
FluorineDog
e65cfe1e3d Enable complex dsl parser 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-12-19 10:36:49 +08:00
zhenshan.cao
0d75840ed6 Fix missing file 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-18 18:35:03 +08:00
FluorineDog
1540cffbb1 Add executor for expression 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-12-12 18:17:53 +08:00
FluorineDog
02f855359a Fix term bug and add todo note 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-12-10 20:13:37 +08:00
bigsheeper
762b1e1f1f Add ddService, fieldID, requestID and refactor params table, fix nil hits search result bug 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-12-10 16:31:09 +08:00
sunby
ed54d3e26c Fix binlog reader bug 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-12-09 09:55:56 +08:00
quicksilver
d09ad77fb2 Add archiving file workflow for cache thirdparty 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-12-08 19:53:22 +08:00
sunby
8ace1c3837 Add binlog serialization and deserialization 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-12-08 19:13:39 +08:00
XuanYang-cn
e6f726e73a Add cache for thirdparty files cache 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-12-08 18:51:07 +08:00
neza2017
70710dee47 Add parquet payload 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-05 16:11:03 +08:00
FluorineDog
63c8f60c6e Enable term parser and executor 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-12-05 09:51:27 +08:00
FluorineDog
6412ebc0d4 Add support of metric type in schema, enable binary vector, fix segfault 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-12-05 06:46:01 +08:00
godchen
7ab5b5d80d Add MinIO kv implements 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-12-03 19:00:11 +08:00
neza2017
cec903da19 Add parquet payload 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-02 18:31:56 +08:00
xige-16
36cf8a8ea7 Support return primary key when doing search 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-12-03 17:18:06 +08:00
zhenshan.cao
23aebe7e2a Fix proxy unittest 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-01 19:53:53 +08:00
cai.zhang
c1fbc4f8fa Open the tests for insert 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-01 15:18:57 +08:00
FluorineDog
6b74d82259 Support some validation for dsl parser 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-12-01 02:16:53 +08:00
zhenshan.cao
fda8d62b38 Fix make error 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-30 22:14:19 +08:00
bigsheeper
0cd3e8d86c Use exception instead of runtime error 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-30 17:58:23 +08:00
quicksilver
86573d0053 Create Jenkins pipeline 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-11-30 10:07:04 +08:00
FluorineDog
77fa75b1ec Add binary insert and warper of binary search, rename vector 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-30 05:18:44 +08:00
cai.zhang
85a544b79b Add dockerfile for each component 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-28 19:06:48 +08:00
dragondriver
568cef0730 Fix InsertTask and SearchTask 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-28 10:48:29 +08:00
FluorineDog
c9fb34142c Enable primary_key switch 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-28 09:16:00 +08:00
neza2017
32445dd02b Add cpu profile 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-26 16:01:31 +08:00
cai.zhang
57da66ba72 Update read config logic in docker 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-26 15:18:36 +08:00
zhenshan.cao
045fc3d808 Fix segment fault 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-26 14:29:01 +08:00
XuanYang-cn
0a16a9a651 Add logic of getting milvus distributed config from master by grpc 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-26 13:21:06 +08:00
dragondriver
8ce0deca4e Add default partition tag to InsertTask in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-26 11:38:04 +08:00
xige-16
ae78aa1ac1 Warp cpp reduce and repack searchResultMsg to specified pulsar channel 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-11-26 11:12:33 +08:00
sunby
f4c643f1bd Add number limitation of partition and field. And Change default partition tag to "_default" 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-25 18:39:05 +08:00
zhenshan.cao
f12366342f Fix bug and delete unused code 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-25 16:45:42 +08:00
bigsheeper
3b24c52a8c Catch cpp runtime error 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-25 16:20:07 +08:00
FluorineDog
df1dcf81b9 Update cpplint.py and lint all files 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-24 21:28:38 +08:00
FluorineDog
83379977b2 Enable structured index 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-24 19:09:57 +08:00
FluorineDog
9f35dee2df Support range executor 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-21 15:56:13 +08:00
GuoRentong
8b88a9c306 Update docs: master::syncMsgProducer 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2020-11-21 11:39:23 +08:00
xige-16
cf11212932 Refactor reduce using cgo in query node 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-11-19 14:13:39 +08:00
neza2017
ce89f64bb3 Set master config 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-19 10:46:17 +08:00
sunby
9e4ce8454e Implement segment management in master 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-18 15:04:17 +08:00
FluorineDog
e7dd30a884 Add framework of ExecExprVisitor 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-18 17:32:52 +08:00
cai.zhang
c7861c2dba Add the check of C++ code in the CI progress 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-18 10:07:05 +08:00
dragondriver
b32e55d5f0 Add timeout logic to task in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-17 20:00:23 +08:00
xige-16
833fee59d9 Add searchService for query node 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-11-17 10:07:42 +08:00
FluorineDog
8c48cf30c0 Format and and extra parameters for checking 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-16 15:41:56 +08:00
xige-16
d59f6ac6ca Add queryNodeSegStatsMsg for msgStream 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-11-16 10:55:49 +08:00
dragondriver
c2382adf04 Initialize the task scheduler of Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-14 11:24:49 +08:00
FluorineDog
f47fc7fef1 Using std::string instead of char * for PlaceholderGroup 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-13 19:37:59 +08:00
FluorineDog
f0ec7a8c78 Support Placeholder Parser and refine CreatePlan on predicate-less 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-12 12:18:07 +08:00
FluorineDog
5e67e5eb43 Enable Query Executor without predicates 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-10 13:17:31 +08:00
bigsheeper
be409b29c8 Refactor cgo collection, partition and segment 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-09 18:07:15 +08:00
FluorineDog
3ff3a5b659 Add ShowPlanNodeVisitor under visitor pattern 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-06 15:34:39 +08:00
FluorineDog
e45df02874 Add Generator for visitor pattern (#89) 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-05 14:30:52 +08:00
FluorineDog
d7ef21c644 Remove message.pb and reformat 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-03 12:42:13 +08:00
FluorineDog
9d2fa4e430 Add SyntaxTree of QueryNode and Expr 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-03 11:45:48 +08:00
GuoRentong
15b6963be0 Replace pdf figs with png figs 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2020-10-31 15:11:47 +08:00
quicksilver
d66d48c6b6 Enable UnitTest 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-10-27 15:51:16 +08:00
shengjh
77b2fcf015 Refactor manipulationreq and add tso(pre-alloc from master) 
Signed-off-by: shengjh <1572099106@qq.com>
 2020-10-27 12:01:27 +08:00
quicksilver
eb64839aef Update build environment 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-10-26 15:45:18 +08:00
FluorineDog
e84b0180c9 Refactor cmake and build script and add timed benchmark 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-10-23 18:01:24 +08:00
zhenshan.cao
64295db471 Refact master and proxy and add etcdutil 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-15 21:31:50 +08:00