test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-05 05:18:52 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
7,895 Commits 96 Branches 105 Tags 186 MiB
42aafdc407
Commit Graph

227 Commits

Author SHA1 Message Date
xige-16
2ca53fa668 Fix msgstream deadlock when loadCollection 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-02-07 15:47:10 +08:00
yukun
563a8d66ae Add RmqTtMsgStream 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-02-07 15:10:13 +08:00
yukun
099220394e Add rmq_msgstream unittest and fix bugs 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-02-06 11:39:12 +08:00
XuanYang-cn
dd72dfcbd1 Fix queryservice start 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-02-05 17:57:41 +08:00
godchen
c231f6da79 Fix collectionName not found error 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-02-05 16:32:03 +08:00
xige-16
57ba236117 Add mutex for message stream’s asConsumer 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-02-05 15:42:53 +08:00
godchen
c2ca2c276f Fix response check error 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-02-04 19:34:35 +08:00
yukun
e3fadc45d4 Fix for new msgstream interface 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-02-04 15:23:21 +08:00
zhenshan.cao
b89e5a3240 Add GetQuerySegmentInfo 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-02-04 14:37:12 +08:00
sunby
71b6c88c6e Defer lock's unlock in meta::DropSegment 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-02-04 11:52:10 +08:00
Xiangyu Wang
8d35e76ad1 Change Msgstream interface 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-02-04 13:55:47 +08:00
godchen
6e7e0b748a Send timetick to insert channel 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-02-03 20:04:29 +08:00
Xiangyu Wang
fd9e42d3ed Update msgstream/unmarshal interface 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-02-03 17:30:10 +08:00
bigsheeper
abffdbff62 Remove partition tag 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-02-03 16:44:38 +08:00
yukun
35f6f4b7c2 Add consume in rmq_msgstream 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-02-03 15:18:54 +08:00
xige-16
4cd315408b Refactor query service’s meta interface 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-02-02 11:52:41 +08:00
zhenshan.cao
c2914dd113 Refactor segment allocator, use collectionID and partitionID 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-31 10:15:54 +08:00
neza2017
854accf95b Remove master and writenode 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-30 16:41:47 +08:00
cai.zhang
f940cc455a Add dockerfile for index 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-26 09:38:40 +08:00
FluorineDog
a8fd6e7686 Enable drop index/field_data and extract info visitor 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-01-25 18:59:44 +08:00
yukun
5600d06583 Add global_rmq 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-01-25 18:53:08 +08:00
neza2017
5aec8bc5e6 Refactor masterservice 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-24 20:26:35 +08:00
neza2017
92e3c519d9 Use FlushCompletedMsg instead 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-23 10:40:34 +08:00
neza2017
e68d50f29e Invalid collection meta caceh && ingore time stamp if not dd request 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-23 10:12:41 +08:00
XuanYang-cn
50e2369000 Change name and tag to ID 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-22 19:36:09 +08:00
XuanYang-cn
377ee8687d Modify flush logic 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-22 09:36:40 +08:00
XuanYang-cn
ec27788628 Add segment statistics updates logic for datanode 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-21 09:55:25 +08:00
xige-16
76bc365181 Add seek function for pulsarTtMsgStream 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-01-20 17:34:50 +08:00
BossZou
4588342fa1 Add IdAlocator service 
Signed-off-by: BossZou <yinghao.zou@zilliz.com>
 2021-01-20 15:02:23 +08:00
Xiangyu Wang
7ee8623e1a Refactor msgstream 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-01-20 10:02:59 +08:00
zhenshan.cao
2ec573d2f9 Recover delete docs 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-20 09:36:50 +08:00
cai.zhang
fb493cc235 Update interface name of GetIndexStates 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-19 18:32:57 +08:00
neza2017
918e279869 Set msg stream 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-19 16:14:13 +08:00
zhenshan.cao
76d92e73d1 Replace old proto with new proto 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-18 21:39:56 +08:00
xige-16
d22c2cd203 Add proto for query service loading collection 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-01-18 19:32:08 +08:00
XuanYang-cn
37688559f1 Fix multi rowdata writenode crash bug 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-16 15:06:19 +08:00
Xiangyu Wang
52bd6abdf8 Change RocksMQ interface 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-01-13 17:26:57 +08:00
bigsheeper
2d2af1505a Improve mutex usage in query node 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-12 18:03:24 +08:00
GuoRentong
f3d2afa4f4 Update doc:detailed interface definition 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2021-01-11 18:35:54 +08:00
bigsheeper
01781103a9 Fix incorrect usage of msgStream and illegal check in master 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-11 18:02:22 +08:00
quicksilver
a6690dbc99 Fix syntax error: Bad fd number 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-11 15:25:19 +08:00
yukun
18cfd31d40 Fix Load and Remove with prefix 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-01-11 15:17:06 +08:00
zhenshan.cao
02df310fa5 Fix data race 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-09 12:30:22 +08:00
xige-16
f4566731fc Fix search error in regression test 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-01-09 09:47:22 +08:00
sunby
5dfe9448ae Modify test_index 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-08 16:00:16 +08:00
GuoRentong
82ad488555 Update doc: rocksmq 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2021-01-08 18:37:24 +08:00
XuanYang-cn
65089ea362 Fix flush sync test bug and remove unecessary lock in meta_table 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-08 17:20:59 +08:00
GuoRentong
c4599e26de Update doc: node api 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2021-01-08 16:59:19 +08:00
bigsheeper
e13822043d Fix search test when partition not exists, add binary vector search validation 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-08 16:41:27 +08:00
godchen
fa73f17f94 Add opentracing doc 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-01-08 15:32:38 +08:00
dragondriver
ced56c84f8 Add support to build binary vector index 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-07 14:56:17 +08:00
godchen
8f1f118b26 Add query opentracing 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-01-07 14:24:35 +08:00
bigsheeper
a1e2ff3c26 Add gcNode to write node 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-06 16:44:12 +08:00
neza2017
4015d7245d Merge operation 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-06 14:45:50 +08:00
zhenshan.cao
b06e01f523 Initmate querynode collection manager 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-06 11:31:36 +08:00
godchen
1c87faf8b3 Add insert request opentracing 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-01-06 11:17:35 +08:00
bigsheeper
b7fc945aca Add flush msg unmarshal function register 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-12-31 17:25:45 +08:00
XuanYang-cn
c0797333ce Add ddl binlog metaTable in writenode 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-12-24 20:55:40 +08:00
neza2017
4dbf4ade41 Add test for master 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-24 16:19:42 +08:00
xige-16
f5198bcaee Add LoadIndexService in query node 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-12-24 14:51:55 +08:00
XuanYang-cn
d64aa37db3 Add KFlush msg type 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-12-11 12:01:20 +08:00
xige-16
0067e2d989 Add load index client in query node 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-12-11 11:29:54 +08:00
bigsheeper
762b1e1f1f Add ddService, fieldID, requestID and refactor params table, fix nil hits search result bug 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-12-10 16:31:09 +08:00
zhenshan.cao
7bbbc14637 Fix bug: address already used 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-07 15:22:20 +08:00
xige-16
37d7526d31 Fix search test failure 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-12-07 14:37:42 +08:00
neza2017
aeca8f85a5 Run cwrapper unittest in ci 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-05 17:39:58 +08:00
cai.zhang
806a97505c Add query node for CI progress 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-05 16:12:45 +08:00
FluorineDog
6412ebc0d4 Add support of metric type in schema, enable binary vector, fix segfault 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-12-05 06:46:01 +08:00
zhenshan.cao
0b6fe0a8cf Refactor paramtable 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-04 14:18:17 +08:00
godchen
7ab5b5d80d Add MinIO kv implements 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-12-03 19:00:11 +08:00
neza2017
cec903da19 Add parquet payload 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-02 18:31:56 +08:00
xige-16
36cf8a8ea7 Support return primary key when doing search 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-12-03 17:18:06 +08:00
quicksilver
0530fdf62f Open regression test 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-12-03 14:05:52 +08:00
zhenshan.cao
23aebe7e2a Fix proxy unittest 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-01 19:53:53 +08:00
neza2017
17cc7bc337 Use MetaRootPath instead 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-01 17:03:39 +08:00
neza2017
d3858500c6 Add static check 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-30 19:38:23 +08:00
quicksilver
86573d0053 Create Jenkins pipeline 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-11-30 10:07:04 +08:00
FluorineDog
77fa75b1ec Add binary insert and warper of binary search, rename vector 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-30 05:18:44 +08:00
cai.zhang
85a544b79b Add dockerfile for each component 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-28 19:06:48 +08:00
cai.zhang
115d0732af Update docker-compose file for unittest 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-28 16:43:39 +08:00
dragondriver
eb6c0e0a28 Fix the bug when reduce the multiple search result from query nodes 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-28 15:57:49 +08:00
godchen
92bf09c7e6 Add ddstream and scheduler implements 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-11-28 15:26:39 +08:00
bigsheeper
f21c0ef2e9 Reduce cpu usage 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-26 17:58:08 +08:00
neza2017
32445dd02b Add cpu profile 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-26 16:01:31 +08:00
cai.zhang
57da66ba72 Update read config logic in docker 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-26 15:18:36 +08:00
zhenshan.cao
045fc3d808 Fix segment fault 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-26 14:29:01 +08:00
XuanYang-cn
0a16a9a651 Add logic of getting milvus distributed config from master by grpc 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-26 13:21:06 +08:00
dragondriver
8ce0deca4e Add default partition tag to InsertTask in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-26 11:38:04 +08:00
xige-16
ae78aa1ac1 Warp cpp reduce and repack searchResultMsg to specified pulsar channel 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-11-26 11:12:33 +08:00
sunby
f4c643f1bd Add number limitation of partition and field. And Change default partition tag to "_default" 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-25 18:39:05 +08:00
cai.zhang
17c3a70d64 update ParameterTable 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-21 15:06:46 +08:00
GuoRentong
8b88a9c306 Update docs: master::syncMsgProducer 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2020-11-21 11:39:23 +08:00
neza2017
c3de667bf5 Implement segment management in master 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-18 19:46:18 +08:00
bigsheeper
99ea7e9f05 Update param table 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-18 19:33:56 +08:00
sunby
9e4ce8454e Implement segment management in master 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-18 15:04:17 +08:00
xige-16
4e8efe85df Delete wrong useage of *TsMsg 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-11-17 14:10:07 +08:00
dragondriver
aff1e79f82 Fix SearchTask in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-16 17:01:10 +08:00
FluorineDog
8c48cf30c0 Format and and extra parameters for checking 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-16 15:41:56 +08:00
xige-16
d59f6ac6ca Add queryNodeSegStatsMsg for msgStream 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-11-16 10:55:49 +08:00
cai.zhang
0b478b614a Change Id to ID in go files according to golint check 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-13 15:17:18 +08:00
cai.zhang
b68322d469 Open golangci-lint check 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-12 17:58:05 +08:00
cai.zhang
1cd2fd9954 Add the standard of golangci-lint 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-12 12:04:12 +08:00
bigsheeper
c9c8fb9def Close pulsar channel 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-12 11:18:23 +08:00
cai.zhang
3b2c86c42d Fix bug for cmake_build dir was changed 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-12 10:45:46 +08:00
xige-16
205abfbbcd Add pulsar message stream for system 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-11-11 20:14:20 +08:00
XuanYang-cn
a2289d3ce6 Add softTimeTickBarrier and hardTimeTickBarrier 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-11 16:41:53 +08:00
zhenshan.cao
3b5765ae47 Add proxy timetick 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-11 09:54:01 +08:00
cai.zhang
a2f2284932 Add code coverage for go files 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-10 15:56:57 +08:00
zhenshan.cao
87a4495c59 Fix proxy bug 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-09 17:52:47 +08:00
bigsheeper
b441685635 Refactor segment, partition and collection, refactor search and services 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-09 16:27:11 +08:00
neza2017
7e182a230a Fix bug :GetTimeTick not return error if TimeBarrier is closed 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-07 13:19:31 +08:00
zhenshan.cao
86d2d36053 Add MemoryKV, mockkv and tso test 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-06 16:47:18 +08:00
zhenshan.cao
9c490a209b Delete unused code 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-05 19:11:12 +08:00
dragondriver
c732c267e1 Refactor proxy framework and add CreateCollection Task 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-05 18:01:33 +08:00
XuanYang-cn
425f57e1c7 Replace hand-drawing pictures with OminiGraffle 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-05 10:10:16 +08:00
zhenshan.cao
e9122921b9 Use type alias 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-04 17:58:43 +08:00
neza2017
d18c17e786 Add Meta table implementation 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-04 16:28:14 +08:00
godchen
bade037fb2 Add meta_table implementation 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-11-04 16:01:28 +08:00
zhenshan.cao
2e2e059f8a Add msgheader and change ReqType to MsgType 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-04 15:13:42 +08:00
neza2017
1bd7938d72 Modify logic of time tick 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-04 14:52:03 +08:00
bigsheeper
d6fe379143 Add insertNode and serviceTimeNode 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-03 17:09:51 +08:00
zhenshan.cao
da18bc4952 Update proto 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-03 16:38:16 +08:00
zhenshan.cao
e962b57fbb Add timestamp allocator 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-03 14:53:36 +08:00
cai.zhang
9d212505d8 Add Makefile 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-03 11:25:47 +08:00
zhenshan.cao
3e596fa474 Update proto and doc 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-02 16:01:04 +08:00
zhenshan.cao
27b9a51938 Add logic of allocate id 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-30 16:27:58 +08:00
GuoRentong
f7bd6ebfad Add docs 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2020-10-29 20:42:47 +08:00