test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-04 12:59:23 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
8,265 Commits 96 Branches 105 Tags 185 MiB
bdfb8768d4
Commit Graph

276 Commits

Author SHA1 Message Date
bigsheeper
762b1e1f1f Add ddService, fieldID, requestID and refactor params table, fix nil hits search result bug 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-12-10 16:31:09 +08:00
XuanYang-cn
32977e270c Add impl cgo of parquet 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-12-08 14:41:04 +08:00
zhenshan.cao
65ce1f97e7 Fix bug: pulsar dirty msg 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-07 19:41:39 +08:00
zhenshan.cao
7bbbc14637 Fix bug: address already used 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-07 15:22:20 +08:00
xige-16
37d7526d31 Fix search test failure 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-12-07 14:37:42 +08:00
neza2017
aeca8f85a5 Run cwrapper unittest in ci 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-05 17:39:58 +08:00
cai.zhang
806a97505c Add query node for CI progress 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-05 16:12:45 +08:00
neza2017
70710dee47 Add parquet payload 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-05 16:11:03 +08:00
FluorineDog
6412ebc0d4 Add support of metric type in schema, enable binary vector, fix segfault 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-12-05 06:46:01 +08:00
cai.zhang
18a9ffb617 Increase timeout for golangci-lint 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-04 17:57:24 +08:00
zhenshan.cao
0b6fe0a8cf Refactor paramtable 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-04 14:18:17 +08:00
godchen
7ab5b5d80d Add MinIO kv implements 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-12-03 19:00:11 +08:00
neza2017
cec903da19 Add parquet payload 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-02 18:31:56 +08:00
quicksilver
0530fdf62f Open regression test 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-12-03 14:05:52 +08:00
zhenshan.cao
569057251c Add support of custom ID 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-02 16:12:21 +08:00
zhenshan.cao
23aebe7e2a Fix proxy unittest 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-01 19:53:53 +08:00
neza2017
17cc7bc337 Use MetaRootPath instead 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-01 17:03:39 +08:00
dragondriver
84b15c1f5c Fix the bug of meta cache in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-12-01 16:41:25 +08:00
cai.zhang
c1fbc4f8fa Open the tests for insert 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-01 15:18:57 +08:00
FluorineDog
6b74d82259 Support some validation for dsl parser 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-12-01 02:16:53 +08:00
zhenshan.cao
fda8d62b38 Fix make error 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-30 22:14:19 +08:00
neza2017
d3858500c6 Add static check 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-30 19:38:23 +08:00
dragondriver
2358fae703 Check the status of search results before reduce in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-30 19:08:32 +08:00
bigsheeper
0cd3e8d86c Use exception instead of runtime error 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-30 17:58:23 +08:00
dragondriver
51a9f49d35 Fix the topk check when deal with the search result in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-30 17:46:00 +08:00
zhenshan.cao
24942c3d6d Fix insert failed to return correct id range 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-30 12:08:47 +08:00
bigsheeper
d88a654db8 Fix search result 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-30 11:22:59 +08:00
quicksilver
86573d0053 Create Jenkins pipeline 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-11-30 10:07:04 +08:00
FluorineDog
77fa75b1ec Add binary insert and warper of binary search, rename vector 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-30 05:18:44 +08:00
cai.zhang
85a544b79b Add dockerfile for each component 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-28 19:06:48 +08:00
cai.zhang
115d0732af Update docker-compose file for unittest 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-28 16:43:39 +08:00
dragondriver
eb6c0e0a28 Fix the bug when reduce the multiple search result from query nodes 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-28 15:57:49 +08:00
godchen
92bf09c7e6 Add ddstream and scheduler implements 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-11-28 15:26:39 +08:00
dragondriver
568cef0730 Fix InsertTask and SearchTask 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-28 10:48:29 +08:00
FluorineDog
c9fb34142c Enable primary_key switch 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-28 09:16:00 +08:00
dragondriver
235e723eb6 Read proxy id from param table instead of hardcode 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-27 11:17:12 +08:00
XuanYang-cn
3e605ae25f Rename reader to querynode 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-27 10:56:53 +08:00
bigsheeper
1decc1a4ca Add metaRootPath and kvRootPath 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-27 09:59:40 +08:00
dragondriver
72a7af3f4a Add time tick logic to Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-26 17:47:46 +08:00
neza2017
32445dd02b Add cpu profile 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-26 16:01:31 +08:00
cai.zhang
57da66ba72 Update read config logic in docker 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-26 15:18:36 +08:00
dragondriver
ab75438abf Fix bug of repack function of InsertTask in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-26 15:17:20 +08:00
neza2017
d9e5a8774d Add dimension validation 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-26 15:07:47 +08:00
FluorineDog
8ae573b580 Fix bool bug 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-26 14:56:58 +08:00
sunby
e8e21a0308 Add dimension validation. 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-26 14:54:03 +08:00
zhenshan.cao
045fc3d808 Fix segment fault 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-26 14:29:01 +08:00
XuanYang-cn
0a16a9a651 Add logic of getting milvus distributed config from master by grpc 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-26 13:21:06 +08:00
dragondriver
8ce0deca4e Add default partition tag to InsertTask in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-26 11:38:04 +08:00
xige-16
ae78aa1ac1 Warp cpp reduce and repack searchResultMsg to specified pulsar channel 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-11-26 11:12:33 +08:00
neza2017
ae26a81550 Change to use Marshal as text 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-26 10:13:23 +08:00
sunby
f4c643f1bd Add number limitation of partition and field. And Change default partition tag to "_default" 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-25 18:39:05 +08:00
zhenshan.cao
f12366342f Fix bug and delete unused code 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-25 16:45:42 +08:00
bigsheeper
4ed11d9775 Reopen segment test assertion 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-25 16:24:57 +08:00
bigsheeper
3b24c52a8c Catch cpp runtime error 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-25 16:20:07 +08:00
dragondriver
a7b3efecd7 Read query node num from param table instead of hardcode 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-25 16:17:33 +08:00
cai.zhang
4bcb460c98 Add clang-format 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-25 15:25:00 +08:00
FluorineDog
a6f950e5b6 Fix boost::dynamic_bitset misuse 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-25 15:17:17 +08:00
sunby
24b29bec30 Add collectionName/partitionTag/fieldName validation. 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-25 14:44:30 +08:00
bigsheeper
41fb2d2991 fix lock usage 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-24 16:12:39 +08:00
bigsheeper
8ec7e4576e Add dropPartition and createPartition 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-24 15:59:51 +08:00
neza2017
ad0078c07a Load grpc port of proxy from config 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-24 11:50:21 +08:00
bigsheeper
84f3d974fa Delete pulsar address test and refactor master param table 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-23 18:04:09 +08:00
dragondriver
c7a49c97cc Add repack function of InsertTask in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-23 16:52:17 +08:00
zhenshan.cao
7c39fc24a9 Simplify proxy config 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-21 19:12:59 +08:00
quicksilver
859ff62bc9 Unify Network for UnitTest 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-11-21 16:54:20 +08:00
cai.zhang
8ff82c2fd5 Add judgement when executing clang-format 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-21 16:37:48 +08:00
dragondriver
e36b565ec0 Normalize the naming of variable and function in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-21 16:31:38 +08:00
cai.zhang
17c3a70d64 update ParameterTable 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-21 15:06:46 +08:00
dragondriver
aabe9afd75 Add meta cache in Proxy and use meta cache to generate id in InsertTask 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-20 17:53:31 +08:00
bigsheeper
dd3654f953 Fix query node param table 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-20 17:10:24 +08:00
quicksilver
1728a4f419 Update .devcontainer.json 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-11-20 15:02:26 +08:00
neza2017
cda47a9252 Remove unused code 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-20 09:13:29 +08:00
zhenshan.cao
50d59d91ee Add segmentIDAssigner for proxy 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-19 21:02:31 +08:00
dragondriver
0b2add0d7b Fix query result loop logic in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-19 18:45:24 +08:00
neza2017
429c94e18b Add grpc for proxy 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-19 17:09:22 +08:00
neza2017
c3de667bf5 Implement segment management in master 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-18 19:46:18 +08:00
bigsheeper
99ea7e9f05 Update param table 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-18 19:33:56 +08:00
sunby
9e4ce8454e Implement segment management in master 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-18 15:04:17 +08:00
dragondriver
a18ac17a98 Increase timeout interval of task in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-18 15:44:17 +08:00
neza2017
544c701f98 Start timeSyncMsgProducer in master 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-18 10:14:11 +08:00
dragondriver
b32e55d5f0 Add timeout logic to task in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-17 20:00:23 +08:00
xige-16
4e8efe85df Delete wrong useage of *TsMsg 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-11-17 14:10:07 +08:00
cai.zhang
5bcabffdaf Replace conf struct with ParamsTable 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-16 21:10:43 +08:00
dragondriver
aff1e79f82 Fix SearchTask in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-16 17:01:10 +08:00
FluorineDog
8c48cf30c0 Format and and extra parameters for checking 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-16 15:41:56 +08:00
neza2017
9d3a21a9c9 Rewrite NewTSOKVBase 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-16 12:37:46 +08:00
dragondriver
23d9ddb4a3 Add unittest to grpc service that Proxy provide 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-14 18:18:10 +08:00
neza2017
ce969e9568 Update segment 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-14 14:39:52 +08:00
dragondriver
c2382adf04 Initialize the task scheduler of Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-14 11:24:49 +08:00
cai.zhang
0b478b614a Change Id to ID in go files according to golint check 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-13 15:17:18 +08:00
XuanYang-cn
88cb274644 Refactor master scheduler: drop_collection 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-13 12:46:24 +08:00
cai.zhang
cfee642a11 Add ruleguard and open ruleguard check 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-13 10:00:32 +08:00
cai.zhang
b68322d469 Open golangci-lint check 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-12 17:58:05 +08:00
cai.zhang
1cd2fd9954 Add the standard of golangci-lint 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-12 12:04:12 +08:00
bigsheeper
c9c8fb9def Close pulsar channel 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-12 11:18:23 +08:00
cai.zhang
3b2c86c42d Fix bug for cmake_build dir was changed 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-12 10:45:46 +08:00
zhenshan.cao
170792d9bc Unify proto package and version 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-11 18:13:20 +08:00
zhenshan.cao
057563d936 Refactor master 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-11 17:53:54 +08:00
XuanYang-cn
a2289d3ce6 Add softTimeTickBarrier and hardTimeTickBarrier 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-11 16:41:53 +08:00
dragondriver
fb1e24ade8 Refactor task interface of Proxy and fix the wait logic of task 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-11 16:00:56 +08:00
zhenshan.cao
3b5765ae47 Add proxy timetick 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-11 09:54:01 +08:00
zhenshan.cao
87a4495c59 Fix proxy bug 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-09 17:52:47 +08:00
dragondriver
be0a2e7e5f Add other data definition related task to Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-09 17:25:53 +08:00
zhenshan.cao
db9957d48b Add unittest for master 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-07 18:03:52 +08:00
dragondriver
b8ccbc1c97 Add InsertTask and SearchTask to Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-07 16:18:23 +08:00
zhenshan.cao
9c490a209b Delete unused code 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-05 19:11:12 +08:00
dragondriver
c732c267e1 Refactor proxy framework and add CreateCollection Task 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-05 18:01:33 +08:00
zhenshan.cao
e9122921b9 Use type alias 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-04 17:58:43 +08:00
neza2017
d18c17e786 Add Meta table implementation 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-04 16:28:14 +08:00
godchen
bade037fb2 Add meta_table implementation 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-11-04 16:01:28 +08:00
zhenshan.cao
2e2e059f8a Add msgheader and change ReqType to MsgType 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-04 15:13:42 +08:00
zhenshan.cao
d587b95361 Fix parameter unmatch 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-03 15:29:59 +08:00
zhenshan.cao
e962b57fbb Add timestamp allocator 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-03 14:53:36 +08:00
GuoRentong
15b6963be0 Replace pdf figs with png figs 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2020-10-31 15:11:47 +08:00
zhenshan.cao
27b9a51938 Add logic of allocate id 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-30 16:27:58 +08:00
GuoRentong
f7bd6ebfad Add docs 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2020-10-29 20:42:47 +08:00
zhenshan.cao
6eee7d1342 Fix bug and update proto 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-29 19:55:57 +08:00
GuoRentong
1cfc6c7f86 Add docs 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2020-10-28 10:09:35 +08:00
quicksilver
d66d48c6b6 Enable UnitTest 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-10-27 15:51:16 +08:00
shengjh
77b2fcf015 Refactor manipulationreq and add tso(pre-alloc from master) 
Signed-off-by: shengjh <1572099106@qq.com>
 2020-10-27 12:01:27 +08:00
quicksilver
eb64839aef Update build environment 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-10-26 15:45:18 +08:00
FluorineDog
a48ca80286 Format Code and duplicate class Segment 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-10-24 18:04:57 +08:00
zhenshan.cao
251bc2a19e Fix conf.LoadConfig failed to load yaml file 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-19 18:31:00 +08:00
GuoRentong
974496a2b2 Update issue templates 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2020-10-19 17:45:56 +08:00
zhenshan.cao
6a136c1a76 Change import path 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-19 17:39:51 +08:00
zhenshan.cao
64295db471 Refact master and proxy and add etcdutil 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-15 21:31:50 +08:00