Commit Graph

6122 Commits

Author SHA1 Message Date
bigsheeper
b7fc945aca Add flush msg unmarshal function register
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-31 17:25:45 +08:00
xige-16
bfb18df7e7 Parse result_id from target entry
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-31 16:53:57 +08:00
quicksilver
1927eaf88b Add revive linter
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-31 16:38:37 +08:00
zhenshan.cao
59878b1dbb Add lazy connect logic for indexbuilder
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-31 15:44:06 +08:00
dragondriver
6cd8c2528d Add parameter check for almost all index type
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-31 15:16:03 +08:00
xige-16
29b21b4bf2 Refactor reduce strategy in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-31 14:49:27 +08:00
sunby
4808b46246 Filter indexable fields in flush scheduler
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-30 19:56:54 +08:00
dragondriver
2e198e2783 Add support for idmap, nsg, sq8
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-30 19:37:45 +08:00
FluorineDog
09620efadf Merge from master
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-30 18:50:56 +08:00
zhenshan.cao
adf77c423c Update knowhere
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-30 18:30:51 +08:00
bigsheeper
4835d82060 Add index builder test cases
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-30 18:16:34 +08:00
sunby
e7998da797 Fix bug when starting indexbuilder
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-30 16:41:24 +08:00
neza2017
e05c441fc9 Modify Makefile to compile binlog
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-30 14:09:00 +08:00
XuanYang-cn
3a2e2a04b6 Fix writenode bug
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-29 21:15:00 +08:00
GuoRentong
1abc69277b Update doc: service api
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-12-29 18:02:44 +08:00
bigsheeper
bb8da15691 Return status and add try catch exception in index builder
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-29 17:53:27 +08:00
quicksilver
b1b8747477 Add logic of incremental check for go code
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-29 17:19:44 +08:00
dragondriver
243346247b Add unittest case which used in regression to index builder
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-29 16:31:03 +08:00
bigsheeper
1e3b7cd55e Fix binary vector metric type validation
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-29 16:14:52 +08:00
xige-16
be32a33eff Refactor loadIndexTest to test diffrent index params
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-29 14:43:40 +08:00
XuanYang-cn
884f66d56d Fix timesync start twice in master
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-29 14:10:22 +08:00
cai.zhang
37a55f3c1d Update sdk version
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-29 12:51:19 +08:00
cai.zhang
f80536ed77 Update the logic of running go unittest
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-29 11:56:37 +08:00
XuanYang-cn
9577da9fce Add writenode main
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-28 18:52:34 +08:00
FluorineDog
eb8717188e Enable load index
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-28 17:55:48 +08:00
dragondriver
f67aae9596 Fix the codec bug of cgo wrapper of index builder
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-28 16:55:50 +08:00
bigsheeper
5b9e8c4f60 Add write node client segment flushing
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-28 15:25:16 +08:00
godchen
d489183798 Random generate querynode channel in unittest
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-28 15:24:20 +08:00
XuanYang-cn
aab6dede4a Add Flush for DDBuffer and insertBuffer
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-28 11:29:17 +08:00
dragondriver
11cef6e978 Add support to build binary index
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-28 10:00:02 +08:00
GuoRentong
e8ec0424d8 Update doc: service api
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-12-27 09:05:24 +08:00
neza2017
7e8b203fe2 Add time tick in wite node
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-26 17:05:24 +08:00
XuanYang-cn
e316533a3a Add Flush Sync service
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-26 16:28:55 +08:00
bigsheeper
5acc9681d6 Fix search error about metric type
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-26 15:29:48 +08:00
xige-16
d599407e2b Add unittest for loadIndex service
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-26 14:16:51 +08:00
cai.zhang
2031c54746 Add unittest about index in proxy
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-26 11:51:07 +08:00
sunby
a56f8f7b9e Add runtime stats in master
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-25 18:32:03 +08:00
sunby
e21397d68a Add runtime stats unittest
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-25 16:08:35 +08:00
sunby
a03ab05c6c Add DescribeIndex and DescribeIndexProgress RPC
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-25 15:39:56 +08:00
dragondriver
84a0cf7097 Add unittest to c index wrapper
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-25 11:10:31 +08:00
XuanYang-cn
c0797333ce Add ddl binlog metaTable in writenode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-24 20:55:40 +08:00
neza2017
4dbf4ade41 Add test for master
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-24 16:19:42 +08:00
zhenshan.cao
a0244b7683 Add segment expire logic for proxy
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-24 16:53:31 +08:00
bigsheeper
4ecdea698f Refactor query node and query serviceMain changes:1. Add ddBuffer and save binLog.
2. Trans to insertData.
3. Change dataFields data to Data, dim to Dim4. Add float vector and binary vector.5. Deserialize data and convert to InsertData.6. Move all data into InsertData.7. Add insert buffer and hash string.
8. Add minIOkV in insertBuffer node.
9. Init write node insertBuffer maxSize from writeNode.yaml.
10. Add ddBuffer.
11. Add ddBuffer binLog and minio.
12. Add ddNode unittest.
13. Remove redundant call.
14. Increase test time.
15. Delete ddl const, use request's timestamp instead.

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-24 15:38:29 +08:00
xige-16
f5198bcaee Add LoadIndexService in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-24 14:51:55 +08:00
sunby
add31188ba Add CreateIndex RPC
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-24 14:50:16 +08:00
xige-16
14332d49fb Add minio for regression
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-24 14:34:14 +08:00
neza2017
0afeaa78c8 Fix unittest of flow graph
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-24 14:10:00 +08:00
sunby
5d58606349 Move Status to SegIDAssignment
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-24 10:11:34 +08:00
cai.zhang
a8b78f11c3 Update proto about index
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-23 19:06:11 +08:00