Commit Graph

6122 Commits

Author SHA1 Message Date
FluorineDog
342f4cb741 Support dynamic chunk size
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-23 19:02:37 +08:00
XuanYang-cn
7ce0f27ebc Add buffer to minIO for binlogs
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-23 18:06:04 +08:00
sunby
e7ebfcb05a Save index meta to meta table
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-23 15:13:45 +08:00
godchen
e52b130ba6 Refactor data codec code
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-23 15:46:16 +08:00
sunby
0b9cffaf87 Remove index_name in IndexRequest and remove indexType in FieldIndexMeta
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-23 11:34:35 +08:00
zhenshan.cao
11316525e5 Fix bug of running unittest in parallel
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-22 22:08:03 +08:00
sunby
2aa483c922 Add index meta to meta table
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-22 20:16:32 +08:00
dragondriver
adfb5187cf Dock build index task with storage & indexbuilder
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-22 00:14:36 +00:00
cai.zhang
05918f55d2 Impl CreateIndex interface for proxy server
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-22 15:39:10 +08:00
GuoRentong
9d5c93744c Fix figure path
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-12-22 14:47:55 +08:00
sunby
3a1c210098 Add runtime stats to record field stats
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-21 20:24:40 +08:00
godchen
8f87ee632e Add field id when create collection
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-21 19:31:24 +08:00
godchen
e90ef211c2 Add flush, build index, load index scheduler
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-21 19:30:24 +08:00
cai.zhang
b582cf7b8e Add the interface of index in proto
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-21 19:28:54 +08:00
dragondriver
d023c1afba Refactor index wrapper, use protobuf instead of json to pass data
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-21 16:36:07 +08:00
XuanYang-cn
87521adfbd Add logic of deserilize rawData into InsertData
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-21 16:27:03 +08:00
FluorineDog
d5daa18392 Enable most DSL-related cases
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-21 14:45:00 +08:00
sunby
06620935ab Move expire timestamp to SegIDAssignment
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-21 10:51:37 +08:00
zhenshan.cao
9694203f8b Add writer client and metatable for writer
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-21 10:06:46 +08:00
sunby
f360ed7004 Add unittests
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-21 09:56:35 +08:00
sunby
c71cd40f68 Refactor segment manager
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-19 12:55:24 +08:00
FluorineDog
e65cfe1e3d Enable complex dsl parser
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-19 10:36:49 +08:00
zhenshan.cao
0d75840ed6 Fix missing file
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-18 18:35:03 +08:00
neza2017
0110ba6bd2 List events of binlog
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-12 16:52:09 +08:00
dragondriver
da9ea7d2b9 Add cgo wrapper to index builder
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-18 15:44:27 +08:00
godchen
475d36a2c9 Add data codec
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-18 15:21:25 +08:00
zhenshan.cao
3f6e926aef Refactor indexbuilder
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-13 06:48:05 +08:00
FluorineDog
1540cffbb1 Add executor for expression
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-12 18:17:53 +08:00
cai.zhang
54f2b79f1b Add indexbuilder client
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-12 17:10:42 +08:00
neza2017
07d68de2a3 Fix data codec
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-11 18:14:19 +08:00
bigsheeper
585d3f9831 Refactor param table, and add ddNode
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-11 17:20:14 +08:00
neza2017
8df05714a8 Add binlog unittest
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-11 12:01:38 +08:00
FluorineDog
e54d5ccf19 Fix push failed because git hook detects "wrong error"
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-11 14:59:13 +08:00
XuanYang-cn
d64aa37db3 Add KFlush msg type
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-11 12:01:20 +08:00
zhenshan.cao
ca34353e9b Add writernode client
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-11 11:38:32 +08:00
xige-16
0067e2d989 Add load index client in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-11 11:29:54 +08:00
cai.zhang
62e9002348 Add git-hooks for check code
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-11 11:29:07 +08:00
FluorineDog
02f855359a Fix term bug and add todo note
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-10 20:13:37 +08:00
zhenshan.cao
fc054874d3 Add index_builder
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-10 17:55:55 +08:00
bigsheeper
762b1e1f1f Add ddService, fieldID, requestID and refactor params table, fix nil hits search result bug
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-10 16:31:09 +08:00
neza2017
9585819154 Add binlog unittest
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-10 15:50:09 +08:00
quicksilver
046aa3529f Publish image using Docker-in-Docker
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-10 15:27:30 +08:00
neza2017
9cbebc0221 Add binlog unittest
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-10 14:52:42 +08:00
sunby
16071d92b5 Modify metatable close segment interface.
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-10 13:35:09 +08:00
quicksilver
e805be5e9c Show ccache statistics
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-10 10:20:39 +08:00
quicksilver
21721d2e03 Cache go mod workflow for jenkins pipeline
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-10 09:57:14 +08:00
neza2017
5512ce8d8a Add binlog unittest
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-10 09:31:29 +08:00
XuanYang-cn
881be7f3e3 Impl minimum runable writenode and writenode flowgraph
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-09 20:07:27 +08:00
neza2017
de12fa5a10 Add binlog event
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-09 11:18:13 +08:00
FluorineDog
968ddc6016 Fix thrift.a not found
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-09 14:57:07 +08:00