dragondriver
84a0cf7097
Add unittest to c index wrapper
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-25 11:10:31 +08:00
XuanYang-cn
c0797333ce
Add ddl binlog metaTable in writenode
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-24 20:55:40 +08:00
neza2017
4dbf4ade41
Add test for master
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-24 16:19:42 +08:00
zhenshan.cao
a0244b7683
Add segment expire logic for proxy
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-24 16:53:31 +08:00
bigsheeper
4ecdea698f
Refactor query node and query serviceMain changes:1. Add ddBuffer and save binLog.
...
2. Trans to insertData.
3. Change dataFields data to Data, dim to Dim4. Add float vector and binary vector.5. Deserialize data and convert to InsertData.6. Move all data into InsertData.7. Add insert buffer and hash string.
8. Add minIOkV in insertBuffer node.
9. Init write node insertBuffer maxSize from writeNode.yaml.
10. Add ddBuffer.
11. Add ddBuffer binLog and minio.
12. Add ddNode unittest.
13. Remove redundant call.
14. Increase test time.
15. Delete ddl const, use request's timestamp instead.
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-24 15:38:29 +08:00
xige-16
f5198bcaee
Add LoadIndexService in query node
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-24 14:51:55 +08:00
sunby
add31188ba
Add CreateIndex RPC
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-24 14:50:16 +08:00
xige-16
14332d49fb
Add minio for regression
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-24 14:34:14 +08:00
neza2017
0afeaa78c8
Fix unittest of flow graph
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-24 14:10:00 +08:00
sunby
5d58606349
Move Status to SegIDAssignment
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-24 10:11:34 +08:00
cai.zhang
a8b78f11c3
Update proto about index
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-23 19:06:11 +08:00
FluorineDog
342f4cb741
Support dynamic chunk size
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-23 19:02:37 +08:00
XuanYang-cn
7ce0f27ebc
Add buffer to minIO for binlogs
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-23 18:06:04 +08:00
sunby
e7ebfcb05a
Save index meta to meta table
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-23 15:13:45 +08:00
godchen
e52b130ba6
Refactor data codec code
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-23 15:46:16 +08:00
sunby
0b9cffaf87
Remove index_name in IndexRequest and remove indexType in FieldIndexMeta
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-23 11:34:35 +08:00
zhenshan.cao
11316525e5
Fix bug of running unittest in parallel
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-22 22:08:03 +08:00
sunby
2aa483c922
Add index meta to meta table
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-22 20:16:32 +08:00
dragondriver
adfb5187cf
Dock build index task with storage & indexbuilder
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-22 00:14:36 +00:00
cai.zhang
05918f55d2
Impl CreateIndex interface for proxy server
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-22 15:39:10 +08:00
GuoRentong
9d5c93744c
Fix figure path
...
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-12-22 14:47:55 +08:00
sunby
3a1c210098
Add runtime stats to record field stats
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-21 20:24:40 +08:00
godchen
8f87ee632e
Add field id when create collection
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-21 19:31:24 +08:00
godchen
e90ef211c2
Add flush, build index, load index scheduler
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-21 19:30:24 +08:00
cai.zhang
b582cf7b8e
Add the interface of index in proto
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-21 19:28:54 +08:00
dragondriver
d023c1afba
Refactor index wrapper, use protobuf instead of json to pass data
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-21 16:36:07 +08:00
XuanYang-cn
87521adfbd
Add logic of deserilize rawData into InsertData
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-21 16:27:03 +08:00
FluorineDog
d5daa18392
Enable most DSL-related cases
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-21 14:45:00 +08:00
sunby
06620935ab
Move expire timestamp to SegIDAssignment
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-21 10:51:37 +08:00
zhenshan.cao
9694203f8b
Add writer client and metatable for writer
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-21 10:06:46 +08:00
sunby
f360ed7004
Add unittests
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-21 09:56:35 +08:00
sunby
c71cd40f68
Refactor segment manager
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-19 12:55:24 +08:00
FluorineDog
e65cfe1e3d
Enable complex dsl parser
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-19 10:36:49 +08:00
zhenshan.cao
0d75840ed6
Fix missing file
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-18 18:35:03 +08:00
neza2017
0110ba6bd2
List events of binlog
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-12 16:52:09 +08:00
dragondriver
da9ea7d2b9
Add cgo wrapper to index builder
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-18 15:44:27 +08:00
godchen
475d36a2c9
Add data codec
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-18 15:21:25 +08:00
zhenshan.cao
3f6e926aef
Refactor indexbuilder
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-13 06:48:05 +08:00
FluorineDog
1540cffbb1
Add executor for expression
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-12 18:17:53 +08:00
cai.zhang
54f2b79f1b
Add indexbuilder client
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-12 17:10:42 +08:00
neza2017
07d68de2a3
Fix data codec
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-11 18:14:19 +08:00
bigsheeper
585d3f9831
Refactor param table, and add ddNode
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-11 17:20:14 +08:00
neza2017
8df05714a8
Add binlog unittest
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-11 12:01:38 +08:00
FluorineDog
e54d5ccf19
Fix push failed because git hook detects "wrong error"
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-11 14:59:13 +08:00
XuanYang-cn
d64aa37db3
Add KFlush msg type
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-11 12:01:20 +08:00
zhenshan.cao
ca34353e9b
Add writernode client
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-11 11:38:32 +08:00
xige-16
0067e2d989
Add load index client in query node
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-11 11:29:54 +08:00
cai.zhang
62e9002348
Add git-hooks for check code
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-11 11:29:07 +08:00
FluorineDog
02f855359a
Fix term bug and add todo note
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-10 20:13:37 +08:00
zhenshan.cao
fc054874d3
Add index_builder
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-10 17:55:55 +08:00