Commit Graph

228 Commits

Author SHA1 Message Date
dragondriver
f660caca0c Refactor the client interface of proxy service
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-29 17:29:31 +08:00
Xiangyu Wang
99cef4b5c8 Add Distributed main entrypoint
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-29 17:08:31 +08:00
bigsheeper
73d2b6a101 Get index param from minio and filter by vector fields
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-29 15:22:24 +08:00
neza2017
bdf84f08ab Add watcher_test and fix some bugs
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-29 14:40:19 +08:00
zhenshan.cao
ee0faddb07 Refactor proxy
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-29 09:27:26 +08:00
dragondriver
7957170220 Dock Proxy with other service component
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-28 20:51:44 +08:00
sunby
bcd7368533 Fix get component states
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-28 15:20:24 +08:00
sunby
5ac463c9ca Add datanode client in data service
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-28 11:24:41 +08:00
XuanYang-cn
4acaa97039 Add unittests for datanode and queryservice
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-27 20:00:47 +08:00
bigsheeper
68cd15af63 Get index info from master
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-27 14:41:56 +08:00
sunby
b4bcaaf847 Fix data service startup bug
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-27 11:40:10 +08:00
XuanYang-cn
05b013c52a Fix datanode bug
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-27 11:37:26 +08:00
xige-16
947976dbec Add test for query service’s load function
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-27 11:34:16 +08:00
bigsheeper
4f914a2c30 Add docker file and main function of query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-27 09:50:52 +08:00
neza2017
4d37a329da Fix data service init
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-26 19:25:17 +08:00
neza2017
d1b23cb8c5 Add debug info
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-26 19:24:09 +08:00
sunby
f632ed0272 Fix data service init
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-26 18:45:12 +08:00
zhenshan.cao
e83ac41bca Add component for index
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-26 18:01:32 +08:00
neza2017
8c54af292e Add dd handler
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-26 17:55:15 +08:00
XuanYang-cn
0b1c4f0420 Add building datanode cmd in Makefile
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-26 17:40:26 +08:00
sunby
9f72633fd9 Add dd handler
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-26 17:06:13 +08:00
neza2017
2ea6a5f9ee Add make dataservice in Makefile
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-26 16:41:10 +08:00
sunby
b4997a37a2 Add make dataservice in Makefile
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-26 16:36:26 +08:00
neza2017
b6a788373b Fix proxy server
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-26 16:30:36 +08:00
neza2017
fd0227b69a Add logic of get time tick
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-26 15:23:42 +08:00
sunby
3b08162059 Add main function
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-26 15:14:49 +08:00
xige-16
7c210310dc Add load function for query service
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-26 15:13:20 +08:00
dragondriver
ad244dc4e8 Add initial interface to proxy service client
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-26 15:09:31 +08:00
dragondriver
d972b75aaa Add GetTimeTickChannel, GetComponentStates to proxy service
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-26 14:55:57 +08:00
XuanYang-cn
b445587e11 Add datanode main
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-26 14:46:54 +08:00
cai.zhang
346bb1ba49 Delete some unused code and some debug logs
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-26 14:31:31 +08:00
dragondriver
c6a6b1436c Add soft time tick in proxy service
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-26 13:41:41 +08:00
cai.zhang
f940cc455a Add dockerfile for index
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-26 09:38:40 +08:00
neza2017
7f3aa92d10 Add docker file for masterservice
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-25 15:58:04 +08:00
bigsheeper
7554246ace Add segment seeking and use real client
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-25 18:33:10 +08:00
sunby
7c0c835b49 Init params and add segment start/end position
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-25 15:16:28 +08:00
XuanYang-cn
5015a1035d Add logic of get meta from MasterService for datanode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-25 17:10:32 +08:00
neza2017
1fe099775d Refactor data service
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-25 15:17:17 +08:00
neza2017
e89e89b894 Add main for masterservice
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-25 12:03:44 +08:00
sunby
54fcd486bb Refactor data service.
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-25 13:45:56 +08:00
XuanYang-cn
9fe672ab86 Enchance datanode interface
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-24 21:20:11 +08:00
neza2017
5aec8bc5e6 Refactor masterservice
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-24 20:26:35 +08:00
sunby
82d6fb18b8 Add init params returned to data node
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-23 20:22:59 +08:00
neza2017
e2b45f9866 Init param table and open unittest at ci
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-23 17:56:57 +08:00
sunby
c23e2de435 Implment data service
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-23 14:41:29 +08:00
sunby
2f7319cdbb Add interfaces with other modules
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-22 19:43:27 +08:00
neza2017
e68d50f29e Invalid collection meta caceh && ingore time stamp if not dd request
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-23 10:12:41 +08:00
bigsheeper
067c30c422 Add sealedSegment cgo unittest, fix growingSegment field id check
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-22 15:41:54 +08:00
xige-16
511aa419fa Refactor query service
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-22 14:28:06 +08:00
neza2017
2d2dbd7d19 Add logic of segment flush complete
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-22 11:06:12 +08:00
dragondriver
cd52adc18b Add proxy service to ci workflow
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 12:57:23 +08:00
bigsheeper
46a0a6133a Implement distributed api, delete partition states api
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-22 11:17:18 +08:00
sunby
ef79b8d8c7 Add client and grpc service
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-22 11:07:07 +08:00
XuanYang-cn
377ee8687d Modify flush logic
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-22 09:36:40 +08:00
dragondriver
eba6bb288c Refactor the sructure of proto file
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 09:36:18 +08:00
neza2017
9828a52999 Add create index
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-21 10:01:29 +08:00
FluorineDog
7f044fff82 Enable search for sealed
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-01-21 15:29:52 +08:00
sunby
be6775671b Add error returned by Init,Start,Stop functions
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-19 17:38:01 +08:00
cai.zhang
83c60fd84f Update proto about index
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-21 15:20:23 +08:00
cai.zhang
7619d968fd Generate random node port for indexService
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-20 18:26:20 +08:00
yukun
527c0c49df Add rocksmq unittest with goroutines
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-20 16:46:58 +08:00
cai.zhang
c35079d7e7 Update registerNode in indexservice
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-20 10:15:43 +08:00
sunby
3602376a10 Rename GetServiceStates to GetComponentStates and reconstruct NodeStates and ServiceStates
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-20 11:02:29 +08:00
zhenshan.cao
2ec573d2f9 Recover delete docs
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-20 09:36:50 +08:00
cai.zhang
fb493cc235 Update interface name of GetIndexStates
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-19 18:32:57 +08:00
neza2017
918e279869 Set msg stream
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-19 16:14:13 +08:00
sunby
7e8162a79e Add dd handler
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-19 15:35:40 +08:00
neza2017
d5e53aa28a Add Meta table implementation
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-19 14:13:49 +08:00
bigsheeper
2064b014a1 Add loadFieldData, use partition id instead of tag
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-19 14:44:03 +08:00
XuanYang-cn
6a13386393 Add DataNode package
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-19 11:37:16 +08:00
neza2017
1ce32d8775 Add master service
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-19 09:45:42 +08:00
xige-16
0164e78bb5 Add query service module
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-16 15:31:10 +08:00
bigsheeper
46a14da3eb Implement segment manager and loadSegment
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-16 15:04:32 +08:00
bigsheeper
f02bd8c8f5 Rename query node package, implement watchDmChannel
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-16 10:12:14 +08:00
bigsheeper
b98b226d8c Refactor query node and implement channelRemove, channelAdd
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-15 15:28:54 +08:00
quicksilver
7fe061b846 Raneme init_devcontainer.sh to devcontainer.sh
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-15 14:38:36 +08:00
neza2017
56ab2bda2d Update proto:add partition id
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-15 11:53:22 +08:00
zhenshan.cao
63b21321d6 Refactor indexservice and update doc
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-15 13:50:27 +08:00