Commit Graph

168 Commits

Author SHA1 Message Date
dragondriver
6ebb03791f Fix drop index interface
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-20 10:37:11 +08:00
zhenshan.cao
b3891ca199 Correct docker file
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-20 10:15:37 +08:00
xige-16
450ea631bc Fix queryService assign queryChannel failure
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-18 16:26:02 +08:00
neza2017
85c1404393 Refactor master:index ids
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-02-11 08:41:59 +08:00
xige-16
70fe5233cf Watch queryChannel on query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-09 17:09:26 +08:00
neza2017
e2d8358cb4 Refactor master:index ids
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-02-09 13:11:55 +08:00
neza2017
4035083188 Support Index name
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-02-08 14:49:12 +08:00
groot
dc3736281a Integrate message stream
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-02-08 14:30:54 +08:00
sunby
eba5b9ae27 Fix queryservice client init bug
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-07 13:53:40 +08:00
groot
b034740c6c Make paramstable initialize once by using do_once
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-02-06 13:39:15 +08:00
sunby
0111cba8ae Fix startup bugs in some modules
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-06 10:28:53 +08:00
XuanYang-cn
dd72dfcbd1 Fix queryservice start
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-05 17:57:41 +08:00
dragondriver
e6aec3fd08 Hardcode the peer id of proxy node
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-05 14:09:55 +08:00
godchen
0f620ab149 Fix invalidate metacache error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-05 11:49:13 +08:00
dragondriver
e384222803 Fix the logic of node id allocator
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-05 11:25:52 +08:00
neza2017
bea1535425 Add call of release collection when drop collection
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-02-05 11:05:37 +08:00
dragondriver
a48590a2df Add query service logic to Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-05 10:29:14 +08:00
XuanYang-cn
a64c4efde9 Refactor collectionReplica in datanode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-04 20:31:23 +08:00
godchen
c2ca2c276f Fix response check error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-04 19:34:35 +08:00
dragondriver
e0e8e1605e Implement the release-related task and load-related task in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-04 17:47:19 +08:00
sunby
7270d18c98 Fix timesync startup bugs
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-04 17:31:02 +08:00
xige-16
aaac839075 Joint debug query service success with other components
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-04 17:09:18 +08:00
XuanYang-cn
560d2350ae Fix datanode watchDmChannel bug
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-04 16:09:34 +08:00
zhenshan.cao
b89e5a3240 Add GetQuerySegmentInfo
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-04 14:37:12 +08:00
bigsheeper
c6c99ef32b Implement getSegmengInfo function
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-04 11:40:14 +08:00
XuanYang-cn
bc7ad02df4 Fix datanode init bug
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-04 10:25:01 +08:00
godchen
6e7e0b748a Send timetick to insert channel
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-03 20:04:29 +08:00
sunby
e7588d3250 Implement getSegmentInfo interfaces
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-03 19:45:52 +08:00
zhenshan.cao
1b616fb874 Add persistent_segmentinfo
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-03 18:55:00 +08:00
bigsheeper
01e9dc8e3f Remove collection name
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-03 11:52:19 +08:00
sunby
f3aad3a71c Change SegmentInfo
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-02 18:53:10 +08:00
bigsheeper
5e781b9370 Remove field name in query node and segCore
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-03 10:10:07 +08:00
sunby
45b99c0cf3 Save indexName and indexID in IndexCodec
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-02 19:56:11 +08:00
neza2017
899d31e72d Change interface: add index id and index name params
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-02-02 20:09:46 +08:00
sunby
ca9c2f5c12 Add GetCount and implement GetCollectionStatistics
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-02 14:25:58 +08:00
neza2017
5de89422ed Support multi index
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-02-02 10:09:10 +08:00
XuanYang-cn
90d471b133 Refactor main of queryservice and querynode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-02 09:52:42 +08:00
godchen
94dfab5b21 Check collection whether exists before drop
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-01 10:53:13 +08:00
godchen
abcc565311 Add proxy metacache
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-31 14:55:36 +08:00
sunby
3a67dda06c Add NewDataService in main
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-30 11:49:48 +08:00
dragondriver
f660caca0c Refactor the client interface of proxy service
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-29 17:29:31 +08:00
Xiangyu Wang
99cef4b5c8 Add Distributed main entrypoint
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-29 17:08:31 +08:00
bigsheeper
73d2b6a101 Get index param from minio and filter by vector fields
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-29 15:22:24 +08:00
neza2017
bdf84f08ab Add watcher_test and fix some bugs
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-29 14:40:19 +08:00
zhenshan.cao
ee0faddb07 Refactor proxy
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-29 09:27:26 +08:00
dragondriver
7957170220 Dock Proxy with other service component
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-28 20:51:44 +08:00
sunby
bcd7368533 Fix get component states
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-28 15:20:24 +08:00
sunby
5ac463c9ca Add datanode client in data service
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-28 11:24:41 +08:00
XuanYang-cn
4acaa97039 Add unittests for datanode and queryservice
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-27 20:00:47 +08:00
bigsheeper
68cd15af63 Get index info from master
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-27 14:41:56 +08:00
sunby
b4bcaaf847 Fix data service startup bug
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-27 11:40:10 +08:00
XuanYang-cn
05b013c52a Fix datanode bug
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-27 11:37:26 +08:00
xige-16
947976dbec Add test for query service’s load function
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-27 11:34:16 +08:00
bigsheeper
4f914a2c30 Add docker file and main function of query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-27 09:50:52 +08:00
neza2017
4d37a329da Fix data service init
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-26 19:25:17 +08:00
neza2017
d1b23cb8c5 Add debug info
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-26 19:24:09 +08:00
sunby
f632ed0272 Fix data service init
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-26 18:45:12 +08:00
zhenshan.cao
e83ac41bca Add component for index
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-26 18:01:32 +08:00
neza2017
8c54af292e Add dd handler
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-26 17:55:15 +08:00
XuanYang-cn
0b1c4f0420 Add building datanode cmd in Makefile
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-26 17:40:26 +08:00
sunby
9f72633fd9 Add dd handler
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-26 17:06:13 +08:00
neza2017
2ea6a5f9ee Add make dataservice in Makefile
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-26 16:41:10 +08:00
sunby
b4997a37a2 Add make dataservice in Makefile
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-26 16:36:26 +08:00
neza2017
b6a788373b Fix proxy server
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-26 16:30:36 +08:00
neza2017
fd0227b69a Add logic of get time tick
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-26 15:23:42 +08:00
sunby
3b08162059 Add main function
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-26 15:14:49 +08:00
xige-16
7c210310dc Add load function for query service
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-26 15:13:20 +08:00
dragondriver
ad244dc4e8 Add initial interface to proxy service client
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-26 15:09:31 +08:00
dragondriver
d972b75aaa Add GetTimeTickChannel, GetComponentStates to proxy service
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-26 14:55:57 +08:00
XuanYang-cn
b445587e11 Add datanode main
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-26 14:46:54 +08:00
cai.zhang
346bb1ba49 Delete some unused code and some debug logs
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-26 14:31:31 +08:00
dragondriver
c6a6b1436c Add soft time tick in proxy service
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-26 13:41:41 +08:00
cai.zhang
f940cc455a Add dockerfile for index
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-26 09:38:40 +08:00
neza2017
7f3aa92d10 Add docker file for masterservice
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-25 15:58:04 +08:00
bigsheeper
7554246ace Add segment seeking and use real client
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-25 18:33:10 +08:00
sunby
7c0c835b49 Init params and add segment start/end position
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-25 15:16:28 +08:00
XuanYang-cn
5015a1035d Add logic of get meta from MasterService for datanode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-25 17:10:32 +08:00
neza2017
1fe099775d Refactor data service
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-25 15:17:17 +08:00
neza2017
e89e89b894 Add main for masterservice
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-25 12:03:44 +08:00
sunby
54fcd486bb Refactor data service.
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-25 13:45:56 +08:00
XuanYang-cn
9fe672ab86 Enchance datanode interface
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-24 21:20:11 +08:00
neza2017
5aec8bc5e6 Refactor masterservice
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-24 20:26:35 +08:00
sunby
82d6fb18b8 Add init params returned to data node
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-23 20:22:59 +08:00
neza2017
e2b45f9866 Init param table and open unittest at ci
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-23 17:56:57 +08:00
sunby
c23e2de435 Implment data service
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-23 14:41:29 +08:00
sunby
2f7319cdbb Add interfaces with other modules
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-22 19:43:27 +08:00
neza2017
e68d50f29e Invalid collection meta caceh && ingore time stamp if not dd request
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-23 10:12:41 +08:00
bigsheeper
067c30c422 Add sealedSegment cgo unittest, fix growingSegment field id check
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-22 15:41:54 +08:00
xige-16
511aa419fa Refactor query service
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-22 14:28:06 +08:00
neza2017
2d2dbd7d19 Add logic of segment flush complete
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-22 11:06:12 +08:00
dragondriver
cd52adc18b Add proxy service to ci workflow
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 12:57:23 +08:00
bigsheeper
46a0a6133a Implement distributed api, delete partition states api
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-22 11:17:18 +08:00
sunby
ef79b8d8c7 Add client and grpc service
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-22 11:07:07 +08:00
XuanYang-cn
377ee8687d Modify flush logic
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-22 09:36:40 +08:00
dragondriver
eba6bb288c Refactor the sructure of proto file
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 09:36:18 +08:00
neza2017
9828a52999 Add create index
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-21 10:01:29 +08:00
FluorineDog
7f044fff82 Enable search for sealed
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-01-21 15:29:52 +08:00
sunby
be6775671b Add error returned by Init,Start,Stop functions
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-19 17:38:01 +08:00
cai.zhang
83c60fd84f Update proto about index
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-21 15:20:23 +08:00
cai.zhang
7619d968fd Generate random node port for indexService
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-20 18:26:20 +08:00