Commit Graph

403 Commits

Author SHA1 Message Date
bigsheeper
067c30c422 Add sealedSegment cgo unittest, fix growingSegment field id check
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-22 15:41:54 +08:00
sunby
ef79b8d8c7 Add client and grpc service
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-22 11:07:07 +08:00
Xiangyu Wang
c83a91eb1e Update doc of rocksmq
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-22 10:50:05 +08:00
neza2017
9828a52999 Add create index
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-21 10:01:29 +08:00
FluorineDog
7f044fff82 Enable search for sealed
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-01-21 15:29:52 +08:00
sunby
be6775671b Add error returned by Init,Start,Stop functions
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-19 17:38:01 +08:00
yukun
527c0c49df Add rocksmq unittest with goroutines
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-20 16:46:58 +08:00
Xiangyu Wang
7ee8623e1a Refactor msgstream
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-20 10:02:59 +08:00
zhenshan.cao
2ec573d2f9 Recover delete docs
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-20 09:36:50 +08:00
cai.zhang
fb493cc235 Update interface name of GetIndexStates
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-19 18:32:57 +08:00
neza2017
918e279869 Set msg stream
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-19 16:14:13 +08:00
GuoRentong
4e5df50a39 Update doc:Component interface
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-19 16:19:35 +08:00
sunby
7e8162a79e Add dd handler
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-19 15:35:40 +08:00
neza2017
d5e53aa28a Add Meta table implementation
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-19 14:13:49 +08:00
bigsheeper
48821690b3 Rename Service interface to Component, and update segmentLoad strategy
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-18 10:38:41 +08:00
GuoRentong
dd6c4bfb75 Update doc:interface definitions related to LoadCollection
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-18 10:09:17 +08:00
XuanYang-cn
4af3914836 add segmengt statistics message in datanode and Update documentation
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-16 15:47:33 +08:00
zhenshan.cao
bfe720bfec Update doc
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-15 18:03:16 +08:00
quicksilver
7fe061b846 Raneme init_devcontainer.sh to devcontainer.sh
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-15 14:38:36 +08:00
neza2017
56ab2bda2d Update proto:add partition id
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-15 11:53:22 +08:00
GuoRentong
9038521aa3 Update doc: msgstream
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-15 14:02:12 +08:00
zhenshan.cao
63b21321d6 Refactor indexservice and update doc
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-15 13:50:27 +08:00
zhenshan.cao
04e2062750 Update proto
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-14 20:30:27 +08:00
XuanYang-cn
fb63983eb2 Modify rocksdb compilation
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-14 15:12:08 +08:00
bigsheeper
4303fc0334 Rename channelID to channelNames in documents
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-14 15:03:26 +08:00
yukun
6e36f10a26 Fix rocksdb illegal instruction in some machine
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-14 14:24:14 +08:00
Xiangyu Wang
52bd6abdf8 Change RocksMQ interface
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-13 17:26:57 +08:00
GuoRentong
1104f059ee Update doc:module interfaces
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-13 11:08:03 +08:00
bigsheeper
2d2af1505a Improve mutex usage in query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-12 18:03:24 +08:00
Xiangyu Wang
b6e1713044 Change int to MessageID
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-12 10:52:57 +08:00
GuoRentong
f3d2afa4f4 Update doc:detailed interface definition
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-11 18:35:54 +08:00
quicksilver
a6690dbc99 Fix syntax error: Bad fd number
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-11 15:25:19 +08:00
yukun
18cfd31d40 Fix Load and Remove with prefix
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-11 15:17:06 +08:00
sunby
5dfe9448ae Modify test_index
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-08 16:00:16 +08:00
yukun
d11f00cd9f Add rocksdb in kv
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-08 19:07:57 +08:00
GuoRentong
82ad488555 Update doc: rocksmq
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 18:37:24 +08:00
XuanYang-cn
65089ea362 Fix flush sync test bug and remove unecessary lock in meta_table
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-08 17:20:59 +08:00
GuoRentong
c4599e26de Update doc: node api
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 16:59:19 +08:00
GuoRentong
c82565bd5c Update doc: service api
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-04 14:16:43 +08:00
GuoRentong
1abc69277b Update doc: service api
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-12-29 18:02:44 +08:00
GuoRentong
e8ec0424d8 Update doc: service api
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-12-27 09:05:24 +08:00
GuoRentong
9d5c93744c Fix figure path
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-12-22 14:47:55 +08:00
sunby
6fddb992f4 Add binlog desgin to chap08_binlog.md
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-03 10:16:22 +08:00
zhenshan.cao
7bbbc14637 Fix bug: address already used
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-07 15:22:20 +08:00
xige-16
37d7526d31 Fix search test failure
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-07 14:37:42 +08:00
neza2017
aeca8f85a5 Run cwrapper unittest in ci
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-05 17:39:58 +08:00
cai.zhang
806a97505c Add query node for CI progress
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-05 16:12:45 +08:00
neza2017
70710dee47 Add parquet payload
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-05 16:11:03 +08:00
FluorineDog
63c8f60c6e Enable term parser and executor
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-05 09:51:27 +08:00
FluorineDog
6412ebc0d4 Add support of metric type in schema, enable binary vector, fix segfault
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-05 06:46:01 +08:00
zhenshan.cao
0b6fe0a8cf Refactor paramtable
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-04 14:18:17 +08:00
godchen
7ab5b5d80d Add MinIO kv implements
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-03 19:00:11 +08:00
neza2017
cec903da19 Add parquet payload
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-02 18:31:56 +08:00
zhenshan.cao
23aebe7e2a Fix proxy unittest
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-01 19:53:53 +08:00
neza2017
17cc7bc337 Use MetaRootPath instead
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-01 17:03:39 +08:00
cai.zhang
85a544b79b Add dockerfile for each component
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-28 19:06:48 +08:00
cai.zhang
115d0732af Update docker-compose file for unittest
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-28 16:43:39 +08:00
dragondriver
eb6c0e0a28 Fix the bug when reduce the multiple search result from query nodes
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-28 15:57:49 +08:00
godchen
92bf09c7e6 Add ddstream and scheduler implements
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-28 15:26:39 +08:00
dragondriver
235e723eb6 Read proxy id from param table instead of hardcode
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-27 11:17:12 +08:00
XuanYang-cn
3e605ae25f Rename reader to querynode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-27 10:56:53 +08:00
neza2017
32445dd02b Add cpu profile
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-26 16:01:31 +08:00
cai.zhang
57da66ba72 Update read config logic in docker
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-26 15:18:36 +08:00
zhenshan.cao
045fc3d808 Fix segment fault
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-26 14:29:01 +08:00
XuanYang-cn
0a16a9a651 Add logic of getting milvus distributed config from master by grpc
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-26 13:21:06 +08:00
neza2017
3277987898 Add segment threshold factor
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-23 11:41:53 +08:00
sunby
578e952c60 Add segment threshold factor
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-23 10:20:30 +08:00
godchen
1d1692055d Add api reference docs
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-22 11:12:34 +08:00
GuoRentong
8b88a9c306 Update docs: master::syncMsgProducer
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-11-21 11:39:23 +08:00
GuoRentong
d97bc04ced Add sysconfig in doc
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-11-20 10:42:51 +08:00
GuoRentong
9057c506b2 Reorganize developer guides
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-11-19 10:59:10 +08:00
neza2017
c3de667bf5 Implement segment management in master
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-18 19:46:18 +08:00
bigsheeper
99ea7e9f05 Update param table
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-18 19:33:56 +08:00
sunby
9e4ce8454e Implement segment management in master
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-18 15:04:17 +08:00
neza2017
ce969e9568 Update segment
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-14 14:39:52 +08:00
neza2017
74f8c45a23 Add ListCollection for meta table
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-14 11:50:57 +08:00
godchen
4a11a6431b Add time sync producer
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-12 11:21:21 +08:00
bigsheeper
c9c8fb9def Close pulsar channel
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-12 11:18:23 +08:00
cai.zhang
3b2c86c42d Fix bug for cmake_build dir was changed
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-12 10:45:46 +08:00
XuanYang-cn
a2289d3ce6 Add softTimeTickBarrier and hardTimeTickBarrier
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-11 16:41:53 +08:00
neza2017
202ded96b9 Update time tick
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-09 14:09:10 +08:00
neza2017
7e182a230a Fix bug :GetTimeTick not return error if TimeBarrier is closed
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-07 13:19:31 +08:00
dragondriver
c732c267e1 Refactor proxy framework and add CreateCollection Task
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-05 18:01:33 +08:00
GuoRentong
6828d19d37 Update developer_guides.md
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-11-05 11:52:11 +08:00
bigsheeper
88a3fa31fa Refactor query node and services
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-05 10:52:50 +08:00
XuanYang-cn
425f57e1c7 Replace hand-drawing pictures with OminiGraffle
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-05 10:10:16 +08:00
neza2017
9c807cc4df Update doc and add context
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-04 17:23:18 +08:00
neza2017
d18c17e786 Add Meta table implementation
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-04 16:28:14 +08:00
godchen
bade037fb2 Add meta_table implementation
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-04 16:01:28 +08:00
XuanYang-cn
9a9bc4ecd5 Replace hand-drawing pictures in developer_guide.md
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-03 22:26:35 +08:00
XuanYang-cn
3de52a51c2 Add interface for EtcdKV
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-03 15:08:50 +08:00
GuoRentong
fbdc5df96f Update docs
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-11-03 12:40:13 +08:00
neza2017
10217f9485 Add test for etcd kv
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-02 10:26:33 +08:00
GuoRentong
15b6963be0 Replace pdf figs with png figs
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-10-31 15:11:47 +08:00
GuoRentong
dbf19f492d Update docs: GlobalParamTable & FlowGraph
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-10-30 10:42:48 +08:00
GuoRentong
f7bd6ebfad Add docs
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-10-29 20:42:47 +08:00
zhenshan.cao
8324f8853e Fix knowhere build test cache
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-29 15:50:24 +08:00
zhenshan.cao
bbecf51f8c Move kv directory
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-29 11:46:34 +08:00
GuoRentong
1cfc6c7f86 Add docs
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-10-28 10:09:35 +08:00
quicksilver
d66d48c6b6 Enable UnitTest
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-27 15:51:16 +08:00
shengjh
77b2fcf015 Refactor manipulationreq and add tso(pre-alloc from master)
Signed-off-by: shengjh <1572099106@qq.com>
2020-10-27 12:01:27 +08:00
zhenshan.cao
848e375c0d Fix bug and update doc
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-26 17:27:53 +08:00
bigsheeper
52932da551 Remove segment status
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-10-24 10:45:57 +08:00