XuanYang-cn
cebdfb34f7
Enable multiple datanode ( #5068 )
...
Now it's able to start multiple datanode, however, they will process the same insert data.
Further changes are needed to truly enable multiple datanode:
While registering, dataservice need to return different insert channels for different datanode.
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-04-28 18:43:48 +08:00
bigsheeper
c4b379be8b
Set search graceful time from config ( #5014 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-24 07:53:37 +00:00
XuanYang-cn
e281f6a4a1
Remove useless configs in config files
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-04-13 10:04:39 +08:00
zhenshan.cao
ab200e5598
Change querynode num to one
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-16 21:30:44 +08:00
dragondriver
af32f442bb
Split big insert message into serveral smaller
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-09 16:18:58 +08:00
sunby
76480fcefe
Change default log output to stdout
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-08 16:24:55 +08:00
dragondriver
801396e3ef
Disable register link logic, use proxy node directly
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-04 22:27:12 +08:00
cai.zhang
1d899513dd
Unify service name in config file
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-24 18:46:19 +08:00
zhenshan.cao
7c5e2d89f6
Read node port from config
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-23 18:08:17 +08:00
sunby
5769c000a1
Find failed python tests and add skip mark "r0.3-test"
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-19 15:37:04 +08:00
bigsheeper
d8f41db823
Fix search crash error
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-19 13:56:01 +08:00
sunby
5b61182140
Add zap log
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-18 19:53:55 +08:00
xige-16
7c210310dc
Add load function for query service
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-26 15:13:20 +08:00
XuanYang-cn
b445587e11
Add datanode main
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-26 14:46:54 +08:00
cai.zhang
f940cc455a
Add dockerfile for index
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-26 09:38:40 +08:00
XuanYang-cn
9fe672ab86
Enchance datanode interface
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-24 21:20:11 +08:00
xige-16
511aa419fa
Refactor query service
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-22 14:28:06 +08:00
dragondriver
cd52adc18b
Add proxy service to ci workflow
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 12:57:23 +08:00
dragondriver
eba6bb288c
Refactor the sructure of proto file
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 09:36:18 +08:00
neza2017
9828a52999
Add create index
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-21 10:01:29 +08:00
cai.zhang
83c60fd84f
Update proto about index
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-21 15:20:23 +08:00
cai.zhang
fb493cc235
Update interface name of GetIndexStates
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-19 18:32:57 +08:00
XuanYang-cn
6a13386393
Add DataNode package
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-19 11:37:16 +08:00
quicksilver
7fe061b846
Raneme init_devcontainer.sh to devcontainer.sh
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-15 14:38:36 +08:00
neza2017
56ab2bda2d
Update proto:add partition id
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-15 11:53:22 +08:00
zhenshan.cao
63b21321d6
Refactor indexservice and update doc
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-15 13:50:27 +08:00
bigsheeper
cb3ca1ab7c
Refactor kvPath param and unify the segment flush kvPath in write node
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-04 14:17:59 +08:00
bigsheeper
5b9e8c4f60
Add write node client segment flushing
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-28 15:25:16 +08:00
XuanYang-cn
e316533a3a
Add Flush Sync service
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-26 16:28:55 +08:00
XuanYang-cn
7ce0f27ebc
Add buffer to minIO for binlogs
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-23 18:06:04 +08:00
zhenshan.cao
3f6e926aef
Refactor indexbuilder
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-13 06:48:05 +08:00
zhenshan.cao
fc054874d3
Add index_builder
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-10 17:55:55 +08:00
XuanYang-cn
32977e270c
Add impl cgo of parquet
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-08 14:41:04 +08:00
zhenshan.cao
7bbbc14637
Fix bug: address already used
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-07 15:22:20 +08:00
xige-16
37d7526d31
Fix search test failure
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-07 14:37:42 +08:00
neza2017
aeca8f85a5
Run cwrapper unittest in ci
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-05 17:39:58 +08:00
cai.zhang
806a97505c
Add query node for CI progress
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-05 16:12:45 +08:00
neza2017
70710dee47
Add parquet payload
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-05 16:11:03 +08:00
FluorineDog
6412ebc0d4
Add support of metric type in schema, enable binary vector, fix segfault
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-05 06:46:01 +08:00
zhenshan.cao
0b6fe0a8cf
Refactor paramtable
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-04 14:18:17 +08:00
cai.zhang
85a544b79b
Add dockerfile for each component
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-28 19:06:48 +08:00
cai.zhang
115d0732af
Update docker-compose file for unittest
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-28 16:43:39 +08:00
dragondriver
eb6c0e0a28
Fix the bug when reduce the multiple search result from query nodes
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-28 15:57:49 +08:00
godchen
92bf09c7e6
Add ddstream and scheduler implements
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-28 15:26:39 +08:00
FluorineDog
c9fb34142c
Enable primary_key switch
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-28 09:16:00 +08:00
XuanYang-cn
3e605ae25f
Rename reader to querynode
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-27 10:56:53 +08:00
bigsheeper
1decc1a4ca
Add metaRootPath and kvRootPath
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-27 09:59:40 +08:00
dragondriver
72a7af3f4a
Add time tick logic to Proxy
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-26 17:47:46 +08:00
neza2017
32445dd02b
Add cpu profile
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-26 16:01:31 +08:00
cai.zhang
57da66ba72
Update read config logic in docker
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-26 15:18:36 +08:00
zhenshan.cao
045fc3d808
Fix segment fault
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-26 14:29:01 +08:00
XuanYang-cn
0a16a9a651
Add logic of getting milvus distributed config from master by grpc
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-26 13:21:06 +08:00
dragondriver
a7b3efecd7
Read query node num from param table instead of hardcode
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-25 16:17:33 +08:00
cai.zhang
4bcb460c98
Add clang-format
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-25 15:25:00 +08:00
sunby
24b29bec30
Add collectionName/partitionTag/fieldName validation.
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-25 14:44:30 +08:00
bigsheeper
dd3654f953
Fix query node param table
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-20 17:10:24 +08:00