zhenshan.cao
6766169878
Refactor repack logic for insertion ( #5399 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-25 11:53:15 +00:00
zhenshan.cao
3e73775cc1
Add ComputeProduceChannelIndexes for msgstream ( #5364 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-24 08:30:09 +00:00
godchen
d189bf4d33
Change pulsar version ( #5352 )
...
Change pulsar version.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-22 03:36:49 +00:00
zwd1208
7d49096e8c
Add prometheus metrics ( #5342 )
...
Add prometheus metrics for components
Resolves : #5325
Signed-off-by: Weida Zhu <weida.zhu@zilliz.com>
2021-05-21 13:48:04 +00:00
zhenshan.cao
70241a8bf9
Cancel local timestamp caching logic ( #5327 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-21 05:11:21 +00:00
XuanYang-cn
c3ac1375d8
Add buffer function for auto flush ( #5271 )
...
Auto-flush of a segment is not considered flush-completed.
So we need to buffer binlog paths generated by auto-flush.
See also: #5268 #5220
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-05-18 08:33:05 +00:00
godchen
cca75583a6
Add session util ( #5269 )
...
Add session util.
Issue #5174
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-18 03:39:21 +00:00
XuanYang-cn
eb557b289b
Add docs in package datanode ( #5117 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-05-08 07:24:12 +00:00
godchen
895037889e
Upgrade grpc version from 1.26 to 1.27 ( #5128 )
...
Upgrade grpc version from 1.26 to 1.27
Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-07 18:30:11 +08:00
FluorineDog
88f5642603
Add plan proto and support basic boolean expr parser ( #5088 )
...
**What type of PR is this?**
- [x] Feature
**What this PR does / why we need it:**
This PR supports boolean expression as DSL.
1. The goal of this PR is to support predicates
like `A > 3 && not B < 5 or C in [1, 2, 3]`.
2. Defines `plan.proto`, as Intermediate Representation (IR)
used between go and cpp.
3. Support expr parser, convert predicate expr to IR
in proxynode, while doing static check there
4. Support IR to AST in cpp, enable the execution
2021-04-29 08:48:06 +00:00
XuanYang-cn
cebdfb34f7
Enable multiple datanode ( #5068 )
...
Now it's able to start multiple datanode, however, they will process the same insert data.
Further changes are needed to truly enable multiple datanode:
While registering, dataservice need to return different insert channels for different datanode.
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-04-28 18:43:48 +08:00
godchen
c64f3a2a52
Fix the version of protobuf in go.mod not consistence with MakeFile ( #5047 )
...
Fix the version of protobuf in go.mod not consistence with MakeFile
Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-04-27 18:18:04 +08:00
Xiangyu Wang
82ccd4cec0
Rename module ( #4988 )
...
* Rename module
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
godchen
139b334732
Add kv etcd unittest and remove useless code ( #4974 )
...
* Add kv etcd unittest and remove useless code
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-21 18:45:35 +08:00
sunby
751c9d4e81
Refactor meta.go
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-09 09:55:04 +08:00
sunby
1d7195e036
Add minio and etcd stats watcher
...
Our system needs to watch the performance of etcd and minio. For now I just add the creation stats.
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-08 14:14:43 +08:00
XuanYang-cn
35656ea9ce
Update pulsar client version and fix cannot close tcp connection error
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-03-27 13:58:52 +08:00
xige-16
a48d46cfaf
Alter msgID’s type to bytes
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-27 09:46:54 +08:00
xige-16
7e60460aee
close timeTickStream in flow graph when the collection is released
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-26 18:40:04 +08:00
xige-16
cee0c4df11
Set pulsar version to 0.1.1
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-25 17:06:48 +08:00
zhenshan.cao
c2734fa55f
Fix bug and enchance system
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-22 16:36:10 +08:00
dragondriver
af32f442bb
Split big insert message into serveral smaller
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-09 16:18:58 +08:00
sunby
aeb3038545
Remove GetCount in data service
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-08 10:49:44 +08:00
sunby
ddddd65d10
Delete internal/errors package
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-05 10:15:27 +08:00
godchen
7b9fdd7f29
Add opentracing
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-26 17:44:24 +08:00
sunby
ea1d9ea99a
Replace log in dataservice
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-23 09:58:06 +08:00
sunby
b07a371f25
Create a goroutine to receive msg for every consumer
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-22 09:58:34 +08:00
neza2017
1d3fdebcf4
Add drop index for proxy
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-02-20 15:38:44 +08:00
sunby
5769c000a1
Find failed python tests and add skip mark "r0.3-test"
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-19 15:37:04 +08:00
bigsheeper
d8f41db823
Fix search crash error
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-19 13:56:01 +08:00
sunby
5b61182140
Add zap log
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-18 19:53:55 +08:00
groot
dc3736281a
Integrate message stream
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-02-08 14:30:54 +08:00
Xiangyu Wang
fd9e42d3ed
Update msgstream/unmarshal interface
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-03 17:30:10 +08:00
bigsheeper
abffdbff62
Remove partition tag
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-03 16:44:38 +08:00
yukun
35f6f4b7c2
Add consume in rmq_msgstream
...
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-02-03 15:18:54 +08:00
Xiangyu Wang
99cef4b5c8
Add Distributed main entrypoint
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-29 17:08:31 +08:00
dragondriver
eba6bb288c
Refactor the sructure of proto file
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 09:36:18 +08:00
xige-16
d22c2cd203
Add proto for query service loading collection
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-18 19:32:08 +08:00
XuanYang-cn
37688559f1
Fix multi rowdata writenode crash bug
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-16 15:06:19 +08:00
GuoRentong
f3d2afa4f4
Update doc:detailed interface definition
...
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-11 18:35:54 +08:00
quicksilver
a6690dbc99
Fix syntax error: Bad fd number
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-11 15:25:19 +08:00
yukun
18cfd31d40
Fix Load and Remove with prefix
...
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-11 15:17:06 +08:00
sunby
5dfe9448ae
Modify test_index
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-08 16:00:16 +08:00
yukun
d11f00cd9f
Add rocksdb in kv
...
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-08 19:07:57 +08:00
GuoRentong
82ad488555
Update doc: rocksmq
...
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 18:37:24 +08:00
XuanYang-cn
65089ea362
Fix flush sync test bug and remove unecessary lock in meta_table
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-08 17:20:59 +08:00
GuoRentong
c4599e26de
Update doc: node api
...
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 16:59:19 +08:00
bigsheeper
e13822043d
Fix search test when partition not exists, add binary vector search validation
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-08 16:41:27 +08:00
godchen
fa73f17f94
Add opentracing doc
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-08 15:32:38 +08:00
dragondriver
ced56c84f8
Add support to build binary vector index
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-07 14:56:17 +08:00