Jiquan Long
98ceb162aa
Support antlr as plan parser ( #16696 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
Co-authored-by: xaxys <tpnnghd@163.com>
Co-authored-by: xaxys <tpnnghd@163.com>
2022-05-06 17:43:51 +08:00
Xiaofan
5922f147e5
Fix stale etcd dependency ( #16777 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-05 20:07:50 +08:00
shaoyue
fa97f86cda
Clean up not used id_cache related code ( #16655 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-05-05 09:59:51 +08:00
yah01
7af02fa531
Improve load performance, load binlogs concurrently per file, deserialize binlogs concurrently per field/segment ( #16514 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-04-25 15:57:47 +08:00
jaime
ed3c29eae7
Support Kafka ( #16149 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-04-12 19:47:33 +08:00
groot
be8d9a8b6b
Support import numpy file ( #16348 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-04-03 11:27:29 +08:00
yah01
0f53989f17
Modify proto to support replicas ( #16289 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-30 17:57:28 +08:00
Xiaofan
801eeffbcc
Replace cgo parquet reader to go parquet reader ( #16199 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-03-30 15:21:28 +08:00
xige-16
205c92e54b
Support insert string data ( #15993 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-03-25 14:27:25 +08:00
groot
2078b24dca
Prepare for import ( #16083 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-03-21 15:47:23 +08:00
Bingyi Sun
ca45e0bd00
Add new config file(not applied) ( #15891 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-03-18 15:53:23 +08:00
Ji Bin
3cd28420f1
Support compile under windows ( #15786 )
...
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
* using gofrs/flock instead of syscall.Flock
* using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`
issue #7706
Signed-off-by: Ji Bin <matrixji@live.com>
2022-03-17 17:17:22 +08:00
jaime
97b1ed7bca
Remove reader API from Mqstream and replace it with consumer API ( #15971 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-15 14:45:22 +08:00
shaoyue
83fdc1da7c
Add web server in proxy with sample handler ( #15647 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-02-23 14:37:52 +08:00
Nemo
dc65b1aeea
Switch to knowhere v1.0.1. Also switch to forked gorocksdb v0.0.1 ( #15603 )
...
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-02-17 19:05:49 +08:00
congqixia
1a2a69279e
Revert go.mod change of forked gorocksdb ( #15528 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-02-10 18:47:47 +08:00
jaime
307a8ce535
Support compile and run on Mac ( #15491 )
...
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
2022-02-09 14:27:46 +08:00
Bingyi Sun
f016cd0489
Fix pulsar client go bug ( #15343 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-01-24 18:57:38 +08:00
congqixia
21f999f175
Use forked version of pulsar-client-go ( #15328 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-01-20 22:37:38 +08:00
Bingyi Sun
9a564a7a5e
Upgrade pulsar client ( #15175 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-01-14 17:13:35 +08:00
congqixia
3cf44cb83f
Add automaxprocs ( #14496 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-29 17:40:59 +08:00
Xiangyu Wang
fc7ea7bcd9
Remove golint to avoid deprecated warnings ( #12847 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-07 19:43:03 +08:00
congqixia
43ef945b6f
Replace jwt-go to golang-jwt/jwt ( #12756 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-06 14:07:35 +08:00
shaoyue
5b50731ff4
Fix searchResultBufFlags & queryResultBufFlags memory leak ( #11585 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-16 14:13:12 +08:00
XuanYang-cn
3cd0584a04
Add compaction in datanode ( #11353 )
...
See also: #9530
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-08 19:49:07 +08:00
bigsheeper
5c58924420
Add cgroups to get container memory and check index memory in segment loader ( #10363 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-22 20:49:10 +08:00
sunby
044b06421a
Use etcd to watch channel on datanode ( #7115 )
...
issue: #6578
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-14 15:44:34 +08:00
JackLCL
41b4264ac2
[skip ci]Fix doc error in milvus_create_index_en.md ( #9653 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-10-11 19:06:38 +08:00
congqixia
619beb0d2c
Upgrade pulsar-client-go to BUGFIX commit ( #8835 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-29 15:02:00 +08:00
XuanYang-cn
ff8fef6ad0
Upgrade pulsar-client-go to 0.6.0 ( #7909 )
...
MessageID interface of pulsar-client-go adds
4 more methods. So I add these methods into
`MessageID` interface.
Resolves : #7770
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-15 18:13:49 +08:00
Xiaofan
619c4393f3
Refine logs in proxy search path( #7357 ) ( #7753 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-12 17:54:01 +08:00
dragondriver
960741ee16
Support more detailed metrics information ( #7472 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-03 19:35:47 +08:00
Xiaofan
58b2089692
Import Embedded Etcd Kv Part 1( #7112 ) ( #7174 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-08-24 09:45:51 +08:00
godchen
db25550fd0
Add segment filter interface ( #7231 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-23 17:49:50 +08:00
dragondriver
ad77a6e0d4
Fix #6859 , increase the MaxCallRecvMsgSize and MaxCallSendMsgSize of grpc client ( #6861 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-04 13:03:24 +08:00
godchen
b9f5949680
Add vector chunk manager ( #6613 )
...
* add file manager
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* add file manager
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* add vector file manager
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* rename
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix ut error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix memory error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-20 15:06:09 +08:00
dragondriver
676a30e418
Use channelsMgr to manage search message stream ( #5819 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-18 10:33:58 +08:00
godchen
b7bf26b486
Update grpc trace ( #5817 )
...
* Update grpc trace
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove useless code in mod
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-17 14:17:56 +08:00
dragondriver
e76830ab09
Support column-based insert request in proxy ( #5560 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-03 15:03:34 +08:00
zhenshan.cao
6766169878
Refactor repack logic for insertion ( #5399 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-25 11:53:15 +00:00
zhenshan.cao
3e73775cc1
Add ComputeProduceChannelIndexes for msgstream ( #5364 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-24 08:30:09 +00:00
godchen
d189bf4d33
Change pulsar version ( #5352 )
...
Change pulsar version.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-22 03:36:49 +00:00
zhenshan.cao
70241a8bf9
Cancel local timestamp caching logic ( #5327 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-21 05:11:21 +00:00
godchen
895037889e
Upgrade grpc version from 1.26 to 1.27 ( #5128 )
...
Upgrade grpc version from 1.26 to 1.27
Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-07 18:30:11 +08:00
FluorineDog
88f5642603
Add plan proto and support basic boolean expr parser ( #5088 )
...
**What type of PR is this?**
- [x] Feature
**What this PR does / why we need it:**
This PR supports boolean expression as DSL.
1. The goal of this PR is to support predicates
like `A > 3 && not B < 5 or C in [1, 2, 3]`.
2. Defines `plan.proto`, as Intermediate Representation (IR)
used between go and cpp.
3. Support expr parser, convert predicate expr to IR
in proxynode, while doing static check there
4. Support IR to AST in cpp, enable the execution
2021-04-29 08:48:06 +00:00
godchen
139b334732
Add kv etcd unittest and remove useless code ( #4974 )
...
* Add kv etcd unittest and remove useless code
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-21 18:45:35 +08:00
neza2017
56d367b1e9
Add unit test for master service
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-09 16:10:12 +08:00
sunby
1d7195e036
Add minio and etcd stats watcher
...
Our system needs to watch the performance of etcd and minio. For now I just add the creation stats.
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-08 14:14:43 +08:00
XuanYang-cn
35656ea9ce
Update pulsar client version and fix cannot close tcp connection error
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-03-27 13:58:52 +08:00
xige-16
7e60460aee
close timeTickStream in flow graph when the collection is released
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-26 18:40:04 +08:00