sunby
db53eccec9
Add binlog iterators ( #10173 )
...
issue: #9530
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-20 11:52:35 +08:00
godchen
8daeb0d519
Change bloom filter use pk ( #10193 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-19 20:18:47 +08:00
XuanYang-cn
2255fe0b45
Change deserialize deltelog from 1 blob to blobs ( #10085 )
...
See also: #9530
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-19 10:28:35 +08:00
XuanYang-cn
75dccad4fa
[skip ci]Fix const golint in data_codec ( #9793 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-13 18:59:26 +08:00
XuanYang-cn
2659807826
[skip ci]Fix golint in data_codec ( #9792 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-13 18:57:44 +08:00
Cai Yudong
a63ef91c74
Fix static-check ( #9776 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 13:22:33 +08:00
godchen
59ab0e441c
Add bloom filter for stats ( #9630 )
...
* Add bloom filter for stats
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* trigger GitHub actions
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-13 10:22:33 +08:00
dragondriver
1f224c4b2e
Optimize the ut of storage utils ( #9740 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-12 19:47:08 +08:00
dragondriver
f85271cf3f
Estimate memory size by descriptor event ( #9688 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-12 17:00:34 +08:00
dragondriver
abb8c2b9ed
Fix the way that binlog store the original size ( #9681 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 21:02:37 +08:00
dragondriver
7daa319dc2
[skip ci] Rename EstimateMemorySize to GetBinlogSize ( #9651 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 18:20:30 +08:00
dragondriver
9a7a060484
Store original memory size of binlog file to extra information ( #9628 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 17:28:30 +08:00
dragondriver
1bc4b36617
Estimate the memory size of binlog file ( #9612 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 14:10:48 +08:00
dragondriver
dedf745b76
Rename IndexParamsFile to IndexParamsKey ( #9563 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-09 19:27:02 +08:00
dragondriver
28a90f9e7a
Store index parameters to descriptor event ( #9451 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-09 16:08:56 +08:00
congqixia
74233fcfd8
[skip ci] Fix golint for binlog_writer.go ( #9388 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-07 22:13:09 +08:00
zhenshan.cao
b76e9de5ab
[skip ci] Fix golint error in event_reader.go ( #9156 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-03 20:56:05 +08:00
zhenshan.cao
6d2efe13b6
[skip ci] fix golint error in binlog_reader.go ( #9114 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-03 08:53:55 +08:00
zhenshan.cao
5e78500519
[skip ci] Fix golint error in print_binlog ( #9042 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-01 23:41:23 +08:00
dragondriver
818cf3ffa0
Split blob into several string rows when index file is large ( #8919 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-30 17:57:01 +08:00
dragondriver
ca5e9ebe55
Binlog parser tool supports index file ( #8914 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-30 15:47:32 +08:00
dragondriver
cf8600077f
Refactor the index file format ( #8514 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-29 09:52:12 +08:00
godchen
c23236c50e
Fix chunk manager ci lint ( #8779 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-28 20:46:04 +08:00
godchen
af173dd2a0
Add delete codec ( #8736 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-28 14:30:02 +08:00
ZhiShen
0e767f0e1b
Change cmake version ( #8666 )
...
Change cmake version from 3.16 to 3.18
1. Change the CMakeList's minimum require version.
2. Change the describtion document of cmake version.
Resolves: milvus-io#8407
Signed-off-by: Shen Zhi <m13120163046@163.com>
2021-09-28 14:00:03 +08:00
dragondriver
7a76022f3b
[skip ci] Update doc of descriptor event format ( #8487 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-24 18:17:56 +08:00
godchen
10c07a3041
Add description event extras. ( #8264 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-23 17:23:54 +08:00
godchen
b47ff1f97f
[skip ci]Add chunk manager interface comment ( #8350 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-23 17:13:56 +08:00
Xiaofan
acfd7c7911
[skip ci] Fix typo in binlog writer ( #8255 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-18 22:55:51 +08:00
yukun
269e041e34
[skip ci]Fix typo ( #8251 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-18 19:53:51 +08:00
godchen
d1d3993689
[skip ci]Add binlog reader comment ( #8230 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:57:51 +08:00
godchen
3f5e876188
[skip ci]Add binlog writer comment ( #8231 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:39:56 +08:00
godchen
0cf0217ed5
[skip ci]Add event data comment ( #8232 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:37:56 +08:00
congqixia
bdfb8768d4
Enable gosec ( #8202 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-18 14:45:50 +08:00
godchen
31df0faaf5
[skip ci]Add chunk manager comment ( #7833 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 14:49:50 +08:00
godchen
96539f02d8
Add data codec comment ( #7998 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 11:05:49 +08:00
sunby
095b7c12c1
Add insert codec comment ( #7891 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-15 10:47:48 +08:00
groot
314eed2172
Update storage unittest ( #7637 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-09 17:12:55 +08:00
groot
a3666c843f
Add unittest for chunk manager ( #7628 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-09 17:12:15 +08:00
groot
dbd2a02462
Add unittest for VectorChunkManager ( #7610 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-09 14:34:00 +08:00
XuanYang-cn
4785e452be
Fix Arrow unable to find Boost error ( #7552 )
...
Resolve : #7549
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-08 10:59:59 +08:00
Cai Yudong
7edd96989f
Improve codecov for paramtable and typeutil ( #7451 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-02 22:18:10 +08:00
Xiangyu Wang
c62f23e201
[skip ci]Remove neza2017 from reviewers ( #7324 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-08-27 00:27:36 +08:00
godchen
8cc24e09c9
Make users get vectors without using local storage ( #7134 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-18 16:30:11 +08:00
Cai Yudong
e771bda92f
optimize retrieve output vector code structure ( #7102 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-14 11:18:10 +08:00
Xiangyu Wang
5e78fd6a97
[skip ci]Update approvers ( #7063 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-08-12 19:36:09 +08:00
bigsheeper
7307332fab
Add nil check ( #6832 )
...
* add nil check
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* use grpc functions
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* use grpc functions
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* fix indexCoord crash
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-07-29 20:11:23 +08:00
godchen
61786f769c
Add file exist check ( #6840 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-28 16:31:22 +08:00
godchen
db94d7771f
Read vector from disk ( #6707 )
...
* Read vector from disk
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix git action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix test error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix caculate error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change var name
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix len error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused code
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change bytes to float method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change float to bytes method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-24 09:25:22 +08:00
godchen
b9f5949680
Add vector chunk manager ( #6613 )
...
* add file manager
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* add file manager
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* add vector file manager
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* rename
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix ut error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix memory error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-20 15:06:09 +08:00
