XuanYang-cn
e580bb9ccb
[skip e2e]Update license for storage event writer ( #14043 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 12:07:10 +08:00
XuanYang-cn
78c7ec7300
[skip e2e]Update license for storage event ( #14042 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 12:05:21 +08:00
XuanYang-cn
6eb0de1640
[skip e2e]Update license for storage writer ( #14040 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 12:03:28 +08:00
XuanYang-cn
bccf65ec67
[skip e2e]Update license for storage datacodec ( #14039 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 12:01:36 +08:00
XuanYang-cn
a666cb4f76
[skip e2e]Update license for storage sorter ( #14038 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 11:59:21 +08:00
shaoyue
cd410c6069
[skip e2e] Add comment for internal/storage.PayloadWriter ( #13993 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-22 19:33:39 +08:00
shaoyue
ec91866a5c
[skip e2e] Add comment for internal/storage.Int8FieldData ( #13992 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-22 19:31:51 +08:00
shaoyue
770adc17ae
Support library link in centos7 ( #13974 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-22 19:22:19 +08:00
JackLCL
b79d751977
[skip ci]Fix error log output format in data_codec.go ( #13382 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-22 09:59:04 +08:00
shaoyue
8998e1d29b
[skip e2e] Add comment for PayloadReader ( #13899 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-21 21:06:28 +08:00
XuanYang-cn
d2c83c24f4
[skip e2e]Update license for storage iterator ( #13890 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-21 18:48:57 +08:00
shaoyue
bcb951b0de
[skip e2e] Add comment for event writer ( #13800 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-20 23:18:53 +08:00
jaime
40a0c76e73
[skip e2e] Fix grammar mistake in event_data ( #13805 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-20 22:49:00 +08:00
jaime
99737d30e2
[skip e2e] Fix golint in data_codec ( #13804 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-20 22:47:07 +08:00
jaime
7723d7b571
[skip e2e] Fix golint in payload ( #13803 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-20 22:45:15 +08:00
shaoyue
83a59d2545
[skip e2e]Add comment for payload ( #13799 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-20 20:00:53 +08:00
Xieql
35ab21372b
[skip e2e] Improve annotation ( #13722 )
...
Signed-off-by: Xieql <727092844@qq.com>
2021-12-20 19:08:38 +08:00
congqixia
65faf03923
[skip e2e] Add comment for Int64Stats ( #13663 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-17 22:04:43 +08:00
congqixia
0e30ec25f3
[skip e2e] Add comment for descriptorEvent ( #13662 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-17 22:02:42 +08:00
godchen
9576ec4dcb
[skip e2e]Fix binlog writer comment ( #13576 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 19:42:50 +08:00
godchen
ecd3dc5830
[skip e2e]Remove useless event header check func ( #13573 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 19:00:14 +08:00
shaoyue
43fbb0fd16
[skip e2d] Fix typo in StatsReader comment ( #13623 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-17 18:47:56 +08:00
godchen
7e56f08747
Add payload bytes interface. ( #13467 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-16 16:35:42 +08:00
shaoyue
1f2c098fe7
[skip ci]Add comment for PayloadReader ( #13486 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-16 09:37:22 +08:00
shaoyue
0e24520192
[skip ci] Add comment for index codec ( #13464 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-15 21:13:23 +08:00
jaime
a91d2118b6
[skip ci] Fix grammar mistake in event_data ( #13419 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-15 12:03:58 +08:00
jaime
dec2eba610
[skip ci] Fix grammar mistake in local_chunk_manager ( #13418 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-15 11:56:07 +08:00
jaime
0aa8e65501
[skip ci] Fix grammar mistake in minio_chunk_manager ( #13417 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-15 11:53:47 +08:00
congqixia
89a26b2679
Fix redundant init declaration in storage/util.go ( #13381 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-15 11:13:10 +08:00
shaoyue
a54d1ec674
[skip ci]add comment for EventWriter ( #13369 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-14 20:05:09 +08:00
shaoyue
18fbc167f8
[skip ci] Add comment for payload ( #13367 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-14 20:03:20 +08:00
shaoyue
41190c23f1
[skip ci] Add comment for EventTypeCode ( #13368 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-14 19:55:17 +08:00
Xiangyu Wang
405b3cd932
Use the same lint rules with golint in revive ( #13324 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
JackLCL
5b9282fdc3
[skip ci]Fix error log output format in data_ciodec.go ( #13226 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-13 13:22:14 +08:00
godchen
cec42cb19a
Make arrow use jemalloc ( #13029 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-09 14:17:36 +08:00
godchen
febdda90f4
Change binlog writer close behavior ( #13046 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-09 12:37:06 +08:00
godchen
5c44ee8c0f
Close binlog event when error occur ( #12995 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 21:11:39 +08:00
XuanYang-cn
383f14999d
Make Arrow compilation easier ( #13005 )
...
replace all the bundled libraries with arrow_bundled_dependencies
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-08 20:55:05 +08:00
godchen
0c60df4b3b
[skip ci]Fix comment typo ( #13017 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 20:51:06 +08:00
godchen
6845b0e986
[skip ci]Fix comment typo ( #13016 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 20:49:14 +08:00
godchen
9363dbf7b2
[skip ci]Fix comment typo ( #13015 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 20:47:24 +08:00
zhenshan.cao
69259d9294
Call ReleaseUnused of memorypool in arrow ( #12893 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-08 15:53:05 +08:00
shaoyue
5045ba208e
[skip ci] Add comment for storage.StatsWriter ( #12965 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-08 15:13:32 +08:00
shaoyue
d5aa125c49
[skip ci] Add comment for StatsReader ( #12870 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-07 14:53:13 +08:00
shaoyue
ccf957e1a8
[skip ci] Add comment for PayloadReader ( #12869 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-07 14:51:21 +08:00
godchen
513afd9e42
Update arrow version ( #12644 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-03 18:59:33 +08:00
congqixia
21a6ce8647
Remove redundant conversion in event_writer.go ( #12590 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-02 19:15:33 +08:00
shaoyue
490f81b932
[skip ci] Add comment for DataDefinitionCodec ( #12616 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-02 18:57:32 +08:00
shaoyue
ffda2e5945
[skip ci] Fix comment for PayloadReader ( #12621 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-02 18:07:33 +08:00
shaoyue
0d92f61d56
[skip ci] Add comment for storage.ChunManger methods ( #12524 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-01 15:45:40 +08:00
shaoyue
ee89ca83e1
[skip ci] Add comment for internal/storage/data_codec.go ( #12520 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-01 15:39:57 +08:00
congqixia
001752eb91
Fix zero length slice declaration in storage/util.go ( #12412 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-30 09:57:44 +08:00
XuanYang-cn
48b45d82e5
Add ut for binlog_io to 100 coverage ( #12283 )
...
Make DN ut coverage upto 90%
Resolves : #8058
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-26 17:43:17 +08:00
XuanYang-cn
6bf0c4326d
Fix compaction generates wrong insert binlogs ( #12204 )
...
This PR
- changes Get() to GetRow() in BinlogIterator
- removes Get() and Length() of FieldData
- adds ut in BinlogIterator for floatvector and binaryvector
- fix a log bug
Fixes : #12146
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-23 17:09:15 +08:00
congqixia
8c107ab15f
Set segment DroppedAt when compacted ( #12182 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 20:11:14 +08:00
godchen
9d5bcd3e3a
Close event and binlog reader ( #12173 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-22 17:27:14 +08:00
Bingyi Sun
a3d4cbdd4c
Convert c array to a golang slice ( #12066 )
...
issue: #11974
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-22 10:05:14 +08:00
shaoyue
1587214676
[skip ci] Add comment for exported items in data_codec.go ( #12089 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-18 19:15:27 +08:00
XuanYang-cn
9bd3664672
Fix compaction bug ( #11816 )
...
This PR fixes:
- timeout in compaction
- BinlogIterator using rawID as PKField bug
See also: #11757
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 10:07:13 +08:00
Xiangyu Wang
12f50cb22c
[skip ci]Update OWNERS files ( #11898 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-16 15:41:11 +08:00
Cai Yudong
b3d85adb6e
Use API HandleCStatus to handle CStatus returned by CGo in storage ( #11782 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 13:27:09 +08:00
bigsheeper
93149c5ad9
Load growing segment in query node ( #11664 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 18:27:10 +08:00
Xiangyu Wang
95ac530f5c
[skip ci]Improve import statements ( #11715 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-12 11:14:44 +08:00
Xiangyu Wang
b8dcaa31bb
[skip ci]Improve import statements ( #11714 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-12 11:12:47 +08:00
Xiangyu Wang
0b4d7dc7f6
[skip ci]Improve import statements ( #11713 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-12 11:10:47 +08:00
godchen
863f1bb34e
Fix multi delete data not effect ( #11422 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 15:01:17 +08:00
shaoyue
e00a4242df
[skip ci] Add comments ( #11408 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-08 11:31:00 +08:00
dragondriver
82b510eda2
[skip ci] Fix golint warning of binlog_iterator.go ( #11091 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-02 21:45:53 +08:00
godchen
a0a3a889e7
Add common endian for global use ( #11092 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-02 18:16:32 +08:00
XuanYang-cn
8704293215
Fix storage Value not exposed problem ( #10755 )
...
See also: #9530
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-27 22:32:23 +08:00
zhenshan.cao
373a4684b9
[skip ci]Fix golint error in data_codec ( #10697 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-26 22:32:44 +08:00
cai.zhang
5b42a3223c
Increase compatibility for EstimateMemorySize interface ( #10603 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-26 15:34:21 +08:00
XuanYang-cn
cd06f50645
Remove schema in delete codec ( #10517 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-24 09:59:10 +08:00
Xiangyu Wang
99ca6e4ba2
Improve comment in storage ( #10448 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-22 20:45:12 +08:00
Xiangyu Wang
99d57beff8
Improve comment in storage ( #10447 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-22 17:29:11 +08:00
godchen
ffc0c07610
Change delete data primary key to int64 ( #10438 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 15:37:12 +08:00
godchen
e7738243b9
Fix stats log nil when not int64 field ( #10417 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 12:51:11 +08:00
congqixia
c3518b8c81
Fix nil stats from DeserializeStats ( #10255 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-20 14:26:35 +08:00
sunby
db53eccec9
Add binlog iterators ( #10173 )
...
issue: #9530
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-20 11:52:35 +08:00
godchen
8daeb0d519
Change bloom filter use pk ( #10193 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-19 20:18:47 +08:00
XuanYang-cn
2255fe0b45
Change deserialize deltelog from 1 blob to blobs ( #10085 )
...
See also: #9530
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-19 10:28:35 +08:00
XuanYang-cn
75dccad4fa
[skip ci]Fix const golint in data_codec ( #9793 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-13 18:59:26 +08:00
XuanYang-cn
2659807826
[skip ci]Fix golint in data_codec ( #9792 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-13 18:57:44 +08:00
Cai Yudong
a63ef91c74
Fix static-check ( #9776 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 13:22:33 +08:00
godchen
59ab0e441c
Add bloom filter for stats ( #9630 )
...
* Add bloom filter for stats
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* trigger GitHub actions
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-13 10:22:33 +08:00
dragondriver
1f224c4b2e
Optimize the ut of storage utils ( #9740 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-12 19:47:08 +08:00
dragondriver
f85271cf3f
Estimate memory size by descriptor event ( #9688 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-12 17:00:34 +08:00
dragondriver
abb8c2b9ed
Fix the way that binlog store the original size ( #9681 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 21:02:37 +08:00
dragondriver
7daa319dc2
[skip ci] Rename EstimateMemorySize to GetBinlogSize ( #9651 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 18:20:30 +08:00
dragondriver
9a7a060484
Store original memory size of binlog file to extra information ( #9628 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 17:28:30 +08:00
dragondriver
1bc4b36617
Estimate the memory size of binlog file ( #9612 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 14:10:48 +08:00
dragondriver
dedf745b76
Rename IndexParamsFile to IndexParamsKey ( #9563 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-09 19:27:02 +08:00
dragondriver
28a90f9e7a
Store index parameters to descriptor event ( #9451 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-09 16:08:56 +08:00
congqixia
74233fcfd8
[skip ci] Fix golint for binlog_writer.go ( #9388 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-07 22:13:09 +08:00
zhenshan.cao
b76e9de5ab
[skip ci] Fix golint error in event_reader.go ( #9156 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-03 20:56:05 +08:00
zhenshan.cao
6d2efe13b6
[skip ci] fix golint error in binlog_reader.go ( #9114 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-03 08:53:55 +08:00
zhenshan.cao
5e78500519
[skip ci] Fix golint error in print_binlog ( #9042 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-01 23:41:23 +08:00
dragondriver
818cf3ffa0
Split blob into several string rows when index file is large ( #8919 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-30 17:57:01 +08:00
dragondriver
ca5e9ebe55
Binlog parser tool supports index file ( #8914 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-30 15:47:32 +08:00
dragondriver
cf8600077f
Refactor the index file format ( #8514 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-29 09:52:12 +08:00
godchen
c23236c50e
Fix chunk manager ci lint ( #8779 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-28 20:46:04 +08:00
godchen
af173dd2a0
Add delete codec ( #8736 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-28 14:30:02 +08:00
ZhiShen
0e767f0e1b
Change cmake version ( #8666 )
...
Change cmake version from 3.16 to 3.18
1. Change the CMakeList's minimum require version.
2. Change the describtion document of cmake version.
Resolves: milvus-io#8407
Signed-off-by: Shen Zhi <m13120163046@163.com>
2021-09-28 14:00:03 +08:00
dragondriver
7a76022f3b
[skip ci] Update doc of descriptor event format ( #8487 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-24 18:17:56 +08:00
godchen
10c07a3041
Add description event extras. ( #8264 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-23 17:23:54 +08:00
godchen
b47ff1f97f
[skip ci]Add chunk manager interface comment ( #8350 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-23 17:13:56 +08:00
Xiaofan
acfd7c7911
[skip ci] Fix typo in binlog writer ( #8255 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-18 22:55:51 +08:00
yukun
269e041e34
[skip ci]Fix typo ( #8251 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-18 19:53:51 +08:00
godchen
d1d3993689
[skip ci]Add binlog reader comment ( #8230 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:57:51 +08:00
godchen
3f5e876188
[skip ci]Add binlog writer comment ( #8231 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:39:56 +08:00
godchen
0cf0217ed5
[skip ci]Add event data comment ( #8232 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:37:56 +08:00
congqixia
bdfb8768d4
Enable gosec ( #8202 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-18 14:45:50 +08:00
godchen
31df0faaf5
[skip ci]Add chunk manager comment ( #7833 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 14:49:50 +08:00
godchen
96539f02d8
Add data codec comment ( #7998 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 11:05:49 +08:00
sunby
095b7c12c1
Add insert codec comment ( #7891 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-15 10:47:48 +08:00
groot
314eed2172
Update storage unittest ( #7637 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-09 17:12:55 +08:00
groot
a3666c843f
Add unittest for chunk manager ( #7628 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-09 17:12:15 +08:00
groot
dbd2a02462
Add unittest for VectorChunkManager ( #7610 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-09 14:34:00 +08:00
XuanYang-cn
4785e452be
Fix Arrow unable to find Boost error ( #7552 )
...
Resolve : #7549
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-08 10:59:59 +08:00
Cai Yudong
7edd96989f
Improve codecov for paramtable and typeutil ( #7451 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-02 22:18:10 +08:00
Xiangyu Wang
c62f23e201
[skip ci]Remove neza2017 from reviewers ( #7324 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-08-27 00:27:36 +08:00
godchen
8cc24e09c9
Make users get vectors without using local storage ( #7134 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-18 16:30:11 +08:00
Cai Yudong
e771bda92f
optimize retrieve output vector code structure ( #7102 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-14 11:18:10 +08:00
Xiangyu Wang
5e78fd6a97
[skip ci]Update approvers ( #7063 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-08-12 19:36:09 +08:00
bigsheeper
7307332fab
Add nil check ( #6832 )
...
* add nil check
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* use grpc functions
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* use grpc functions
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* fix indexCoord crash
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-07-29 20:11:23 +08:00
godchen
61786f769c
Add file exist check ( #6840 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-28 16:31:22 +08:00
godchen
db94d7771f
Read vector from disk ( #6707 )
...
* Read vector from disk
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix git action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix test error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix caculate error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change var name
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix len error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused code
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change bytes to float method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change float to bytes method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-24 09:25:22 +08:00
godchen
b9f5949680
Add vector chunk manager ( #6613 )
...
* add file manager
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* add file manager
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* add vector file manager
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* rename
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix ut error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix memory error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-20 15:06:09 +08:00
Cai Yudong
a992dcf6a8
Support query return vector output field ( #6570 )
...
* improve code readibility
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add offset in RetrieveResults
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add VectorFieldInfo into Segment struct
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add new interface for query vector
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update load vector field logic
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update load vector field logic
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fill in field name in query result
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add FieldId into FieldData
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add fillVectorOutputFieldsIfNeeded
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update data_codec_test.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add DeserializeFieldData
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* realize query return vector output field
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* disable query vector case
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-16 17:19:55 +08:00
congqixia
bc15b74244
Handle datasorter edge cases ( #6465 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-07-13 14:37:54 +08:00
quicksilver
7d920e9c9c
Fix compile error on CentOS ( #6359 )
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-08 15:43:45 +08:00
Cai Yudong
3387b07dfd
Optimize code under storage ( #6335 )
...
* rename AddOneStringToPayload/GetOneStringFromPayload to AddStringToPayload/GetStringFromPayload
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code optimize
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename print_binglog_test to print_binlog_test
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update chap08_binlog.md
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* use SetEventTimestamp() to replace SetStartTimestamp() and SetEndTimestamp()
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code optimize
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename AddStringToPayload/GetStringFromPayload to AddOneStringToPayload/GetOneStringFromPayload
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-07 19:10:07 +08:00
Cai Yudong
5a1f7e4feb
rename masterservice to rootcoord ( #5875 )
...
* rename masterservice to rootcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix build error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename service to coord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename package
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename masterservice to rootcoord under distributed
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update scripts
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* enable more unittests
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-18 21:30:08 +08:00
godchen
1c6786f85c
Add blob info ( #5792 )
...
* Add blob info
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-16 12:03:57 +08:00
Xiangyu Wang
ca0993c274
Update OWNERS
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-30 18:58:47 +08:00
Xiangyu Wang
23c4de0eb8
Flush statistics for all int64 fields ( #5318 )
...
Resolves : #5262
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-20 10:38:45 +00:00
yukun
4e6e502df1
Add data sorter in storage ( #5200 )
...
GetEntityByID needs the flushed segment to be sorted by RowID field,
then do binary search to get the target id and entities.
See also: #5177
Signed-off-by: fishpenguin kun.yu@zilliz.com
2021-05-14 02:59:49 +00:00
Xiangyu Wang
82ccd4cec0
Rename module ( #4988 )
...
* Rename module
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
godchen
0dfcb90881
Add storage copyright
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-19 11:32:24 +08:00
godchen
a5ad70a5ab
Add unittest for storage
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-19 10:36:19 +08:00
FluorineDog
ce7a5ea699
Support segcoreinit
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-16 14:02:49 +08:00
godchen
8204546bcd
Add unit test for binlog module
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-12 14:07:46 +08:00
godchen
f3649f0419
Refactor interface and proto
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-12 14:22:09 +08:00
XuanYang-cn
7dd531d159
Fix release collection bug
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-03-11 18:42:25 +08:00
xige-16
09ae985daa
Fix wrong error code in master_service_test.go
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-10 22:06:22 +08:00
quicksilver
455cc59dbb
Update publish-test-images.yaml
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-09 13:55:35 +08:00
sunby
ddddd65d10
Delete internal/errors package
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-05 10:15:27 +08:00
bigsheeper
01e9dc8e3f
Remove collection name
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-03 11:52:19 +08:00
bigsheeper
5e781b9370
Remove field name in query node and segCore
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-03 10:10:07 +08:00
sunby
45b99c0cf3
Save indexName and indexID in IndexCodec
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-02 19:56:11 +08:00