Cai Yudong
92c8e32ebd
Let MemoryKV.Load return error when key not exist ( #15814 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-02 18:51:55 +08:00
Cai Yudong
503724be19
Optimize CMakeLists.txt under internal/core ( #15770 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-01 10:31:55 +08:00
godchen
2e4391e6c5
Add lru cache ( #15733 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-02-28 21:43:55 +08:00
Cai Yudong
adca79facc
Fix centos build error ( #15760 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-25 18:49:54 +08:00
godchen
fcf0887d92
Add and implement chunk manager interface. ( #15541 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-02-24 23:53:53 +08:00
jaime
307a8ce535
Support compile and run on Mac ( #15491 )
...
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
2022-02-09 14:27:46 +08:00
Ji Bin
d83f69bb21
Support windows compliation ( #15448 )
...
- remove dl dependency while compiling some lib under MSYS
- int types aligement in golang
- core/src/utils adaptation for compile under MSYS
issue: #7706
Signed-off-by: Ji Bin <matrixji@live.com>
2022-02-07 23:43:46 +08:00
congqixia
4369e08f2a
Fix storage memory leak caused by runtime.SetFinalizer ( #15100 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-01-10 17:13:35 +08:00
congqixia
998ebcce4e
Fix file not close when ReadAll returns error in local chunk manager ( #15068 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-01-10 11:53:34 +08:00
godchen
384ceea223
Close payload writer when error occurs ( #15013 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-01-07 18:27:23 +08:00
congqixia
b22e945513
[skip e2e] Add comment for NewInsertCodec ( #14907 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-01-06 18:04:03 +08:00
XuanYang-cn
befb5d77e7
[skip e2e]Update license for cwrapper test ( #14785 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-06 09:37:30 +08:00
shaoyue
c5e3efa874
[skip e2e] Add comment for payload ( #14803 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-01-05 13:53:35 +08:00
shaoyue
756904dd3e
[skip e2e] Add coment for payloadwriter ( #14724 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-01-04 10:49:27 +08:00
XuanYang-cn
99fd72cfb6
[skip e2e]Update license for cwrapper payload ( #14626 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-04 09:11:39 +08:00
XuanYang-cn
3afe467d86
[skip e2e]Update license for cwrapper parquet ( #14625 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-04 09:09:22 +08:00
XuanYang-cn
c7c147b26c
[skip e2e]Update license for cwrapper cmake ( #14627 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-30 20:05:26 +08:00
shaoyue
f9dc87ba6c
[skip e2e] Add comment for data_codec ( #14571 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-30 10:44:05 +08:00
XuanYang-cn
7bfde0aa73
[skip e2e]Update license for storage vector chunk m ( #14540 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-29 22:42:14 +08:00
Xiaofan
029b153259
Remove data directory for test ( #14363 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 10:08:47 +08:00
XuanYang-cn
dd860a76cf
[skip e2e]Update license for storage util ( #14453 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 20:11:55 +08:00
XuanYang-cn
758dc8b70f
[skip e2e]Update license for storage unsafe ( #14452 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 20:03:56 +08:00
XuanYang-cn
647307ea64
[skip e2e]Update license for storage types ( #14451 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 19:57:10 +08:00
XuanYang-cn
9b335e74a2
[skip e2e]Update license for storage stats ( #14349 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 09:44:06 +08:00
XuanYang-cn
e4ae7a6bef
[skip e2e]Update license for storage print binlog ( #14348 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 09:43:49 +08:00
XuanYang-cn
1567aa3f53
[skip e2e]Update license for storage payload ( #14347 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 09:43:26 +08:00
congqixia
20cc6843a4
[skip e2e] Add comment for FieldData interface ( #14351 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-28 09:34:15 +08:00
edward.zeng
57ec25c246
[skip e2e] Refine storage binlog iterator comment ( #14309 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-27 15:46:03 +08:00
edward.zeng
94e65eaaa5
[skip e2e] Refine storage binlog writer comment ( #14312 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-27 15:42:03 +08:00
jaime
28dfccb6ea
[skip e2e] Fix golint in data_codec ( #14212 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-24 19:56:28 +08:00
XuanYang-cn
7ce71870ce
[skip e2e]Update license for storage event test ( #14191 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-24 17:34:21 +08:00
XuanYang-cn
effd4cc461
[skip e2e]Update license for storage miniochunk ( #14193 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-24 17:32:20 +08:00
XuanYang-cn
c29cf1bc21
[skip e2e]Update license for storage localchunck ( #14192 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-24 17:30:32 +08:00
shaoyue
e0a2f1ce82
[skip e2e] Add comment for IndexCodec ( #14139 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-24 13:31:30 +08:00
shaoyue
94265639fe
[skip e2e] Add comment for PayloadWriter ( #14138 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-24 13:29:03 +08:00
XuanYang-cn
107e3f8971
[skip e2e]Update license for storage reader ( #14041 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-24 13:08:05 +08:00
jaime
d623ea5c37
[skip e2e] Fix goint error in payload ( #14109 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-23 22:07:38 +08:00
jaime
0114708c95
[skip e2e] Fix grammar mistake in data_codec ( #14108 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-23 22:05:51 +08:00
jaime
846e86b478
[skip e2e] Fix grammar mistake in event_data ( #14107 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-23 22:03:56 +08:00
shaoyue
d4f9365a3d
[skip e2e] Add comment for internal/storage/data_codec.go ( #14030 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-23 14:30:34 +08:00
XuanYang-cn
e580bb9ccb
[skip e2e]Update license for storage event writer ( #14043 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 12:07:10 +08:00
XuanYang-cn
78c7ec7300
[skip e2e]Update license for storage event ( #14042 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 12:05:21 +08:00
XuanYang-cn
6eb0de1640
[skip e2e]Update license for storage writer ( #14040 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 12:03:28 +08:00
XuanYang-cn
bccf65ec67
[skip e2e]Update license for storage datacodec ( #14039 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 12:01:36 +08:00
XuanYang-cn
a666cb4f76
[skip e2e]Update license for storage sorter ( #14038 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 11:59:21 +08:00
shaoyue
cd410c6069
[skip e2e] Add comment for internal/storage.PayloadWriter ( #13993 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-22 19:33:39 +08:00
shaoyue
ec91866a5c
[skip e2e] Add comment for internal/storage.Int8FieldData ( #13992 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-22 19:31:51 +08:00
shaoyue
770adc17ae
Support library link in centos7 ( #13974 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-22 19:22:19 +08:00
JackLCL
b79d751977
[skip ci]Fix error log output format in data_codec.go ( #13382 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-22 09:59:04 +08:00
shaoyue
8998e1d29b
[skip e2e] Add comment for PayloadReader ( #13899 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-21 21:06:28 +08:00
XuanYang-cn
d2c83c24f4
[skip e2e]Update license for storage iterator ( #13890 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-21 18:48:57 +08:00
shaoyue
bcb951b0de
[skip e2e] Add comment for event writer ( #13800 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-20 23:18:53 +08:00
jaime
40a0c76e73
[skip e2e] Fix grammar mistake in event_data ( #13805 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-20 22:49:00 +08:00
jaime
99737d30e2
[skip e2e] Fix golint in data_codec ( #13804 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-20 22:47:07 +08:00
jaime
7723d7b571
[skip e2e] Fix golint in payload ( #13803 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-20 22:45:15 +08:00
shaoyue
83a59d2545
[skip e2e]Add comment for payload ( #13799 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-20 20:00:53 +08:00
Xieql
35ab21372b
[skip e2e] Improve annotation ( #13722 )
...
Signed-off-by: Xieql <727092844@qq.com>
2021-12-20 19:08:38 +08:00
congqixia
65faf03923
[skip e2e] Add comment for Int64Stats ( #13663 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-17 22:04:43 +08:00
congqixia
0e30ec25f3
[skip e2e] Add comment for descriptorEvent ( #13662 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-17 22:02:42 +08:00
godchen
9576ec4dcb
[skip e2e]Fix binlog writer comment ( #13576 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 19:42:50 +08:00
godchen
ecd3dc5830
[skip e2e]Remove useless event header check func ( #13573 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 19:00:14 +08:00
shaoyue
43fbb0fd16
[skip e2d] Fix typo in StatsReader comment ( #13623 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-17 18:47:56 +08:00
godchen
7e56f08747
Add payload bytes interface. ( #13467 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-16 16:35:42 +08:00
shaoyue
1f2c098fe7
[skip ci]Add comment for PayloadReader ( #13486 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-16 09:37:22 +08:00
shaoyue
0e24520192
[skip ci] Add comment for index codec ( #13464 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-15 21:13:23 +08:00
jaime
a91d2118b6
[skip ci] Fix grammar mistake in event_data ( #13419 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-15 12:03:58 +08:00
jaime
dec2eba610
[skip ci] Fix grammar mistake in local_chunk_manager ( #13418 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-15 11:56:07 +08:00
jaime
0aa8e65501
[skip ci] Fix grammar mistake in minio_chunk_manager ( #13417 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-15 11:53:47 +08:00
congqixia
89a26b2679
Fix redundant init declaration in storage/util.go ( #13381 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-15 11:13:10 +08:00
shaoyue
a54d1ec674
[skip ci]add comment for EventWriter ( #13369 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-14 20:05:09 +08:00
shaoyue
18fbc167f8
[skip ci] Add comment for payload ( #13367 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-14 20:03:20 +08:00
shaoyue
41190c23f1
[skip ci] Add comment for EventTypeCode ( #13368 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-14 19:55:17 +08:00
Xiangyu Wang
405b3cd932
Use the same lint rules with golint in revive ( #13324 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
JackLCL
5b9282fdc3
[skip ci]Fix error log output format in data_ciodec.go ( #13226 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-13 13:22:14 +08:00
godchen
cec42cb19a
Make arrow use jemalloc ( #13029 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-09 14:17:36 +08:00
godchen
febdda90f4
Change binlog writer close behavior ( #13046 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-09 12:37:06 +08:00
godchen
5c44ee8c0f
Close binlog event when error occur ( #12995 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 21:11:39 +08:00
XuanYang-cn
383f14999d
Make Arrow compilation easier ( #13005 )
...
replace all the bundled libraries with arrow_bundled_dependencies
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-08 20:55:05 +08:00
godchen
0c60df4b3b
[skip ci]Fix comment typo ( #13017 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 20:51:06 +08:00
godchen
6845b0e986
[skip ci]Fix comment typo ( #13016 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 20:49:14 +08:00
godchen
9363dbf7b2
[skip ci]Fix comment typo ( #13015 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 20:47:24 +08:00
zhenshan.cao
69259d9294
Call ReleaseUnused of memorypool in arrow ( #12893 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-08 15:53:05 +08:00
shaoyue
5045ba208e
[skip ci] Add comment for storage.StatsWriter ( #12965 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-08 15:13:32 +08:00
shaoyue
d5aa125c49
[skip ci] Add comment for StatsReader ( #12870 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-07 14:53:13 +08:00
shaoyue
ccf957e1a8
[skip ci] Add comment for PayloadReader ( #12869 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-07 14:51:21 +08:00
godchen
513afd9e42
Update arrow version ( #12644 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-03 18:59:33 +08:00
congqixia
21a6ce8647
Remove redundant conversion in event_writer.go ( #12590 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-02 19:15:33 +08:00
shaoyue
490f81b932
[skip ci] Add comment for DataDefinitionCodec ( #12616 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-02 18:57:32 +08:00
shaoyue
ffda2e5945
[skip ci] Fix comment for PayloadReader ( #12621 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-02 18:07:33 +08:00
shaoyue
0d92f61d56
[skip ci] Add comment for storage.ChunManger methods ( #12524 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-01 15:45:40 +08:00
shaoyue
ee89ca83e1
[skip ci] Add comment for internal/storage/data_codec.go ( #12520 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-01 15:39:57 +08:00
congqixia
001752eb91
Fix zero length slice declaration in storage/util.go ( #12412 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-30 09:57:44 +08:00
XuanYang-cn
48b45d82e5
Add ut for binlog_io to 100 coverage ( #12283 )
...
Make DN ut coverage upto 90%
Resolves : #8058
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-26 17:43:17 +08:00
XuanYang-cn
6bf0c4326d
Fix compaction generates wrong insert binlogs ( #12204 )
...
This PR
- changes Get() to GetRow() in BinlogIterator
- removes Get() and Length() of FieldData
- adds ut in BinlogIterator for floatvector and binaryvector
- fix a log bug
Fixes : #12146
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-23 17:09:15 +08:00
congqixia
8c107ab15f
Set segment DroppedAt when compacted ( #12182 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 20:11:14 +08:00
godchen
9d5bcd3e3a
Close event and binlog reader ( #12173 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-22 17:27:14 +08:00
Bingyi Sun
a3d4cbdd4c
Convert c array to a golang slice ( #12066 )
...
issue: #11974
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-22 10:05:14 +08:00
shaoyue
1587214676
[skip ci] Add comment for exported items in data_codec.go ( #12089 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-18 19:15:27 +08:00
XuanYang-cn
9bd3664672
Fix compaction bug ( #11816 )
...
This PR fixes:
- timeout in compaction
- BinlogIterator using rawID as PKField bug
See also: #11757
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 10:07:13 +08:00
Xiangyu Wang
12f50cb22c
[skip ci]Update OWNERS files ( #11898 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-16 15:41:11 +08:00