test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-04 12:59:23 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
14,554 Commits 96 Branches 105 Tags 185 MiB
7af02fa531
Commit Graph

272 Commits

Author SHA1 Message Date
shaoyue
94265639fe
[skip e2e] Add comment for PayloadWriter (#14138) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-24 13:29:03 +08:00
XuanYang-cn
107e3f8971
[skip e2e]Update license for storage reader (#14041) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-24 13:08:05 +08:00
jaime
d623ea5c37
[skip e2e] Fix goint error in payload (#14109) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-23 22:07:38 +08:00
jaime
0114708c95
[skip e2e] Fix grammar mistake in data_codec (#14108) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-23 22:05:51 +08:00
jaime
846e86b478
[skip e2e] Fix grammar mistake in event_data (#14107) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-23 22:03:56 +08:00
shaoyue
d4f9365a3d
[skip e2e] Add comment for internal/storage/data_codec.go (#14030) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-23 14:30:34 +08:00
XuanYang-cn
e580bb9ccb
[skip e2e]Update license for storage event writer (#14043) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-23 12:07:10 +08:00
XuanYang-cn
78c7ec7300
[skip e2e]Update license for storage event (#14042) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-23 12:05:21 +08:00
XuanYang-cn
6eb0de1640
[skip e2e]Update license for storage writer (#14040) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-23 12:03:28 +08:00
XuanYang-cn
bccf65ec67
[skip e2e]Update license for storage datacodec (#14039) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-23 12:01:36 +08:00
XuanYang-cn
a666cb4f76
[skip e2e]Update license for storage sorter (#14038) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-23 11:59:21 +08:00
shaoyue
cd410c6069
[skip e2e] Add comment for internal/storage.PayloadWriter (#13993) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-22 19:33:39 +08:00
shaoyue
ec91866a5c
[skip e2e] Add comment for internal/storage.Int8FieldData (#13992) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-22 19:31:51 +08:00
shaoyue
770adc17ae
Support library link in centos7 (#13974) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-22 19:22:19 +08:00
JackLCL
b79d751977
[skip ci]Fix error log output format in data_codec.go (#13382) 
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
 2021-12-22 09:59:04 +08:00
shaoyue
8998e1d29b
[skip e2e] Add comment for PayloadReader (#13899) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-21 21:06:28 +08:00
XuanYang-cn
d2c83c24f4
[skip e2e]Update license for storage iterator (#13890) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-21 18:48:57 +08:00
shaoyue
bcb951b0de
[skip e2e] Add comment for event writer (#13800) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-20 23:18:53 +08:00
jaime
40a0c76e73
[skip e2e] Fix grammar mistake in event_data (#13805) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-20 22:49:00 +08:00
jaime
99737d30e2
[skip e2e] Fix golint in data_codec (#13804) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-20 22:47:07 +08:00
jaime
7723d7b571
[skip e2e] Fix golint in payload (#13803) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-20 22:45:15 +08:00
shaoyue
83a59d2545
[skip e2e]Add comment for payload (#13799) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-20 20:00:53 +08:00
Xieql
35ab21372b
[skip e2e] Improve annotation (#13722) 
Signed-off-by: Xieql <727092844@qq.com>
 2021-12-20 19:08:38 +08:00
congqixia
65faf03923
[skip e2e] Add comment for Int64Stats (#13663) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-17 22:04:43 +08:00
congqixia
0e30ec25f3
[skip e2e] Add comment for descriptorEvent (#13662) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-17 22:02:42 +08:00
godchen
9576ec4dcb
[skip e2e]Fix binlog writer comment (#13576) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2021-12-17 19:42:50 +08:00
godchen
ecd3dc5830
[skip e2e]Remove useless event header check func (#13573) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2021-12-17 19:00:14 +08:00
shaoyue
43fbb0fd16
[skip e2d] Fix typo in StatsReader comment (#13623) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-17 18:47:56 +08:00
godchen
7e56f08747
Add payload bytes interface. (#13467) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2021-12-16 16:35:42 +08:00
shaoyue
1f2c098fe7
[skip ci]Add comment for PayloadReader (#13486) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-16 09:37:22 +08:00
shaoyue
0e24520192
[skip ci] Add comment for index codec (#13464) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-15 21:13:23 +08:00
jaime
a91d2118b6
[skip ci] Fix grammar mistake in event_data (#13419) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-15 12:03:58 +08:00
jaime
dec2eba610
[skip ci] Fix grammar mistake in local_chunk_manager (#13418) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-15 11:56:07 +08:00
jaime
0aa8e65501
[skip ci] Fix grammar mistake in minio_chunk_manager (#13417) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-15 11:53:47 +08:00
congqixia
89a26b2679
Fix redundant init declaration in storage/util.go (#13381) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-15 11:13:10 +08:00
shaoyue
a54d1ec674
[skip ci]add comment for EventWriter (#13369) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-14 20:05:09 +08:00
shaoyue
18fbc167f8
[skip ci] Add comment for payload (#13367) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-14 20:03:20 +08:00
shaoyue
41190c23f1
[skip ci] Add comment for EventTypeCode (#13368) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-14 19:55:17 +08:00
Xiangyu Wang
405b3cd932
Use the same lint rules with golint in revive (#13324) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-12-14 15:31:07 +08:00
JackLCL
5b9282fdc3
[skip ci]Fix error log output format in data_ciodec.go (#13226) 
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
 2021-12-13 13:22:14 +08:00
godchen
cec42cb19a
Make arrow use jemalloc (#13029) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-12-09 14:17:36 +08:00
godchen
febdda90f4
Change binlog writer close behavior (#13046) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-12-09 12:37:06 +08:00
godchen
5c44ee8c0f
Close binlog event when error occur (#12995) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-12-08 21:11:39 +08:00
XuanYang-cn
383f14999d
Make Arrow compilation easier (#13005) 
replace all the bundled libraries with arrow_bundled_dependencies

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-08 20:55:05 +08:00
godchen
0c60df4b3b
[skip ci]Fix comment typo (#13017) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-12-08 20:51:06 +08:00
godchen
6845b0e986
[skip ci]Fix comment typo (#13016) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-12-08 20:49:14 +08:00
godchen
9363dbf7b2
[skip ci]Fix comment typo (#13015) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-12-08 20:47:24 +08:00
zhenshan.cao
69259d9294
Call ReleaseUnused of memorypool in arrow (#12893) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-12-08 15:53:05 +08:00
shaoyue
5045ba208e
[skip ci] Add comment for storage.StatsWriter (#12965) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-08 15:13:32 +08:00
shaoyue
d5aa125c49
[skip ci] Add comment for StatsReader (#12870) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-07 14:53:13 +08:00
shaoyue
ccf957e1a8
[skip ci] Add comment for PayloadReader (#12869) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-07 14:51:21 +08:00
godchen
513afd9e42
Update arrow version (#12644) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-12-03 18:59:33 +08:00
congqixia
21a6ce8647
Remove redundant conversion in event_writer.go (#12590) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-02 19:15:33 +08:00
shaoyue
490f81b932
[skip ci] Add comment for DataDefinitionCodec (#12616) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-02 18:57:32 +08:00
shaoyue
ffda2e5945
[skip ci] Fix comment for PayloadReader (#12621) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-02 18:07:33 +08:00
shaoyue
0d92f61d56
[skip ci] Add comment for storage.ChunManger methods (#12524) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-01 15:45:40 +08:00
shaoyue
ee89ca83e1
[skip ci] Add comment for internal/storage/data_codec.go (#12520) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-01 15:39:57 +08:00
congqixia
001752eb91
Fix zero length slice declaration in storage/util.go (#12412) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-30 09:57:44 +08:00
XuanYang-cn
48b45d82e5
Add ut for binlog_io to 100 coverage (#12283) 
Make DN ut coverage upto 90%
Resolves: #8058

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-26 17:43:17 +08:00
XuanYang-cn
6bf0c4326d
Fix compaction generates wrong insert binlogs (#12204) 
This PR
- changes Get() to GetRow() in BinlogIterator
- removes Get() and Length() of FieldData
- adds ut in BinlogIterator for floatvector and binaryvector
- fix a log bug

Fixes: #12146

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-23 17:09:15 +08:00
congqixia
8c107ab15f
Set segment DroppedAt when compacted (#12182) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-22 20:11:14 +08:00
godchen
9d5bcd3e3a
Close event and binlog reader (#12173) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-22 17:27:14 +08:00
Bingyi Sun
a3d4cbdd4c
Convert c array to a golang slice (#12066) 
issue: #11974
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-22 10:05:14 +08:00
shaoyue
1587214676
[skip ci] Add comment for exported items in data_codec.go (#12089) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-18 19:15:27 +08:00
XuanYang-cn
9bd3664672
Fix compaction bug (#11816) 
This PR fixes:
- timeout in compaction
- BinlogIterator using rawID as PKField bug

See also: #11757

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-17 10:07:13 +08:00
Xiangyu Wang
12f50cb22c
[skip ci]Update OWNERS files (#11898) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-16 15:41:11 +08:00
Cai Yudong
b3d85adb6e
Use API HandleCStatus to handle CStatus returned by CGo in storage (#11782) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-15 13:27:09 +08:00
bigsheeper
93149c5ad9
Load growing segment in query node (#11664) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-12 18:27:10 +08:00
Xiangyu Wang
95ac530f5c
[skip ci]Improve import statements (#11715) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-12 11:14:44 +08:00
Xiangyu Wang
b8dcaa31bb
[skip ci]Improve import statements (#11714) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-12 11:12:47 +08:00
Xiangyu Wang
0b4d7dc7f6
[skip ci]Improve import statements (#11713) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-12 11:10:47 +08:00
godchen
863f1bb34e
Fix multi delete data not effect (#11422) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-09 15:01:17 +08:00
shaoyue
e00a4242df
[skip ci] Add comments (#11408) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-08 11:31:00 +08:00
dragondriver
82b510eda2
[skip ci] Fix golint warning of binlog_iterator.go (#11091) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-02 21:45:53 +08:00
godchen
a0a3a889e7
Add common endian for global use (#11092) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-02 18:16:32 +08:00
XuanYang-cn
8704293215
Fix storage Value not exposed problem (#10755) 
See also: #9530

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-27 22:32:23 +08:00
zhenshan.cao
373a4684b9
[skip ci]Fix golint error in data_codec (#10697) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-26 22:32:44 +08:00
cai.zhang
5b42a3223c
Increase compatibility for EstimateMemorySize interface (#10603) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-26 15:34:21 +08:00
XuanYang-cn
cd06f50645
Remove schema in delete codec (#10517) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-24 09:59:10 +08:00
Xiangyu Wang
99ca6e4ba2
Improve comment in storage (#10448) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-22 20:45:12 +08:00
Xiangyu Wang
99d57beff8
Improve comment in storage (#10447) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-22 17:29:11 +08:00
godchen
ffc0c07610
Change delete data primary key to int64 (#10438) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-22 15:37:12 +08:00
godchen
e7738243b9
Fix stats log nil when not int64 field (#10417) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-22 12:51:11 +08:00
congqixia
c3518b8c81
Fix nil stats from DeserializeStats (#10255) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-20 14:26:35 +08:00
sunby
db53eccec9
Add binlog iterators (#10173) 
issue: #9530
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-20 11:52:35 +08:00
godchen
8daeb0d519
Change bloom filter use pk (#10193) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-19 20:18:47 +08:00
XuanYang-cn
2255fe0b45
Change deserialize deltelog from 1 blob to blobs (#10085) 
See also: #9530

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-19 10:28:35 +08:00
XuanYang-cn
75dccad4fa
[skip ci]Fix const golint in data_codec (#9793) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-13 18:59:26 +08:00
XuanYang-cn
2659807826
[skip ci]Fix golint in data_codec (#9792) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-13 18:57:44 +08:00
Cai Yudong
a63ef91c74
Fix static-check (#9776) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-13 13:22:33 +08:00
godchen
59ab0e441c
Add bloom filter for stats (#9630) 
* Add bloom filter for stats

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* trigger GitHub actions

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-13 10:22:33 +08:00
dragondriver
1f224c4b2e
Optimize the ut of storage utils (#9740) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-12 19:47:08 +08:00
dragondriver
f85271cf3f
Estimate memory size by descriptor event (#9688) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-12 17:00:34 +08:00
dragondriver
abb8c2b9ed
Fix the way that binlog store the original size (#9681) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-11 21:02:37 +08:00
dragondriver
7daa319dc2
[skip ci] Rename EstimateMemorySize to GetBinlogSize (#9651) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-11 18:20:30 +08:00
dragondriver
9a7a060484
Store original memory size of binlog file to extra information (#9628) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-11 17:28:30 +08:00
dragondriver
1bc4b36617
Estimate the memory size of binlog file (#9612) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-11 14:10:48 +08:00
dragondriver
dedf745b76
Rename IndexParamsFile to IndexParamsKey (#9563) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-09 19:27:02 +08:00
dragondriver
28a90f9e7a
Store index parameters to descriptor event (#9451) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-09 16:08:56 +08:00
congqixia
74233fcfd8
[skip ci] Fix golint for binlog_writer.go (#9388) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-07 22:13:09 +08:00