Commit Graph

151 Commits

Author SHA1 Message Date
godchen
863f1bb34e
Fix multi delete data not effect (#11422)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 15:01:17 +08:00
shaoyue
e00a4242df
[skip ci] Add comments (#11408)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-08 11:31:00 +08:00
dragondriver
82b510eda2
[skip ci] Fix golint warning of binlog_iterator.go (#11091)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-02 21:45:53 +08:00
godchen
a0a3a889e7
Add common endian for global use (#11092)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-02 18:16:32 +08:00
XuanYang-cn
8704293215
Fix storage Value not exposed problem (#10755)
See also: #9530

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-27 22:32:23 +08:00
zhenshan.cao
373a4684b9
[skip ci]Fix golint error in data_codec (#10697)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-26 22:32:44 +08:00
cai.zhang
5b42a3223c
Increase compatibility for EstimateMemorySize interface (#10603)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-26 15:34:21 +08:00
XuanYang-cn
cd06f50645
Remove schema in delete codec (#10517)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-24 09:59:10 +08:00
Xiangyu Wang
99ca6e4ba2
Improve comment in storage (#10448)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-22 20:45:12 +08:00
Xiangyu Wang
99d57beff8
Improve comment in storage (#10447)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-22 17:29:11 +08:00
godchen
ffc0c07610
Change delete data primary key to int64 (#10438)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 15:37:12 +08:00
godchen
e7738243b9
Fix stats log nil when not int64 field (#10417)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 12:51:11 +08:00
congqixia
c3518b8c81
Fix nil stats from DeserializeStats (#10255)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-20 14:26:35 +08:00
sunby
db53eccec9
Add binlog iterators (#10173)
issue: #9530
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-20 11:52:35 +08:00
godchen
8daeb0d519
Change bloom filter use pk (#10193)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-19 20:18:47 +08:00
XuanYang-cn
2255fe0b45
Change deserialize deltelog from 1 blob to blobs (#10085)
See also: #9530

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-19 10:28:35 +08:00
XuanYang-cn
75dccad4fa
[skip ci]Fix const golint in data_codec (#9793)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-13 18:59:26 +08:00
XuanYang-cn
2659807826
[skip ci]Fix golint in data_codec (#9792)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-13 18:57:44 +08:00
Cai Yudong
a63ef91c74
Fix static-check (#9776)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 13:22:33 +08:00
godchen
59ab0e441c
Add bloom filter for stats (#9630)
* Add bloom filter for stats

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* trigger GitHub actions

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-13 10:22:33 +08:00
dragondriver
1f224c4b2e
Optimize the ut of storage utils (#9740)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-12 19:47:08 +08:00
dragondriver
f85271cf3f
Estimate memory size by descriptor event (#9688)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-12 17:00:34 +08:00
dragondriver
abb8c2b9ed
Fix the way that binlog store the original size (#9681)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 21:02:37 +08:00
dragondriver
7daa319dc2
[skip ci] Rename EstimateMemorySize to GetBinlogSize (#9651)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 18:20:30 +08:00
dragondriver
9a7a060484
Store original memory size of binlog file to extra information (#9628)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 17:28:30 +08:00
dragondriver
1bc4b36617
Estimate the memory size of binlog file (#9612)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 14:10:48 +08:00
dragondriver
dedf745b76
Rename IndexParamsFile to IndexParamsKey (#9563)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-09 19:27:02 +08:00
dragondriver
28a90f9e7a
Store index parameters to descriptor event (#9451)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-09 16:08:56 +08:00
congqixia
74233fcfd8
[skip ci] Fix golint for binlog_writer.go (#9388)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-07 22:13:09 +08:00
zhenshan.cao
b76e9de5ab
[skip ci] Fix golint error in event_reader.go (#9156)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-03 20:56:05 +08:00
zhenshan.cao
6d2efe13b6
[skip ci] fix golint error in binlog_reader.go (#9114)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-03 08:53:55 +08:00
zhenshan.cao
5e78500519
[skip ci] Fix golint error in print_binlog (#9042)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-01 23:41:23 +08:00
dragondriver
818cf3ffa0
Split blob into several string rows when index file is large (#8919)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-30 17:57:01 +08:00
dragondriver
ca5e9ebe55
Binlog parser tool supports index file (#8914)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-30 15:47:32 +08:00
dragondriver
cf8600077f
Refactor the index file format (#8514)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-29 09:52:12 +08:00
godchen
c23236c50e
Fix chunk manager ci lint (#8779)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-28 20:46:04 +08:00
godchen
af173dd2a0
Add delete codec (#8736)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-28 14:30:02 +08:00
ZhiShen
0e767f0e1b
Change cmake version (#8666)
Change cmake version from 3.16 to 3.18

1. Change the CMakeList's minimum require version.

2. Change the describtion document of cmake version.

Resolves: milvus-io#8407

Signed-off-by: Shen Zhi <m13120163046@163.com>
2021-09-28 14:00:03 +08:00
dragondriver
7a76022f3b
[skip ci] Update doc of descriptor event format (#8487)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-24 18:17:56 +08:00
godchen
10c07a3041
Add description event extras. (#8264)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-23 17:23:54 +08:00
godchen
b47ff1f97f
[skip ci]Add chunk manager interface comment (#8350)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-23 17:13:56 +08:00
Xiaofan
acfd7c7911
[skip ci] Fix typo in binlog writer (#8255)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-18 22:55:51 +08:00
yukun
269e041e34
[skip ci]Fix typo (#8251)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-18 19:53:51 +08:00
godchen
d1d3993689
[skip ci]Add binlog reader comment (#8230)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:57:51 +08:00
godchen
3f5e876188
[skip ci]Add binlog writer comment (#8231)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:39:56 +08:00
godchen
0cf0217ed5
[skip ci]Add event data comment (#8232)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 18:37:56 +08:00
congqixia
bdfb8768d4
Enable gosec (#8202)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-18 14:45:50 +08:00
godchen
31df0faaf5
[skip ci]Add chunk manager comment (#7833)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 14:49:50 +08:00
godchen
96539f02d8
Add data codec comment (#7998)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-17 11:05:49 +08:00
sunby
095b7c12c1
Add insert codec comment (#7891)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-15 10:47:48 +08:00