test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-03 20:39:36 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
20,167 Commits 96 Branches 105 Tags 185 MiB
e5d691d854
Commit Graph

454 Commits

Author SHA1 Message Date
xige-16
94d6cbb238
Fix querynode panic when binlog ts wrong (#25635) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-07-18 10:41:20 +08:00
xige-16
33c2012675
Add more metrics (#25081) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-26 17:52:44 +08:00
Xiaofan
e8911ebda7
Add retry time when lazy load BF (#25096) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-06-25 11:32:43 +08:00
PowderLi
3f4356df10
fix the spelling of field (#25008) 
Signed-off-by: PowderLi <min.li@zilliz.com>
 2023-06-21 14:00:42 +08:00
yah01
8bc5282eb3
Fix datanode always retries to load stats even file corrupted (#25012) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-20 16:40:42 +08:00
Enwei Jiao
1ef8f0fceb
Remove cgo PayloadWriter (#24892) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-06-14 18:04:38 +08:00
yah01
a9dccec03a
Add go payload writer (#24656) (#24762) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-09 13:52:39 +08:00
congqixia
41af0a98fa
Use go-api/v2 for milvus-proto (#24770) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-09 01:28:37 +08:00
yah01
ebd0279d3f
Check error by Error() and NoError() for better report message (#24736) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-08 15:36:36 +08:00
Enwei Jiao
d3af451d92
Upgrade golangci-lint (#24707) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-06-07 19:34:36 +08:00
Bingyi Sun
b71c967ed7
Fix NoSuchKey error caused by special stats log (#24670) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-06-06 17:34:36 +08:00
aoiasd
c84bdcea49
merge stats log when segment flushing or compacting (#23570) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-05-29 10:21:28 +08:00
congqixia
73a181d226
Fix get vector it timeout and improve some string const usage (#24141) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-16 17:41:22 +08:00
yah01
546080dcdd
Support to retrieve json (#23563) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-21 11:46:32 +08:00
Enwei Jiao
967a97b9bd
Support json & array types (#23408) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
 2023-04-20 11:32:31 +08:00
cai.zhang
9288020da3
Fix bug for batch delete files on gcp of minio (#23052) (#23083) (#23090) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-04-09 16:22:30 +08:00
jaime
c9d0c157ec
Move some modules from internal to public package (#22572) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-04-06 19:14:32 +08:00
yah01
081572d31c
Refactor QueryNode (#21625) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-03-27 00:42:00 +08:00
xige-16
9aa99aedbb
[Cherry-Pick] Remove arrow uasge in FieldData (#22726) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-03-20 10:41:56 +08:00
huanghaoyuanhhy
024beddfe6
Make GCS OAuth token thread-safe (#22714) 
Signed-off-by: huanghaoyuan <haoyuan.huang@zilliz.com>
 2023-03-14 18:09:54 +08:00
congqixia
732986aa04
Remove fmt.Print from internal package (#22722) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-14 17:36:05 +08:00
shaoyue
32581e6452
Support aliyun oss as object storage with ak or IAM (#22376) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2023-03-09 16:33:52 +08:00
yah01
90a5aa6265
Refine errors, re-define error codes (#22501) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-09 15:47:52 +08:00
jaime
d126f06946
Decouple mq module from internal proto definition (#22536) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-03-04 23:21:50 +08:00
congqixia
ea4ab9e4a4
Replace ErrorList with multiErrors (#22532) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-03 14:59:49 +08:00
Enwei Jiao
697dedac7e
Use cockroachdb/errors to replace other error pkg (#22390) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-02-26 11:31:49 +08:00
jaime
5936723904
Refine Read method of MinioChunkManager (#22235) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-02-21 16:22:26 +08:00
congqixia
f2575e5fa8
Add unconvert & durationcheck linters and fix issues (#22161) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-02-15 17:22:34 +08:00
Xiaofan
6004867853
Add bucket name in error message (#21887) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-02-10 17:44:31 +08:00
Xiaofan
949d5d078f
Fix memory calculation in dataCodec (#21800) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-01-28 11:09:52 +08:00
congqixia
5986106037
Make paramtable init only once (#21782) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-01-19 14:53:44 +08:00
Enwei Jiao
264f08953d
Refactor Rocksmq's config (#21304) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-12-26 19:11:30 +08:00
Enwei Jiao
166e9f0da5
Refactor GrpcConfig (#21142) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-12-16 15:59:23 +08:00
Xiaofan
908023a06e
Add more test on file reader (#21082) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-12-09 11:55:19 +08:00
cai.zhang
eb7ef01b9a
Fix bug for ListWithPrefix from minio with recursive is false (#21059) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-12-08 15:47:18 +08:00
Enwei Jiao
89b810a4db
Refactor all params into ParamItem (#20987) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-12-07 18:01:19 +08:00
jaime
548e90ec68
Support an analogous Java Guava cache implementation (#20831) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-12-05 20:29:18 +08:00
congqixia
f745d7f489
Fix compaction target segment rowNum is always 0 (#20937) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-12-01 20:33:17 +08:00
yah01
f76ea292d2
Change LRU to a generic type (#20744) 
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-11-22 12:11:11 +08:00
groot
bf2107ecf5
Fix a regression of local storage (#20653) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2022-11-21 10:19:10 +08:00
Xiaofan
633a749880
Recude IndexCodec Load Memory (#20621) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-11-18 10:47:08 +08:00
Enwei Jiao
c05b9ad539
Add event dispatcher for config (#20393) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-11-17 18:59:09 +08:00
shaoyue
09ea38615e
Fix gcp oauth token not cached (#20380) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>

Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-11-08 12:43:02 +08:00
Xiaofan
766957e75a
Recuce memory consumption in MinioChunkManager (#20284) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-11-03 12:19:35 +08:00
shaoyue
9fac1476f3
Add support for GCS(GoogleCloudStorage) with IAM (#20164) 
go mod tidy

Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>

Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-11-01 11:07:35 +08:00
Xiaofan
2bfecf5b4e
Refine bloomfilter and memory usage (#20168) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-10-31 17:41:34 +08:00
SimFG
a55f739608
Separate public proto files (#19782) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-10-16 20:49:27 +08:00
yah01
89c9cb3680
Fix scan may break GC limitation (#19670) 
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-10-15 15:13:24 +08:00
jaime
1919353f02
Fix parse segment id error from delta log (#19566) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-09-30 14:18:55 +08:00
congqixia
838a633584
Add ctx parameter for ChunkManager methods (#19546) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-09-29 16:18:56 +08:00
Ten Thousand Leaves
b30c9d4f60
Support Bulk Load in Milvus 2.2 (#18982) 
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-09-26 18:06:54 +08:00
Xiaofan
928a213e31
Fix Chunk Manager Path mis use (#19141) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-09-23 14:40:51 +08:00
congqixia
f24e16a66f
Handle multiple parquet RowGroup/Column (#19283) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-09-21 09:12:50 +08:00
SimFG
d7f38a803d
Separate some proto files (#19218) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-09-16 16:56:49 +08:00
groot
b161aec95e
Support input empty string (#19111) (#19144) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2022-09-13 13:36:29 +08:00
xige-16
4de1bfe5bc
Add cpp data codec (#18538) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: zhagnlu lu.zhang@zilliz.com

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-09-09 22:12:34 +08:00
congqixia
ce9ba0dd02
Remove debug log in minio chunk manager (#19134) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-09-09 17:32:37 +08:00
congqixia
db23a256c2
Make minioChunkManager ListObject level by level when recursive is true (#19096) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-09-08 14:58:34 +08:00
congqixia
68a6587374
Set insert&stats binlog timestamp range (#19005) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-09-04 09:05:09 +08:00
congqixia
c91bb0b015
Unify rootPath in configs and ChunkManager (#18808) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-08-25 19:32:53 +08:00
codeman
70254c3ec5
Unified catalog interface for segment (#18289) (#18290) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Signed-off-by: kejiang <ke.jiang@zilliz.com>
Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-08-20 10:24:51 +08:00
xige-16
e40061b864
Update binlog event format (#18347) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-08-11 14:06:38 +08:00
jaime
efa5dfaa7b
Fix Parse binlog path failure (#18583) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-08-10 17:04:37 +08:00
jaime
6e7831470c
Revert settings of Pulsar address and refine config code (#18494) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-08-02 21:26:33 +08:00
jaime
c9174d55ba
Refine merge operation during compacting phase (#18399) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-07-28 14:52:31 +08:00
congqixia
e9d777b336
Fix ParseSegmentIDBinlog panicks with bad input (#18413) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-07-26 19:32:30 +08:00
xing.zhao
d90313a1a8
Use chunkManager rather than minio.Client in datanode garbage collection (#18092) 
Signed-off-by: xingzhao <xing.zhao@zilliz.com>

Co-authored-by: xingzhao <xing.zhao@zilliz.com>
 2022-07-22 22:10:28 +08:00
Xiaofan
6d82ef8c20
fix garbage collector err handling (#18277) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-07-15 13:54:26 +08:00
cai.zhang
0ad15a22c8
IndexCoord handle events correctly (#17878) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-07-07 14:44:21 +08:00
Letian Jiang
4ae1ca2cac
Fix arrow builder nullptr check in FinishPayloadWriter (#17873) 
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
 2022-06-28 20:04:17 +08:00
Enwei Jiao
16c3aedc15
refine complie configuration (#17502) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-06-24 21:12:15 +08:00
congqixia
37464a281d
Fix datasorter swap vector logic (#17661) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-06-21 11:38:12 +08:00
shaoyue
04f836f516
Fix s3 delete file (#17574) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-06-16 18:14:10 +08:00
yah01
70f8bea4b4
Avoid growing slice as deserializing binlogs (#17421) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-06-08 11:46:06 +08:00
shaoyue
76eaa3fc50
Support access s3 through AWS IAM role (#17292) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-06-02 19:42:03 +08:00
Enwei Jiao
d28a2db46c
move arrow from storage to core (#17061) 
Signed-off-by: Enwei Jiao <jiaoew2011@gmail.com>
 2022-05-22 20:03:58 +08:00
Xiaofan
5355153805
Minio Error is not Handled gracefully (#17003) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-05-16 19:25:55 +08:00
Letian Jiang
72bbe40254
Make PayloadReader read column data in batch (#16826) 
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
 2022-05-10 11:37:52 +08:00
cai.zhang
2be46a01c0
Reduce the number of retries and add error log (#16754) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-05-05 09:31:51 +08:00
Letian Jiang
5b2b917987
Benchmark go/cgo parquet payload readers (#16736) 
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
 2022-04-29 15:59:47 +08:00
xige-16
515d0369de
Support string type in segcore (#16546) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: dragondriver <jiquan.long@zilliz.com>
 2022-04-29 13:35:49 +08:00
jaime
68b1b82faf
Remove DataKV interface (#16692) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-04-28 21:03:47 +08:00
yah01
7af02fa531
Improve load performance, load binlogs concurrently per file, deserialize binlogs concurrently per field/segment (#16514) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-04-25 15:57:47 +08:00
Ten Thousand Leaves
4ef2df8cb9
Fix an issue where query coord calls MinioChunkManager during init (#16629) 
It causes Milvus not runnable with local storage.

issue: #15604

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-25 11:11:46 +08:00
congqixia
9769426e84
Use fmt.Errorf instead of string concat in local_chunk_manager.go (#16442) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-04-19 18:39:39 +08:00
Ten Thousand Leaves
e76a8c5ec2
Update compile options and config for embedded Milvus (#16472) 
/kind enhancement

issue: #15711
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-14 19:57:34 +08:00
godchen
4781db8a2a
Add datanode import (#16414) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-04-12 22:19:34 +08:00
godchen
bb7a0766fe
Add dependency factory (#16204) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-04-07 22:05:32 +08:00
xige-16
99984b88e1
Support delete varChar value (#16229) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-04-02 17:43:29 +08:00
Jiquan Long
ba37531456
Add support for loading multiple indexes (#16138) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-30 21:11:28 +08:00
Xiaofan
801eeffbcc
Replace cgo parquet reader to go parquet reader (#16199) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-03-30 15:21:28 +08:00
Xiaofan
b6b3c9863c
Fix incompatibility of stats log (#16277) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-03-30 10:15:28 +08:00
godchen
478f6ca11e
Add cache for vector chunk (#15912) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-03-26 22:05:26 +08:00
xige-16
205c92e54b
Support insert string data (#15993) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-03-25 14:27:25 +08:00
Ji Bin
3cd28420f1
Support compile under windows (#15786) 
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
  * using gofrs/flock instead of syscall.Flock
  * using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`

issue #7706

Signed-off-by: Ji Bin <matrixji@live.com>
 2022-03-17 17:17:22 +08:00
yah01
d4225117ee
Enable Zstd compression for binlog (#15840) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-03-14 16:00:01 +08:00
Jiquan Long
3121619758
Chunk manager support scalar data (#16010) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-11 14:39:59 +08:00
Jiquan Long
f71651e294
Support column-based insert data in message stream (#15802) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-04 15:09:56 +08:00
Cai Yudong
92c8e32ebd
Let MemoryKV.Load return error when key not exist (#15814) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-02 18:51:55 +08:00
Cai Yudong
503724be19
Optimize CMakeLists.txt under internal/core (#15770) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-01 10:31:55 +08:00
godchen
2e4391e6c5
Add lru cache (#15733) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-02-28 21:43:55 +08:00
Cai Yudong
adca79facc
Fix centos build error (#15760) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-25 18:49:54 +08:00
godchen
fcf0887d92
Add and implement chunk manager interface. (#15541) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-02-24 23:53:53 +08:00
jaime
307a8ce535
Support compile and run on Mac (#15491) 
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
 2022-02-09 14:27:46 +08:00
Ji Bin
d83f69bb21
Support windows compliation (#15448) 
- remove dl dependency while compiling some lib under MSYS
- int types aligement in golang
- core/src/utils adaptation for compile under MSYS

issue: #7706

Signed-off-by: Ji Bin <matrixji@live.com>
 2022-02-07 23:43:46 +08:00
congqixia
4369e08f2a
Fix storage memory leak caused by runtime.SetFinalizer (#15100) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-10 17:13:35 +08:00
congqixia
998ebcce4e
Fix file not close when ReadAll returns error in local chunk manager (#15068) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-10 11:53:34 +08:00
godchen
384ceea223
Close payload writer when error occurs (#15013) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-01-07 18:27:23 +08:00
congqixia
b22e945513
[skip e2e] Add comment for NewInsertCodec (#14907) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-06 18:04:03 +08:00
XuanYang-cn
befb5d77e7
[skip e2e]Update license for cwrapper test (#14785) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-06 09:37:30 +08:00
shaoyue
c5e3efa874
[skip e2e] Add comment for payload (#14803) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-01-05 13:53:35 +08:00
shaoyue
756904dd3e
[skip e2e] Add coment for payloadwriter (#14724) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-01-04 10:49:27 +08:00
XuanYang-cn
99fd72cfb6
[skip e2e]Update license for cwrapper payload (#14626) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-04 09:11:39 +08:00
XuanYang-cn
3afe467d86
[skip e2e]Update license for cwrapper parquet (#14625) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-04 09:09:22 +08:00
XuanYang-cn
c7c147b26c
[skip e2e]Update license for cwrapper cmake (#14627) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-30 20:05:26 +08:00
shaoyue
f9dc87ba6c
[skip e2e] Add comment for data_codec (#14571) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-30 10:44:05 +08:00
XuanYang-cn
7bfde0aa73
[skip e2e]Update license for storage vector chunk m (#14540) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-29 22:42:14 +08:00
Xiaofan
029b153259
Remove data directory for test (#14363) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-12-29 10:08:47 +08:00
XuanYang-cn
dd860a76cf
[skip e2e]Update license for storage util (#14453) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-28 20:11:55 +08:00
XuanYang-cn
758dc8b70f
[skip e2e]Update license for storage unsafe (#14452) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-28 20:03:56 +08:00
XuanYang-cn
647307ea64
[skip e2e]Update license for storage types (#14451) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-28 19:57:10 +08:00
XuanYang-cn
9b335e74a2
[skip e2e]Update license for storage stats (#14349) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-28 09:44:06 +08:00
XuanYang-cn
e4ae7a6bef
[skip e2e]Update license for storage print binlog (#14348) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-28 09:43:49 +08:00
XuanYang-cn
1567aa3f53
[skip e2e]Update license for storage payload (#14347) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-28 09:43:26 +08:00
congqixia
20cc6843a4
[skip e2e] Add comment for FieldData interface (#14351) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-28 09:34:15 +08:00
edward.zeng
57ec25c246
[skip e2e] Refine storage binlog iterator comment (#14309) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-27 15:46:03 +08:00
edward.zeng
94e65eaaa5
[skip e2e] Refine storage binlog writer comment (#14312) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-27 15:42:03 +08:00
jaime
28dfccb6ea
[skip e2e] Fix golint in data_codec (#14212) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-24 19:56:28 +08:00
XuanYang-cn
7ce71870ce
[skip e2e]Update license for storage event test (#14191) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-24 17:34:21 +08:00
XuanYang-cn
effd4cc461
[skip e2e]Update license for storage miniochunk (#14193) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-24 17:32:20 +08:00
XuanYang-cn
c29cf1bc21
[skip e2e]Update license for storage localchunck (#14192) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-24 17:30:32 +08:00
shaoyue
e0a2f1ce82
[skip e2e] Add comment for IndexCodec (#14139) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-24 13:31:30 +08:00
shaoyue
94265639fe
[skip e2e] Add comment for PayloadWriter (#14138) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-24 13:29:03 +08:00
XuanYang-cn
107e3f8971
[skip e2e]Update license for storage reader (#14041) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-24 13:08:05 +08:00
jaime
d623ea5c37
[skip e2e] Fix goint error in payload (#14109) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-23 22:07:38 +08:00
jaime
0114708c95
[skip e2e] Fix grammar mistake in data_codec (#14108) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-23 22:05:51 +08:00
jaime
846e86b478
[skip e2e] Fix grammar mistake in event_data (#14107) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-23 22:03:56 +08:00
shaoyue
d4f9365a3d
[skip e2e] Add comment for internal/storage/data_codec.go (#14030) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-23 14:30:34 +08:00
XuanYang-cn
e580bb9ccb
[skip e2e]Update license for storage event writer (#14043) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-23 12:07:10 +08:00
XuanYang-cn
78c7ec7300
[skip e2e]Update license for storage event (#14042) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-23 12:05:21 +08:00
XuanYang-cn
6eb0de1640
[skip e2e]Update license for storage writer (#14040) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-23 12:03:28 +08:00
XuanYang-cn
bccf65ec67
[skip e2e]Update license for storage datacodec (#14039) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-23 12:01:36 +08:00
XuanYang-cn
a666cb4f76
[skip e2e]Update license for storage sorter (#14038) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-23 11:59:21 +08:00
shaoyue
cd410c6069
[skip e2e] Add comment for internal/storage.PayloadWriter (#13993) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-22 19:33:39 +08:00
shaoyue
ec91866a5c
[skip e2e] Add comment for internal/storage.Int8FieldData (#13992) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-22 19:31:51 +08:00
shaoyue
770adc17ae
Support library link in centos7 (#13974) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-22 19:22:19 +08:00
JackLCL
b79d751977
[skip ci]Fix error log output format in data_codec.go (#13382) 
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
 2021-12-22 09:59:04 +08:00
shaoyue
8998e1d29b
[skip e2e] Add comment for PayloadReader (#13899) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-21 21:06:28 +08:00
XuanYang-cn
d2c83c24f4
[skip e2e]Update license for storage iterator (#13890) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-21 18:48:57 +08:00
shaoyue
bcb951b0de
[skip e2e] Add comment for event writer (#13800) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-20 23:18:53 +08:00