test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-04 04:49:08 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
13,113 Commits 96 Branches 105 Tags 185 MiB
0114708c95
Commit Graph

76 Commits

Author SHA1 Message Date
jaime
0114708c95
[skip e2e] Fix grammar mistake in data_codec (#14108) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-23 22:05:51 +08:00
shaoyue
d4f9365a3d
[skip e2e] Add comment for internal/storage/data_codec.go (#14030) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-23 14:30:34 +08:00
XuanYang-cn
bccf65ec67
[skip e2e]Update license for storage datacodec (#14039) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-23 12:01:36 +08:00
shaoyue
ec91866a5c
[skip e2e] Add comment for internal/storage.Int8FieldData (#13992) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-22 19:31:51 +08:00
JackLCL
b79d751977
[skip ci]Fix error log output format in data_codec.go (#13382) 
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
 2021-12-22 09:59:04 +08:00
jaime
99737d30e2
[skip e2e] Fix golint in data_codec (#13804) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-20 22:47:07 +08:00
Xieql
35ab21372b
[skip e2e] Improve annotation (#13722) 
Signed-off-by: Xieql <727092844@qq.com>
 2021-12-20 19:08:38 +08:00
godchen
7e56f08747
Add payload bytes interface. (#13467) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2021-12-16 16:35:42 +08:00
shaoyue
0e24520192
[skip ci] Add comment for index codec (#13464) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-15 21:13:23 +08:00
JackLCL
5b9282fdc3
[skip ci]Fix error log output format in data_ciodec.go (#13226) 
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
 2021-12-13 13:22:14 +08:00
godchen
febdda90f4
Change binlog writer close behavior (#13046) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-12-09 12:37:06 +08:00
godchen
5c44ee8c0f
Close binlog event when error occur (#12995) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-12-08 21:11:39 +08:00
shaoyue
490f81b932
[skip ci] Add comment for DataDefinitionCodec (#12616) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-02 18:57:32 +08:00
shaoyue
ee89ca83e1
[skip ci] Add comment for internal/storage/data_codec.go (#12520) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-01 15:39:57 +08:00
XuanYang-cn
48b45d82e5
Add ut for binlog_io to 100 coverage (#12283) 
Make DN ut coverage upto 90%
Resolves: #8058

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-26 17:43:17 +08:00
XuanYang-cn
6bf0c4326d
Fix compaction generates wrong insert binlogs (#12204) 
This PR
- changes Get() to GetRow() in BinlogIterator
- removes Get() and Length() of FieldData
- adds ut in BinlogIterator for floatvector and binaryvector
- fix a log bug

Fixes: #12146

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-23 17:09:15 +08:00
godchen
9d5bcd3e3a
Close event and binlog reader (#12173) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-22 17:27:14 +08:00
shaoyue
1587214676
[skip ci] Add comment for exported items in data_codec.go (#12089) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-18 19:15:27 +08:00
bigsheeper
93149c5ad9
Load growing segment in query node (#11664) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-12 18:27:10 +08:00
godchen
863f1bb34e
Fix multi delete data not effect (#11422) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-09 15:01:17 +08:00
zhenshan.cao
373a4684b9
[skip ci]Fix golint error in data_codec (#10697) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-26 22:32:44 +08:00
XuanYang-cn
cd06f50645
Remove schema in delete codec (#10517) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-24 09:59:10 +08:00
godchen
ffc0c07610
Change delete data primary key to int64 (#10438) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-22 15:37:12 +08:00
godchen
e7738243b9
Fix stats log nil when not int64 field (#10417) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-22 12:51:11 +08:00
sunby
db53eccec9
Add binlog iterators (#10173) 
issue: #9530
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-20 11:52:35 +08:00
godchen
8daeb0d519
Change bloom filter use pk (#10193) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-19 20:18:47 +08:00
XuanYang-cn
2255fe0b45
Change deserialize deltelog from 1 blob to blobs (#10085) 
See also: #9530

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-19 10:28:35 +08:00
XuanYang-cn
75dccad4fa
[skip ci]Fix const golint in data_codec (#9793) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-13 18:59:26 +08:00
XuanYang-cn
2659807826
[skip ci]Fix golint in data_codec (#9792) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-13 18:57:44 +08:00
godchen
59ab0e441c
Add bloom filter for stats (#9630) 
* Add bloom filter for stats

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* trigger GitHub actions

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-13 10:22:33 +08:00
dragondriver
abb8c2b9ed
Fix the way that binlog store the original size (#9681) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-11 21:02:37 +08:00
dragondriver
9a7a060484
Store original memory size of binlog file to extra information (#9628) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-11 17:28:30 +08:00
dragondriver
dedf745b76
Rename IndexParamsFile to IndexParamsKey (#9563) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-09 19:27:02 +08:00
dragondriver
28a90f9e7a
Store index parameters to descriptor event (#9451) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-09 16:08:56 +08:00
dragondriver
818cf3ffa0
Split blob into several string rows when index file is large (#8919) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-30 17:57:01 +08:00
dragondriver
cf8600077f
Refactor the index file format (#8514) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-29 09:52:12 +08:00
godchen
af173dd2a0
Add delete codec (#8736) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-28 14:30:02 +08:00
godchen
96539f02d8
Add data codec comment (#7998) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-17 11:05:49 +08:00
sunby
095b7c12c1
Add insert codec comment (#7891) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-15 10:47:48 +08:00
godchen
db94d7771f
Read vector from disk (#6707) 
* Read vector from disk

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix git action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix test error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix caculate error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change var name

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix len error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused code

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change bytes to float method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change float to bytes method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-07-24 09:25:22 +08:00
Cai Yudong
a992dcf6a8
Support query return vector output field (#6570) 
* improve code readibility

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add offset in RetrieveResults

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add VectorFieldInfo into Segment struct

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add new interface for query vector

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update load vector field logic

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update load vector field logic

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fill in field name in query result

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add FieldId into FieldData

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add fillVectorOutputFieldsIfNeeded

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update data_codec_test.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add DeserializeFieldData

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* realize query return vector output field

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* disable query vector case

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-16 17:19:55 +08:00
Cai Yudong
3387b07dfd
Optimize code under storage (#6335) 
* rename AddOneStringToPayload/GetOneStringFromPayload to AddStringToPayload/GetStringFromPayload

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename print_binglog_test to print_binlog_test

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update chap08_binlog.md

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* use SetEventTimestamp() to replace SetStartTimestamp() and SetEndTimestamp()

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename AddStringToPayload/GetStringFromPayload to AddOneStringToPayload/GetOneStringFromPayload

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-07 19:10:07 +08:00
Cai Yudong
5a1f7e4feb
rename masterservice to rootcoord (#5875) 
* rename masterservice to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix build error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename package

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename masterservice to rootcoord under distributed

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update scripts

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* enable more unittests

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-18 21:30:08 +08:00
godchen
1c6786f85c
Add blob info (#5792) 
* Add blob info

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-16 12:03:57 +08:00
Xiangyu Wang
23c4de0eb8
Flush statistics for all int64 fields (#5318) 
Resolves: #5262

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-05-20 10:38:45 +00:00
yukun
4e6e502df1
Add data sorter in storage (#5200) 
GetEntityByID needs the flushed segment to be sorted by RowID field, 
then do binary search to get the target id and entities.

See also: #5177 

Signed-off-by: fishpenguin kun.yu@zilliz.com
 2021-05-14 02:59:49 +00:00
Xiangyu Wang
82ccd4cec0
Rename module (#4988) 
* Rename module

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-04-22 14:45:57 +08:00
godchen
0dfcb90881 Add storage copyright 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-04-19 11:32:24 +08:00
godchen
a5ad70a5ab Add unittest for storage 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-04-19 10:36:19 +08:00
godchen
f3649f0419 Refactor interface and proto 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-03-12 14:22:09 +08:00