test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-03 04:19:18 +08:00
Code Issues Actions 13 Packages Projects Releases Wiki Activity
15,068 Commits 95 Branches 105 Tags 184 MiB
4ae1ca2cac
Commit Graph

285 Commits

Author SHA1 Message Date
Letian Jiang
4ae1ca2cac
Fix arrow builder nullptr check in FinishPayloadWriter (#17873) 
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
 2022-06-28 20:04:17 +08:00
Enwei Jiao
16c3aedc15
refine complie configuration (#17502) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-06-24 21:12:15 +08:00
congqixia
37464a281d
Fix datasorter swap vector logic (#17661) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-06-21 11:38:12 +08:00
shaoyue
04f836f516
Fix s3 delete file (#17574) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-06-16 18:14:10 +08:00
yah01
70f8bea4b4
Avoid growing slice as deserializing binlogs (#17421) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-06-08 11:46:06 +08:00
shaoyue
76eaa3fc50
Support access s3 through AWS IAM role (#17292) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-06-02 19:42:03 +08:00
Enwei Jiao
d28a2db46c
move arrow from storage to core (#17061) 
Signed-off-by: Enwei Jiao <jiaoew2011@gmail.com>
 2022-05-22 20:03:58 +08:00
Xiaofan
5355153805
Minio Error is not Handled gracefully (#17003) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-05-16 19:25:55 +08:00
Letian Jiang
72bbe40254
Make PayloadReader read column data in batch (#16826) 
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
 2022-05-10 11:37:52 +08:00
cai.zhang
2be46a01c0
Reduce the number of retries and add error log (#16754) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-05-05 09:31:51 +08:00
Letian Jiang
5b2b917987
Benchmark go/cgo parquet payload readers (#16736) 
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
 2022-04-29 15:59:47 +08:00
xige-16
515d0369de
Support string type in segcore (#16546) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: dragondriver <jiquan.long@zilliz.com>
 2022-04-29 13:35:49 +08:00
jaime
68b1b82faf
Remove DataKV interface (#16692) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-04-28 21:03:47 +08:00
yah01
7af02fa531
Improve load performance, load binlogs concurrently per file, deserialize binlogs concurrently per field/segment (#16514) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-04-25 15:57:47 +08:00
Ten Thousand Leaves
4ef2df8cb9
Fix an issue where query coord calls MinioChunkManager during init (#16629) 
It causes Milvus not runnable with local storage.

issue: #15604

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-25 11:11:46 +08:00
congqixia
9769426e84
Use fmt.Errorf instead of string concat in local_chunk_manager.go (#16442) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-04-19 18:39:39 +08:00
Ten Thousand Leaves
e76a8c5ec2
Update compile options and config for embedded Milvus (#16472) 
/kind enhancement

issue: #15711
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-14 19:57:34 +08:00
godchen
4781db8a2a
Add datanode import (#16414) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-04-12 22:19:34 +08:00
godchen
bb7a0766fe
Add dependency factory (#16204) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-04-07 22:05:32 +08:00
xige-16
99984b88e1
Support delete varChar value (#16229) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-04-02 17:43:29 +08:00
Jiquan Long
ba37531456
Add support for loading multiple indexes (#16138) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-30 21:11:28 +08:00
Xiaofan
801eeffbcc
Replace cgo parquet reader to go parquet reader (#16199) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-03-30 15:21:28 +08:00
Xiaofan
b6b3c9863c
Fix incompatibility of stats log (#16277) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-03-30 10:15:28 +08:00
godchen
478f6ca11e
Add cache for vector chunk (#15912) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-03-26 22:05:26 +08:00
xige-16
205c92e54b
Support insert string data (#15993) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-03-25 14:27:25 +08:00
Ji Bin
3cd28420f1
Support compile under windows (#15786) 
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
  * using gofrs/flock instead of syscall.Flock
  * using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`

issue #7706

Signed-off-by: Ji Bin <matrixji@live.com>
 2022-03-17 17:17:22 +08:00
yah01
d4225117ee
Enable Zstd compression for binlog (#15840) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-03-14 16:00:01 +08:00
Jiquan Long
3121619758
Chunk manager support scalar data (#16010) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-11 14:39:59 +08:00
Jiquan Long
f71651e294
Support column-based insert data in message stream (#15802) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-04 15:09:56 +08:00
Cai Yudong
92c8e32ebd
Let MemoryKV.Load return error when key not exist (#15814) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-02 18:51:55 +08:00
Cai Yudong
503724be19
Optimize CMakeLists.txt under internal/core (#15770) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-01 10:31:55 +08:00
godchen
2e4391e6c5
Add lru cache (#15733) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-02-28 21:43:55 +08:00
Cai Yudong
adca79facc
Fix centos build error (#15760) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-25 18:49:54 +08:00
godchen
fcf0887d92
Add and implement chunk manager interface. (#15541) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-02-24 23:53:53 +08:00
jaime
307a8ce535
Support compile and run on Mac (#15491) 
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
 2022-02-09 14:27:46 +08:00
Ji Bin
d83f69bb21
Support windows compliation (#15448) 
- remove dl dependency while compiling some lib under MSYS
- int types aligement in golang
- core/src/utils adaptation for compile under MSYS

issue: #7706

Signed-off-by: Ji Bin <matrixji@live.com>
 2022-02-07 23:43:46 +08:00
congqixia
4369e08f2a
Fix storage memory leak caused by runtime.SetFinalizer (#15100) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-10 17:13:35 +08:00
congqixia
998ebcce4e
Fix file not close when ReadAll returns error in local chunk manager (#15068) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-10 11:53:34 +08:00
godchen
384ceea223
Close payload writer when error occurs (#15013) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-01-07 18:27:23 +08:00
congqixia
b22e945513
[skip e2e] Add comment for NewInsertCodec (#14907) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-06 18:04:03 +08:00
XuanYang-cn
befb5d77e7
[skip e2e]Update license for cwrapper test (#14785) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-06 09:37:30 +08:00
shaoyue
c5e3efa874
[skip e2e] Add comment for payload (#14803) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-01-05 13:53:35 +08:00
shaoyue
756904dd3e
[skip e2e] Add coment for payloadwriter (#14724) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-01-04 10:49:27 +08:00
XuanYang-cn
99fd72cfb6
[skip e2e]Update license for cwrapper payload (#14626) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-04 09:11:39 +08:00
XuanYang-cn
3afe467d86
[skip e2e]Update license for cwrapper parquet (#14625) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-04 09:09:22 +08:00
XuanYang-cn
c7c147b26c
[skip e2e]Update license for cwrapper cmake (#14627) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-30 20:05:26 +08:00
shaoyue
f9dc87ba6c
[skip e2e] Add comment for data_codec (#14571) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-30 10:44:05 +08:00
XuanYang-cn
7bfde0aa73
[skip e2e]Update license for storage vector chunk m (#14540) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-29 22:42:14 +08:00
Xiaofan
029b153259
Remove data directory for test (#14363) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-12-29 10:08:47 +08:00
XuanYang-cn
dd860a76cf
[skip e2e]Update license for storage util (#14453) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-28 20:11:55 +08:00