Commit Graph

261 Commits

Author SHA1 Message Date
xige-16
205c92e54b
Support insert string data (#15993)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-03-25 14:27:25 +08:00
Ji Bin
3cd28420f1
Support compile under windows (#15786)
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
  * using gofrs/flock instead of syscall.Flock
  * using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`

issue #7706

Signed-off-by: Ji Bin <matrixji@live.com>
2022-03-17 17:17:22 +08:00
yah01
d4225117ee
Enable Zstd compression for binlog (#15840)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-14 16:00:01 +08:00
Jiquan Long
3121619758
Chunk manager support scalar data (#16010)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-11 14:39:59 +08:00
Jiquan Long
f71651e294
Support column-based insert data in message stream (#15802)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-04 15:09:56 +08:00
Cai Yudong
92c8e32ebd
Let MemoryKV.Load return error when key not exist (#15814)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-02 18:51:55 +08:00
Cai Yudong
503724be19
Optimize CMakeLists.txt under internal/core (#15770)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-01 10:31:55 +08:00
godchen
2e4391e6c5
Add lru cache (#15733)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-02-28 21:43:55 +08:00
Cai Yudong
adca79facc
Fix centos build error (#15760)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-25 18:49:54 +08:00
godchen
fcf0887d92
Add and implement chunk manager interface. (#15541)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-02-24 23:53:53 +08:00
jaime
307a8ce535
Support compile and run on Mac (#15491)
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
2022-02-09 14:27:46 +08:00
Ji Bin
d83f69bb21
Support windows compliation (#15448)
- remove dl dependency while compiling some lib under MSYS
- int types aligement in golang
- core/src/utils adaptation for compile under MSYS

issue: #7706

Signed-off-by: Ji Bin <matrixji@live.com>
2022-02-07 23:43:46 +08:00
congqixia
4369e08f2a
Fix storage memory leak caused by runtime.SetFinalizer (#15100)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-01-10 17:13:35 +08:00
congqixia
998ebcce4e
Fix file not close when ReadAll returns error in local chunk manager (#15068)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-01-10 11:53:34 +08:00
godchen
384ceea223
Close payload writer when error occurs (#15013)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-01-07 18:27:23 +08:00
congqixia
b22e945513
[skip e2e] Add comment for NewInsertCodec (#14907)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-01-06 18:04:03 +08:00
XuanYang-cn
befb5d77e7
[skip e2e]Update license for cwrapper test (#14785)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-06 09:37:30 +08:00
shaoyue
c5e3efa874
[skip e2e] Add comment for payload (#14803)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-01-05 13:53:35 +08:00
shaoyue
756904dd3e
[skip e2e] Add coment for payloadwriter (#14724)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-01-04 10:49:27 +08:00
XuanYang-cn
99fd72cfb6
[skip e2e]Update license for cwrapper payload (#14626)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-04 09:11:39 +08:00
XuanYang-cn
3afe467d86
[skip e2e]Update license for cwrapper parquet (#14625)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-04 09:09:22 +08:00
XuanYang-cn
c7c147b26c
[skip e2e]Update license for cwrapper cmake (#14627)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-30 20:05:26 +08:00
shaoyue
f9dc87ba6c
[skip e2e] Add comment for data_codec (#14571)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-30 10:44:05 +08:00
XuanYang-cn
7bfde0aa73
[skip e2e]Update license for storage vector chunk m (#14540)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-29 22:42:14 +08:00
Xiaofan
029b153259
Remove data directory for test (#14363)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 10:08:47 +08:00
XuanYang-cn
dd860a76cf
[skip e2e]Update license for storage util (#14453)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 20:11:55 +08:00
XuanYang-cn
758dc8b70f
[skip e2e]Update license for storage unsafe (#14452)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 20:03:56 +08:00
XuanYang-cn
647307ea64
[skip e2e]Update license for storage types (#14451)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 19:57:10 +08:00
XuanYang-cn
9b335e74a2
[skip e2e]Update license for storage stats (#14349)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 09:44:06 +08:00
XuanYang-cn
e4ae7a6bef
[skip e2e]Update license for storage print binlog (#14348)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 09:43:49 +08:00
XuanYang-cn
1567aa3f53
[skip e2e]Update license for storage payload (#14347)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-28 09:43:26 +08:00
congqixia
20cc6843a4
[skip e2e] Add comment for FieldData interface (#14351)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-28 09:34:15 +08:00
edward.zeng
57ec25c246
[skip e2e] Refine storage binlog iterator comment (#14309)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-27 15:46:03 +08:00
edward.zeng
94e65eaaa5
[skip e2e] Refine storage binlog writer comment (#14312)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-27 15:42:03 +08:00
jaime
28dfccb6ea
[skip e2e] Fix golint in data_codec (#14212)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-24 19:56:28 +08:00
XuanYang-cn
7ce71870ce
[skip e2e]Update license for storage event test (#14191)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-24 17:34:21 +08:00
XuanYang-cn
effd4cc461
[skip e2e]Update license for storage miniochunk (#14193)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-24 17:32:20 +08:00
XuanYang-cn
c29cf1bc21
[skip e2e]Update license for storage localchunck (#14192)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-24 17:30:32 +08:00
shaoyue
e0a2f1ce82
[skip e2e] Add comment for IndexCodec (#14139)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-24 13:31:30 +08:00
shaoyue
94265639fe
[skip e2e] Add comment for PayloadWriter (#14138)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-24 13:29:03 +08:00
XuanYang-cn
107e3f8971
[skip e2e]Update license for storage reader (#14041)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-24 13:08:05 +08:00
jaime
d623ea5c37
[skip e2e] Fix goint error in payload (#14109)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-23 22:07:38 +08:00
jaime
0114708c95
[skip e2e] Fix grammar mistake in data_codec (#14108)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-23 22:05:51 +08:00
jaime
846e86b478
[skip e2e] Fix grammar mistake in event_data (#14107)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-23 22:03:56 +08:00
shaoyue
d4f9365a3d
[skip e2e] Add comment for internal/storage/data_codec.go (#14030)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-23 14:30:34 +08:00
XuanYang-cn
e580bb9ccb
[skip e2e]Update license for storage event writer (#14043)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 12:07:10 +08:00
XuanYang-cn
78c7ec7300
[skip e2e]Update license for storage event (#14042)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 12:05:21 +08:00
XuanYang-cn
6eb0de1640
[skip e2e]Update license for storage writer (#14040)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 12:03:28 +08:00
XuanYang-cn
bccf65ec67
[skip e2e]Update license for storage datacodec (#14039)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 12:01:36 +08:00
XuanYang-cn
a666cb4f76
[skip e2e]Update license for storage sorter (#14038)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-23 11:59:21 +08:00