test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-11-30 02:48:45 +08:00
Code Issues Actions 11 Packages Projects Releases Wiki Activity
21,021 Commits 94 Branches 105 Tags 184 MiB
1cc9cb49ad
Commit Graph

63 Commits

Author SHA1 Message Date
Yinzuo Jiang
3628593d20
feat: Implement custom function module in milvus expr (#36560) 
OSPP 2024 project:
https://summer-ospp.ac.cn/org/prodetail/247410235?list=org&navpage=org

Solutions:

- parser (planparserv2)
    - add CallExpr in planparserv2/Plan.g4
    - update parser_visitor and show_visitor
- grpc protobuf
    - add CallExpr in plan.proto
- execution (`core/src/exec`)
- add `CallExpr` `ValueExpr` and `ColumnExpr` (both logical and
physical) for function call and function parameters
- function factory (`core/src/exec/expression/function`)
    - create a global hashmap when starting milvus (see server.go)
- the global hashmap stores function signatures and their function
pointers, the CallExpr in execution engine can get the function pointer
by function signature.
- custom functions
    - empty(string)
    - starts_with(string, string)
- add cpp/go unittests and E2E tests

closes: #36559

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
 2024-10-25 15:25:30 +08:00
yellow-shine
8902e2220e
enhance: enable asan for cpp unittest (#37041) 
https://github.com/milvus-io/milvus/issues/35854

Signed-off-by: chyezh <chyezh@outlook.com>
Co-authored-by: chyezh <chyezh@outlook.com>
 2024-10-23 17:21:27 +08:00
Zhen Ye
75da36d1aa
enhance: enable asan for milvus (#35627) 
issue: #35626

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-08-23 21:06:58 +08:00
Zhen Ye
a773836b89
enhance: optimize milvus core building (#35610) 
issue: #35549,#35611,#35633

- remove milvus_segcore milvus_indexbuilder..., add libmilvus_core
- core building only link once
- move opendal compilation into cmake
- fix odr

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-08-23 12:35:02 +08:00
foxspy
8e64bf929c
enhance: add scalar filtering and vector search latency metrics (#34785) 
add scalar filtering and vector search latency metrics to distinguish
the cost of scalar filtering.
To add metrics in query chain, add a monitor module and move the metric
files from original storage module.
issue: #34780

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2024-07-19 14:01:39 +08:00
chyezh
f53ab54c5d
enhance: async cgo utility (#33133) 
issue: #30926, #33132

- implement future-based cgo utility.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-06-09 22:55:53 +08:00
cai.zhang
27cc9f2630
enhance: Support analyze data (#33651) 
issue: #30633

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
Co-authored-by: chasingegg <chao.gao@zilliz.com>
 2024-06-06 17:37:51 +08:00
Xiaofan
4bda6c33ad
fix: binary vector should not limit dimension to 32768 (#30676) 
all the vector dimension check should happen on collection creation but
not index build
fix #30285

Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
 2024-03-05 14:21:00 +08:00
zhagnlu
976b6fc0e4
enhance: change opendal as compile configurable (#30384) 
#30373

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-02-20 19:16:52 +08:00
Bingyi Sun
36f69ea031
feat: integrate storagev2 in building index of segcore (#28768) 
issue: https://github.com/milvus-io/milvus/issues/28655

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2023-12-05 16:48:54 +08:00
zhagnlu
2efc4ec703
Remove deprecated cmake parameter (#27695) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-10-14 02:57:35 +08:00
Enwei Jiao
0afdfdb9af
Remove other Exceptions, keeps SegcoreError only (#27017) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-09-14 14:05:20 +08:00
yah01
732d92b642
Add -g flag to compile with debug info (#26354) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-08-15 14:13:32 +08:00
Cai Yudong
4b60e44b38
Remove redundant macro setting for knowhere (#26235) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-08-10 17:13:15 +08:00
Jiquan Long
5c1f79dc54
Push down the limit operator to segcore (#25959) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-08-01 20:29:05 +08:00
Cai Yudong
ad9271c3a2
Fix knowhere prometheus metrics not show (#25601) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-07-17 10:30:34 +08:00
zhagnlu
65cb52d06b
Support dynamic simd framework and using term expr as example (#25260) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-07-13 16:22:30 +08:00
yah01
6da8853756
Fix the JSON parser always parse all documents (#24290) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-22 15:49:27 +08:00
zhagnlu
113f9a0ebc
Support SIMD of several Expr (#23715) (#23717) 
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2023-05-12 14:11:20 +08:00
Enwei Jiao
f14c221123
Revert "Opt compile time for Mac (#23453)" (#23533) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-04-19 16:52:30 +08:00
Enwei Jiao
e9dcba3050
Opt compile time for Mac (#23453) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-04-19 10:24:30 +08:00
Cai Yudong
ab3cbdfc61
Partial change to prepare for GPU index type support (#22591) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-03-14 23:21:56 +08:00
Enwei Jiao
b25b3ef431
Integreation with Velox (#22102) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-02-16 17:26:35 +08:00
Cai Yudong
fc1d2d18cf
Optimize knowhere CMakeLists.txt (#22000) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2023-02-07 16:12:04 +08:00
Enwei Jiao
564173dcbc
Upgrade protobuf to 3.21.9 (#21679) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-01-13 14:05:41 +08:00
Jiquan Long
d7156812c1
Try using ASAN in ci ut (#21089) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-12-29 15:29:31 +08:00
Enwei Jiao
958e94f6f0
Use Conan as c++ package manager (#19920) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-11-23 10:39:11 +08:00
xige-16
428840178c
Support diskann index for vector field (#19093) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-09-21 20:16:51 +08:00
Ji Bin
f3c755602b
Adaptation for latest MinGW64 (#18699) 
Signed-off-by: Ji Bin <matrixji@live.com>

Signed-off-by: Ji Bin <matrixji@live.com>
 2022-08-25 10:56:53 +08:00
Enwei Jiao
16c3aedc15
refine complie configuration (#17502) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-06-24 21:12:15 +08:00
Jiquan Long
90ca61d948
Fix double-freed global variable in easylogging lib (#17730) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-06-23 19:12:14 +08:00
Enwei Jiao
d28a2db46c
move arrow from storage to core (#17061) 
Signed-off-by: Enwei Jiao <jiaoew2011@gmail.com>
 2022-05-22 20:03:58 +08:00
Cai Yudong
fa697d0d48
[skip e2e] Remove useless OpenMP settings in CMakeLists.txt (#16441) 
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2022-04-09 14:15:32 +08:00
Cai Yudong
a37479d728
Upgrade to knowhere-v1.1.2 to support all index types for mac (#16416) 
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2022-04-08 15:29:31 +08:00
Cai Yudong
7323180861
Move bench to directory unittest (#16386) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-04-05 12:43:30 +08:00
Cai Yudong
1160693e4c
Fix centos build error (#16251) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-29 15:13:30 +08:00
Cai Yudong
2ac53c89e9
Revert #16242 (#16247) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-29 00:53:27 +08:00
Cai Yudong
9a6b2b8806
Fix centos build error (#16242) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-28 23:23:27 +08:00
Ji Bin
3cd28420f1
Support compile under windows (#15786) 
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
  * using gofrs/flock instead of syscall.Flock
  * using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`

issue #7706

Signed-off-by: Ji Bin <matrixji@live.com>
 2022-03-17 17:17:22 +08:00
Cai Yudong
503724be19
Optimize CMakeLists.txt under internal/core (#15770) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-01 10:31:55 +08:00
zhenshan.cao
142848fcc3
Abandon using protobuf to pass binaryset parameter (#15626) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-02-18 18:39:50 +08:00
jaime
307a8ce535
Support compile and run on Mac (#15491) 
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
 2022-02-09 14:27:46 +08:00
zhenshan.cao
930e9daeaf
[skip ci] Update License (#13536) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-12-16 20:23:28 +08:00
Ji Bin
68d6839ab0
Improvements: Some adaptation for gcc-10 (#7853) 
Support windows compile with MSYS (partial). This part including:

- CMakeLists.txt using CMAKE_SHARED_LIBRARY_SUFFIX instead .so
- Replace finite() with std::isfinite()
  ref: https://github.com/facebookresearch/faiss/pull/1341
- Replace bzero (deprecated in POSIX 2001) with memset.
  ref: https://github.com/facebookresearch/faiss/pull/1340
- Some int types match.

Signed-off-by: Ji Bin <matrixji@live.com>
 2021-11-03 16:00:16 +08:00
Cai Yudong
bb721f1cf4
Format internal/core/CMakeLists.txt (#9931) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-15 16:52:43 +08:00
ZhiShen
0e767f0e1b
Change cmake version (#8666) 
Change cmake version from 3.16 to 3.18

1. Change the CMakeList's minimum require version.

2. Change the describtion document of cmake version.

Resolves: milvus-io#8407

Signed-off-by: Shen Zhi <m13120163046@163.com>
 2021-09-28 14:00:03 +08:00
groot
b6e43e0439
Fix cpp code coverage bug (#8203) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-18 16:15:51 +08:00
groot
16a6afa9bd
Fix build version typo (#7639) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-10 11:10:00 +08:00
FluorineDog
b1a9aea6a6
support get entity by ids in segcore (#5456) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-05-28 10:39:30 +08:00
xige-16
1165db75f6 Optimize search performance 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-04-19 19:30:36 +08:00