Commit Graph

922 Commits

Author SHA1 Message Date
Yinzuo Jiang
3628593d20
feat: Implement custom function module in milvus expr (#36560)
OSPP 2024 project:
https://summer-ospp.ac.cn/org/prodetail/247410235?list=org&navpage=org

Solutions:

- parser (planparserv2)
    - add CallExpr in planparserv2/Plan.g4
    - update parser_visitor and show_visitor
- grpc protobuf
    - add CallExpr in plan.proto
- execution (`core/src/exec`)
- add `CallExpr` `ValueExpr` and `ColumnExpr` (both logical and
physical) for function call and function parameters
- function factory (`core/src/exec/expression/function`)
    - create a global hashmap when starting milvus (see server.go)
- the global hashmap stores function signatures and their function
pointers, the CallExpr in execution engine can get the function pointer
by function signature.
- custom functions
    - empty(string)
    - starts_with(string, string)
- add cpp/go unittests and E2E tests

closes: #36559

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
2024-10-25 15:25:30 +08:00
wayblink
35cc7dde63
enhance: Add clustering compaction user guide doc (#35427)
#30633

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2024-08-15 10:30:59 +08:00
Yinzuo Jiang
7d74edd6dd
fix: update clang-tidy and clang-format from 10 to 12 (#33141)
Default llvm toolchain version in Ubuntu 20.04 is 10, while Ubuntu 22.04
does not have `clang-tidy-10` or `clang-format-10` by default.

issue: #33142

Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
2024-06-13 15:27:58 +08:00
shaoting-huang
ca0cf9b3b1
doc: fix typos in design docs (#32885)
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-05-09 15:43:30 +08:00
congqixia
076b8f2fbc
doc: [skip e2e] Add document for developing with local milvus-proto guide (#31513)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-25 16:35:25 +08:00
jaime
18c3cbe46d
enhance: Update tls user doc (#32353)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-04-18 21:07:23 +08:00
Sheldon
351c64b606
fix some typos (#27851)
1. fix some typos in md,yaml #22893

Signed-off-by: Sheldon <chuanfeng.liu@zilliz.com>
2023-10-24 09:30:10 +08:00
congqixia
e02670eae9
[Design Doc] Remove runtime dependency of datacoord from datanode (#27183)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-09-26 14:05:26 +08:00
Enwei Jiao
78bc688d16
Remove QueryMsgStream in MqFactory interface (#26374)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-08-16 10:29:33 +08:00
yiwangdr
c7b851f870
add interface for non-watch metakv (#25092)
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
2023-06-26 09:20:44 +08:00
yiwangdr
4387f36897
make etcdKV private (#24778)
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
2023-06-13 10:52:38 +08:00
yiwangdr
37c02c9927
clean up meta interface (#24729)
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
2023-06-08 14:18:35 +08:00
congqixia
baddf3d438
Add design doc for collection-level auto compaction switch (#24041)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-11 15:57:20 +08:00
smellthemoon
2afc982ce1
[MEP]Default Value (#23343)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-04-20 10:56:31 +08:00
congqixia
aca442e985
[DOC] Add QueryNodev2 design doc (#23478)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-18 11:44:30 +08:00
yah01
c855ea3171
MEP for search by primary keys (#23193)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-07 18:26:29 +08:00
Enwei Jiao
940ead200a
Update Development.md (#23207)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-04 13:38:28 +08:00
Enwei Jiao
66f50fd354
Add design doc for dynamic config (#23115)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-03-30 08:48:21 +08:00
Enwei Jiao
d2f95176e9
Organize design document directory (#22972)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-03-24 15:33:59 +08:00
jaime
d126f06946
Decouple mq module from internal proto definition (#22536)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-03-04 23:21:50 +08:00
jaime
58b79eb74c
Add based on timetravel GC for snapshot KV (#21417)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-01-04 21:37:35 +08:00
jaime
f8cb260931
Add a collection TTL doc (#19859)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-10-18 14:09:26 +08:00
wayblink
85e04d845c
Move GetComponentStates to milvus.proto, make it an external interface (#19594)
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-10-10 15:55:22 +08:00
xige-16
e40061b864
Update binlog event format (#18347)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-08-11 14:06:38 +08:00
jaime
9672eae62c
Unify metastore catalog interface (#17772)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-07-22 10:20:29 +08:00
zhuwenxing
7ac21fac91
[skip e2e]Fix bad links in doc (#18049)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-07-05 19:00:21 +08:00
jaime
b64a467311
Revert "Use unified catalog interface to reconstruct metastore (#17042)" (#17480)
This reverts commit 218326bafe.

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-06-10 13:10:08 +08:00
jaime
218326bafe
Use unified catalog interface to reconstruct metastore (#17042)
Co-authored-by: kejiang ke.jiang@zilliz.com
Co-authored-by: yun.zhang yun.zhang@zilliz.com

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-06-07 12:00:07 +08:00
SimFG
0986c29d7f
proxy tls support one-way authentication (#17348)
Signed-off-by: xiyichan <2863768433@qq.com>

Co-authored-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>

Co-authored-by: xiyichan <2863768433@qq.com>
2022-06-02 18:56:04 +08:00
SimFG
2c9ffce8bc
Improve the user guide of the tls mutual authentication (#17213)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-05-25 22:00:00 +08:00
exia
01d5580d34
proxy support tls document (#16891)
Signed-off-by: xiyichan <2863768433@qq.com>
2022-05-16 12:21:55 +08:00
exia
96aa698160
proxy support tls document (#16829)
Signed-off-by: xiyichan <2863768433@qq.com>
2022-05-09 22:33:52 +08:00
jaime
c25b337c36
Remove AddTenant from meta table (#16717)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-05-05 09:23:51 +08:00
xiyichan
ca129d4308
Support configurable msgstream (#16131)
Signed-off-by: xiyichan <2863768433@qq.com>
2022-03-24 10:15:25 +08:00
zhuwenxing
3b1030de2b
[skip e2e]Fix bad link in doc (#15525)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-02-11 09:31:47 +08:00
min.tian
2b1625819d
[skip e2e] Check the grammar of segcore/timetravel.md (#15182)
Signed-off-by: min.tian <min.tian.cn@gmail.com>
2022-02-09 10:23:47 +08:00
min.tian
a0a88f1b48
[skip e2e] Check the grammar of segment_interface.md (#15174)
Signed-off-by: min.tian <min.tian.cn@gmail.com>
2022-02-09 10:21:52 +08:00
min.tian
06535eb7eb
[skip e2e] Check the grammar of segment_growing.md (#15134)
Signed-off-by: min.tian <min.tian.cn@gmail.com>
2022-02-09 10:16:10 +08:00
yanliang567
f3f46d3bb2
[skip e2e]Update default consistency level in doc (#15356)
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2022-01-24 15:11:41 +08:00
Xieql
17887de140
[skip e2e] Improve annotation (#15071)
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2022-01-10 13:26:24 +08:00
Xieql
8c2045a6cb
[skip e2e] Improve annotation (#15070)
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2022-01-10 13:24:27 +08:00
Bennu
513626c69d
[skip e2e] Fix grammar (#15066)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2022-01-10 13:20:40 +08:00
Bennu
0a0cf9bf94
[skip e2e] Fix grammar (#15065)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2022-01-10 13:18:42 +08:00
Bennu
65ea6b9172
[skip e2e] Fix grammar (#15064)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2022-01-10 13:16:48 +08:00
min.tian
0c621fa314
[skip e2e] Check the grammar of segcore/Search.md (#15047)
Signed-off-by: min.tian <min.tian.cn@gmail.com>
2022-01-10 09:47:36 +08:00
Bennu
a1c29d4709
[skip e2e] Fix grammar (#15010)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2022-01-07 19:03:49 +08:00
Bennu
3aaf65efa9
[skip e2e] Fix grammar (#15009)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2022-01-07 19:01:56 +08:00
Bennu
56eb069494
[skip e2e] Fix grammar (#15011)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2022-01-07 18:53:49 +08:00
min.tian
c666645629
[skip e2e] Check the syntax of index design doc (#14973)
Signed-off-by: min.tian <min.tian.cn@gmail.com>
2022-01-07 13:16:22 +08:00
Bennu
b2da0c67f4
[skip e2e] Fix grammar (#14940)
Signed-off-by: Bennu <yunmei.li@zilliz.com>
2022-01-06 18:25:26 +08:00