test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-11-29 18:38:44 +08:00
Code Issues Actions 11 Packages Projects Releases Wiki Activity
21,322 Commits 94 Branches 105 Tags 184 MiB
84698c072a
Commit Graph

112 Commits

Author SHA1 Message Date
Zhen Ye
2b4f211d84
enhance: add switch for local rpc enabled (#37985) 
issue: #33285

- Add switch for local rpc

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-11-26 17:00:54 +08:00
congqixia
cfa1f1f141
enhance: Add thread watcher to provide actual thread num (#37905) 
Related to #37904

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-11-22 10:20:33 +08:00
yihao.dai
3685edb264
enhance: Use common gc config (#36668) 
Use the GC config from `common` and remove the GC config from
`queryNode`.

issue: https://github.com/milvus-io/milvus/issues/36667

related pr: https://github.com/milvus-io/milvus/pull/34949

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-10-09 19:47:19 +08:00
Zhen Ye
d29e01e284
fix: port listen racing in mix or standalone mode (#36442) 
issue: #36441

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-09-26 21:23:16 +08:00
Zhen Ye
f65261215b
fix: streaming node health check panic (#36336) 
issue: #36335

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-09-19 17:11:12 +08:00
Jiquan Long
89bf226f0b
feat: support keyword text match (#35923) 
fix: #35922

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-09-10 15:11:08 +08:00
wei liu
5aedc169cd
fix: Revert "enhance: avoid the coexistence of the old coordinator and the new node/proxy (#35720)" (#36113) 
issue: #36100
This reverts commit 73be0ba941.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-09-10 10:23:07 +08:00
SimFG
99817953eb
fix: delay to start the metric server port (#36080) 
- issue: #36083
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-09-09 14:01:05 +08:00
congqixia
9e96ed4873
fix: Fix tracing config update logic (#35928) 
Related to #35927

There are serveral issue this PR addresses:
- Use `ResetTraceConfig` method instead init one in update event handler
- Implement dynamic stats.Handler to receive tracing config update event
- Update `enable_trace` flag when `ResetTraceConfig` is invoked
- Change `enable_trace` to `std::atomic<bool>` in case of data race

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-05 14:27:04 +08:00
wei liu
73be0ba941
enhance: avoid the coexistence of the old coordinator and the new node/proxy (#35720) 
issue: #35719
In standalone mode, block the start process until the new coordinator is
active to avoid the coexistence of the old coordinator and the new
node/proxy
1. In the start/restart process, the new coordinator will become active
immediately and will not be blocked
2. In the rolling upgrade process, the new coordinator will not be
active until the old coordinator is down, and it will be blocked

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-08-29 13:55:01 +08:00
Zhen Ye
99dff06391
enhance: using streaming service in insert/upsert/flush/delete/querynode (#35406) 
issue: #33285

- using streaming service in insert/upsert/flush/delete/querynode
- fixup flusher bugs and refactor the flush operation
- enable streaming service for dml and ddl
- pass the e2e when enabling streaming service
- pass the integration tst when enabling streaming service

---------

Signed-off-by: chyezh <chyezh@outlook.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-08-29 10:03:08 +08:00
Jiquan Long
91df03afe8
feat: put inverted index into ram (#35222) 
fix: https://github.com/milvus-io/milvus/issues/35224

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-08-06 11:54:16 +08:00
wei liu
4bb969ef8f
enhance: Skip manual stopped component during health check (#34953) 
after manual stop component by management restful api, `healthz` may
return unhealthy state. k8s may restart the pod to save the unhealthy
sate, and the manual stop operation will got unexpected result.

to solve this, we make `healthz` API skip the manual stopped component.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-07-30 14:37:51 +08:00
cai.zhang
2372452fac
enhance: Optimized the GC logic to ensure that memory is released in time (#34949) 
issue: #34703

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-07-28 23:53:47 +08:00
chyezh
bef06e5acf
enhance: add streaming coord and node grpc service register (#34655) 
issue: #33285

- register streaming coord service into datacoord.
- add new streaming node role.
- add global static switch to enable streaming service or not.

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-07-25 12:19:44 +08:00
SimFG
e56ab76d99
fix: make the log level can be dynamically changed at runtime (#34757) 
- issue: #34756

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-07-17 20:31:42 +08:00
jaime
9630974fbb
enhance: move rocksmq from internal to pkg module (#33881) 
issue: #33956

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-06-25 21:18:15 +08:00
wei liu
0a3d456688
enhance: add restful api to trigger component stop (#32076) 
issue: #32698
This PR add two rest api for component stop and status check:
1. `/management/stop?role=querynode` can stop the specified component
2. `/management/check/ready?role=rootcoord` can check whether the target
component is serviceable

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-06-07 10:35:54 +08:00
aoiasd
2422084a29
fix: paramtable cache cause dynamic config non-dynamic (#33473) 
relate: https://github.com/milvus-io/milvus/issues/33461

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-06-04 11:39:46 +08:00
aoiasd
54a51b1236
enhance: Support dynamic config for opentelemetry trace (#32169) 
relate: https://github.com/milvus-io/milvus/issues/31940

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-05-09 17:43:30 +08:00
smellthemoon
9815cf50c9
fix: close rocksmq and natsmq when shutdown (#30706) 
related: #30703 #30355

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-02-26 11:38:55 +08:00
congqixia
20a3569c14
enhance: Set correct role for non-standalone deployment (#30303) 
See also #30211

After fix initialization problem, distributed components do no have
their role set. This will cause logger & tracing miss component service
info when recording information.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-01-26 14:05:01 +08:00
congqixia
c9860e3d2a
fix: Init paramtable after milvus role setup (#30211) 
See also #30176

Move paramtable.Init after env setup in roles.Run. Also introduced a
flag for mixture run to set role correctly for mixture mode.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-01-23 19:10:56 +08:00
Bingyi Sun
dad27cbb40
fix: fix wrong log file name when running as mixture type (#29979) 
See also: #25323, #29969
many users reported log file name is incorrect when starting in mixture
type.

---------

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-01-19 11:48:54 +08:00
SimFG
dd9c61831d
enhance: Support to get the param value in the runtime (#29297) 
/kind improvement
issue: #29299

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-12-22 18:36:44 +08:00
wei liu
0c69f48ba4
refine stop order (#28016) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-11-01 11:40:15 +08:00
Filip Haltmayer
6b1a106a31
Moving etcd client into session (#27069) 
Signed-off-by: Filip Haltmayer <filip.haltmayer@zilliz.com>
 2023-10-27 07:36:12 +08:00
wayblink
aa1fba79b1
Register metrics before component start (#27744) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-10-19 17:14:10 +08:00
jaime
ec1fe3549e
Add a stop hook to clean session (#27564) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-10-16 10:24:10 +08:00
SimFG
26f06dd732
Format the code (#27275) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-09-21 09:45:27 +08:00
yihao.dai
bb6711f28c
Add ChunkCache: support get vector from storage (#26142) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-09-15 10:21:20 +08:00
congqixia
f7b2ad6650
Fix component pointer to component interface never be nil caused panic (#27072) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-14 13:37:18 +08:00
Enwei Jiao
fb0705df1b
Decouple basetable and componentparam (#26725) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-09-05 10:31:48 +08:00
congqixia
4bf26dd4ed
Refine standalone components stop order (#26742) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-31 16:51:02 +08:00
congqixia
073ac8350b
Refine signal handler for whole milvus role lifetime (#26642) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-29 19:28:28 +08:00
SimFG
8b54914287
Add go.mod file for the milvus/pkg package (#26359) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-08-16 14:49:32 +08:00
Jiquan Long
fb5d809599
Fix components' setup (#26182) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-08-09 14:33:15 +08:00
xige-16
33c2012675
Add more metrics (#25081) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-26 17:52:44 +08:00
chyezh
f97127ae55
add nats mq wrappers (#24445) 
bug fixup, configurable natsmq, add unittest, pass e2e.



move natsmq to pkg project

Signed-off-by: chyezh <ye.zhen@zilliz.com>
Co-authored-by: yiwangdr <yiwangdr@gmail.com>
 2023-06-07 10:00:37 +08:00
xige-16
fe18109aab
Clean tmp disk data when start milvus (#24404) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-05-26 15:07:26 +08:00
Cai Yudong
55202ce7d9
Support show knowhere prometheus metrics (#23102) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2023-04-07 15:34:29 +08:00
jaime
c9d0c157ec
Move some modules from internal to public package (#22572) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-04-06 19:14:32 +08:00
aoiasd
1a485044a9
fix NumConsumers metric not work (#23167) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-04-05 08:18:28 +08:00
Enwei Jiao
0851e05014
Gernate milvus.yaml by code (#22003) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-02-23 11:37:46 +08:00
wayblink
e9f99081e4
Start management API before roles run (#21874) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-02-02 12:03:58 +08:00
Enwei Jiao
fb42466c65
Use opentelemetry (#21509) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-01-12 16:09:39 +08:00
Xiaofan
dc2bfb0901
Add stack trace for core dump (#21555) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-01-06 16:53:35 +08:00
cai.zhang
aa203acfb3
Low IndexCoord weight (#21548) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-01-06 14:21:37 +08:00
Enwei Jiao
166e9f0da5
Refactor GrpcConfig (#21142) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-12-16 15:59:23 +08:00
Enwei Jiao
89b810a4db
Refactor all params into ParamItem (#20987) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-12-07 18:01:19 +08:00