Commit Graph

1121 Commits

Author SHA1 Message Date
xige-16
cd04258122
Abort execute timeout search/query (#17729)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-08-11 09:58:41 +08:00
congqixia
179b496824
Add cgo worker pool for querynode (#18461)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-08-09 16:34:37 +08:00
bigsheeper
002f509808
Remove deprecated cacheSize param (#18566)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-08-09 15:54:36 +08:00
Xiaofan
b427450593
Remove Load Delta Channel Request (#18497)
Fix #18393

remove watch delta channel task related logic

Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2022-08-04 17:50:37 +08:00
aoiasd
a7ce0eb6f6
Add ShowConfigurations to QueryNode (#18426)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-08-03 01:12:33 +08:00
congqixia
ab461c6e5e
Release collection resources when all partition released (#18488)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-08-02 11:40:34 +08:00
congqixia
f0fe8dae0b
Close Node/Segment detector when close ShardCluster (#18476)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-08-01 13:50:33 +08:00
yah01
9621b6615d
Limit the concurrency level for single load request (#18400)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-07-26 15:18:30 +08:00
wgcn
f192c6c298
fix the search metric of querynode (#18367)
Signed-off-by: wanggang11335 <wanggang11335@autohome.com.cn>

fix the search metric of querynode

Co-authored-by: wanggang11335 <wanggang11335@autohome.com.cn>
2022-07-22 17:38:29 +08:00
bigsheeper
cef8b1e7cc
Enable jemalloc (#18349)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-20 22:22:31 +08:00
wei liu
a79c5e2366
fix sync problem during reblance (#18332)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-07-20 15:02:30 +08:00
bigsheeper
c038cd7a48
Fix addSegment error, avoid the risk of mem leaks (#18309)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-19 20:58:28 +08:00
Jeng.Gwan
638f6c36e9
Support to get real row count of segment (#18115)
Signed-off-by: xaxys <zheng.guan@zilliz.com>
2022-07-18 09:58:28 +08:00
bigsheeper
73aef14820
Improve check of purge memory and change purge place (#18271)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-15 10:22:27 +08:00
xige-16
54d17bc5da
Fix query too slow when insert multi repeated pk data (#18231)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-07-13 10:22:26 +08:00
bigsheeper
1da970af18
Remove useless statsService in QueryNode (#17395)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-11 15:12:25 +08:00
bigsheeper
22508f36d3
Get search field id from search plan and log if loaded index when search segments (#18183)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-08 20:18:22 +08:00
congqixia
543197c2be
Fix handoff segment unit test uses wrong node id (#18137)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-07 15:22:21 +08:00
Zach
1c9647ff31
Merging multiple shard query/search requests into one rpc request if QueryNode is the leader of multiple shards of Collection (#17588)
Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>
2022-07-06 15:06:21 +08:00
bigsheeper
7d6624fcad
Improve flow graph node name and log msgID in QueryCoord (#18043)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-05 16:46:23 +08:00
zhenshan.cao
749558d55b
Fix bug: get correct number of cpu (#17973) (#18030)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-07-05 16:40:20 +08:00
congqixia
63230f0280
Fix data race in ShardCluster.SyncReplicas (#18054)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-05 13:16:20 +08:00
congqixia
d652fa567a
Return NotShardLeader error code when dml channel is not watched (#18055)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-05 13:08:19 +08:00
zhenshan.cao
1647bebaf4
Count growing segment number to estimate cpu usage (#17820) (#18027)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-07-04 15:10:20 +08:00
zhenshan.cao
9bd35dd84e
Refine logs to reduce print (#17759) (#18028)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-07-04 11:10:20 +08:00
congqixia
566f5b5766
Make querynode handle segmentChangeInfo with multiple vchannel (#18009)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-01 19:20:20 +08:00
bigsheeper
641fb96958
Return malloc_trim result and log if malloc_trim successfully (#17959)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-01 10:44:18 +08:00
congqixia
f4177f4434
Remove growing according to offline as well (#17968)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-30 20:14:19 +08:00
zhenshan.cao
0baeb609dc
Fix bugs in monitoring metrics (#17894)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-06-30 17:26:19 +08:00
congqixia
c179986e6c
Fix shard cluster segments data race (#17903)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-29 16:20:19 +08:00
bigsheeper
6b79d4f7bc
Log segment type as possible in QueryNode (#17846)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-28 10:16:17 +08:00
yah01
797218a8ad
Fix handoff isn't processed correctly (#17738)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>

Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-27 22:08:17 +08:00
congqixia
68d385137a
Fix: Miss channel info when load growing segment (#17789) (#17797)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Co-authored-by: zhagnlu <1542303831@qq.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-06-27 12:02:16 +08:00
congqixia
5471e35ccc
Wait last version search to release growing safely (#17713)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-25 18:48:15 +08:00
Enwei Jiao
16c3aedc15
refine complie configuration (#17502)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-06-24 21:12:15 +08:00
xige-16
3a0f9d41df
Print log after segment search done (#17769)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-24 14:10:14 +08:00
codeman
294f7e4408
fix: log datapb.SegmentInfo is too large #17685 (#17727)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-06-23 14:36:13 +08:00
Jiquan Long
216e2f80aa
Add msg id to log in query path (#17677)
/kind improvement

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-06-23 10:46:13 +08:00
codeman
6cb00aa5bb
fix: log datapb.SegmentInfo is too large #17685 (#17693)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-06-22 21:46:13 +08:00
bigsheeper
8cf54137cf
Add nil check in reduce and add collection rwmutex when release segments (#17698)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-22 16:12:14 +08:00
Jiquan Long
0282f69eb4
Add msg id to log in search path. (#17654)
issue: #17513
Add msg id to log in search path,
which should help us to trace a detailed request more easier.

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-06-21 13:30:12 +08:00
congqixia
aa4b42c74b
Remove wait before release collection/partition (#17623)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-17 19:00:11 +08:00
bigsheeper
92d06b2e30
Purge memory by the memory state and try to purge after each search (#17565)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-17 17:46:10 +08:00
congqixia
785a5a757f
Use segment version instead of ref cnt (#17609)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-17 17:38:12 +08:00
Letian Jiang
be4077421e
Filter duplicated sealed segments which are both online and offline (#17593)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-06-16 17:42:11 +08:00
wayblink
eb5b0b7fc8
Move SegmentInfo out of VchannelInfo, leave Id only to decrease kv size. Get complete SegmentInfo through RPC (#17441)
Resolves: #17233 #16047

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-06-16 12:00:10 +08:00
Jiquan Long
875b6f88b0
Add channel information to flow graph node (#17349)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-06-15 21:04:10 +08:00
xige-16
98b32f3eba
Improve time record log in search/query (#17545)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-15 20:48:10 +08:00
xige-16
dd483beefd
Delete the log that prints a lot of deleteMsg.timestamps (#17543)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-15 20:46:14 +08:00
xige-16
16f0815184
Add time record log on search/query execution path (#17497)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-13 11:42:09 +08:00