test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-04 04:49:08 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
18,309 Commits 96 Branches 105 Tags 185 MiB
0c69f48ba4
Commit Graph

321 Commits

Author SHA1 Message Date
yah01
941a383019
Fix failed to load collection with more than 128 partitions (#26763) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-02 00:09:01 +08:00
congqixia
e8f1b1736e
Remove log.Error(err.error())-style log (#26783) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-01 13:09:01 +08:00
wei liu
5602b22531
refine checker code style (#26759) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-09-01 11:57:01 +08:00
wei liu
949c320185
remove pull target from qc recover (#26775) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-09-01 11:17:01 +08:00
yah01
213db490bd
Use pointer receiver for large struct (#26668) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-08-30 10:24:29 +08:00
congqixia
9364d0ea49
Remove etcd dependency for querycoord unit test (#26550) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-28 11:20:25 +08:00
yah01
f9c060e0d2
Treat balance task with released source segment as stale (#26453) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-08-22 17:12:22 +08:00
congqixia
065d1a962e
Add sourceID output for task.String and fill reduce channel reason (#26447) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-18 13:50:19 +08:00
yihao.dai
63b86b32a6
Add server id validation interceptor (#26395) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-08-17 20:20:20 +08:00
yah01
9723787141
Calculate memory usage without page cache (#26389) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-08-16 17:04:17 +08:00
Enwei Jiao
7d61355ab0
Refactor log for Query (#26310) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-08-14 18:57:32 +08:00
wei liu
b47a72bfcf
fix set dirty segment distribution to leader view (#26180) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-08-11 11:21:32 +08:00
yah01
889424b3f9
Fix load index with empty file list (#26236) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-08-09 18:39:16 +08:00
congqixia
e13b6b88eb
Replace deprecated grpc WithInsecure option (#26226) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-09 13:37:16 +08:00
Bingyi Sun
54c0e64059
Fix search on empty segments set bug (#26136) 
Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2023-08-08 11:17:08 +08:00
xige-16
d1d0169fa3
Delete useless config (#26173) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-08-08 10:23:08 +08:00
wei liu
6f89620a43
remove pull target rpc from lock (#26054) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-08-04 10:31:06 +08:00
wei liu
518b6310a2
refine retry times on replica (#26043) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-08-03 15:55:09 +08:00
yah01
df26b909f0
Fix panic while saw the failed task status (#26082) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-08-02 13:47:05 +08:00
yah01
2180ef180c
Record only failed task error (#26033) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-08-01 10:11:05 +08:00
Bingyi Sun
a3e22786ed
Move meta store to kv catalog (#25915) 
Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2023-07-31 13:57:04 +08:00
congqixia
2b9ec565bb
Fix task executor can not dedup same task (#25901) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-26 08:51:02 +08:00
congqixia
a669440ee9
Allow querycoord executor load sealed segment with no index (#25902) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-25 18:47:01 +08:00
congqixia
0bc03ede0d
Add eventlog pkg and support grpc streaming event observation (#25812) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-25 17:23:01 +08:00
wei liu
1748c54fd7
skip load/release segment when more than one delegator exist (#25718) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-24 19:01:01 +08:00
congqixia
76e03fe6d3
Set reason for balance, index checker generated tasks (#25865) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-24 17:07:00 +08:00
yah01
dc37b4587e
Fix panic if channel not watched while getting shard leaders (#25820) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-24 14:13:02 +08:00
wei liu
fc19b85a40
fix count(*）retrieve redundant growing segment (#25825) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-24 14:09:00 +08:00
Bingyi Sun
9f31fc9a31
Add broker timeout config item. (#25855) 
Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2023-07-24 14:07:00 +08:00
congqixia
efcaa07fe9
Implement Stringer for task related enums (#25860) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-24 13:57:00 +08:00
congqixia
3c503afe7c
Use typeutil.ConcurrentMap instead of sync.Map (#25846) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-24 10:23:01 +08:00
congqixia
1045c88102
Support replace indexed field in QueryCoord (#25747) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-19 21:22:58 +08:00
yihao.dai
172db82b23
Release collection if all partition released (#25706) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-19 16:54:58 +08:00
wei liu
6534396b3d
enable config different interval for different checker (#25514) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-19 16:50:57 +08:00
yah01
224515eaa3
Add segment dist containing condition for loading segment (#25736) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-19 15:02:58 +08:00
yah01
228c0df3f7
Skip record ChannelNotFound error while loading segment (#25669) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-18 11:53:18 +08:00
MrPresent-Han
49655d2f13
fix panic due to lack of indexInfo on querynode(#25362) (#25613) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-07-17 19:23:19 +08:00
Bingyi Sun
5afea0e5bf
Fix querycoord crash (#25638) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-07-17 16:56:35 +08:00
yah01
948d1f1f4a
Handle errors by merr for QueryCoord (#24926) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-17 14:59:34 +08:00
wei liu
b62c82af22
fix set target version in loading sealed segment (#25603) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-14 20:00:31 +08:00
yiwangdr
b9189b9f41
Organize mocks from types.go (#25466) 
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2023-07-14 10:12:31 +08:00
congqixia
7d00020c9e
Reduce DataScope to historical for segment release task (#25489) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-12 09:12:28 +08:00
congqixia
5aec6036dc
Add index info in GetDataDistribution response (#25444) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-11 11:22:29 +08:00
congqixia
2bed5bc461
Fix false load success for partition load timeout but collection remains (#25379) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-06 19:10:25 +08:00
wei liu
2ae6def394
fix sync target version with wrong segment list (#25337) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-06 10:30:26 +08:00
yihao.dai
c56a26a556
Add SetMetricType and set metric only for shard leader (#25285) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-04 10:20:25 +08:00
congqixia
b68fa2049b
Fix querycoord segment checker nil reference (#25290) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-03 18:48:24 +08:00
wei liu
cba0feb119
add coordinator broker, to unify rootcoord api access (#25187) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-03 18:28:25 +08:00
yihao.dai
3be502c155
Fix not fully loaded error after restart (#25243) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-03 16:58:28 +08:00
wei liu
68ae199a9f
load segment with target version, avoid read redundant segment (#24929) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-27 11:48:45 +08:00
xige-16
33c2012675
Add more metrics (#25081) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-26 17:52:44 +08:00
jaime
18df2ba6fd
[Cherry-Pick] Support Database (#24769) 
Support Database(#23742)
Fix db nonexists error for FlushAll (#24222)
Fix check collection limits fails (#24235)
backward compatibility with empty DB name (#24317)
Fix GetFlushAllState with DB (#24347)
Remove db from global meta cache after drop database (#24474)
Fix db name is empty for describe collection response (#24603)
Add RBAC for Database API (#24653)
Fix miss load the same name collection during recover stage (#24941)

RBAC supports Database validation (#23609)
Fix to list grant with db return empty (#23922)
Optimize PrivilegeAll permission check (#23972)
Add the default db value for the rbac request (#24307)

Signed-off-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-25 17:20:43 +08:00
congqixia
a3630e17a0
Refine grpc Status handling: retry legacy only for Unimplemented (#25041) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-25 10:30:43 +08:00
Bingyi Sun
b88e74a109
Fix querycoord close error (#25034) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-06-21 11:02:42 +08:00
yah01
7eeb78726e
Fix refresh unstable (#25027) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-20 21:50:43 +08:00
yah01
e962a8ba31
Limit the frequency of debug logs (#25009) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-20 14:14:41 +08:00
yihao.dai
c7dc1c067a
Assign metric type in load segment request (#24917) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-16 16:50:41 +08:00
Gao
51404abe93
Add missing indexInfo in watchDmChannelsRequest (#24696) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-06-14 14:40:39 +08:00
yiwangdr
4387f36897
make etcdKV private (#24778) 
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2023-06-13 10:52:38 +08:00
congqixia
41af0a98fa
Use go-api/v2 for milvus-proto (#24770) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-09 01:28:37 +08:00
yihao.dai
89db828f71
Fix load collection failed after drop partition (#24680) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-07 19:04:36 +08:00
yihao.dai
5f7099a9bd
Fix search failed due to metric type mismatch (#24691) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-06 21:40:35 +08:00
yihao.dai
b0ce4cff83
Assign metric type in search request when user has not explicitly assigned (#24591) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-01 18:10:32 +08:00
congqixia
39d31f8bbf
Trigger checker while waiting collection/partition released (#24523) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-30 17:41:28 +08:00
MrPresent-Han
b09e7aeaf7
support detailed task metrics(#23414) (#24507) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-05-30 14:59:28 +08:00
yihao.dai
d8ad09b710
Fix sync partition context deadline exceeded (#24479) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-29 20:55:28 +08:00
yah01
848ef7418b
Fix the refresh may be notified finished early (#24438) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-05-26 18:43:26 +08:00
wei liu
8e3ba74648
fix qc service unstable ut (#24340) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-24 18:49:25 +08:00
wei liu
ce03248b1a
simplify logic circle in search (#24110) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-23 16:01:26 +08:00
MrPresent-Han
675821c79d
refine log and process for distribution handler (#24239) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-05-22 19:37:25 +08:00
wei liu
8965ea2a08
refine err msg about no available node in replica (#24256) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-22 11:59:26 +08:00
yihao.dai
1a3dca9b5e
Fix dynamic partitions loading (#24112) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-18 09:17:23 +08:00
Bingyi Sun
a53beba14f
Move release collection metrics to job (#24079) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-05-17 11:17:22 +08:00
Jiquan Long
30415e1b83
Fix metric QueryCoordNumCollections (#24053) (#24107) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-15 16:33:22 +08:00
wei liu
7407669a02
fix qc coordinator retry policy (#24057) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-12 16:59:21 +08:00
yah01
67cf23d050
Fix panic while balancing releasing collection (#24003) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-11 12:47:20 +08:00
smellthemoon
146050db82
Fix some wrong ut (#23990) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-10 09:31:19 +08:00
yihao.dai
7e0d1492c7
Load delete from channel checkpoint (#23961) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-09 19:10:41 +08:00
wei liu
fb6e4ceee7
correct the behavior of create duplicate rg (#23963) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-09 14:06:40 +08:00
yihao.dai
3827ac30bc
Remove load cache (#23287) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-09 10:36:41 +08:00
congqixia
ed81eaa963
Make CollectionObserver trigger checker more frequently during load procedure (#23928) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-08 14:06:41 +08:00
Enwei Jiao
240c5625cd
Fix nil pointer access (#23919) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-08 10:08:39 +08:00
MrPresent-Han
b517bc9e6a
refine balance mechanism including:(#23454) (#23763) (#23791) 
1. balance granuity to replica to avoid influence unrelated replicas
2. avoid balance back and forth

Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
 2023-05-04 12:22:40 +08:00
Xiaofan
87d790f052
Fix upgrade casue panic (#23833) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-05-02 14:06:37 +08:00
yihao.dai
4b26c0afb3
Add collection in querynode when sync new partitions (#23825) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-01 16:36:38 +08:00
wei liu
b6ae70db43
fix get replica return wrong node list (#23792) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-04-28 19:48:36 +08:00
wei liu
f36cdc182a
add retry on get recovery info (#23764) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-04-27 17:46:34 +08:00
wei liu
5244020336
ban auto balance channel (#23725) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-04-26 19:26:39 +08:00
foxspy
6f4ed517de
add growing segment index (#23615) 
Signed-off-by: xianliang <xianliang.li@zilliz.com>
 2023-04-26 10:14:41 +08:00
wei liu
1deac692a0
fix nodeup block (#23634) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-04-25 19:20:37 +08:00
wei liu
6653e2c3b0
fix balance channel (#23631) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-04-25 10:22:37 +08:00
congqixia
6b29a991a5
Fix releasing non-loaded partition blocks forever (#23623) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-23 19:16:32 +08:00
XuanYang-cn
d56771b7b7
Fix return too many nodeIDs (#23397) 
See also: #23396

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-04-20 13:50:31 +08:00
wei liu
4336ed8609
fix node up (#23415) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-04-20 09:52:31 +08:00
wei liu
3933080511
skip to balance redundant segment (#23490) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-04-18 18:32:32 +08:00
wei liu
cbfe7a45ef
fix pull target (#23491) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-04-18 18:30:32 +08:00
congqixia
b5a73e6d1a
Add OWNERS files for querycoordv2 sub pkgs (#23489) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-18 15:52:30 +08:00
yah01
bed8d6892e
Protect the QueryCoord meta from stale data migrated from old version (#23412) 
Fix #23411

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-14 14:42:28 +08:00
cai.zhang
43a9e175a3
Exit component process when session key is deleted (#21658) (#22164) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-04-12 20:12:28 +08:00
yah01
296380d6e6
Support async refresh (#23107) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-12 15:06:28 +08:00