test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-02 20:09:57 +08:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity
18,526 Commits 94 Branches 105 Tags 184 MiB
4b8bc2798e
Commit Graph

344 Commits

Author SHA1 Message Date
wei liu
4071132f6a
reload loading collection when qc recover (#27300) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-09-27 11:43:28 +08:00
yah01
6539a5ae2c
Refine DataCoord status (#27262) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-26 17:15:27 +08:00
jaime
7f7c71ea7d
Decoupling client and server API in types interface (#27186) 
Co-authored-by:: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-09-26 09:57:25 +08:00
yah01
24354b166c
Fix unit test failed when run single test (#27348) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-26 09:23:25 +08:00
foxspy
5db4a0489e
dynamic index version control (#27335) 
Co-authored-by: longjiquan <jiquan.long@zilliz.com>
 2023-09-25 21:39:27 +08:00
MrPresent-Han
4b12cb8847
fix unstable ut due to unstable sort of unique set (#27302) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-09-22 19:07:26 +08:00
foxspy
370b6fde58
milvus support multi index engine (#27178) 
Co-authored-by: longjiquan <jiquan.long@zilliz.com>
 2023-09-22 09:59:26 +08:00
SimFG
26f06dd732
Format the code (#27275) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-09-21 09:45:27 +08:00
yah01
b4f86ea55e
Construct all success status with merr (#27226) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-20 10:57:23 +08:00
congqixia
cc9974979f
Add staticcheck linter and fix existing problems (#27174) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-19 10:05:22 +08:00
yah01
168e82ee10
Fix panic while handling with the nil status (#27040) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-15 10:09:21 +08:00
congqixia
edde3cf1c7
Add tracer for querycoord tasks (#27058) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-14 09:59:19 +08:00
PowderLi
c033580af4
show index info while GetSegmentInfo (#26981) 
according to QueryNode::GetSegmentInfo

Signed-off-by: PowderLi <min.li@zilliz.com>
 2023-09-13 11:37:18 +08:00
aoiasd
e107d0794c
support complex delete expression (#25752) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-09-12 10:19:17 +08:00
congqixia
c45c32fad4
Set task reason for collection released (#26962) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-10 15:15:17 +08:00
MrPresent-Han
2101f2d289
fix unstable checker id due to go map iteration(#26943) (#26944) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-09-10 10:11:16 +08:00
congqixia
758aad705d
Fix checker using default interval after manual check (#26953) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-09 08:29:16 +08:00
SimFG
0901b76732
Avoid the panic when the status of rpc response is nil (#26910) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-09-07 19:23:15 +08:00
yiwangdr
337edc321b
tikv integration (#26246) 
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2023-09-07 07:25:14 +08:00
SimFG
28681276e2
Improve the retry of the rpc client (#26795) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-09-06 17:43:14 +08:00
Enwei Jiao
fb0705df1b
Decouple basetable and componentparam (#26725) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-09-05 10:31:48 +08:00
congqixia
1a8cf5c415
Organize all mockery generation commands in Makefile (#26826) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-04 21:19:48 +08:00
yah01
3349db4aa7
Refine errors to remove changes breaking design (#26521) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-04 09:57:09 +08:00
yah01
941a383019
Fix failed to load collection with more than 128 partitions (#26763) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-02 00:09:01 +08:00
congqixia
e8f1b1736e
Remove log.Error(err.error())-style log (#26783) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-01 13:09:01 +08:00
wei liu
5602b22531
refine checker code style (#26759) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-09-01 11:57:01 +08:00
wei liu
949c320185
remove pull target from qc recover (#26775) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-09-01 11:17:01 +08:00
yah01
213db490bd
Use pointer receiver for large struct (#26668) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-08-30 10:24:29 +08:00
congqixia
9364d0ea49
Remove etcd dependency for querycoord unit test (#26550) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-28 11:20:25 +08:00
yah01
f9c060e0d2
Treat balance task with released source segment as stale (#26453) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-08-22 17:12:22 +08:00
congqixia
065d1a962e
Add sourceID output for task.String and fill reduce channel reason (#26447) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-18 13:50:19 +08:00
yihao.dai
63b86b32a6
Add server id validation interceptor (#26395) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-08-17 20:20:20 +08:00
yah01
9723787141
Calculate memory usage without page cache (#26389) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-08-16 17:04:17 +08:00
Enwei Jiao
7d61355ab0
Refactor log for Query (#26310) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-08-14 18:57:32 +08:00
wei liu
b47a72bfcf
fix set dirty segment distribution to leader view (#26180) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-08-11 11:21:32 +08:00
yah01
889424b3f9
Fix load index with empty file list (#26236) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-08-09 18:39:16 +08:00
congqixia
e13b6b88eb
Replace deprecated grpc WithInsecure option (#26226) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-09 13:37:16 +08:00
Bingyi Sun
54c0e64059
Fix search on empty segments set bug (#26136) 
Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2023-08-08 11:17:08 +08:00
xige-16
d1d0169fa3
Delete useless config (#26173) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-08-08 10:23:08 +08:00
wei liu
6f89620a43
remove pull target rpc from lock (#26054) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-08-04 10:31:06 +08:00
wei liu
518b6310a2
refine retry times on replica (#26043) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-08-03 15:55:09 +08:00
yah01
df26b909f0
Fix panic while saw the failed task status (#26082) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-08-02 13:47:05 +08:00
yah01
2180ef180c
Record only failed task error (#26033) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-08-01 10:11:05 +08:00
Bingyi Sun
a3e22786ed
Move meta store to kv catalog (#25915) 
Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2023-07-31 13:57:04 +08:00
congqixia
2b9ec565bb
Fix task executor can not dedup same task (#25901) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-26 08:51:02 +08:00
congqixia
a669440ee9
Allow querycoord executor load sealed segment with no index (#25902) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-25 18:47:01 +08:00
congqixia
0bc03ede0d
Add eventlog pkg and support grpc streaming event observation (#25812) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-25 17:23:01 +08:00
wei liu
1748c54fd7
skip load/release segment when more than one delegator exist (#25718) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-24 19:01:01 +08:00
congqixia
76e03fe6d3
Set reason for balance, index checker generated tasks (#25865) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-24 17:07:00 +08:00
yah01
dc37b4587e
Fix panic if channel not watched while getting shard leaders (#25820) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-24 14:13:02 +08:00
wei liu
fc19b85a40
fix count(*）retrieve redundant growing segment (#25825) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-24 14:09:00 +08:00
Bingyi Sun
9f31fc9a31
Add broker timeout config item. (#25855) 
Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2023-07-24 14:07:00 +08:00
congqixia
efcaa07fe9
Implement Stringer for task related enums (#25860) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-24 13:57:00 +08:00
congqixia
3c503afe7c
Use typeutil.ConcurrentMap instead of sync.Map (#25846) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-24 10:23:01 +08:00
congqixia
1045c88102
Support replace indexed field in QueryCoord (#25747) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-19 21:22:58 +08:00
yihao.dai
172db82b23
Release collection if all partition released (#25706) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-19 16:54:58 +08:00
wei liu
6534396b3d
enable config different interval for different checker (#25514) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-19 16:50:57 +08:00
yah01
224515eaa3
Add segment dist containing condition for loading segment (#25736) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-19 15:02:58 +08:00
yah01
228c0df3f7
Skip record ChannelNotFound error while loading segment (#25669) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-18 11:53:18 +08:00
MrPresent-Han
49655d2f13
fix panic due to lack of indexInfo on querynode(#25362) (#25613) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-07-17 19:23:19 +08:00
Bingyi Sun
5afea0e5bf
Fix querycoord crash (#25638) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-07-17 16:56:35 +08:00
yah01
948d1f1f4a
Handle errors by merr for QueryCoord (#24926) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-07-17 14:59:34 +08:00
wei liu
b62c82af22
fix set target version in loading sealed segment (#25603) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-14 20:00:31 +08:00
yiwangdr
b9189b9f41
Organize mocks from types.go (#25466) 
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2023-07-14 10:12:31 +08:00
congqixia
7d00020c9e
Reduce DataScope to historical for segment release task (#25489) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-12 09:12:28 +08:00
congqixia
5aec6036dc
Add index info in GetDataDistribution response (#25444) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-11 11:22:29 +08:00
congqixia
2bed5bc461
Fix false load success for partition load timeout but collection remains (#25379) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-06 19:10:25 +08:00
wei liu
2ae6def394
fix sync target version with wrong segment list (#25337) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-06 10:30:26 +08:00
yihao.dai
c56a26a556
Add SetMetricType and set metric only for shard leader (#25285) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-04 10:20:25 +08:00
congqixia
b68fa2049b
Fix querycoord segment checker nil reference (#25290) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-03 18:48:24 +08:00
wei liu
cba0feb119
add coordinator broker, to unify rootcoord api access (#25187) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-03 18:28:25 +08:00
yihao.dai
3be502c155
Fix not fully loaded error after restart (#25243) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-03 16:58:28 +08:00
wei liu
68ae199a9f
load segment with target version, avoid read redundant segment (#24929) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-27 11:48:45 +08:00
xige-16
33c2012675
Add more metrics (#25081) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-26 17:52:44 +08:00
jaime
18df2ba6fd
[Cherry-Pick] Support Database (#24769) 
Support Database(#23742)
Fix db nonexists error for FlushAll (#24222)
Fix check collection limits fails (#24235)
backward compatibility with empty DB name (#24317)
Fix GetFlushAllState with DB (#24347)
Remove db from global meta cache after drop database (#24474)
Fix db name is empty for describe collection response (#24603)
Add RBAC for Database API (#24653)
Fix miss load the same name collection during recover stage (#24941)

RBAC supports Database validation (#23609)
Fix to list grant with db return empty (#23922)
Optimize PrivilegeAll permission check (#23972)
Add the default db value for the rbac request (#24307)

Signed-off-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-25 17:20:43 +08:00
congqixia
a3630e17a0
Refine grpc Status handling: retry legacy only for Unimplemented (#25041) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-25 10:30:43 +08:00
Bingyi Sun
b88e74a109
Fix querycoord close error (#25034) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-06-21 11:02:42 +08:00
yah01
7eeb78726e
Fix refresh unstable (#25027) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-20 21:50:43 +08:00
yah01
e962a8ba31
Limit the frequency of debug logs (#25009) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-20 14:14:41 +08:00
yihao.dai
c7dc1c067a
Assign metric type in load segment request (#24917) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-16 16:50:41 +08:00
Gao
51404abe93
Add missing indexInfo in watchDmChannelsRequest (#24696) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-06-14 14:40:39 +08:00
yiwangdr
4387f36897
make etcdKV private (#24778) 
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2023-06-13 10:52:38 +08:00
congqixia
41af0a98fa
Use go-api/v2 for milvus-proto (#24770) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-09 01:28:37 +08:00
yihao.dai
89db828f71
Fix load collection failed after drop partition (#24680) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-07 19:04:36 +08:00
yihao.dai
5f7099a9bd
Fix search failed due to metric type mismatch (#24691) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-06 21:40:35 +08:00
yihao.dai
b0ce4cff83
Assign metric type in search request when user has not explicitly assigned (#24591) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-01 18:10:32 +08:00
congqixia
39d31f8bbf
Trigger checker while waiting collection/partition released (#24523) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-30 17:41:28 +08:00
MrPresent-Han
b09e7aeaf7
support detailed task metrics(#23414) (#24507) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-05-30 14:59:28 +08:00
yihao.dai
d8ad09b710
Fix sync partition context deadline exceeded (#24479) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-29 20:55:28 +08:00
yah01
848ef7418b
Fix the refresh may be notified finished early (#24438) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-05-26 18:43:26 +08:00
wei liu
8e3ba74648
fix qc service unstable ut (#24340) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-24 18:49:25 +08:00
wei liu
ce03248b1a
simplify logic circle in search (#24110) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-23 16:01:26 +08:00
MrPresent-Han
675821c79d
refine log and process for distribution handler (#24239) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-05-22 19:37:25 +08:00
wei liu
8965ea2a08
refine err msg about no available node in replica (#24256) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-22 11:59:26 +08:00
yihao.dai
1a3dca9b5e
Fix dynamic partitions loading (#24112) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-18 09:17:23 +08:00
Bingyi Sun
a53beba14f
Move release collection metrics to job (#24079) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2023-05-17 11:17:22 +08:00
Jiquan Long
30415e1b83
Fix metric QueryCoordNumCollections (#24053) (#24107) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-15 16:33:22 +08:00
wei liu
7407669a02
fix qc coordinator retry policy (#24057) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-12 16:59:21 +08:00
yah01
67cf23d050
Fix panic while balancing releasing collection (#24003) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-11 12:47:20 +08:00
smellthemoon
146050db82
Fix some wrong ut (#23990) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-10 09:31:19 +08:00