Commit Graph

1078 Commits

Author SHA1 Message Date
wei liu
4c956fab73
enable config collection level rate limit (#24012)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-05-12 18:13:26 +08:00
wei liu
4cd9f32dd6
enable global static rate limit (#24009)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-05-12 15:49:20 +08:00
yah01
7d0c47dd65
Check the length of JSON (#24035)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-05-12 11:33:20 +08:00
smellthemoon
146050db82
Fix some wrong ut (#23990)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-05-10 09:31:19 +08:00
yihao.dai
ae6fccc3a3
Filter id field out if not specified (#23982)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-05-09 17:26:41 +08:00
wei liu
d06ae53f79
make ddl rate limit be global level (#23962)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-05-09 16:56:40 +08:00
congqixia
f6d3b4f7ac
Fix concurrent map read/write in rate limiter (#23958)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-09 11:00:40 +08:00
yihao.dai
3827ac30bc
Remove load cache (#23287)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-05-09 10:36:41 +08:00
Enwei Jiao
d7edd1b99b
Fix parse token error (#23909)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-05-08 10:28:39 +08:00
wayblink
e13d900398
Add some log in getIndexStatisticsTask (#23897)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-05-08 10:02:39 +08:00
smellthemoon
dcf55e77b5
Remove superfluous idempotent in proxy (#23894)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-05-07 21:08:39 +08:00
Jiquan Long
7be7e6f360
Refactor check logic of index parameters (#23856)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-05-06 10:40:39 +08:00
wayblink
899702f13c
Implement GetIndexStatistics interface (#23603)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-05-06 10:34:39 +08:00
Gao
c1e8406c44
Override index type as AUTOINDEX when autoindex is enabled (#23744)
Signed-off-by: chasingegg <gaoc96@qq.com>
2023-04-30 11:50:40 +08:00
yihao.dai
6f94bfd26d
Add constraint of releasing partitions before dropping (#23732)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-28 11:12:36 +08:00
SimFG
5cd21893c8
Fix superusers' password verification problem (#23733)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-04-26 21:16:34 +08:00
yah01
f8ff97fe29
Fix travel timestamp set unique leads to disable task merge (#23605)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-25 19:04:34 +08:00
wei liu
4fb8919a97
support collection level rate limit (#22767)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-25 15:54:35 +08:00
wayblink
b7cb34b966
Add blank GetIndexStatistics interface (#23610)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-04-23 14:50:32 +08:00
yihao.dai
092d743917
Add support for getting vectors by ids (#23450)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-23 09:00:32 +08:00
zhenshan.cao
03ec804e68
Change default shard number to 1 (#23586)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-04-21 07:08:32 +08:00
Enwei Jiao
967a97b9bd
Support json & array types (#23408)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
2023-04-20 11:32:31 +08:00
zhenshan.cao
a88178a5ea
Add slow log for read (#23272)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-04-14 15:30:29 +08:00
cai.zhang
43a9e175a3
Exit component process when session key is deleted (#21658) (#22164)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-04-12 20:12:28 +08:00
yah01
296380d6e6
Support async refresh (#23107)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-12 15:06:28 +08:00
Jiquan Long
a940df94c7
Forbid counting entities with pagination (#23375)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-04-12 14:22:34 +08:00
congqixia
f1f8ce01de
Remove querynode v1 package (#23289)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-11 11:28:31 +08:00
yihao.dai
0b354cbab1
Fix timetick block caused by dml task pop failed (#23277)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-11 11:00:31 +08:00
cai.zhang
bd65ef8e95
Fix bug for type params when indexing (#23242) (#23250)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-04-09 16:18:29 +08:00
congqixia
132c010271
Fix proxy panicking when QueryCoord offline (#23254)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-07 17:30:28 +08:00
congqixia
32be374c33
Fix MetaCache ut internal not changed (#23276)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-07 13:20:28 +08:00
jaime
c9d0c157ec
Move some modules from internal to public package (#22572)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-04-06 19:14:32 +08:00
Jiquan Long
2c1c3aecfc
Fix metric ProxySyncTimeTickLag (#23235)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-04-06 15:28:33 +08:00
smellthemoon
ce91f61e5a
Pre-create topics (#21907)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-04-03 16:44:23 +08:00
yihao.dai
a0ca4d6108
Improve search/query logs in Proxy (#23144)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-03 10:54:23 +08:00
aoiasd
bd5fab1e53
Remove merge policy of proxy RoundRobin policy (#23021)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-03-31 14:36:22 +08:00
zhenshan.cao
1287ca699a
Refine usage of TimeRecorder.Record (#23142)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-03-30 18:56:22 +08:00
yihao.dai
a182594bf5
Add FlushAll support (#22942)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-03-30 11:28:25 +08:00
Jiquan Long
0f2c3ac832
Optimize log (#23121)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-03-30 10:44:22 +08:00
smellthemoon
b1992e84cc
Delete dup check (#23076)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-03-29 10:06:01 +08:00
wei liu
ed60b434fa
fix unstable ut (#23070)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-03-28 19:06:01 +08:00
yah01
081572d31c
Refactor QueryNode (#21625)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: aoiasd <zhicheng.yue@zilliz.com>
2023-03-27 00:42:00 +08:00
cai.zhang
977943463e
Check index params and type params (#22988)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-03-26 22:15:59 +08:00
Jiquan Long
0be96ab610
Check if all columns aligned with same num_rows (#22968)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-03-24 17:09:58 +08:00
smellthemoon
3dae84f065
Use merr in proxy (#22904)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-03-24 15:27:58 +08:00
Gao
8b3e5189e1
Add querynode plugin (#22379)
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2023-03-24 15:21:59 +08:00
SimFG
e8f8c1b445
Check the collection num when creating the collection (#22946)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-03-23 16:47:57 +08:00
smellthemoon
4c603cd02c
Fix upsert msgid (#22839)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-03-21 14:06:01 +08:00
SimFG
8259ca6929
Add the user rpc counter (#22872)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-03-21 11:37:56 +08:00
yihao.dai
1f718118e9
Dynamic load/release partitions (#22655)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-03-20 14:55:57 +08:00
wei liu
5f571ea915
remove debug log (#22828)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-03-17 18:05:56 +08:00
yah01
99f31dc37a
Fix data after travel timestamp is still visible (#22813)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-17 18:03:55 +08:00
Jiquan Long
dff15c3488
Check dimension of inserted records (#22819)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-03-17 17:33:58 +08:00
wei liu
6b5dfa6db2
deprecate shard cache immediately if query failed (#22779)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-03-17 16:25:55 +08:00
congqixia
a085af931d
Fix metrics info panic when network error happens (#22802) (#22809)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-17 11:55:54 +08:00
Jiquan Long
8139106b51
Feat: count entities by expression (#22765)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-03-16 19:31:55 +08:00
wei liu
69cc68caff
support first or random strategy (#22766)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-03-16 14:25:55 +08:00
zhenshan.cao
ecde42a493
Fix proxy's pchan statistic min ts out of order (#22757)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-03-15 11:17:55 +08:00
congqixia
732986aa04
Remove fmt.Print from internal package (#22722)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-14 17:36:05 +08:00
MrPresent-Han
89618b7e12
fix wrong sequence of timetick stats on proxy #21855 (#22685)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-03-14 15:43:54 +08:00
groot
6f6bd98c27
Verify vector float data for bulkinsert and insert (#22728)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-03-14 14:03:58 +08:00
yah01
fa2c1c1f40
Fix RootCoord double updates TSO (#22715)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-13 18:01:53 +08:00
congqixia
3ffa6d5302
Mark cache deprecated instead of removing it (#22674)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-10 10:19:53 +08:00
yah01
e581fef115
Use the request's context to allocate ts (#22633)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-09 18:51:52 +08:00
congqixia
d9908ff231
Fix TestMetaCache_ExpireShardLeaderCache unit test (#22651)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-09 18:25:52 +08:00
yah01
90a5aa6265
Refine errors, re-define error codes (#22501)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-09 15:47:52 +08:00
bigsheeper
f994052099
Reduce printing frequency of rate limit log (#22636)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-03-09 14:15:55 +08:00
wei liu
1a1a5caafa
update shard leader cache periodically (#22595)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-03-08 15:13:51 +08:00
smellthemoon
29b3690c83
Upsert raise error (#22533)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-03-06 14:29:51 +08:00
jaime
d126f06946
Decouple mq module from internal proto definition (#22536)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-03-04 23:21:50 +08:00
aoiasd
872721e3ec
Refactor invalid unit test (#22347)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-02-27 14:27:47 +08:00
Xiaofan
3d6bded115
Fix Row Number Mismatch (#22307)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-02-27 10:41:46 +08:00
Enwei Jiao
697dedac7e
Use cockroachdb/errors to replace other error pkg (#22390)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-26 11:31:49 +08:00
zhenshan.cao
e768437681
Correct usage of Timer and Ticker (#22228)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-02-23 18:59:45 +08:00
Enwei Jiao
0851e05014
Gernate milvus.yaml by code (#22003)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-23 11:37:46 +08:00
SimFG
7e19a924b7
Add the rbac for the GetLoadingProgress and GetLoadState api (#22320)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-02-22 20:37:45 +08:00
aoiasd
cc5d72a9f2
add search option to ignore ignore segment (#21994)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-02-22 17:31:46 +08:00
congqixia
abbf1efa0e
[Cherry-Pick] Fix read wrong variable caused nil error (#22297)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-21 18:38:26 +08:00
jaime
5936723904
Refine Read method of MinioChunkManager (#22235)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-02-21 16:22:26 +08:00
Enwei Jiao
0a9a9058b9
Fix UT timeout (#22261)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-20 21:14:25 +08:00
wei liu
13b508103e
refine mock querycoord (#22198)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-02-16 15:38:34 +08:00
bigsheeper
f4e7b246f2
Fix msgdispatcher concurrency issue and add prometheus metrics (#22174)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-02-16 14:58:34 +08:00
wei liu
87a4ddc7e2
fix rg e2e (#22187)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-02-16 10:48:34 +08:00
congqixia
f2575e5fa8
Add unconvert & durationcheck linters and fix issues (#22161)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-02-15 17:22:34 +08:00
SimFG
c2a49d5a0b
Add error log and metrics for the hook and privilege interceptor (#22111) (#22137)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-02-13 16:50:33 +08:00
bigsheeper
d2667064bb
Add msgDispatcher to support sharing msgs for different vChannel (#21917)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-02-13 16:38:33 +08:00
wei liu
d078441522
support rg api rbac (#22097)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-02-10 10:54:33 +08:00
wei liu
d085abbd56
fix load collection with rg (#22083)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-02-09 16:24:31 +08:00
wei liu
6fb60629be
fix describe rg api (#21998)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-02-07 19:30:31 +08:00
wei liu
aced41d5d8
add resource group name rule (#21992)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-02-07 17:52:31 +08:00
Ten Thousand Leaves
74e3cc64fb
Add refresh path to proxy (#21933)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-02-02 19:29:51 +08:00
Enwei Jiao
53ae40b8c6
Make ratelimiter's config refreshable (#21757)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-01 16:03:51 +08:00
Cai Yudong
e3d1624e97
Handle distance Inf correctly (#21828)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2023-02-01 14:59:51 +08:00
Xiaofan
f1daef22a1
Fix failed bulkload segment marked as sealed (#21799)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-01-31 12:41:53 +08:00
smellthemoon
bb086f47e4
Swap execution flow order in enqueue (#21845)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-01-30 10:27:50 +08:00
wei liu
73c44d4b29
resource group impl (#21609)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-01-30 10:19:48 +08:00
jaime
d7bb908148
Fix rename collection data race (#21827)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-01-24 10:01:46 +08:00
congqixia
5986106037
Make paramtable init only once (#21782)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-01-19 14:53:44 +08:00
jaime
1dcd9eeb79
Support rename collection (#21693)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-01-19 14:13:43 +08:00
smellthemoon
ad6cbc990f
Combine similar function (#21752)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-01-17 17:53:42 +08:00