test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-04 21:09:06 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
18,766 Commits 96 Branches 105 Tags 186 MiB
4f8c540c77
Commit Graph

579 Commits

Author SHA1 Message Date
Enwei Jiao
fb0705df1b
Decouple basetable and componentparam (#26725) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-09-05 10:31:48 +08:00
congqixia
1a8cf5c415
Organize all mockery generation commands in Makefile (#26826) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-04 21:19:48 +08:00
yihao.dai
7624c2b949
Improve rated log in insertBufferNode (#26788) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-09-04 09:59:10 +08:00
yah01
3349db4aa7
Refine errors to remove changes breaking design (#26521) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-04 09:57:09 +08:00
yihao.dai
c6024a32f5
Add rate limit ratio monitoring (#26709) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-09-03 20:47:02 +08:00
congqixia
e8f1b1736e
Remove log.Error(err.error())-style log (#26783) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-09-01 13:09:01 +08:00
jaime
d001133bd2
[skip e2e] Refine collection not exists error (#26707) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-08-31 17:29:03 +08:00
wei liu
cd7f811d40
fix rootcoord unstable ut (#26460) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-08-30 09:42:27 +08:00
jaime
9f61dba3f9
Support rename db name of the collection (#26543) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-08-29 14:54:26 +08:00
jaime
c603f1c244
Remove mysql metastore (#26633) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-08-29 14:36:26 +08:00
yah01
4a181c1635
Fix panic while stopping the cluster (#26580) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-08-23 19:08:23 +08:00
SimFG
d13ca54414
Change the default gracefulStopTimeout and only warn when fail to refresh policy cache (#26450) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-08-22 09:04:21 +08:00
chyezh
85886f039e
[Fixup] msg context access data race when msgdispatcher (#26463) 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-08-21 19:16:22 +08:00
yihao.dai
63b86b32a6
Add server id validation interceptor (#26395) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-08-17 20:20:20 +08:00
congqixia
8d13717cac
Fill Collection start position timestamp in WatchInfo (#26370) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-16 09:05:32 +08:00
groot
279a060e75
Not allow to set partition name for collection with partition key (#26129) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-08-10 18:55:21 +08:00
congqixia
2770ac4df5
Fix nilness linter errors (#26218) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-09 11:31:15 +08:00
congqixia
b9850ce5c0
Fix copylocks linter errors (#26217) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-08-08 20:41:15 +08:00
yihao.dai
b6effd7345
Disable deny writing when the growing segment size exceeds the watermark (#26163) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-08-08 12:43:07 +08:00
xige-16
d1d0169fa3
Delete useless config (#26173) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-08-08 10:23:08 +08:00
SimFG
4e1b65d38f
Refine the rbac cache update process (#26150) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-08-07 11:59:07 +08:00
SimFG
d2649b63db
Delete the user-role mapping info when deleting the user (#25988) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-08-04 18:37:08 +08:00
XuanYang-cn
1fff8d2c66
Fix restore redrop enormous dup collections (#26029) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-08-03 10:37:06 +08:00
jaime
51b7354349
[skip e2e]Fix missed db parameter (#25790) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-07-26 19:46:51 +08:00
cai.zhang
fe1c0ffe56
Check sgement exist before check import task state (#25809) (#25817) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-07-25 10:09:01 +08:00
congqixia
3c503afe7c
Use typeutil.ConcurrentMap instead of sync.Map (#25846) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-24 10:23:01 +08:00
Enwei Jiao
9fe62cb5f3
Fix kafka producer panic by nil (#25691) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-07-18 18:24:57 +08:00
yihao.dai
74ad7c4601
Fix monitoring metrics (#25549) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-16 18:48:33 +08:00
congqixia
c114d46244
Support create alias with dropping collection name (#25616) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-14 19:46:31 +08:00
Enwei Jiao
66fdc71479
Refactor logs in DataCoord & DataNode (#25574) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-07-14 15:56:31 +08:00
yiwangdr
b9189b9f41
Organize mocks from types.go (#25466) 
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2023-07-14 10:12:31 +08:00
groot
96c987ed62
Bulkinsert supports partition keys (#25284) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2023-07-11 15:18:28 +08:00
smellthemoon
d63323d117
Add rate limit and deny write in upsert (#25351) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-07-11 11:20:34 +08:00
congqixia
412b2fab67
Fix rootcoord restoration missing gcConfirmStep (#25293) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-07-10 10:16:26 +08:00
yihao.dai
d3eacb2563
Disable release partition when drop partition (#25244) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-07-01 16:18:23 +08:00
xige-16
33c2012675
Add more metrics (#25081) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-26 17:52:44 +08:00
wei liu
2d029b7fd3
fix rootcoord meta table unstable ut (#25126) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-26 12:02:44 +08:00
jaime
18df2ba6fd
[Cherry-Pick] Support Database (#24769) 
Support Database(#23742)
Fix db nonexists error for FlushAll (#24222)
Fix check collection limits fails (#24235)
backward compatibility with empty DB name (#24317)
Fix GetFlushAllState with DB (#24347)
Remove db from global meta cache after drop database (#24474)
Fix db name is empty for describe collection response (#24603)
Add RBAC for Database API (#24653)
Fix miss load the same name collection during recover stage (#24941)

RBAC supports Database validation (#23609)
Fix to list grant with db return empty (#23922)
Optimize PrivilegeAll permission check (#23972)
Add the default db value for the rbac request (#24307)

Signed-off-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-25 17:20:43 +08:00
wei liu
0d51f55c48
enable config each collection has different rate limit (#24139) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-21 15:02:42 +08:00
PowderLi
3f4356df10
fix the spelling of field (#25008) 
Signed-off-by: PowderLi <min.li@zilliz.com>
 2023-06-21 14:00:42 +08:00
SimFG
0c3f92d7d7
Improve the panic code about the rootcoord/session/rocksmq (#24859) (#25024) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-06-21 11:24:42 +08:00
Jiquan Long
e9f1515a0e
Add log for confirming gc finished (#24945) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-19 10:52:41 +08:00
congqixia
5e7446e65e
Enlarge compact testcase timeout (#24924) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-15 20:54:43 +08:00
smellthemoon
db31e88a73
Add length check when insert and upsert (#24759) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-06-15 10:24:38 +08:00
congqixia
41af0a98fa
Use go-api/v2 for milvus-proto (#24770) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-09 01:28:37 +08:00
aoiasd
44e5daae3a
Fix querynode read quota (#24412) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-06-08 17:24:36 +08:00
yah01
ebd0279d3f
Check error by Error() and NoError() for better report message (#24736) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-08 15:36:36 +08:00
xige-16
732fe54775
Support partition Key (#24047) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-06 10:24:34 +08:00
yihao.dai
0fb9131973
Improve rate limiter log (#24459) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-30 11:23:28 +08:00
yihao.dai
1471da846d
Fix panic due to collection not exist in quota effect (#24320) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-24 20:53:30 +08:00
cai.zhang
d16e18fd34
Add output fields for search/query results (#24302) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-23 10:19:26 +08:00
cai.zhang
008285f849
Support dynamic schema for create collection (#24176) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-18 09:33:24 +08:00
yihao.dai
1a3dca9b5e
Fix dynamic partitions loading (#24112) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-18 09:17:23 +08:00
wei liu
2935e9f767
fix alter collection merge multi props policy (#24147) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-17 16:05:22 +08:00
wei liu
6cfb4559d2
fix deny writing use wrong errcode (#24152) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-17 14:23:23 +08:00
yihao.dai
7384d83d2c
Support rate limit based on growing segments size (#24121) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-17 09:57:22 +08:00
SimFG
ef82e0f1a4
Fix the error when a role removes an already deleted user (#24049) (#24109) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-05-16 10:15:22 +08:00
smellthemoon
8a85dd6869
Support Default Value (#23448) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-15 16:15:21 +08:00
wei liu
4c956fab73
enable config collection level rate limit (#24012) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-12 18:13:26 +08:00
smellthemoon
ab95754069
Remove debug log (#24030) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-11 14:09:19 +08:00
smellthemoon
f1adb1c06d
can only use the topic in the list when preCreatedTopicEnabled (#23913) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-10 13:47:19 +08:00
smellthemoon
146050db82
Fix some wrong ut (#23990) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-10 09:31:19 +08:00
yihao.dai
f1cc31ceee
Fix creating partition is not atomic (#23823) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-08 10:18:39 +08:00
Xiaofan
87d790f052
Fix upgrade casue panic (#23833) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-05-02 14:06:37 +08:00
yihao.dai
4b26c0afb3
Add collection in querynode when sync new partitions (#23825) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-01 16:36:38 +08:00
yihao.dai
5a9a86ba74
Fix quota center assignment to entry in nil map (#23819) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-04-29 18:22:38 +08:00
Jiquan Long
c955c26656
Optimize log when rootcoord goroutine quit (#23698) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-04-29 16:06:42 +08:00
Jiquan Long
156eba846f
Fix synced timetick not updated properly (#23697) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-04-29 16:02:38 +08:00
smellthemoon
9d35a5f943
Fix num of partitions is wrong (#23780) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-04-28 15:20:36 +08:00
wei liu
537e068fb9
fix qupta_center calculate negative memory factor for rate limit (#23750) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-04-28 11:32:35 +08:00
yihao.dai
017b15af6a
Fix disk quota when there's no binlog file (#23776) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-04-28 11:10:35 +08:00
yihao.dai
8c060215e9
Add collection number quota per DB (#23656) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-04-28 11:02:35 +08:00
smellthemoon
912cf4ef0f
Change some configurations, include change the defaultChannelNum to 16 (#23617) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-04-27 14:26:35 +08:00
yihao.dai
ed8836cd15
Add disk quota at the collection level (#23704) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-04-26 21:52:36 +08:00
wei liu
4fb8919a97
support collection level rate limit (#22767) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-04-25 15:54:35 +08:00
zhenshan.cao
03ec804e68
Change default shard number to 1 (#23586) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-04-21 07:08:32 +08:00
Jiquan Long
adfa415b74
Optimize log trace (#23431) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-04-17 11:00:30 +08:00
cai.zhang
43a9e175a3
Exit component process when session key is deleted (#21658) (#22164) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-04-12 20:12:28 +08:00
Jiquan Long
d85f673a95
Fix time tick lag too much (#23265) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-04-09 16:40:29 +08:00
jaime
c9d0c157ec
Move some modules from internal to public package (#22572) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-04-06 19:14:32 +08:00
Jiquan Long
8530dfadb4
Fix metric RootCoordInsertChannelTimeTick (#23236) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-04-06 15:30:29 +08:00
smellthemoon
ce91f61e5a
Pre-create topics (#21907) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-04-03 16:44:23 +08:00
zhenshan.cao
1287ca699a
Refine usage of TimeRecorder.Record (#23142) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-03-30 18:56:22 +08:00
yah01
081572d31c
Refactor QueryNode (#21625) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-03-27 00:42:00 +08:00
XuanYang-cn
93bc805933
Enhance ID allocator in DataNode (#22905) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2023-03-23 19:43:57 +08:00
SimFG
e8f8c1b445
Check the collection num when creating the collection (#22946) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-03-23 16:47:57 +08:00
yihao.dai
1f718118e9
Dynamic load/release partitions (#22655) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-03-20 14:55:57 +08:00
Jiquan Long
556c1cfc8a
Fix confused timetick log (#22733) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-03-14 09:55:54 +08:00
yah01
fa2c1c1f40
Fix RootCoord double updates TSO (#22715) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-13 18:01:53 +08:00
yah01
e1cb307690
Refine RootCoord services error handle (#22689) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-13 14:29:53 +08:00
yah01
be33911205
Refine RBAC init error handle (#22537) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-13 10:59:53 +08:00
wayblink
28390dfe09
Add bulkinsert integration test (#22621) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2023-03-10 11:03:52 +08:00
yah01
90a5aa6265
Refine errors, re-define error codes (#22501) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-09 15:47:52 +08:00
Jiquan Long
e3c11069eb
Fix ddl tt go back (#22617) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-03-08 10:13:51 +08:00
jaime
d126f06946
Decouple mq module from internal proto definition (#22536) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-03-04 23:21:50 +08:00
congqixia
51cb8590a1
Use errors.Wrap and Combine so retry error could check errors.Is (#22520) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-02 17:25:48 +08:00
Enwei Jiao
697dedac7e
Use cockroachdb/errors to replace other error pkg (#22390) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-02-26 11:31:49 +08:00
zhenshan.cao
e768437681
Correct usage of Timer and Ticker (#22228) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-02-23 18:59:45 +08:00
Jiquan Long
3cb9a44ed8
Add license to rootcoord module (#22301) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-02-22 11:37:45 +08:00
Jiquan Long
d9ca06eb4e
Fix max partition number don't work (#22216) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-02-16 16:34:38 +08:00