groot
8da44638ac
Refine json parser for import ( #20545 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-16 19:05:08 +08:00
yah01
31872f436c
Only balance segments in targets ( #20635 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-16 14:33:11 +08:00
cai.zhang
35db3d2352
Reduce log frequency in IndexCoord ( #20629 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-16 14:23:09 +08:00
congqixia
b0a07983ce
Limit concurrency of decoded index file and do force gc ( #20587 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 21:15:11 +08:00
cai.zhang
3c09a5f2e8
Use GetSegmentUnsafe when get unhealthy segment ( #20617 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-15 19:55:07 +08:00
bigsheeper
2d307c1909
Set delBuf's start-end position of compacted segment ( #20614 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-15 19:41:16 +08:00
XuanYang-cn
51093dfccd
Add a string func for allocation ( #20611 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-15 19:21:12 +08:00
congqixia
ac9a993a39
Fix querynode panics when watch/unsub runs concurrently ( #20606 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 19:03:08 +08:00
aoiasd
d8f8296b03
Make internal proxy use internal port and isolate internal interface and external interface in proxy grpc server ( #20558 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-11-15 16:53:07 +08:00
Ten Thousand Leaves
f3ef430c2e
Keep individual segment's updates in a single Etcd operation ( #20525 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-15 16:45:07 +08:00
congqixia
35ebd17fe4
Remove not needed RLock for getVersion ( #20596 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-15 15:35:08 +08:00
MrPresent-Han
c848896bc8
Fix panic error due to rollDeleteOp ahead by load-and-delete ( #20563 )
...
issue:#20501
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2022-11-15 14:45:07 +08:00
bigsheeper
db33ffa518
Pass endPosition with vchannel in datanode flowgraph ( #20589 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-15 14:37:07 +08:00
zhenshan.cao
c5dc076b04
Fix start of DataCoord ( #20581 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-11-15 14:19:06 +08:00
yah01
2d806788fb
Add version for subscribed channel ( #20585 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-15 13:21:07 +08:00
Ten Thousand Leaves
480a2b8632
Improve compaction logs ( #20490 )
...
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-15 11:13:07 +08:00
Xiaofan
58ae746f69
Fix GC Tuner Overflow ( #20497 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-15 10:43:06 +08:00
XuanYang-cn
3b45189ce9
Refine query logs ( #20559 )
...
See also: #20406
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-15 10:37:08 +08:00
yah01
d37ebe538b
Record load latency for loaded collection ( #20538 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-15 10:11:07 +08:00
yah01
bec1d4c50f
Revert "Make proxy process data definition requests concurrently ( #20503 )" ( #20566 )
...
This reverts commit 911921d5a7
.
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-15 00:41:06 +08:00
liliu-z
0ae4e5265f
Optimize some low efficient code ( #20529 )
...
Signed-off-by: Li Liu <li.liu@zilliz.com>
Signed-off-by: Li Liu <li.liu@zilliz.com>
Co-authored-by: Li Liu <liliu@LideMacBook-Pro.local>
2022-11-14 21:05:07 +08:00
bigsheeper
e73bdbe17d
Disk quota only checks healthy segments ( #20574 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-14 21:03:09 +08:00
smellthemoon
a7ba416b5a
Remove invalid timestamp ( #20557 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-11-14 16:21:07 +08:00
yah01
911921d5a7
Make proxy process data definition requests concurrently ( #20503 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-14 16:03:07 +08:00
smellthemoon
7325b3e1c3
Substitute traceid for msgid in rpc ( #20450 )
...
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-11-14 15:29:06 +08:00
wei liu
6a2e458f90
fix collection not exist cause query coord panic ( #20553 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-14 14:51:06 +08:00
Xiaofan
af66a0b621
Fix Time Tick session2ChanTs map use the same nodeID ( #20537 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-14 14:41:11 +08:00
cai.zhang
2b02b869ec
Return real-time indexed rows and total rows ( #20460 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-14 14:37:07 +08:00
groot
e217b951ee
Fix bulkinsert bug for int64 value ( #20491 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-14 10:15:10 +08:00
bigsheeper
fc15789da9
Ensure compatibility of channel seek position and move syncPeriod to config ( #20504 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-12 21:09:04 +08:00
congqixia
c21497fbb4
Filter fake segments for recovery info ( #20493 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-11 18:03:05 +08:00
yah01
a82c235599
Scheduler should returns err if the queue is full ( #20465 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-11 17:55:05 +08:00
yah01
1a7912e300
Fix checkFullLoaded always returns all partitions as unloaded ( #20514 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-11 16:17:04 +08:00
wei liu
eaa5cfdcb5
fix leader observer sync logic ( #20478 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-11 11:43:06 +08:00
wei liu
701e7b5a6e
support pulsar tenant and auth ( #19727 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-11 10:55:05 +08:00
bigsheeper
cd19d99ad7
Add channel level checkpoint ( #20350 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-10 22:13:04 +08:00
yah01
663bdf3399
Add RootPath field back ( #20488 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-10 19:43:03 +08:00
wei liu
7537dbfa37
skip balance on loading collection ( #20483 )
...
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-10 17:53:04 +08:00
aoiasd
fca2b71e28
add access log for proxy ( #19927 )
...
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-11-10 17:09:06 +08:00
yah01
c71c6378ff
Clear stale replicas ( #20456 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-10 17:01:03 +08:00
liliu-z
174310a14e
Use all() api for bitset check ( #20462 )
...
Signed-off-by: Li Liu <liliu@LideMacBook-Pro.local>
Signed-off-by: Li Liu <liliu@LideMacBook-Pro.local>
Co-authored-by: Li Liu <liliu@LideMacBook-Pro.local>
2022-11-10 16:15:05 +08:00
yah01
a68cec85af
Refine QueryCoordV2 metrics ( #20461 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-10 15:01:04 +08:00
XuanYang-cn
6bff0b6688
Remove too frequent logs ( #20454 )
...
Half of the log messages come from this log if DataNode in stale.
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-10 14:51:05 +08:00
cai.zhang
03c2a280c1
Drop fail jobs on indexnode ( #20425 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-10 12:15:03 +08:00
wgcn
864b9d5953
improve search latency ( #20426 )
...
Signed-off-by: wgcn 1026688210@qq.com
Signed-off-by: wgcn <1026688210@qq.com>
Signed-off-by: wgcn <1026688210@qq.com>
2022-11-10 11:51:03 +08:00
SimFG
c08657e079
Remove the unnecessary lock in the shard_cluster ( #20414 )
...
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-11-10 10:59:04 +08:00
groot
53850e340c
Dont expire pending import tasks ( #20431 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-10 10:25:08 +08:00
liliu-z
0dc659a04c
Upgrade Knowhere to 1.3.3 to fix potential bugs ( #20434 )
...
Signed-off-by: Li Liu <liliu@LideMacBook-Pro.local>
Signed-off-by: Li Liu <liliu@LideMacBook-Pro.local>
Co-authored-by: Li Liu <liliu@LideMacBook-Pro.local>
2022-11-09 20:19:04 +08:00
Jiquan Long
449e4f9153
Fix delete log ( #20407 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-09 19:17:04 +08:00
Jiquan Long
0edb49209d
Fix rootcoord metrics ( #20427 )
...
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-09 17:49:04 +08:00