Commit Graph

6865 Commits

Author SHA1 Message Date
yihao.dai
f1cc31ceee
Fix creating partition is not atomic (#23823)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-05-08 10:18:39 +08:00
Enwei Jiao
240c5625cd
Fix nil pointer access (#23919)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-05-08 10:08:39 +08:00
wayblink
e13d900398
Add some log in getIndexStatisticsTask (#23897)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-05-08 10:02:39 +08:00
smellthemoon
dcf55e77b5
Remove superfluous idempotent in proxy (#23894)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-05-07 21:08:39 +08:00
yihao.dai
fc010ee86b
Improve the metric of stored binlog size to the level of collection and segment (#23859)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-05-07 20:52:38 +08:00
yihao.dai
f0eb5e8563
Fix partition released but can be searched (#23872)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-05-06 17:42:39 +08:00
congqixia
345855c984
Make datanode load statslog lazy if SkipBFStatsLog is true (#23877)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-06 15:12:39 +08:00
congqixia
884f7904a1
Re-calculate segment entry num when binlog field is zero (#23883)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-06 14:24:39 +08:00
sre-ci-robot
8ffa8a28fa
Update knowhere commit (#23874)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-05-06 14:18:39 +08:00
Jiquan Long
7be7e6f360
Refactor check logic of index parameters (#23856)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-05-06 10:40:39 +08:00
wayblink
899702f13c
Implement GetIndexStatistics interface (#23603)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-05-06 10:34:39 +08:00
cai.zhang
c80d8f82ce
Reduce memory usage for diskann index (#23600)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-05-06 10:32:39 +08:00
Enwei Jiao
e172f3e8dc
Fix dependency conflict (#23847)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-05-04 19:46:38 +08:00
yihao.dai
02734d9eb0
Fix ignoring error when loading segment (#23830)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-05-04 15:10:39 +08:00
MrPresent-Han
b517bc9e6a
refine balance mechanism including:(#23454) (#23763) (#23791)
1. balance granuity to replica to avoid influence unrelated replicas
2. avoid balance back and forth

Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-05-04 12:22:40 +08:00
Xiaofan
87d790f052
Fix upgrade casue panic (#23833)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-05-02 14:06:37 +08:00
yihao.dai
4b26c0afb3
Add collection in querynode when sync new partitions (#23825)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-05-01 16:36:38 +08:00
yah01
62eea5286f
Support to filter with json expr (#23739)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-30 20:36:39 +08:00
Gao
c1e8406c44
Override index type as AUTOINDEX when autoindex is enabled (#23744)
Signed-off-by: chasingegg <gaoc96@qq.com>
2023-04-30 11:50:40 +08:00
yihao.dai
5a9a86ba74
Fix quota center assignment to entry in nil map (#23819)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-29 18:22:38 +08:00
Jiquan Long
c955c26656
Optimize log when rootcoord goroutine quit (#23698)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-04-29 16:06:42 +08:00
Jiquan Long
156eba846f
Fix synced timetick not updated properly (#23697)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-04-29 16:02:38 +08:00
Cai Yudong
028054ee0b
Update knowhere version (#23769)
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
2023-04-29 10:06:38 +08:00
wei liu
b6ae70db43
fix get replica return wrong node list (#23792)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-28 19:48:36 +08:00
smellthemoon
9d35a5f943
Fix num of partitions is wrong (#23780)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-04-28 15:20:36 +08:00
wei liu
537e068fb9
fix qupta_center calculate negative memory factor for rate limit (#23750)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-28 11:32:35 +08:00
yihao.dai
6f94bfd26d
Add constraint of releasing partitions before dropping (#23732)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-28 11:12:36 +08:00
yihao.dai
017b15af6a
Fix disk quota when there's no binlog file (#23776)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-28 11:10:35 +08:00
yihao.dai
8c060215e9
Add collection number quota per DB (#23656)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-28 11:02:35 +08:00
Gao
e467e0d451
Seperate reading build and load params for diskann (#23758)
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2023-04-27 20:30:35 +08:00
yah01
eab94489ba
Refine the merge algorithm (#23767)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-27 18:26:35 +08:00
wei liu
f36cdc182a
add retry on get recovery info (#23764)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-27 17:46:34 +08:00
Enwei Jiao
66a5efeb3d
Fix load failed with DiskANN (#23760)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-27 16:56:35 +08:00
sre-ci-robot
e988256467
Update knowhere commit (#23757)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-04-27 14:44:36 +08:00
smellthemoon
912cf4ef0f
Change some configurations, include change the defaultChannelNum to 16 (#23617)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-04-27 14:26:35 +08:00
Xiaofan
016311ad48
Fix Has Collection Failed on datacoord (#23710)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-04-27 09:50:34 +08:00
sre-ci-robot
8d3007b479
Update knowhere commit (#23727)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-04-27 09:20:43 +08:00
yihao.dai
ed8836cd15
Add disk quota at the collection level (#23704)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-26 21:52:36 +08:00
SimFG
5cd21893c8
Fix superusers' password verification problem (#23733)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-04-26 21:16:34 +08:00
wei liu
5244020336
ban auto balance channel (#23725)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-26 19:26:39 +08:00
smellthemoon
f0ababb420
Use merr in querynodev2 (#23652)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-04-26 17:06:34 +08:00
yah01
0d3fcd5d16
Add method to access nested field at once (#23720)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-26 14:16:34 +08:00
yah01
60fdd7e4f4
Introduce simdjson (#23644)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-26 10:30:34 +08:00
congqixia
796f9355ee
Fix global rateCollector init multiple times (#23703)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-26 10:16:36 +08:00
foxspy
6f4ed517de
add growing segment index (#23615)
Signed-off-by: xianliang <xianliang.li@zilliz.com>
2023-04-26 10:14:41 +08:00
wei liu
1deac692a0
fix nodeup block (#23634)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-25 19:20:37 +08:00
yah01
f8ff97fe29
Fix travel timestamp set unique leads to disable task merge (#23605)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-25 19:04:34 +08:00
wei liu
4fb8919a97
support collection level rate limit (#22767)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-25 15:54:35 +08:00
wei liu
6653e2c3b0
fix balance channel (#23631)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-25 10:22:37 +08:00
XuanYang-cn
72485c9eeb
Remove index check to trigger compaction (#23657)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-04-24 20:26:34 +08:00
yah01
e23af6406f
Add nested path for accessing json fields (#23651)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-24 17:14:34 +08:00
congqixia
6b29a991a5
Fix releasing non-loaded partition blocks forever (#23623)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-23 19:16:32 +08:00
wayblink
b7cb34b966
Add blank GetIndexStatistics interface (#23610)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-04-23 14:50:32 +08:00
yihao.dai
092d743917
Add support for getting vectors by ids (#23450)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-23 09:00:32 +08:00
sre-ci-robot
ccba1334dd
Update knowhere commit (#23595)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-04-21 15:34:31 +08:00
Enwei Jiao
2ced6660e2
Simplify makefile (#23583)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-21 14:16:33 +08:00
yah01
546080dcdd
Support to retrieve json (#23563)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-21 11:46:32 +08:00
zhenshan.cao
03ec804e68
Change default shard number to 1 (#23586)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-04-21 07:08:32 +08:00
yah01
71364056f9
Fix QueryNode may report succeeded to unsubscribe channel early (#23580)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-20 19:30:33 +08:00
LeoReeYang
a2ab94ec3d
remove unused code. (#23572)
Signed-off-by: LeoReeYang <LeoReeYang@outlook.com>
2023-04-20 17:56:32 +08:00
XuanYang-cn
d56771b7b7
Fix return too many nodeIDs (#23397)
See also: #23396

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-04-20 13:50:31 +08:00
congqixia
4a6c2b78a7
Fix multiple transferNewSegment and removeSegment causes panic (#23564)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-20 13:48:31 +08:00
yah01
aa2985490c
Retrieve page size by getpagesize() (#23561)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-20 12:36:30 +08:00
Enwei Jiao
967a97b9bd
Support json & array types (#23408)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
2023-04-20 11:32:31 +08:00
congqixia
4a22af6e1a
Unwatch channel in watch buffer (#23548)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-20 10:34:31 +08:00
Cai Yudong
2725d38b9e
Add COSINE metric type (#23350)
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
2023-04-20 10:20:31 +08:00
wei liu
4336ed8609
fix node up (#23415)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-20 09:52:31 +08:00
congqixia
4fe363c4b2
Add KNN cgo pool (#23526)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-19 23:56:31 +08:00
Enwei Jiao
f14c221123
Revert "Opt compile time for Mac (#23453)" (#23533)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-19 16:52:30 +08:00
yah01
c7c89511b6
Fix data race of timerecord (#23524)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-19 14:18:30 +08:00
Enwei Jiao
e9dcba3050
Opt compile time for Mac (#23453)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-19 10:24:30 +08:00
congqixia
4508786819
Fix test_watch_channel unit test unstable (#23507)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-19 10:00:31 +08:00
wei liu
3933080511
skip to balance redundant segment (#23490)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-18 18:32:32 +08:00
wei liu
cbfe7a45ef
fix pull target (#23491)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-18 18:30:32 +08:00
congqixia
eb690ef033
Fix querynodev2 stop logic (#23487)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-18 17:56:30 +08:00
congqixia
d83654c33f
Add Close method for ChannelManager in datacoord (#23493)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-18 17:54:31 +08:00
wayblink
b23723535c
Add log in AddImportSegment.getChannelLatestMsgID (#23480)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-04-18 17:50:31 +08:00
congqixia
b5a73e6d1a
Add OWNERS files for querycoordv2 sub pkgs (#23489)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-18 15:52:30 +08:00
yah01
5aa0ddf77b
Refine field storage of sealed segment (#23464)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-18 11:24:30 +08:00
zhenshan.cao
4a32b842e8
Improve the check logic of channel remove (#23473)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-04-18 02:58:30 +08:00
wei liu
3ad9ff7a9a
fix release segment failed (#23462)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-17 18:46:30 +08:00
Bennu
f63d52944f
Update knowhere version from main to commit_id (#23437)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-04-17 16:32:33 +08:00
aoiasd
695cc769df
Fix watch event timeout when IO Pool busy (#23293)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-04-17 11:02:30 +08:00
Jiquan Long
adfa415b74
Optimize log trace (#23431)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-04-17 11:00:30 +08:00
aoiasd
f603456b72
remove segment from datanode meta when segment dropped (#23398)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-04-17 10:58:30 +08:00
cqy123456
7ff6a3a246
Set query node thread pool size in milvus.yaml (#23286)
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2023-04-17 10:44:29 +08:00
yah01
7c4cafc83c
Fix task merge doesn't work (#23405)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-14 18:18:29 +08:00
Enwei Jiao
288582b2d9
Optimize mac build time (#23390)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-14 17:56:29 +08:00
zhenshan.cao
a88178a5ea
Add slow log for read (#23272)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-04-14 15:30:29 +08:00
yah01
bed8d6892e
Protect the QueryCoord meta from stale data migrated from old version (#23412)
Fix #23411

Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-14 14:42:28 +08:00
congqixia
ba84f52119
Fix watcher loop quit and channel shouldDrop logic (#23402)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-14 09:54:28 +08:00
congqixia
a9a5f76f74
Fix AddDistribution unit test (#23418)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-13 20:46:29 +08:00
yah01
dc0eb433ae
Add IoPoolSize config (#23360)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-13 14:50:28 +08:00
cai.zhang
43a9e175a3
Exit component process when session key is deleted (#21658) (#22164)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-04-12 20:12:28 +08:00
zhenshan.cao
dc5abe086c
Revert "Restrain gc files by collection (#22504)" (#23380)
This reverts commit fa86de530d.

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-04-12 19:38:28 +08:00
yah01
296380d6e6
Support async refresh (#23107)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-12 15:06:28 +08:00
Jiquan Long
a940df94c7
Forbid counting entities with pagination (#23375)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-04-12 14:22:34 +08:00
congqixia
6cd73d4e2a
Wait safe signal before release growing (#23358)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-11 17:56:31 +08:00
Jiquan Long
ad7f3d4c3e
Support Count(*) on querynodev2 (#23321)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-04-11 15:40:31 +08:00
congqixia
0527d2706c
Fix offline set always nil (#23340)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-11 14:42:30 +08:00
wei liu
dbbd703667
fix balance generate unexpected task (#23299)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-11 14:38:30 +08:00
congqixia
f1f8ce01de
Remove querynode v1 package (#23289)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-11 11:28:31 +08:00
yihao.dai
0b354cbab1
Fix timetick block caused by dml task pop failed (#23277)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-11 11:00:31 +08:00
congqixia
03a4f60b6e
Fix knowhere cpp header files name (#23330)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-10 20:00:30 +08:00
XuanYang-cn
b90fa5f459
Refine codes of datanode buffer (#23168)
This PR refines deltabuffer of datanode:
- Add last sync time for compacted segment, see also: #23210
- Ensure all deltabuffermanager handles all delete related operations
- Change usedMemory to atomic.Int64
- Remove allocator in delete buffer

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-04-10 18:42:30 +08:00
Jiquan Long
d85f673a95
Fix time tick lag too much (#23265)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-04-09 16:40:29 +08:00
cai.zhang
9288020da3
Fix bug for batch delete files on gcp of minio (#23052) (#23083) (#23090)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-04-09 16:22:30 +08:00
cai.zhang
bd65ef8e95
Fix bug for type params when indexing (#23242) (#23250)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-04-09 16:18:29 +08:00
Xiaofan
680ad482b7
Check balance checker chore to 10s (#23304)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-04-09 16:14:32 +08:00
MrPresent-Han
ba02e70301
fix bug when syncing distribution without schema and remove unused logic(#23085) (#23216)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-07 19:32:29 +08:00
wei liu
9f127dae47
enable balance channel (#23227)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-07 19:06:28 +08:00
congqixia
132c010271
Fix proxy panicking when QueryCoord offline (#23254)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-07 17:30:28 +08:00
Cai Yudong
55202ce7d9
Support show knowhere prometheus metrics (#23102)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2023-04-07 15:34:29 +08:00
Cai Yudong
5f4673fd16
Optimize unittest to save runtime (#23248)
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
2023-04-07 14:20:29 +08:00
congqixia
32be374c33
Fix MetaCache ut internal not changed (#23276)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-07 13:20:28 +08:00
jaime
c9d0c157ec
Move some modules from internal to public package (#22572)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-04-06 19:14:32 +08:00
Jiquan Long
8530dfadb4
Fix metric RootCoordInsertChannelTimeTick (#23236)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-04-06 15:30:29 +08:00
Jiquan Long
2c1c3aecfc
Fix metric ProxySyncTimeTickLag (#23235)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-04-06 15:28:33 +08:00
congqixia
8db24e0a83
Support queryHook in querynodev2 (#23140)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-06 14:32:29 +08:00
aoiasd
1a485044a9
fix NumConsumers metric not work (#23167)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-04-05 08:18:28 +08:00
congqixia
424570b2b8
Remove annoy related unit tests (#23229)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-05 08:14:28 +08:00
congqixia
4a53018e5f
Remove legacy annoy_inner_error (#23220)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-04 18:08:24 +08:00
Cai Yudong
ef63e64ded
Remove ANNOY index type (#23189)
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
2023-04-04 16:30:27 +08:00
congqixia
3af3fe52d8
Remove partition target check in querynodev2 (#23188)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-04 13:36:32 +08:00
Cai Yudong
9ad6d9f1a0
Rename RAFT_IVF_FLAT/RAFT_IVF_PQ to GPU_IVF_FLAT/GPU_IVF_PQ (#23194)
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
2023-04-04 11:44:26 +08:00
yah01
7da870f512
Remove useCustomConfig and simpilify the session type (#23166)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-03 20:10:24 +08:00
yihao.dai
17d3190fcc
Fix DescribeCollection failed with undefined msg type (#23192)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-03 19:52:24 +08:00
Enwei Jiao
4d2e379b09
Add prometheus-cpp (#23199)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-03 19:22:23 +08:00
smellthemoon
ce91f61e5a
Pre-create topics (#21907)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-04-03 16:44:23 +08:00
congqixia
42168f67fc
Add OWNERS file for qnv2 (#23196)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-03 16:22:24 +08:00
congqixia
e3e3ac1525
Use peek segment info in querynodev2 (#23183)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-03 16:10:24 +08:00
yah01
2a760c108c
Add metrics for QueryNodeV2 (#23163)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-03 15:24:24 +08:00
yihao.dai
b6f69fe7f2
Check if loaded before delegator search/query (#23162)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-03 14:26:23 +08:00
yihao.dai
9cecdc4f4e
Fix querynode panic (#23181)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-03 14:18:24 +08:00
MrPresent-Han
afd874b736
enhance segment balance by considering global rowCount(##22914) (#23056)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2023-04-03 14:16:25 +08:00
yihao.dai
a0ca4d6108
Improve search/query logs in Proxy (#23144)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-03 10:54:23 +08:00
Andy Pan
b8c1859aed
Bump ants to v2.7.2 for performance improvement (#22936)
Signed-off-by: Andy Pan <i@andypan.me>
Signed-off-by: Andy Pan <panjf2000@gmail.com>
2023-04-02 08:54:23 +08:00
Ten Thousand Leaves
1596abf6e8
Add lock for segment manager during bulk insert (#23111)
/kind bug

issue: #23106

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-03-31 20:16:24 +08:00
XuanYang-cn
be0827417a
Fix buffer calculate memorysize negative (#23152)
Along with the following small patches:
- And fix logging dup segmentIDs for delete buffer status
- Add String method for PriorityQueue to debug

See also: #23105

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2023-03-31 18:30:23 +08:00
congqixia
127867b873
Add ratedgroup for some info/warning log (#23095)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-03-31 15:22:23 +08:00
aoiasd
bd5fab1e53
Remove merge policy of proxy RoundRobin policy (#23021)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-03-31 14:36:22 +08:00
smellthemoon
22aeb72eba
Fix LoadSegment req don't fill in collection id (#23136)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-03-31 11:28:23 +08:00
Cai Yudong
7612c75c47
Let RAFT_IVF_PQ param accept m=0 (#23134)
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
2023-03-31 11:22:22 +08:00
yah01
75737c65ac
Refine error handle of QueryCoord (#23068)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-31 10:54:29 +08:00
zhenshan.cao
1287ca699a
Refine usage of TimeRecorder.Record (#23142)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-03-30 18:56:22 +08:00
yihao.dai
a182594bf5
Add FlushAll support (#22942)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-03-30 11:28:25 +08:00
wei liu
74da53c027
fix update load percentage (#23054)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-03-30 10:48:23 +08:00
Jiquan Long
0f2c3ac832
Optimize log (#23121)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-03-30 10:44:22 +08:00
Enwei Jiao
50dab2d394
Add tracing for retrieve (#23033)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-03-29 18:10:02 +08:00
aoiasd
970dcb3161
Fix panic because timestamp was nil (#23096)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-03-29 17:20:04 +08:00