bigsheeper
338e32362b
Return error if setSegment failed when loadSegment ( #8075 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-18 10:03:50 +08:00
bigsheeper
691e4c5bc9
Use definitional type instead of raw type ( #7797 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-14 10:25:26 +08:00
bigsheeper
cb5cd1cf12
Add index unittests for query node ( #7674 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-10 17:11:09 +08:00
bigsheeper
b7103357fd
Load failed if collection beyonds the memory limit ( #7434 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-07 11:35:18 +08:00
bigsheeper
b9d3897deb
Return error when any failed detected in loadSegment ( #7005 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-08-12 14:14:08 +08:00
bigsheeper
4123deef9e
Return error message in grpc.LoadSegment in query node ( #6908 )
...
* return load error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* init streaming meta in loadSegment
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* fix excluded init
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* improve impl
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-08-03 22:01:27 +08:00
bigsheeper
e8ea8b51d5
improve query node log ( #6897 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-07-31 10:47:22 +08:00
godchen
db94d7771f
Read vector from disk ( #6707 )
...
* Read vector from disk
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix git action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix test error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix caculate error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change var name
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix len error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused code
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change bytes to float method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change float to bytes method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-24 09:25:22 +08:00
Cai Yudong
a7b27db63e
update fillRetrieveResults parameter ( #6598 )
...
* update fillRetrieveResults parameter
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize fillVectorFieldData process
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-17 15:17:30 +08:00
Cai Yudong
a992dcf6a8
Support query return vector output field ( #6570 )
...
* improve code readibility
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add offset in RetrieveResults
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add VectorFieldInfo into Segment struct
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add new interface for query vector
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update load vector field logic
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update load vector field logic
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fill in field name in query result
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add FieldId into FieldData
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add fillVectorOutputFieldsIfNeeded
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update data_codec_test.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add DeserializeFieldData
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* realize query return vector output field
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* disable query vector case
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-16 17:19:55 +08:00
xige-16
2b720fd2f7
Fix load hang when restart querynode many time in short time ( #6351 )
...
* fix load hang when restart querynode many time in short time
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add multi queryNode ut
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add ut for restart querynode
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* set queryCoord contex to load collection
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-07-13 14:16:00 +08:00
Cai Yudong
95135c1681
fix blob file sort error ( #6184 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-29 13:24:15 +08:00
xige-16
2af1c27811
Rename queryservice to querycoordinator ( #5931 )
...
* Rename queryservice to querycoordinator
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix param table
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* code format
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix unittest
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* service to coordinator
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* code format
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* set querycoord in ci
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-22 16:44:09 +08:00
xige-16
7039fb7c82
Fix the problem of stuck after loadBalance and loadFieldData error ( #5960 )
...
* delete nodeInfo after nodeDown
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix load balance can's stop
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix load field data error
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* contiue task loop after error in queryService
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-22 14:10:09 +08:00
sunby
7f2d7c1da3
Rename dataservice to datacoordinator ( #5912 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-21 18:22:13 +08:00
Cai Yudong
92e429d812
Rename IndexService to IndexCoord ( #5932 )
...
* rename package indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix queryservice static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move distributed/indexservice to distributed/indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move internal/indexservice to internal/indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename MasterComponent to RootCoordComponent
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for queryservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for dataservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for datanode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for proxynode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for querynode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename IndexService to IndexCoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename IndexService to IndexCoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix rebase issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-21 17:28:03 +08:00
FluorineDog
255e3959af
support time travel ( #5894 )
...
* support time travel
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
* lint
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-19 17:38:11 +08:00
xige-16
e4c51aae36
Add recovery logic for querynode and queryservice ( #5843 )
...
* merge milvus/recovery2
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add recovery logic in queryservice
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* debug smoke case
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add etcd to querynode
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix release partition error
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix load balance error
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* debug querynode down and recovery
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add log
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix showCollection
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* skip smoke test search without insert
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-19 11:45:09 +08:00
xige-16
97049ce293
use dataservice's getRecoveryInfo to get load and watch info ( #5790 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-16 11:09:56 +08:00
bigsheeper
cdbc6d2c94
Refactor query node and query service ( #5751 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-15 12:41:40 +08:00
Xiangyu Wang
82ccd4cec0
Rename module ( #4988 )
...
* Rename module
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
bigsheeper
71b8f309b2
Add licence to query node and query service
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-19 13:47:10 +08:00
godchen
deba964590
Change name of kvBase
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-12 18:09:28 +08:00
xige-16
332b14c915
Delete querynode’s redundant load IO
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-04-07 18:29:19 +08:00
zhenshan.cao
c2734fa55f
Fix bug and enchance system
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-22 16:36:10 +08:00
godchen
f3649f0419
Refactor interface and proto
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-12 14:22:09 +08:00
xige-16
09ae985daa
Fix wrong error code in master_service_test.go
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-10 22:06:22 +08:00
quicksilver
455cc59dbb
Update publish-test-images.yaml
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-09 13:55:35 +08:00
ThreadDao
7a3223dc81
tags collection stats
...
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-03-08 10:09:48 +08:00
quicksilver
74154a11a4
Fix deploy error during regression stage
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-05 16:52:45 +08:00
sunby
ddddd65d10
Delete internal/errors package
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-05 10:15:27 +08:00
xige-16
6cdd4d02fc
Refactor seek function
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-04 14:49:51 +08:00
godchen
7b9fdd7f29
Add opentracing
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-26 17:44:24 +08:00
bigsheeper
9edbff0a6b
Fix fields check
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-26 11:15:44 +08:00
bigsheeper
08a020798e
Release collection and partitions
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-24 17:24:51 +08:00
xige-16
d5379a82a8
Fix load binlog error when segment not flushed
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-23 14:13:33 +08:00
yukun
e786ad6aa8
Fix inconsistency of produce msg and consume msg with rmq
...
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-02-22 16:34:15 +08:00
sunby
b07a371f25
Create a goroutine to receive msg for every consumer
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-22 09:58:34 +08:00
xige-16
861576f77a
Checkout field ids when load segment in query node
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-22 10:44:38 +08:00
bigsheeper
e9ee9a273e
Refactor load service and check insertion binLog periodically
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-06 11:35:35 +08:00