Commit Graph

54 Commits

Author SHA1 Message Date
xige-16
d666c2a190
Fix txn limit error when querycoord remove task from etcd (#12084)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-18 19:35:15 +08:00
XuanYang-cn
3acb73ebe6
[skip ci]Update license for qc task (#12016)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 19:49:32 +08:00
xige-16
55d162356b
Fix wrong set of segmentLoadInfo.enableIndex (#11964)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 14:37:11 +08:00
xige-16
8a0ee27799
Estimate segment size according index and binlog file header (#11875)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 09:47:12 +08:00
godchen
4cd7680f87
Reschedule load segments (#11391)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-13 08:49:08 +08:00
xige-16
d857577a7b
Postpone the execution of handoff until index creation is complete (#11648)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-12 18:49:10 +08:00
xige-16
dba0ae4421
Refactor segment allocate policy on querycoord (#11181)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-11 12:56:42 +08:00
xige-16
fcbe46ba75
Remove sealed segemnt from query node after compaction (#11430)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-08 21:00:02 +08:00
xige-16
82c199227c
Add execute logic for balancing sealed segments (#11343)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-06 15:22:56 +08:00
godchen
09f8fa1040
Add query coord watch delta channel (#11218)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-05 14:47:19 +08:00
xige-16
6d43ac4a6e
Fix load segment request too large (#10812)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-28 17:26:28 +08:00
xige-16
2f53a57814
Fix too large request when load collection (#10768)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-27 19:32:21 +08:00
xige-16
a414d16c06
Fix remove segment when querynode receive segmentChangeInfo (#10619)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-26 13:04:18 +08:00
xige-16
9ebabdac79
Add handoffTask (#10330)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-24 22:39:09 +08:00
zhenshan.cao
40750f03c7
Enhance querycoord log (#10523)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-24 15:16:00 +08:00
xige-16
8a046a6495
BroadCast sealedSegmentChangeInfo to queryChannel (#10084)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-22 19:07:15 +08:00
godchen
d6bf0c928f
Get stats delta path from datacoord (#10362)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 14:31:13 +08:00
congqixia
f9408259b4
Add comment for shuffleSegmentsToQueryNode (#10336)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-21 11:08:37 +08:00
xige-16
ef6de3e122
Comment MaxSendSizeToEtcd (#10165)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-21 10:53:09 +08:00
xige-16
1103ca8fca
Fix golint error in condition of queryCoord (#10230)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-21 10:51:14 +08:00
xige-16
c5bba3ec2d
Fix assign load segment req error (#10310)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-20 22:32:36 +08:00
congqixia
e8a7c482c8
Use proto Size to calculate req size (#10294)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-20 19:27:27 +08:00
xige-16
f467260208
Split large loadSegmentReq to multi small reqs (#10125)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-19 10:40:35 +08:00
zhenshan.cao
d6f95f49e8
Fix golint error in querycoord (#10127)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-18 21:34:47 +08:00
xige-16
759603671c
[skip ci] Add comment for loadPartitionTask (#10028)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-16 22:01:15 +08:00
xige-16
59764d17bf
[skip ci] Add comment for ReleasePartitionTask (#10027)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-16 21:55:24 +08:00
xige-16
1b50695a40
[skip ci] Add comment for ReleaseCollectionTask (#10026)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-16 21:43:32 +08:00
xige-16
da5195aab8
[skip ci] Add comment for LoadCollectionTask (#9989)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-15 20:29:15 +08:00
xige-16
56466508cc
[skip ci] Add comment for maxRetryNum (#9988)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-15 20:25:08 +08:00
xige-16
e80fbd1f19
Fix golint error in the task of querycoord (#9866)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-14 20:18:33 +08:00
zhenshan.cao
609cc24309
Fix golint error in querycoord (#9836)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-13 21:46:32 +08:00
xige-16
e481a2775a
[skip ci] Add comment for set child task (#9837)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-13 21:26:33 +08:00
xige-16
c84600a496
[skip ci] Add comment for set taskID (#9835)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-13 21:24:41 +08:00
xige-16
ddf0cd2174
[skip ci] Add comment for taskID (#9833)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-13 21:22:47 +08:00
xige-16
c2731dddff
[skip ci] Add comment for task state (#9757)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-12 23:40:36 +08:00
xige-16
235d736a49
Add max number of retries for interTask in querycoord (#8215)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-11 09:54:37 +08:00
godchen
937dbf4279
Add flushed segments (#9476)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-08 19:09:12 +08:00
xige-16
9400694867
Add ut for querycoord's meta (#7968)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-29 09:56:04 +08:00
xige-16
85c2b4d0f6
Add log for releasePartion task (#8222)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-23 21:06:02 +08:00
xige-16
e75693e1a3
Add log for release collection task (#8226)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-18 18:45:51 +08:00
xige-16
c63086fefa
Add ut for querycoord's cluster (#7894)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-15 20:40:07 +08:00
bigsheeper
b7103357fd
Load failed if collection beyonds the memory limit (#7434)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-07 11:35:18 +08:00
xige-16
c8a1f780c1
Use proto marshal instead of MarshalTextString in querycoord (#6958)
* use proto marshal instead of marshalToText

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* log error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* don't retry after init meta/cluster/scheduler failed

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix return err

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* log inconsistent task info

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-03 22:03:25 +08:00
xige-16
87c5a49d9a
Refactor showCollection/showPartition to get load state in memory (#6935)
* refactor showCollection/showPartition to get load state in memory

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update milvus.proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add show result log to debug

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix wrong err message

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update pymilvus-orm version

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix repeated load error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix status nil error

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-02 22:39:25 +08:00
xige-16
2b720fd2f7
Fix load hang when restart querynode many time in short time (#6351)
* fix load hang when restart querynode many time in short time

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add multi queryNode ut

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add ut for restart querynode

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set queryCoord contex to load collection

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-07-13 14:16:00 +08:00
xige-16
ddb027fb9e
clear proxy sarchStream when releaseCollection (#6258)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-07-02 10:40:13 +08:00
godchen
2a07124885
Change default grpc retry config (#6233)
* Change default grpc retry config

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* add retry code

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change time

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-01 15:24:17 +08:00
Cai Yudong
a7a9eeeffe
Add time record for build index and search process (#6231)
* add timerecord for build index process

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix build error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add timerecord for query process

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-30 19:46:14 +08:00
xige-16
f146d3825f
Fix search hang after querynode restart (#6212)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-30 17:48:19 +08:00
godchen
49a0528d53
Fix trace (#6218)
* Fix trace

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-30 16:18:13 +08:00