Commit Graph

51 Commits

Author SHA1 Message Date
xige-16
6336e2326c
Set triggerCondition when queryCoord reload loadbalanceTask meta (#15380)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-25 17:26:13 +08:00
Xieql
1e7c51859a
[skip e2e] Improve annotation (#14799)
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2022-01-05 10:33:30 +08:00
xige-16
a304684b55
Delete useless var in watchDeletaChannelTask (#14641)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-04 19:21:31 +08:00
Xieql
c7d47cefcd
[skip e2e] Improve annotation (#14717)
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2022-01-04 19:15:42 +08:00
xige-16
903e67b0ec
Fix recovery failed after query node down (#14449)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-29 12:15:21 +08:00
xige-16
8e2e9c3735
Fix wrong meta when balance's watchQueryChannel task failed (#14235)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-25 23:12:50 +08:00
xige-16
4e4ff54d98
Watch query channel to near the latest position (#13682)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-21 13:50:54 +08:00
xige-16
11c8461c11
Refactor dmChannelWatchInfo to queryCoord meta (#13543)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-21 11:57:39 +08:00
xige-16
97d5231a0a
Reorganize querycoord proto (#13181)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 16:53:12 +08:00
Xiangyu Wang
405b3cd932
Use the same lint rules with golint in revive (#13324)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
dragondriver
255be8f4a8
Fix querycoord panic when close before init scheduler (#13051)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-11 10:15:13 +08:00
JackLCL
554b7918e9
[skip ci]Fix error log output format in task_scheduler.go (#13129)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-10 10:16:03 +08:00
jaime
4e538f9929
[skip ci] Fix a grammar mistake in querycoord task_scheduler (#13126)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-10 10:11:59 +08:00
xige-16
99397535be
Fix update rollBackTask after triggerTask fail (#12228)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-24 10:19:15 +08:00
xige-16
d666c2a190
Fix txn limit error when querycoord remove task from etcd (#12084)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-18 19:35:15 +08:00
XuanYang-cn
3acb73ebe6
[skip ci]Update license for qc task (#12016)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 19:49:32 +08:00
Xiaofan
f654621650
Remove the etcd deletion of segment data path on querynode (#11863)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-17 12:13:10 +08:00
xige-16
8a0ee27799
Estimate segment size according index and binlog file header (#11875)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 09:47:12 +08:00
xige-16
fcbe46ba75
Remove sealed segemnt from query node after compaction (#11430)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-08 21:00:02 +08:00
godchen
09f8fa1040
Add query coord watch delta channel (#11218)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-05 14:47:19 +08:00
xige-16
373722d1ca
Load segment before watch dmCahnnel when load collection (#10831)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-29 18:36:40 +08:00
xige-16
6d43ac4a6e
Fix load segment request too large (#10812)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-28 17:26:28 +08:00
xige-16
0cedd9d47e
Compaction multiSegmentChangeInfo to a single info (#10587)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-26 15:18:22 +08:00
xige-16
9ebabdac79
Add handoffTask (#10330)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-24 22:39:09 +08:00
xige-16
8a046a6495
BroadCast sealedSegmentChangeInfo to queryChannel (#10084)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-22 19:07:15 +08:00
xige-16
f68a3358dd
Fix multiSave childTask failed to etcd (#10340)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-21 12:18:36 +08:00
xige-16
c298a14e08
Fix golint error of PopTask in queryCoord (#10232)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-20 11:12:35 +08:00
xige-16
a1902f5eec
[skip ci] Add comment for waitActivateTaskDone (#10140)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-19 14:11:18 +08:00
xige-16
500d3eef2b
[skip ci] Add comment for processLoop (#10139)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-19 14:09:00 +08:00
zhenshan.cao
d6f95f49e8
Fix golint error in querycoord (#10127)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-18 21:34:47 +08:00
xige-16
e80fbd1f19
Fix golint error in the task of querycoord (#9866)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-14 20:18:33 +08:00
xige-16
a0fb28fea4
[skip ci] Add comment for taskScheduler close (#9756)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-12 23:38:43 +08:00
xige-16
83c3a677cc
[skip ci] Add comment for taskScheduler start (#9755)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-12 23:36:47 +08:00
xige-16
f8054a409e
[skip ci] Add comment for scheduler's taskChan (#9686)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-11 21:42:33 +08:00
xige-16
0855347576
[skip ci] Add comment for newTaskScheduler (#9687)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-11 21:08:30 +08:00
xige-16
235d736a49
Add max number of retries for interTask in querycoord (#8215)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-11 09:54:37 +08:00
xige-16
b6cc36894b
[skip ci] Add comment for popTask (#9592)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-09 20:19:10 +08:00
xige-16
152d7dfa92
[skip ci] Add comment for enqueue (#9593)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-09 19:54:16 +08:00
xige-16
cc07fc5f29
[skip ci] Add comment for taskScheduler (#9513)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-09 00:02:09 +08:00
xige-16
8798c31c73
[skip ci] Add comment for newTaskQueue (#9512)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-09 00:00:17 +08:00
xige-16
62fa281dbb
[skip ci] Add comment for taskQueue (#9511)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-08 23:58:22 +08:00
xige-16
c63086fefa
Add ut for querycoord's cluster (#7894)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-15 20:40:07 +08:00
XuanYang-cn
6c5be83ea1
Refactor NewEtcdKV API (#7075)
This PR mainly did the following 3 things:

- Refactor NewEtcdKV API
- Add unittests for `kv/etcd/`, raise the coverage
up to 94%
- Correct some APIs from version to revision

The old NewEtcdKV() API took `clientv3.Client` as
one of the input, making everyone who using this API
had to create a new `clientv3.Client`. So there're a lot
of repeated codes everywhere.

Meanwhile, someplace didn't even check whether the
`clientv3.New()` returned error or not, and the old API
also didn't check whether the clientv3.Client was Nil.
This caused issue#6955.

Ectd's version and revision have nothing alike, they
represent different concepts, but our APIs kind of
mixed them all up. So I correct those APIs' names.

Resolves: #6955

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-13 11:04:09 +08:00
xige-16
c8a1f780c1
Use proto marshal instead of MarshalTextString in querycoord (#6958)
* use proto marshal instead of marshalToText

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* log error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* don't retry after init meta/cluster/scheduler failed

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix return err

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* log inconsistent task info

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-03 22:03:25 +08:00
xige-16
87c5a49d9a
Refactor showCollection/showPartition to get load state in memory (#6935)
* refactor showCollection/showPartition to get load state in memory

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update milvus.proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add show result log to debug

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix wrong err message

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update pymilvus-orm version

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix repeated load error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix status nil error

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-02 22:39:25 +08:00
xige-16
2a42244ff6
fix watchQueryChannelTask's info can't be deleted from etcd (#6568)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-07-16 10:21:55 +08:00
xige-16
2b720fd2f7
Fix load hang when restart querynode many time in short time (#6351)
* fix load hang when restart querynode many time in short time

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add multi queryNode ut

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add ut for restart querynode

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set queryCoord contex to load collection

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-07-13 14:16:00 +08:00
xige-16
ddb027fb9e
clear proxy sarchStream when releaseCollection (#6258)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-07-02 10:40:13 +08:00
godchen
49a0528d53
Fix trace (#6218)
* Fix trace

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-30 16:18:13 +08:00
xige-16
5417fee45f
fix releasePartition not work after loadCollection (#6025)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-23 17:44:12 +08:00