Commit Graph

117 Commits

Author SHA1 Message Date
xige-16
a965bdf325
[skip e2e]Fix golint for log QueryNode (#13671)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-17 22:26:50 +08:00
Xiaofan
b8d3808052
Fix Query Coord UT and cleanup logic (#13618)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-17 21:30:42 +08:00
xige-16
5864e5ea47
[skip ci] Fix golint for querycoord init (#13549)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-16 22:39:15 +08:00
xige-16
8259f81ae6
[skip ci] Fix golint for loadBalanceSegmentLoop (#13548)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-16 22:37:34 +08:00
xige-16
8f0b3ccd08
[skip ci] Fix golint for QueryNode (#13547)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-16 22:35:38 +08:00
xige-16
cf82a248d5
[skip ci]Fix golint for QueryNode (#13468)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-16 19:57:14 +08:00
xige-16
b404138ba7
[skip ci]Fix golint for chooseSegmentToBalance (#13303)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 22:19:10 +08:00
xige-16
7c18be6e08
[skip ci]Fix golint for loadBalanceSegmentLoop (#13302)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 21:01:10 +08:00
xige-16
97d5231a0a
Reorganize querycoord proto (#13181)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 16:53:12 +08:00
cai.zhang
9f23fc7f2a
Register the service when the component state is healthy (#13248)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 11:47:10 +08:00
xige-16
c68bae236e
[skip ci]Fix golint for watchHandoffSegmentLoop (#13301)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 07:01:09 +08:00
Xiangyu Wang
405b3cd932
Use the same lint rules with golint in revive (#13324)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
xige-16
9ccbffc4b1
[skip ci]Fix golint for watchNodeLoop (#13199)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-10 21:55:48 +08:00
xige-16
f85c1e8f1e
[skip ci]Fix golint for SetIndexCoord (#13198)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-10 21:54:01 +08:00
xige-16
63ead50544
[skip ci]fix golint for SetDataCoord (#13121)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-09 22:25:08 +08:00
xige-16
60d70e82fd
[skip ci]fix golint for SetRootCoord (#13120)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-09 22:23:22 +08:00
xige-16
1a83064d5a
[skip ci]fix golint for querycoord.start (#13119)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-09 22:21:43 +08:00
congqixia
de454956fe
Refactor session WatchSessions to allow rewatch when Rev Compacted (#12880)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-08 10:11:04 +08:00
congqixia
615b23a7b3
Update querycoord state to unhealthy before stopping (#12905)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-07 21:27:29 +08:00
xige-16
7d723abdff
Start balanceLoop when Params.autoBalance equal to true (#12660)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-06 10:19:41 +08:00
xige-16
e980516036
[skip ci] Fix golint of balanceLoop (#12736)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-06 10:07:35 +08:00
congqixia
4121e31df1
Send SIGINT to runner goroutine after etcd disconnects (#12163)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 16:23:17 +08:00
XuanYang-cn
de95a6c866
[skip ci]Update license for qc qn (#12015)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 19:47:36 +08:00
xige-16
8a0ee27799
Estimate segment size according index and binlog file header (#11875)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 09:47:12 +08:00
congqixia
5edbb82610
Add session revoke (#11908)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-16 22:31:14 +08:00
Xiaofan
71e814f796
Remove common.yaml and component.yaml (#11661)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-12 21:25:08 +08:00
xige-16
d857577a7b
Postpone the execution of handoff until index creation is complete (#11648)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-12 18:49:10 +08:00
xige-16
94b31e6bf9
Postpone the execution of handoff until index creation is complete (#11665)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-12 16:49:10 +08:00
xige-16
fcbe46ba75
Remove sealed segemnt from query node after compaction (#11430)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-08 21:00:02 +08:00
xige-16
9fcfbde368
Add getNodeInfoByID and getSegmentInfoByNode function for cluster (#11247)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-05 16:00:55 +08:00
Xiaofan
2df2d488e1
Fix Unit test fatal fail (#10933)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-30 10:24:38 +08:00
Xiaofan
6fddcb3925
Fix Session checker for proxy (#10737)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-27 21:58:33 +08:00
xige-16
9ebabdac79
Add handoffTask (#10330)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-24 22:39:09 +08:00
xige-16
8a046a6495
BroadCast sealedSegmentChangeInfo to queryChannel (#10084)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-22 19:07:15 +08:00
zhenshan.cao
d6f95f49e8
Fix golint error in querycoord (#10127)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-18 21:34:47 +08:00
congqixia
6b8ff60de3
Close event channel when watch event found error (#9819)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-14 19:20:35 +08:00
congqixia
ec6e8e4127
Hide liveChn into sessionutil and fix liveness init order (#9860)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-14 16:40:35 +08:00
dragondriver
5bbffeacfd
Expose created time and updated time to querycoord metrics (#9732)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-12 19:39:24 +08:00
groot
2cba5053a8
Add comment for QueryCoordComponent (#9648)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-11 19:00:46 +08:00
xige-16
235d736a49
Add max number of retries for interTask in querycoord (#8215)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-11 09:54:37 +08:00
zhenshan.cao
f6e4d8680e
[skip ci]Fix golint error in querycoord (#9596)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-09 20:53:10 +08:00
xige-16
98c26b56a6
[skip ci] Add comment for setDataCoord (#9409)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-07 19:52:46 +08:00
xige-16
ff5ddc2823
[skip ci] Add comment for setRootCoord (#9322)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-06 14:04:25 +08:00
xige-16
ed328f7aa5
[skip ci] Add comment for updateState (#9321)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-06 14:02:34 +08:00
xige-16
d3f6cffa98
[skip ci] Add comment for stop (#9320)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-06 14:00:47 +08:00
xige-16
52e6007233
[skip ci] Add comment for start (#9268)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-05 15:38:03 +08:00
xige-16
a866fc5c6f
[skip ci] Add comment for Init (#9267)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-05 15:36:17 +08:00
xige-16
2ef2ba4c81
[skip ci] Add comment for queryCoord (#9266)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-05 15:34:26 +08:00
xige-16
be98e95a6a
[skip ci] Add comment for TimeStamp (#9207)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-04 17:14:07 +08:00
Xiaofan
2c2b800ff4
Change Log Name with NodeId (#8721)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-01 08:52:50 +08:00
zhenshan.cao
d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal (#8542)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-29 20:26:00 +08:00
xige-16
d35b0718e7
Delete useless var in queryCoord struct (#8004)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-26 21:59:58 +08:00
xige-16
93c945d076
Init querycoord once (#8106)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-23 21:56:02 +08:00
congqixia
da6d93527d
Add session liveness check (#8408)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-23 18:29:55 +08:00
xige-16
c63086fefa
Add ut for querycoord's cluster (#7894)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-09-15 20:40:07 +08:00
dragondriver
1db573731b
Cache the system information metrics (#7436)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-03 17:15:26 +08:00
xige-16
055d94ede1
Add ut for queryCoord (#7212)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-26 14:17:54 +08:00
Xiaofan
58b2089692
Import Embedded Etcd Kv Part 1(#7112) (#7174)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-08-24 09:45:51 +08:00
XuanYang-cn
6c5be83ea1
Refactor NewEtcdKV API (#7075)
This PR mainly did the following 3 things:

- Refactor NewEtcdKV API
- Add unittests for `kv/etcd/`, raise the coverage
up to 94%
- Correct some APIs from version to revision

The old NewEtcdKV() API took `clientv3.Client` as
one of the input, making everyone who using this API
had to create a new `clientv3.Client`. So there're a lot
of repeated codes everywhere.

Meanwhile, someplace didn't even check whether the
`clientv3.New()` returned error or not, and the old API
also didn't check whether the clientv3.Client was Nil.
This caused issue#6955.

Ectd's version and revision have nothing alike, they
represent different concepts, but our APIs kind of
mixed them all up. So I correct those APIs' names.

Resolves: #6955

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-13 11:04:09 +08:00
xige-16
c8a1f780c1
Use proto marshal instead of MarshalTextString in querycoord (#6958)
* use proto marshal instead of marshalToText

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* log error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* don't retry after init meta/cluster/scheduler failed

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix return err

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* log inconsistent task info

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-03 22:03:25 +08:00
xige-16
87c5a49d9a
Refactor showCollection/showPartition to get load state in memory (#6935)
* refactor showCollection/showPartition to get load state in memory

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update milvus.proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add show result log to debug

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix wrong err message

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update pymilvus-orm version

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix repeated load error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix status nil error

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-02 22:39:25 +08:00
xige-16
2b720fd2f7
Fix load hang when restart querynode many time in short time (#6351)
* fix load hang when restart querynode many time in short time

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add multi queryNode ut

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add ut for restart querynode

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set queryCoord contex to load collection

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-07-13 14:16:00 +08:00
xige-16
f973456c10
filter delEvent when querynode register fail (#6150)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-27 12:16:09 +08:00
xige-16
6036ef2c7d
Fix standalone can't start after down (#6148)
* mutil go routine do registerNode and  deleteNode

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* stop retry create querynode client

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-26 22:28:10 +08:00
godchen
fd07a44dba
Fix error in retry refactor (#6000)
* Fix error in retry refactor

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-23 11:48:06 +08:00
godchen
99be4c09a5
change retry (#5996)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-23 09:24:10 +08:00
xige-16
2af1c27811
Rename queryservice to querycoordinator (#5931)
* Rename queryservice to querycoordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix param table

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix unittest

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* service to coordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set querycoord in ci

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-22 16:44:09 +08:00