Commit Graph

7087 Commits

Author SHA1 Message Date
zhenshan.cao
03e3b4beb4
Add log to startup process (#5594)
* Add log to startup process

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fixbug: avoid ctx exceed deadline

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fmt code

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fix bug: wrong time unit

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fixbug: datanservice client reconnect use time ctx

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-04 16:29:35 +08:00
Cai Yudong
2ba93deb5e
Support master get segment info channel name from config file (#5606)
* optimize msgstream unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* get data service segment info channel name from config file directly

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-04 16:28:34 +08:00
binbin
4aefdaeabe
[skip ci] interface name changed. (#5595)
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2021-06-04 14:23:35 +08:00
Xiangyu Wang
afa5da7df0
Add query rpc into proto (#5592)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-06-04 12:02:34 +08:00
FluorineDog
9a90313390
Support GetEntityByIDs in CGo, fix segcore bugs (#5563)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-04 10:38:34 +08:00
yanliang567
f9e03c5468
[skip ci] Add Chaos tests (#5579)
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2021-06-04 10:33:34 +08:00
Xiangyu Wang
0b00eacd90 Update Mergify
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-06-04 10:26:53 +08:00
紫晴
e4e5cf1e3b
[skip ci] Update common code and test cases for partition (#5580) 2021-06-04 09:35:34 +08:00
quicksilver
0a205ec9d6
Rename Milvus archived log files (#5583)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-03 23:54:39 +08:00
Xiangyu Wang
e80f06c030
Add retrieve process log (#5561)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-06-03 20:56:33 +08:00
binbin
786c335b9f
Add test cases for collection search (#5552)
* [skip ci] Add test cases for collection search.

Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>

* [skip ci] Resolve comments for PR 5552.

Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2021-06-03 20:02:34 +08:00
Xiangyu Wang
f791ccb246 Update OWNERS file
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-06-03 20:01:24 +08:00
Xiangyu Wang
e2af77afa7
Update pymilvus version (#5572)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-06-03 19:53:33 +08:00
yukun
57ece4a771
Fix retrieve_collection bugs (#5575)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-03 19:41:33 +08:00
dragondriver
99699b2021
Support to show collections which are loaded into memory (#5567)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-03 19:09:33 +08:00
godchen
0610ceb3dc
Fix ut error (#5573)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-03 18:44:33 +08:00
dragondriver
e76830ab09
Support column-based insert request in proxy (#5560)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-03 15:03:34 +08:00
zhenshan.cao
b0b8f58192
Fix bug: search timeout (#5557)
* Fix bug: search timeout

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Add log and fix unittest bug

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-03 14:58:34 +08:00
ThreadDao
c47b157511
Regress and fix issues (#5550)
* add case of insert

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* add insert cases

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* test insert

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* test insert data

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* fix codacy

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* regress and fix issues

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* [skip ci] add binary not match dim case

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-06-03 10:52:32 +08:00
Cai Yudong
4018dfc5b7
Support data segment channel seek to the break point when system start (#5540)
* add DecodeDdOperation

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* reload MsgPosition from etcd and seek when system start

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename const string

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize master unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add msg into dataSegmentChannel to test seek

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix seek test

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* roll back distributed/masterservice/masterservice_test.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-02 22:36:41 +08:00
紫晴
176109065e
[skip ci] Update codes of connection (#5542)
* Update codes of connection

Signed-off-by: wangting0128 <ting.wang@zilliz.com>

* [skip ci] Update log for test

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2021-06-02 19:21:33 +08:00
yukun
dcb4161c9f
Fix retrieve_service (#5531)
* Fix retrieve_service

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix retrieve_collection

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-02 19:18:33 +08:00
紫晴
56da071cce
Add test cases of connection (#5517)
* Add test cases of connection

Signed-off-by: wangting0128 <ting.wang@zilliz.com>

* Update code

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2021-06-01 18:49:31 +08:00
quicksilver
cc517570ab
Load variables into shell scripts (#5518)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-01 14:52:31 +08:00
Cai Yudong
d5cd561449
Add metrics for master (#5515)
* metric

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* metric

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add MasterDDChannelTimeTick for metrics

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add metrics for all master grpc

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* register metrics

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add metrics register

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add comments for codacy check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix format issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-01 11:04:31 +08:00
Xiangyu Wang
f3fb0f8b00
Change partition_tag to partition_name (#5514)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-31 20:02:30 +08:00
ThreadDao
316b6fbd43
Add test cases of insert data (#5512)
* add case of insert

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* add insert cases

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* test insert

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* test insert data

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* fix codacy

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-05-31 19:23:31 +08:00
yukun
48f35ffa97
Add publishRetrieveResult (#5501)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-31 18:08:32 +08:00
godchen
918458a1be
Add msgstream seek (#5483)
* Add msgstream seek

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change test name

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove file

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* resolve conversation

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-31 17:46:30 +08:00
quicksilver
9e91860ae9
Fix install dependencies scripts file bug (#5511)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-31 16:33:30 +08:00
Xiangyu Wang
e412cb14c7 Update Mergify
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-31 15:24:38 +08:00
quicksilver
fca8760486
Update mergify (#5504)
* Update mergify

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update mergify

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update mergify

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-31 15:13:32 +08:00
Cai Yudong
5ac726b7b9
use NewTicker instead of NewTimer (#5503)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-31 14:44:30 +08:00
Xiangyu Wang
88b32316db
[skip ci]Update mergify (#5497)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-31 14:08:30 +08:00
Cai Yudong
c468481a36
Optimize MqTtMsgStream and unittest (#5498)
* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add getTsMsgFromConsumerMsg

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename some variables for better readability

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add chanWaitGroup

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add chanTtMsgTime

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename lastTimeStamp to currTimeStamp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add comments

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* support unsynced ttMsg

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add TestStream_PulsarTtMsgStream_3

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove debug log

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change ttMsg logic back

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix ci block issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix codacy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-31 11:31:30 +08:00
zhenshan.cao
4af2cacb28
Refactor IndexService and IndexNode: remove redundant serviceID (#5491)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-31 10:32:30 +08:00
Xiangyu Wang
ca0993c274 Update OWNERS
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-30 18:58:47 +08:00
Cai Yudong
b414800d49
Update Seek interface (#5492)
* update Seek

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update Seek for mqTtMsgStream

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* use Retry in Seek

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-29 23:21:34 +08:00
zhenshan.cao
67c4c915b7
Move debugging code of index query to a separate module (#5490)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-29 17:07:29 +08:00
Xiangyu Wang
95e762bb21
Add logs in retrieve request process (#5460)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-29 11:19:30 +08:00
yukun
cd549f812d
Add retrieve_service (#5481)
* Add retrieve_service

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix for tSafeReplica

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-29 11:16:29 +08:00
bigsheeper
03f90ff28c
refactor collection replica and add tsafe replica in querynode (#5475)
* refactor collection replica and add tsafe replica in querynode

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* static check

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* static check2

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* code format

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-05-28 15:40:32 +08:00
shengjun.li
6b5954bf7b
[skip ci] fix badge (#5479)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-05-28 15:16:42 +08:00
quicksilver
177bdb485d
Update the conditions that trigger GitHub actions (#5473)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-28 14:25:08 +08:00
del-zhenwu
9b07959e3a
Add utility cases (#5464)
* Add utility cases

Signed-off-by: zw <zw@milvus.io>
2021-05-28 11:50:31 +08:00
quicksilver
ca49e1a7f0
Fix extract log files bug (#5471)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-28 11:27:30 +08:00
FluorineDog
b1a9aea6a6
support get entity by ids in segcore (#5456)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-28 10:39:30 +08:00
xige-16
fce792b8bf
Add historical and streaming module in querynode (#5469)
* add historical and streaming

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* fix GetSegmentInfo

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* pass regression test

Signed-off-by: xige-16 <xi.ge@zilliz.com>

Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2021-05-28 10:26:30 +08:00
yukun
c63524deb9
Add dablooms (#5440)
* Add dablooms cwrapper

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix undefined reference bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add cwrapper_dablooms_build shell script

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-28 10:23:30 +08:00
Xiangyu Wang
16839f6796
[skip ci]Update code owners (#5467)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-28 09:56:11 +08:00