Commit Graph

7106 Commits

Author SHA1 Message Date
quicksilver
fca8760486
Update mergify (#5504)
* Update mergify

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update mergify

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update mergify

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-31 15:13:32 +08:00
Cai Yudong
5ac726b7b9
use NewTicker instead of NewTimer (#5503)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-31 14:44:30 +08:00
Xiangyu Wang
88b32316db
[skip ci]Update mergify (#5497)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-31 14:08:30 +08:00
Cai Yudong
c468481a36
Optimize MqTtMsgStream and unittest (#5498)
* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add getTsMsgFromConsumerMsg

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename some variables for better readability

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add chanWaitGroup

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add chanTtMsgTime

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename lastTimeStamp to currTimeStamp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add comments

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* support unsynced ttMsg

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code optimize

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add TestStream_PulsarTtMsgStream_3

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove debug log

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change ttMsg logic back

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix ci block issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix codacy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-31 11:31:30 +08:00
zhenshan.cao
4af2cacb28
Refactor IndexService and IndexNode: remove redundant serviceID (#5491)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-31 10:32:30 +08:00
Xiangyu Wang
ca0993c274 Update OWNERS
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-30 18:58:47 +08:00
Cai Yudong
b414800d49
Update Seek interface (#5492)
* update Seek

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update Seek for mqTtMsgStream

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* use Retry in Seek

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-29 23:21:34 +08:00
zhenshan.cao
67c4c915b7
Move debugging code of index query to a separate module (#5490)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-29 17:07:29 +08:00
Xiangyu Wang
95e762bb21
Add logs in retrieve request process (#5460)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-29 11:19:30 +08:00
yukun
cd549f812d
Add retrieve_service (#5481)
* Add retrieve_service

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix for tSafeReplica

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-29 11:16:29 +08:00
bigsheeper
03f90ff28c
refactor collection replica and add tsafe replica in querynode (#5475)
* refactor collection replica and add tsafe replica in querynode

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* static check

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* static check2

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* code format

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-05-28 15:40:32 +08:00
shengjun.li
6b5954bf7b
[skip ci] fix badge (#5479)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-05-28 15:16:42 +08:00
quicksilver
177bdb485d
Update the conditions that trigger GitHub actions (#5473)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-28 14:25:08 +08:00
del-zhenwu
9b07959e3a
Add utility cases (#5464)
* Add utility cases

Signed-off-by: zw <zw@milvus.io>
2021-05-28 11:50:31 +08:00
quicksilver
ca49e1a7f0
Fix extract log files bug (#5471)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-28 11:27:30 +08:00
FluorineDog
b1a9aea6a6
support get entity by ids in segcore (#5456)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-28 10:39:30 +08:00
xige-16
fce792b8bf
Add historical and streaming module in querynode (#5469)
* add historical and streaming

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* fix GetSegmentInfo

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* pass regression test

Signed-off-by: xige-16 <xi.ge@zilliz.com>

Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2021-05-28 10:26:30 +08:00
yukun
c63524deb9
Add dablooms (#5440)
* Add dablooms cwrapper

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix undefined reference bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add cwrapper_dablooms_build shell script

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-28 10:23:30 +08:00
Xiangyu Wang
16839f6796
[skip ci]Update code owners (#5467)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-28 09:56:11 +08:00
yanliang567
c7f8129c1a
[skip ci] update partition tests for #5373 and #5392 (#5458)
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2021-05-28 09:45:59 +08:00
cai.zhang
a606ab9c67
Add power-off restart logic for IndexService and IndexNode (#5395)
Add power-off restart logic for IndexService and IndexNode


Signed-off-by: <xiaocai2333> <cai.zhang@zilliz.com>
2021-05-27 14:24:29 +00:00
Cai Yudong
dde74e2165
Support launch multiple services in one process (#5446)
Resolves: #5450 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-27 14:02:58 +00:00
godchen
6e3a0d2a8e
Add queryservice grpc retry (#5437)
Add queryservice grpc retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-27 10:44:36 +00:00
del-zhenwu
c6aee9b4a3
Index case update (#5455)
Signed-off-by: zhenwu <zhenwu@zilliz.com>
2021-05-27 08:58:11 +00:00
zhenshan.cao
5ac8b8acc6
Add comments to proto (#5452)
Specify which fields must be set by SDK

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-27 08:34:31 +00:00
godchen
220c12e12f
Add indexservice grpc retry (#5425)
Add indexservice grpc retry.

Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-27 07:12:13 +00:00
godchen
279d77020a
Change proxy grpc retry (#5431)
Change proxy grpc retry.

Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-27 07:10:39 +00:00
neza2017
7dbe737061
add server type of mixture, enable the services run on progress (#5451)
Resolves: #5450 

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-27 06:06:13 +00:00
quicksilver
907106f752
Update milvus system configuration (#5448)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-27 03:40:23 +00:00
xige-16
3630eec92c
Fix receving wrong msg after seek (#5441)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-05-27 02:38:37 +00:00
godchen
9aa1fd25fa
Add indexnode grpc retry (#5418)
Add indexnode grpc retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-27 02:30:11 +00:00
yanliang567
74ea346e7c
Add New Partition Tests (#5412)
add new testcases for partition.

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2021-05-27 02:26:35 +00:00
quicksilver
198cc0dcc3
Adjust the directory structure for archived Logs (#5442)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-27 09:51:22 +08:00
quicksilver
63399f5ccd
Extract Milvus log files from KinD logs (#5434)
Extract Milvus log files from KinD logs

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-26 22:28:10 +08:00
neza2017
f80dbab6ec
watch proxynode (#5424)
watch proxy node and,
send InvalidataCollectionMetaCache to each proxynode

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

Resolves: #5423
2021-05-26 12:14:30 +00:00
godchen
5fd92ec80c
Add querynode grpc retry (#5428)
Add querynode grpc retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-26 11:37:34 +00:00
godchen
bfa683ce79
Change dataservice grpc retry (#5411)
Change dataservice grpc retry.

Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-26 10:55:05 +00:00
godchen
5f0f840782
Remove datanode client code (#5427)
Remove datanode client code.

Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-26 10:41:37 +00:00
yukun
a3fb1356de
Fix rocksmq seek error (#5432)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>

In milvus-standalone, when seek is called, rocksmq won't put a
mutex in MsgMutex channel, which cause that the consume
process hang. So the seek function in rocksmq needs to 
notify the consumer to consume.
2021-05-26 09:31:09 +00:00
Xiangyu Wang
e021f5e670
Support to use json to construct dummy request (#5430)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-26 08:57:32 +00:00
ThreadDao
5feb9ae9c4
Add cases for invalid DataFrame data and binary collection (#5426)
- test invalid DataFrame data
- test binary create and data
- add test_insert

Cover: #5404 #5405 #5407 #5414 #5421 

Signed-off-by: ThreadDao yufen.zong@zilliz.com
2021-05-26 08:10:57 +00:00
godchen
200801271d
Fix GetSession error (#5401)
Fix GetSession error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-25 12:15:46 +00:00
zhenshan.cao
6766169878
Refactor repack logic for insertion (#5399)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-25 11:53:15 +00:00
del-zhenwu
1c49ddc86a
Add test cases for Index in sdk-orm (#5410)
Signed-off-by: zw <zw@milvus.io>
2021-05-25 11:09:31 +00:00
godchen
17cabfbed3
Add datanode client retry (#5394)
Add datanode client retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-25 07:47:08 +00:00
neza2017
c28c34e852
let master use session.ServerID as nodeID (#5385)
let master use session.ServerID as nodeID

also see #5386 

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-25 07:06:05 +00:00
Xiangyu Wang
88b42304ef
Add dummy RPC (#5376)
Adding a dummy RPC makes it easier to develop new RPCs in the future.
When developing a new function, the SDK is often implemented last. 
At this time, this is helpful for debugging.

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-25 06:44:43 +00:00
Cai Yudong
dab536a6cf
Rename some field names in master for better code readability (#5389)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-25 06:03:06 +00:00
Cai Yudong
4058350e30
update AddIndex not return error when fail (#5372)
Resolves: #5332 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-25 03:42:23 +00:00
dragondriver
4caf3051dd
Update the version of pymilvus to 2.0a1.dev2 (#5388)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-25 02:32:48 +00:00