Commit Graph

6940 Commits

Author SHA1 Message Date
xige-16
fce792b8bf
Add historical and streaming module in querynode (#5469)
* add historical and streaming

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* fix GetSegmentInfo

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* pass regression test

Signed-off-by: xige-16 <xi.ge@zilliz.com>

Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2021-05-28 10:26:30 +08:00
yukun
c63524deb9
Add dablooms (#5440)
* Add dablooms cwrapper

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix undefined reference bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add cwrapper_dablooms_build shell script

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-28 10:23:30 +08:00
Xiangyu Wang
16839f6796
[skip ci]Update code owners (#5467)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-28 09:56:11 +08:00
yanliang567
c7f8129c1a
[skip ci] update partition tests for #5373 and #5392 (#5458)
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2021-05-28 09:45:59 +08:00
cai.zhang
a606ab9c67
Add power-off restart logic for IndexService and IndexNode (#5395)
Add power-off restart logic for IndexService and IndexNode


Signed-off-by: <xiaocai2333> <cai.zhang@zilliz.com>
2021-05-27 14:24:29 +00:00
Cai Yudong
dde74e2165
Support launch multiple services in one process (#5446)
Resolves: #5450 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-27 14:02:58 +00:00
godchen
6e3a0d2a8e
Add queryservice grpc retry (#5437)
Add queryservice grpc retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-27 10:44:36 +00:00
del-zhenwu
c6aee9b4a3
Index case update (#5455)
Signed-off-by: zhenwu <zhenwu@zilliz.com>
2021-05-27 08:58:11 +00:00
zhenshan.cao
5ac8b8acc6
Add comments to proto (#5452)
Specify which fields must be set by SDK

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-27 08:34:31 +00:00
godchen
220c12e12f
Add indexservice grpc retry (#5425)
Add indexservice grpc retry.

Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-27 07:12:13 +00:00
godchen
279d77020a
Change proxy grpc retry (#5431)
Change proxy grpc retry.

Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-27 07:10:39 +00:00
neza2017
7dbe737061
add server type of mixture, enable the services run on progress (#5451)
Resolves: #5450 

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-27 06:06:13 +00:00
quicksilver
907106f752
Update milvus system configuration (#5448)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-27 03:40:23 +00:00
xige-16
3630eec92c
Fix receving wrong msg after seek (#5441)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-05-27 02:38:37 +00:00
godchen
9aa1fd25fa
Add indexnode grpc retry (#5418)
Add indexnode grpc retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-27 02:30:11 +00:00
yanliang567
74ea346e7c
Add New Partition Tests (#5412)
add new testcases for partition.

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2021-05-27 02:26:35 +00:00
quicksilver
198cc0dcc3
Adjust the directory structure for archived Logs (#5442)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-27 09:51:22 +08:00
quicksilver
63399f5ccd
Extract Milvus log files from KinD logs (#5434)
Extract Milvus log files from KinD logs

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-26 22:28:10 +08:00
neza2017
f80dbab6ec
watch proxynode (#5424)
watch proxy node and,
send InvalidataCollectionMetaCache to each proxynode

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

Resolves: #5423
2021-05-26 12:14:30 +00:00
godchen
5fd92ec80c
Add querynode grpc retry (#5428)
Add querynode grpc retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-26 11:37:34 +00:00
godchen
bfa683ce79
Change dataservice grpc retry (#5411)
Change dataservice grpc retry.

Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-26 10:55:05 +00:00
godchen
5f0f840782
Remove datanode client code (#5427)
Remove datanode client code.

Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-26 10:41:37 +00:00
yukun
a3fb1356de
Fix rocksmq seek error (#5432)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>

In milvus-standalone, when seek is called, rocksmq won't put a
mutex in MsgMutex channel, which cause that the consume
process hang. So the seek function in rocksmq needs to 
notify the consumer to consume.
2021-05-26 09:31:09 +00:00
Xiangyu Wang
e021f5e670
Support to use json to construct dummy request (#5430)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-26 08:57:32 +00:00
ThreadDao
5feb9ae9c4
Add cases for invalid DataFrame data and binary collection (#5426)
- test invalid DataFrame data
- test binary create and data
- add test_insert

Cover: #5404 #5405 #5407 #5414 #5421 

Signed-off-by: ThreadDao yufen.zong@zilliz.com
2021-05-26 08:10:57 +00:00
godchen
200801271d
Fix GetSession error (#5401)
Fix GetSession error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-25 12:15:46 +00:00
zhenshan.cao
6766169878
Refactor repack logic for insertion (#5399)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-25 11:53:15 +00:00
del-zhenwu
1c49ddc86a
Add test cases for Index in sdk-orm (#5410)
Signed-off-by: zw <zw@milvus.io>
2021-05-25 11:09:31 +00:00
godchen
17cabfbed3
Add datanode client retry (#5394)
Add datanode client retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-25 07:47:08 +00:00
neza2017
c28c34e852
let master use session.ServerID as nodeID (#5385)
let master use session.ServerID as nodeID

also see #5386 

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-25 07:06:05 +00:00
Xiangyu Wang
88b42304ef
Add dummy RPC (#5376)
Adding a dummy RPC makes it easier to develop new RPCs in the future.
When developing a new function, the SDK is often implemented last. 
At this time, this is helpful for debugging.

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-25 06:44:43 +00:00
Cai Yudong
dab536a6cf
Rename some field names in master for better code readability (#5389)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-25 06:03:06 +00:00
Cai Yudong
4058350e30
update AddIndex not return error when fail (#5372)
Resolves: #5332 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-25 03:42:23 +00:00
dragondriver
4caf3051dd
Update the version of pymilvus to 2.0a1.dev2 (#5388)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-25 02:32:48 +00:00
yukun
49443e8a33
Add retrieve taskscheduler implementation (#5353)
See also: #5257 

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-24 10:19:43 +00:00
Xiangyu Wang
bfc057d56d
Change pymilvus-distributed to pymilvus (#5369)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-24 18:14:57 +08:00
ThreadDao
6da1c66357
Add test cases for collection primary and data (#5371)
1. update case for collection desc
2. test collection with primary
3. test collection with data

See also: #5345 #5349 #5350 #5367 

Signed-off-by:ThreadDao yufen.zong@zilliz.com
2021-05-24 09:44:56 +00:00
godchen
042a061123
Fix session util error (#5370)
Fix session util error.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-24 08:31:06 +00:00
zhenshan.cao
3e73775cc1
Add ComputeProduceChannelIndexes for msgstream (#5364)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-24 08:30:09 +00:00
shengjun.li
b688cc5f51
Improve IVF query on GPU when no entity deleted (#5359)
Not to call getListIndex() if bitset is empty.

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-05-24 07:38:56 +00:00
Cai Yudong
39f8c9dd56
Save msg start position and end position when AddSegment and AddIndex (#5358)
Resolves: #5332 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-24 06:19:52 +00:00
FluorineDog
3f42a9ed12
reduce unittest time (#5363)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-24 03:54:06 +00:00
godchen
dd736ee8ba
Change session doc (#5355)
Change session doc

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-24 03:53:07 +00:00
zhenshan.cao
4e1b12269b
Fix bug: rand.Seed reset and generate duplicate number (#5361)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-24 02:50:37 +00:00
dragondriver
457e964e41
Add channelsTimeTicker to proxy (#5339)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-24 01:49:28 +00:00
neza2017
e326eaad1e
master client,reconnect if grpc failed (#5360)
master client,reconnect if grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-24 01:44:49 +00:00
godchen
d189bf4d33
Change pulsar version (#5352)
Change pulsar version.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-22 03:36:49 +00:00
quicksilver
6204e4546a
Update devcontainer.sh (#5351)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-22 01:20:41 +00:00
zwd1208
7d49096e8c
Add prometheus metrics (#5342)
Add prometheus metrics for components

Resolves: #5325

Signed-off-by: Weida Zhu <weida.zhu@zilliz.com>
2021-05-21 13:48:04 +00:00
congqixia
4aa6a8fe18
Dataservice use lastest grpc design and saves ddl/dml pos pair (#5348)
Dataservice use lastest grpc design and saves ddl/dml pos pair

* Update SaveBinlogPaths grpc definition
* Saves segment ddl & dml flush pos pair(start, end)

See also #5220 

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-21 11:38:58 +00:00