Commit Graph

7080 Commits

Author SHA1 Message Date
godchen
279d77020a
Change proxy grpc retry (#5431)
Change proxy grpc retry.

Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-27 07:10:39 +00:00
neza2017
7dbe737061
add server type of mixture, enable the services run on progress (#5451)
Resolves: #5450 

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-27 06:06:13 +00:00
quicksilver
907106f752
Update milvus system configuration (#5448)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-27 03:40:23 +00:00
xige-16
3630eec92c
Fix receving wrong msg after seek (#5441)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-05-27 02:38:37 +00:00
godchen
9aa1fd25fa
Add indexnode grpc retry (#5418)
Add indexnode grpc retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-27 02:30:11 +00:00
yanliang567
74ea346e7c
Add New Partition Tests (#5412)
add new testcases for partition.

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2021-05-27 02:26:35 +00:00
quicksilver
198cc0dcc3
Adjust the directory structure for archived Logs (#5442)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-27 09:51:22 +08:00
quicksilver
63399f5ccd
Extract Milvus log files from KinD logs (#5434)
Extract Milvus log files from KinD logs

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-26 22:28:10 +08:00
neza2017
f80dbab6ec
watch proxynode (#5424)
watch proxy node and,
send InvalidataCollectionMetaCache to each proxynode

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

Resolves: #5423
2021-05-26 12:14:30 +00:00
godchen
5fd92ec80c
Add querynode grpc retry (#5428)
Add querynode grpc retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-26 11:37:34 +00:00
godchen
bfa683ce79
Change dataservice grpc retry (#5411)
Change dataservice grpc retry.

Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-26 10:55:05 +00:00
godchen
5f0f840782
Remove datanode client code (#5427)
Remove datanode client code.

Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-26 10:41:37 +00:00
yukun
a3fb1356de
Fix rocksmq seek error (#5432)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>

In milvus-standalone, when seek is called, rocksmq won't put a
mutex in MsgMutex channel, which cause that the consume
process hang. So the seek function in rocksmq needs to 
notify the consumer to consume.
2021-05-26 09:31:09 +00:00
Xiangyu Wang
e021f5e670
Support to use json to construct dummy request (#5430)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-26 08:57:32 +00:00
ThreadDao
5feb9ae9c4
Add cases for invalid DataFrame data and binary collection (#5426)
- test invalid DataFrame data
- test binary create and data
- add test_insert

Cover: #5404 #5405 #5407 #5414 #5421 

Signed-off-by: ThreadDao yufen.zong@zilliz.com
2021-05-26 08:10:57 +00:00
godchen
200801271d
Fix GetSession error (#5401)
Fix GetSession error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-25 12:15:46 +00:00
zhenshan.cao
6766169878
Refactor repack logic for insertion (#5399)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-25 11:53:15 +00:00
del-zhenwu
1c49ddc86a
Add test cases for Index in sdk-orm (#5410)
Signed-off-by: zw <zw@milvus.io>
2021-05-25 11:09:31 +00:00
godchen
17cabfbed3
Add datanode client retry (#5394)
Add datanode client retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-25 07:47:08 +00:00
neza2017
c28c34e852
let master use session.ServerID as nodeID (#5385)
let master use session.ServerID as nodeID

also see #5386 

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-25 07:06:05 +00:00
Xiangyu Wang
88b42304ef
Add dummy RPC (#5376)
Adding a dummy RPC makes it easier to develop new RPCs in the future.
When developing a new function, the SDK is often implemented last. 
At this time, this is helpful for debugging.

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-25 06:44:43 +00:00
Cai Yudong
dab536a6cf
Rename some field names in master for better code readability (#5389)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-25 06:03:06 +00:00
Cai Yudong
4058350e30
update AddIndex not return error when fail (#5372)
Resolves: #5332 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-25 03:42:23 +00:00
dragondriver
4caf3051dd
Update the version of pymilvus to 2.0a1.dev2 (#5388)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-25 02:32:48 +00:00
yukun
49443e8a33
Add retrieve taskscheduler implementation (#5353)
See also: #5257 

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-24 10:19:43 +00:00
Xiangyu Wang
bfc057d56d
Change pymilvus-distributed to pymilvus (#5369)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-24 18:14:57 +08:00
ThreadDao
6da1c66357
Add test cases for collection primary and data (#5371)
1. update case for collection desc
2. test collection with primary
3. test collection with data

See also: #5345 #5349 #5350 #5367 

Signed-off-by:ThreadDao yufen.zong@zilliz.com
2021-05-24 09:44:56 +00:00
godchen
042a061123
Fix session util error (#5370)
Fix session util error.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-24 08:31:06 +00:00
zhenshan.cao
3e73775cc1
Add ComputeProduceChannelIndexes for msgstream (#5364)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-24 08:30:09 +00:00
shengjun.li
b688cc5f51
Improve IVF query on GPU when no entity deleted (#5359)
Not to call getListIndex() if bitset is empty.

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-05-24 07:38:56 +00:00
Cai Yudong
39f8c9dd56
Save msg start position and end position when AddSegment and AddIndex (#5358)
Resolves: #5332 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-24 06:19:52 +00:00
FluorineDog
3f42a9ed12
reduce unittest time (#5363)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-24 03:54:06 +00:00
godchen
dd736ee8ba
Change session doc (#5355)
Change session doc

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-24 03:53:07 +00:00
zhenshan.cao
4e1b12269b
Fix bug: rand.Seed reset and generate duplicate number (#5361)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-24 02:50:37 +00:00
dragondriver
457e964e41
Add channelsTimeTicker to proxy (#5339)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-24 01:49:28 +00:00
neza2017
e326eaad1e
master client,reconnect if grpc failed (#5360)
master client,reconnect if grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-24 01:44:49 +00:00
godchen
d189bf4d33
Change pulsar version (#5352)
Change pulsar version.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-22 03:36:49 +00:00
quicksilver
6204e4546a
Update devcontainer.sh (#5351)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-22 01:20:41 +00:00
zwd1208
7d49096e8c
Add prometheus metrics (#5342)
Add prometheus metrics for components

Resolves: #5325

Signed-off-by: Weida Zhu <weida.zhu@zilliz.com>
2021-05-21 13:48:04 +00:00
congqixia
4aa6a8fe18
Dataservice use lastest grpc design and saves ddl/dml pos pair (#5348)
Dataservice use lastest grpc design and saves ddl/dml pos pair

* Update SaveBinlogPaths grpc definition
* Saves segment ddl & dml flush pos pair(start, end)

See also #5220 

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-21 11:38:58 +00:00
godchen
0eee7e5252
Change session (#5329)
Change session.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-21 11:28:52 +00:00
XuanYang-cn
1bc1fad81d
Add DataNode scales flowgraph design docs (#5346)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-05-21 11:15:58 +00:00
sunby
02f2348500
Save segment allocation status to meta (#5184)
To ensure segments being flushed correctly, we need to load 
the segment allocation status from meta after starting the service.
2021-05-21 10:30:41 +00:00
congqixia
7a82462da8
DataService publishes flush-completed message into its channel (#5320)
DataService publishes flush-completed message  into related msgstream

See also: #5220 

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-21 08:54:29 +00:00
yukun
156d5b9f73
Add RetrieveTask PostExecute function (#5336)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>

See also: #5257
2021-05-21 08:39:28 +00:00
congqixia
46790d9c68
Fix issue 5333 uninitialized return value (#5338)
Fix uninitialized named value `meta` caused crash

Resolves #5333 

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-21 08:21:08 +00:00
Cai Yudong
761350e44d
Refactor timetick msg handling between proxy node and master (#5321)
Proxy node send channel timetick msg to master, master reduce timetick
msg for each channel and send the min timetick to msg stream.

Resolves: #5276 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-21 08:08:12 +00:00
ThreadDao
04eb594d5e
test collection with fields (#5334)
-  test collection with fields
- test collection dup drop

Resolves: #5312 #5317 #5331

Signed-off-by: ThreadDao yufen.zong@zilliz.com
2021-05-21 07:58:22 +00:00
sunby
7c5b1ae5ca
Add todo list to dataservice desgin doc (#5341)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-05-21 07:57:15 +00:00
sunby
c1efa53779
Remove redundant fields in SegmentInfo and related structure (#5280)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-05-21 06:51:25 +00:00