Commit Graph

6915 Commits

Author SHA1 Message Date
godchen
200801271d
Fix GetSession error (#5401)
Fix GetSession error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-25 12:15:46 +00:00
zhenshan.cao
6766169878
Refactor repack logic for insertion (#5399)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-25 11:53:15 +00:00
del-zhenwu
1c49ddc86a
Add test cases for Index in sdk-orm (#5410)
Signed-off-by: zw <zw@milvus.io>
2021-05-25 11:09:31 +00:00
godchen
17cabfbed3
Add datanode client retry (#5394)
Add datanode client retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-25 07:47:08 +00:00
neza2017
c28c34e852
let master use session.ServerID as nodeID (#5385)
let master use session.ServerID as nodeID

also see #5386 

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-25 07:06:05 +00:00
Xiangyu Wang
88b42304ef
Add dummy RPC (#5376)
Adding a dummy RPC makes it easier to develop new RPCs in the future.
When developing a new function, the SDK is often implemented last. 
At this time, this is helpful for debugging.

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-25 06:44:43 +00:00
Cai Yudong
dab536a6cf
Rename some field names in master for better code readability (#5389)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-25 06:03:06 +00:00
Cai Yudong
4058350e30
update AddIndex not return error when fail (#5372)
Resolves: #5332 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-25 03:42:23 +00:00
dragondriver
4caf3051dd
Update the version of pymilvus to 2.0a1.dev2 (#5388)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-25 02:32:48 +00:00
yukun
49443e8a33
Add retrieve taskscheduler implementation (#5353)
See also: #5257 

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-24 10:19:43 +00:00
Xiangyu Wang
bfc057d56d
Change pymilvus-distributed to pymilvus (#5369)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-24 18:14:57 +08:00
ThreadDao
6da1c66357
Add test cases for collection primary and data (#5371)
1. update case for collection desc
2. test collection with primary
3. test collection with data

See also: #5345 #5349 #5350 #5367 

Signed-off-by:ThreadDao yufen.zong@zilliz.com
2021-05-24 09:44:56 +00:00
godchen
042a061123
Fix session util error (#5370)
Fix session util error.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-24 08:31:06 +00:00
zhenshan.cao
3e73775cc1
Add ComputeProduceChannelIndexes for msgstream (#5364)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-24 08:30:09 +00:00
shengjun.li
b688cc5f51
Improve IVF query on GPU when no entity deleted (#5359)
Not to call getListIndex() if bitset is empty.

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-05-24 07:38:56 +00:00
Cai Yudong
39f8c9dd56
Save msg start position and end position when AddSegment and AddIndex (#5358)
Resolves: #5332 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-24 06:19:52 +00:00
FluorineDog
3f42a9ed12
reduce unittest time (#5363)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-24 03:54:06 +00:00
godchen
dd736ee8ba
Change session doc (#5355)
Change session doc

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-24 03:53:07 +00:00
zhenshan.cao
4e1b12269b
Fix bug: rand.Seed reset and generate duplicate number (#5361)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-24 02:50:37 +00:00
dragondriver
457e964e41
Add channelsTimeTicker to proxy (#5339)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-24 01:49:28 +00:00
neza2017
e326eaad1e
master client,reconnect if grpc failed (#5360)
master client,reconnect if grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-24 01:44:49 +00:00
godchen
d189bf4d33
Change pulsar version (#5352)
Change pulsar version.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-22 03:36:49 +00:00
quicksilver
6204e4546a
Update devcontainer.sh (#5351)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-22 01:20:41 +00:00
zwd1208
7d49096e8c
Add prometheus metrics (#5342)
Add prometheus metrics for components

Resolves: #5325

Signed-off-by: Weida Zhu <weida.zhu@zilliz.com>
2021-05-21 13:48:04 +00:00
congqixia
4aa6a8fe18
Dataservice use lastest grpc design and saves ddl/dml pos pair (#5348)
Dataservice use lastest grpc design and saves ddl/dml pos pair

* Update SaveBinlogPaths grpc definition
* Saves segment ddl & dml flush pos pair(start, end)

See also #5220 

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-21 11:38:58 +00:00
godchen
0eee7e5252
Change session (#5329)
Change session.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-21 11:28:52 +00:00
XuanYang-cn
1bc1fad81d
Add DataNode scales flowgraph design docs (#5346)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-05-21 11:15:58 +00:00
sunby
02f2348500
Save segment allocation status to meta (#5184)
To ensure segments being flushed correctly, we need to load 
the segment allocation status from meta after starting the service.
2021-05-21 10:30:41 +00:00
congqixia
7a82462da8
DataService publishes flush-completed message into its channel (#5320)
DataService publishes flush-completed message  into related msgstream

See also: #5220 

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-21 08:54:29 +00:00
yukun
156d5b9f73
Add RetrieveTask PostExecute function (#5336)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>

See also: #5257
2021-05-21 08:39:28 +00:00
congqixia
46790d9c68
Fix issue 5333 uninitialized return value (#5338)
Fix uninitialized named value `meta` caused crash

Resolves #5333 

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-21 08:21:08 +00:00
Cai Yudong
761350e44d
Refactor timetick msg handling between proxy node and master (#5321)
Proxy node send channel timetick msg to master, master reduce timetick
msg for each channel and send the min timetick to msg stream.

Resolves: #5276 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-21 08:08:12 +00:00
ThreadDao
04eb594d5e
test collection with fields (#5334)
-  test collection with fields
- test collection dup drop

Resolves: #5312 #5317 #5331

Signed-off-by: ThreadDao yufen.zong@zilliz.com
2021-05-21 07:58:22 +00:00
sunby
7c5b1ae5ca
Add todo list to dataservice desgin doc (#5341)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-05-21 07:57:15 +00:00
sunby
c1efa53779
Remove redundant fields in SegmentInfo and related structure (#5280)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-05-21 06:51:25 +00:00
zhenshan.cao
70241a8bf9
Cancel local timestamp caching logic (#5327)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-21 05:11:21 +00:00
sunby
ac0b878531
Update describe_index in python tests (#5328)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-05-21 02:12:52 +00:00
dragondriver
f6ab3c81df
Add channelsMgr to proxy (#5323)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-21 01:52:20 +00:00
Xiangyu Wang
23c4de0eb8
Flush statistics for all int64 fields (#5318)
Resolves: #5262

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-20 10:38:45 +00:00
godchen
913712fbea
Improve session manager (#5310)
Improve session manager.
Issue #5174

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-20 07:07:25 +00:00
yukun
f18dfb4ff6
Add RetrieveTask implementation (#5313)
Resolves: #5257 

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-20 07:02:31 +00:00
neza2017
c0daf8e41d
set timestamp on dd requests (#5298)
- set dd request's time tick on master
- send time tick into dd channel

See also: #5291

Signed-off-by: yefu.chen yefu.chen@zilliz.com
2021-05-20 06:14:14 +00:00
congqixia
38f5b0826f
Add SaveBinlogPaths grpc in dataservice (#5277)
* Add SaveBinlogPaths grpc in dataservice

* fix merged compile error

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-20 11:34:45 +08:00
ThreadDao
613cf21950
add cases for collection with data (#5305)
- add cases for collection with data
- cancel import *

See also: #5302 #5304 

Signed-off-by: ThreadDao yufen.zong@zilliz.com
2021-05-20 03:03:45 +00:00
XuanYang-cn
1c779f3efd
Refactor ddl binlog flush (#5303)
DDL won't auto-flush now

See also: #5289 , #5220 

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-05-19 11:42:07 +00:00
yukun
a7bb701f73
Add Retrieve method grpc definition (#5294)
See also: #5253 

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-19 10:45:15 +00:00
godchen
e224d1e725
Add SessionManager (#5288)
Add SessionManager.
Resolves: #5174 

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-19 10:36:05 +00:00
quicksilver
3db653f2d0
Update cpp thirdparty source URL (#5295)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

Resolves: #5293
2021-05-19 09:39:29 +00:00
congqixia
d5ab8ac345
Restore flush and stats stream pos (#5284)
Restore segment flush stream & statistic stream to last success pos

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-05-19 06:13:53 +00:00
XuanYang-cn
4b712284f2
Add ddl flush design (#5289)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-05-19 04:06:16 +00:00