test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-04 21:09:06 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
6,946 Commits 96 Branches 105 Tags 186 MiB
03f90ff28c
Commit Graph

988 Commits

Author SHA1 Message Date
bigsheeper
03f90ff28c
refactor collection replica and add tsafe replica in querynode (#5475) 
* refactor collection replica and add tsafe replica in querynode

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* static check

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* static check2

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* code format

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-05-28 15:40:32 +08:00
FluorineDog
b1a9aea6a6
support get entity by ids in segcore (#5456) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-05-28 10:39:30 +08:00
xige-16
fce792b8bf
Add historical and streaming module in querynode (#5469) 
* add historical and streaming

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* fix GetSegmentInfo

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* pass regression test

Signed-off-by: xige-16 <xi.ge@zilliz.com>

Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
 2021-05-28 10:26:30 +08:00
yukun
c63524deb9
Add dablooms (#5440) 
* Add dablooms cwrapper

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix undefined reference bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add cwrapper_dablooms_build shell script

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-05-28 10:23:30 +08:00
cai.zhang
a606ab9c67
Add power-off restart logic for IndexService and IndexNode (#5395) 
Add power-off restart logic for IndexService and IndexNode


Signed-off-by: <xiaocai2333> <cai.zhang@zilliz.com>
 2021-05-27 14:24:29 +00:00
godchen
6e3a0d2a8e
Add queryservice grpc retry (#5437) 
Add queryservice grpc retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-27 10:44:36 +00:00
zhenshan.cao
5ac8b8acc6
Add comments to proto (#5452) 
Specify which fields must be set by SDK

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-05-27 08:34:31 +00:00
godchen
220c12e12f
Add indexservice grpc retry (#5425) 
Add indexservice grpc retry.

Signed-off-by: godchen qingxiang.chen@zilliz.com
 2021-05-27 07:12:13 +00:00
godchen
279d77020a
Change proxy grpc retry (#5431) 
Change proxy grpc retry.

Signed-off-by: godchen qingxiang.chen@zilliz.com
 2021-05-27 07:10:39 +00:00
xige-16
3630eec92c
Fix receving wrong msg after seek (#5441) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-05-27 02:38:37 +00:00
godchen
9aa1fd25fa
Add indexnode grpc retry (#5418) 
Add indexnode grpc retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-27 02:30:11 +00:00
neza2017
f80dbab6ec
watch proxynode (#5424) 
watch proxy node and,
send InvalidataCollectionMetaCache to each proxynode

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

Resolves: #5423
 2021-05-26 12:14:30 +00:00
godchen
5fd92ec80c
Add querynode grpc retry (#5428) 
Add querynode grpc retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-26 11:37:34 +00:00
godchen
bfa683ce79
Change dataservice grpc retry (#5411) 
Change dataservice grpc retry.

Signed-off-by: godchen qingxiang.chen@zilliz.com
 2021-05-26 10:55:05 +00:00
godchen
5f0f840782
Remove datanode client code (#5427) 
Remove datanode client code.

Signed-off-by: godchen qingxiang.chen@zilliz.com
 2021-05-26 10:41:37 +00:00
yukun
a3fb1356de
Fix rocksmq seek error (#5432) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>

In milvus-standalone, when seek is called, rocksmq won't put a
mutex in MsgMutex channel, which cause that the consume
process hang. So the seek function in rocksmq needs to 
notify the consumer to consume.
 2021-05-26 09:31:09 +00:00
Xiangyu Wang
e021f5e670
Support to use json to construct dummy request (#5430) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-05-26 08:57:32 +00:00
godchen
200801271d
Fix GetSession error (#5401) 
Fix GetSession error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-25 12:15:46 +00:00
zhenshan.cao
6766169878
Refactor repack logic for insertion (#5399) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-05-25 11:53:15 +00:00
godchen
17cabfbed3
Add datanode client retry (#5394) 
Add datanode client retry.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-25 07:47:08 +00:00
neza2017
c28c34e852
let master use session.ServerID as nodeID (#5385) 
let master use session.ServerID as nodeID

also see #5386 

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-05-25 07:06:05 +00:00
Xiangyu Wang
88b42304ef
Add dummy RPC (#5376) 
Adding a dummy RPC makes it easier to develop new RPCs in the future.
When developing a new function, the SDK is often implemented last. 
At this time, this is helpful for debugging.

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-05-25 06:44:43 +00:00
Cai Yudong
dab536a6cf
Rename some field names in master for better code readability (#5389) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-05-25 06:03:06 +00:00
Cai Yudong
4058350e30
update AddIndex not return error when fail (#5372) 
Resolves: #5332 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-05-25 03:42:23 +00:00
yukun
49443e8a33
Add retrieve taskscheduler implementation (#5353) 
See also: #5257 

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-05-24 10:19:43 +00:00
godchen
042a061123
Fix session util error (#5370) 
Fix session util error.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-24 08:31:06 +00:00
zhenshan.cao
3e73775cc1
Add ComputeProduceChannelIndexes for msgstream (#5364) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-05-24 08:30:09 +00:00
shengjun.li
b688cc5f51
Improve IVF query on GPU when no entity deleted (#5359) 
Not to call getListIndex() if bitset is empty.

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2021-05-24 07:38:56 +00:00
Cai Yudong
39f8c9dd56
Save msg start position and end position when AddSegment and AddIndex (#5358) 
Resolves: #5332 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-05-24 06:19:52 +00:00
FluorineDog
3f42a9ed12
reduce unittest time (#5363) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-05-24 03:54:06 +00:00
godchen
dd736ee8ba
Change session doc (#5355) 
Change session doc

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-24 03:53:07 +00:00
zhenshan.cao
4e1b12269b
Fix bug: rand.Seed reset and generate duplicate number (#5361) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-05-24 02:50:37 +00:00
dragondriver
457e964e41
Add channelsTimeTicker to proxy (#5339) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-05-24 01:49:28 +00:00
neza2017
e326eaad1e
master client,reconnect if grpc failed (#5360) 
master client,reconnect if grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-05-24 01:44:49 +00:00
godchen
d189bf4d33
Change pulsar version (#5352) 
Change pulsar version.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-22 03:36:49 +00:00
zwd1208
7d49096e8c
Add prometheus metrics (#5342) 
Add prometheus metrics for components

Resolves: #5325

Signed-off-by: Weida Zhu <weida.zhu@zilliz.com>
 2021-05-21 13:48:04 +00:00
congqixia
4aa6a8fe18
Dataservice use lastest grpc design and saves ddl/dml pos pair (#5348) 
Dataservice use lastest grpc design and saves ddl/dml pos pair

* Update SaveBinlogPaths grpc definition
* Saves segment ddl & dml flush pos pair(start, end)

See also #5220 

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-05-21 11:38:58 +00:00
godchen
0eee7e5252
Change session (#5329) 
Change session.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-21 11:28:52 +00:00
sunby
02f2348500
Save segment allocation status to meta (#5184) 
To ensure segments being flushed correctly, we need to load 
the segment allocation status from meta after starting the service.
 2021-05-21 10:30:41 +00:00
congqixia
7a82462da8
DataService publishes flush-completed message into its channel (#5320) 
DataService publishes flush-completed message  into related msgstream

See also: #5220 

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-05-21 08:54:29 +00:00
yukun
156d5b9f73
Add RetrieveTask PostExecute function (#5336) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>

See also: #5257
 2021-05-21 08:39:28 +00:00
congqixia
46790d9c68
Fix issue 5333 uninitialized return value (#5338) 
Fix uninitialized named value `meta` caused crash

Resolves #5333 

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-05-21 08:21:08 +00:00
Cai Yudong
761350e44d
Refactor timetick msg handling between proxy node and master (#5321) 
Proxy node send channel timetick msg to master, master reduce timetick
msg for each channel and send the min timetick to msg stream.

Resolves: #5276 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-05-21 08:08:12 +00:00
sunby
c1efa53779
Remove redundant fields in SegmentInfo and related structure (#5280) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-05-21 06:51:25 +00:00
zhenshan.cao
70241a8bf9
Cancel local timestamp caching logic (#5327) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-05-21 05:11:21 +00:00
dragondriver
f6ab3c81df
Add channelsMgr to proxy (#5323) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-05-21 01:52:20 +00:00
Xiangyu Wang
23c4de0eb8
Flush statistics for all int64 fields (#5318) 
Resolves: #5262

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-05-20 10:38:45 +00:00
godchen
913712fbea
Improve session manager (#5310) 
Improve session manager.
Issue #5174

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-20 07:07:25 +00:00
yukun
f18dfb4ff6
Add RetrieveTask implementation (#5313) 
Resolves: #5257 

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-05-20 07:02:31 +00:00
neza2017
c0daf8e41d
set timestamp on dd requests (#5298) 
- set dd request's time tick on master
- send time tick into dd channel

See also: #5291

Signed-off-by: yefu.chen yefu.chen@zilliz.com
 2021-05-20 06:14:14 +00:00