test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-04 21:09:06 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
21,227 Commits 96 Branches 105 Tags 186 MiB
e9391acf80
Commit Graph

317 Commits

Author SHA1 Message Date
Cai Yudong
173e7b3808
Fix golint warnings for rootcoord/root_coord.go (#11871) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-16 14:25:17 +08:00
jaime
3a9d6ee070
[skip ci] Add a log (#11729) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-11-15 19:26:49 +08:00
godchen
5357e301f4
Fix retrieve search error (#11501) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-11 00:54:45 +08:00
Cai Yudong
a2ad88237d
Add deltaChannels in rootcoord core (#11097) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-03 21:04:14 +08:00
Cai Yudong
66b9684fe5
Update ListCollectionPhysicalChannels and ListCollectionVirtualChannels (#11007) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-02 15:50:30 +08:00
Xiaofan
2df2d488e1
Fix Unit test fatal fail (#10933) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-30 10:24:38 +08:00
Xiaofan
76ef1c9657
Fix Root Start hang (#10765) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-27 22:00:27 +08:00
Xiaofan
6fddcb3925
Fix Session checker for proxy (#10737) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-27 21:58:33 +08:00
congqixia
ed2b8d67c0
Reduce info saved in SnapshotMeta (#10288) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-21 14:04:36 +08:00
congqixia
ec6e8e4127
Hide liveChn into sessionutil and fix liveness init order (#9860) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-14 16:40:35 +08:00
NotRyan
5d26d88f10
Change English verbage in rood-coord log messages (#9762) 
Signed-off-by: NotRyan <ryan.chan@zilliz.com>

Co-authored-by: NotRyan <ryan.chan@zilliz.com>
 2021-10-13 10:50:41 +08:00
Cai Yudong
ed6101198b
[skip ci] Update order of header files (#8964) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-01 11:08:24 +08:00
Xiaofan
2c2b800ff4
Change Log Name with NodeId (#8721) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-01 08:52:50 +08:00
Xiaofan
1edc00cd82
Add a log ETCD path (#8739) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-28 13:54:03 +08:00
congqixia
88e319acda
Save start position in collection meta (#8682) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-27 18:10:00 +08:00
Cai Yudong
177a465913
Clean golint warnings for rootcoord (#8383) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-23 15:10:00 +08:00
Cai Yudong
a62bce360b
Replace MarshalTextString with Marshal in rootcoord (#8341) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-23 10:37:54 +08:00
congqixia
c676979217
Add error detail when ddl fail (#8304) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-22 19:50:15 +08:00
Yusup
ccb57ba4b2
add collection alias (#7255) 
Signed-off-by: Yusup <yusup@lsgrep.com>
 2021-09-18 11:13:51 +08:00
Cai Yudong
d10c6abc9e
Apply for msgstream from pool when creating collection (#7738) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-18 09:13:50 +08:00
dragondriver
c3eb6f9761
Expose created time and updated time to rootcoord metrics (#8174) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-17 21:52:00 +08:00
Xiangyu Wang
1ee17464e8
Fix possible datarace in rootcoord (#8120) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-17 12:37:50 +08:00
congqixia
675b71cc30
Replace metaSnapshot with suffixSnapshot (#7975) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-15 22:05:49 +08:00
congqixia
7d53e44f3b
Depress gosec false positive (#7899) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-14 18:37:48 +08:00
zhenshan.cao
e5e4b24954
Fix bug: describe collection return wrong shard number (#7841) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-14 11:59:47 +08:00
cai.zhang
8a458b7a38
Add log for building index about num rows (#7811) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-14 10:27:06 +08:00
sunby
4c18910acd
Improve log print in rootcoord (#7354) 
issue: #7306
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-13 11:56:42 +08:00
Cai Yudong
4e23ed9a18
Revert apply physical channels from pool (d5f7e358 and 3b960969) (#7687) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-10 13:00:00 +08:00
zhenshan.cao
b0524adbd8
Support specified shard number when create collection (#7482) 
Add shards_num to CollectionInfo

Modify dmlChannelNum config

Compatible with old meta

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-08 15:00:00 +08:00
Cai Yudong
d15d3fa0ac
Improve rootcoord codecov (#7518) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-07 11:16:37 +08:00
dragondriver
1db573731b
Cache the system information metrics (#7436) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-03 17:15:26 +08:00
Xiangyu Wang
acf4354b83
Add logs in rootcoord (#7457) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-03 14:10:10 +08:00
Cai Yudong
3b9609692b
Apply for msgstream from pool when creating collection (#7377) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-31 18:35:58 +08:00
dragondriver
f0dbdd7f13
Expose metrics of root coordinator (#7228) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-31 11:45:59 +08:00
Cai Yudong
f4b53df727
Revert "Apply for msgstream from pool when creating collection (#7323)" (#7376) 
This reverts commit e6de86a433.
 2021-08-31 11:07:58 +08:00
Cai Yudong
e6de86a433
Apply for msgstream from pool when creating collection (#7323) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-31 09:47:58 +08:00
congqixia
4d9f89df09
Add unit test for 7150 fix (#7276) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-25 14:41:52 +08:00
congqixia
d83bc7fb54
Fix 0 ts when build index (#7272) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-24 21:15:52 +08:00
Xiaofan
58b2089692
Import Embedded Etcd Kv Part 1(#7112) (#7174) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-08-24 09:45:51 +08:00
Cai Yudong
8405d90f5e
proxy add illegal check for search result (#7227) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-23 17:03:51 +08:00
Cai Yudong
305fa9c17e
Fix timestamp go back issue for timeticksync (#7123) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-18 14:36:10 +08:00
XuanYang-cn
6c5be83ea1
Refactor NewEtcdKV API (#7075) 
This PR mainly did the following 3 things:

- Refactor NewEtcdKV API
- Add unittests for `kv/etcd/`, raise the coverage
up to 94%
- Correct some APIs from version to revision

The old NewEtcdKV() API took `clientv3.Client` as
one of the input, making everyone who using this API
had to create a new `clientv3.Client`. So there're a lot
of repeated codes everywhere.

Meanwhile, someplace didn't even check whether the
`clientv3.New()` returned error or not, and the old API
also didn't check whether the clientv3.Client was Nil.
This caused issue#6955.

Ectd's version and revision have nothing alike, they
represent different concepts, but our APIs kind of
mixed them all up. So I correct those APIs' names.

Resolves: #6955

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-08-13 11:04:09 +08:00
XuanYang-cn
47df4a2e57
Fix DataNode BackGroudGC problem (#6551) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-08-03 09:59:24 +08:00
Cai Yudong
cbb4052fdb
Support search and query output fields using wildcard (#6671) 
* update wildcard polocy for search and query

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* mark xfail cases

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* mark xfail cases

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize debug log

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-21 14:52:12 +08:00
neza2017
fac350cc58
fix tso (#6500) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-14 17:11:54 +08:00
neza2017
b66157358c
add more log for create collection (#6478) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-13 22:19:55 +08:00
neza2017
8b89744c6b
search with exp (#6409) 
* process float vector and binary vector field
on the search result

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add more debug info on etcd

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add debug info when grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-10 10:21:52 +08:00
Cai Yudong
21a9bcd844
Create default partition when receive CreateCollectionMsg (#6305) 
* create default partition when create collection

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* adjust sleep time for unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-06 09:16:03 +08:00
neza2017
ca4a562a72
simplify AddIndex, remove collID,PartID from parameters (#6291) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-05 10:08:02 +08:00
neza2017
f8fa025dcc
start background go routine to check if all the segments have indexed (#6290) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-03 17:54:25 +08:00
neza2017
111a24a49f
remove msgstream of segment info (#6280) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-03 14:36:18 +08:00
sunby
07b0989628
Add GetFlushedSegments in data coordinator (#6253) 
Send segment flush message by grpc and add a new interface
`GetFlushedSegments`

Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-07-02 11:16:20 +08:00
neza2017
6019c193fc
add grpc interface to process NewSegment And FlushSegmentCompleted (#6247) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-01 14:58:17 +08:00
godchen
49a0528d53
Fix trace (#6218) 
* Fix trace

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-30 16:18:13 +08:00
zhenshan.cao
42be531f9c
Add InsertCnt (#6131) 
* Add InsertCnt

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Enhance log

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-26 14:02:12 +08:00
neza2017
a1d0e5c980
remove task scheduler (#6123) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-26 09:22:11 +08:00
congqixia
384f440dbf
Fix panic when BuildIndex 0 while err = nil (#6125) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-06-25 17:58:09 +08:00
neza2017
da12e55c6c
rootcoord connect to other components in go routines (#6117) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-25 16:48:10 +08:00
neza2017
9ebca59099
fix time tick (#6017) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-23 15:28:09 +08:00
godchen
99be4c09a5
change retry (#5996) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-23 09:24:10 +08:00
Cai Yudong
7dbf33b788
Update component names in config files (#5989) 
* rename master/indexService in .yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxyNode to proxy in config files

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move master.yaml to root_coord.yaml, move proxy_node.yaml to proxy.yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proto/query_service.proto to proto/query_coord.proto

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proxy_node_manager.go to proxy_manager.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add query_coord.pb.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 19:08:03 +08:00
xige-16
2af1c27811
Rename queryservice to querycoordinator (#5931) 
* Rename queryservice to querycoordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix param table

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix unittest

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* service to coordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set querycoord in ci

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-22 16:44:09 +08:00
Cai Yudong
d5f4ee6f44
Rename proto master/index_service/proxy_service (#5973) 
* rename proto proxy_service to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proto index_service to index_coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proto master to root_coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 16:14:09 +08:00
neza2017
80bb418136
Release partition (#5971) 
* add debug info

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* notify query coord to release partitions after drop partition

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-22 16:08:08 +08:00
sunby
7f2d7c1da3
Rename dataservice to datacoordinator (#5912) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-21 18:22:13 +08:00
Cai Yudong
92e429d812
Rename IndexService to IndexCoord (#5932) 
* rename package indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix queryservice static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/indexservice to distributed/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/indexservice to internal/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename MasterComponent to RootCoordComponent

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for queryservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for dataservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for datanode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for proxynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for querynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix rebase issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-21 17:28:03 +08:00
Cai Yudong
5a1f7e4feb
rename masterservice to rootcoord (#5875) 
* rename masterservice to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix build error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename package

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename masterservice to rootcoord under distributed

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update scripts

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* enable more unittests

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-18 21:30:08 +08:00