test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-03 04:19:18 +08:00
Code Issues Actions 13 Packages Projects Releases Wiki Activity
14,674 Commits 95 Branches 105 Tags 184 MiB
3579ae8240
Commit Graph

1027 Commits

Author SHA1 Message Date
Cai Yudong
5a9e1af3bb
Update create plan CGO interface (#16271) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-30 17:13:27 +08:00
congqixia
18a3e9f265
Add grpc interface for replica Search/Query in QueryNode (#16197) 
Resolves #16195
Add Search and Query grpc interface in query proto and types/types.go

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-03-30 12:03:27 +08:00
jaime
d5d6e115bd
Refine delete segment data log (#16241) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-03-29 18:41:27 +08:00
congqixia
91d5436807
Improve log level and param function in QueryCollection (#16254) 
Use debug level for all debug information
Use specific parameter function for appliable ones

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-03-29 12:31:27 +08:00
bigsheeper
9d673006e0
Improve primary keys print (#16232) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-03-28 23:15:27 +08:00
xige-16
d2424fc50a
Print msgID instead of loadInfo when load segment (#16238) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-03-28 23:13:27 +08:00
godchen
478f6ca11e
Add cache for vector chunk (#15912) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-03-26 22:05:26 +08:00
xige-16
205c92e54b
Support insert string data (#15993) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-03-25 14:27:25 +08:00
bigsheeper
7fee4743f5
Improve log print in OOM error info (#16170) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-03-24 20:17:25 +08:00
yah01
63a71e247a
Loading segments concurrency level fallbacks to the value that won't cause OOM (#16172) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-03-24 13:39:25 +08:00
xiyichan
ca129d4308
Support configurable msgstream (#16131) 
Signed-off-by: xiyichan <2863768433@qq.com>
 2022-03-24 10:15:25 +08:00
Jiquan Long
f8d9bc919d
Unify interface of vector index & scalar index. (#15959) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-21 14:23:24 +08:00
yah01
31c5b286da
Fix wrong unittest, check whether loading collection will cause OOM (#16068) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-03-18 13:17:22 +08:00
godchen
78557ca6d7
Replace minio kv with minio chunk manager (#15936) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-03-17 18:03:23 +08:00
Ji Bin
3cd28420f1
Support compile under windows (#15786) 
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
  * using gofrs/flock instead of syscall.Flock
  * using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`

issue #7706

Signed-off-by: Ji Bin <matrixji@live.com>
 2022-03-17 17:17:22 +08:00
Jiquan Long
ffdad82b9c
Set load info in reschedule tasks (#16065) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-16 11:43:21 +08:00
zhenshan.cao
f3eeecf146
Reduce the number of metrics (#16030) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-03-15 21:51:21 +08:00
congqixia
b61e8201e7
Refactor querynode historical replica (#15992) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-03-15 19:15:20 +08:00
jaime
97b1ed7bca
Remove reader API from Mqstream and replace it with consumer API (#15971) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-03-15 14:45:22 +08:00
bigsheeper
caf9cbfcd4
Fix load failure and remove parition release related code (#16038) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-03-14 23:18:02 +08:00
congqixia
6a66faa2fb
Explictly specify Load operation meta (#16027) 
Fix #15996

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-03-14 09:50:01 +08:00
jaime
29975a7a26
Remove Consume() API from mqstream interface (#15886) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-03-11 20:09:59 +08:00
yah01
4f3d5fb6eb
Make load operation parallel improve performance (#15928) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-03-11 14:28:01 +08:00
bigsheeper
9ad5c14a4a
Return error when create message stream failed in QueryNode (#15317) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-03-09 15:17:59 +08:00
顾炎
4f8c08f912
fix checkSegmentSize overflows int64 (#15858) 
Signed-off-by: guyan <632722781@qq.com>
 2022-03-09 13:29:58 +08:00
zhenshan.cao
dff08dbf47
Refactor querynode unittest (#15929) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-03-08 17:39:58 +08:00
bigsheeper
6fec7ed6fb
Add search benchmark in QueryNode (#15854) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-03-08 10:15:59 +08:00
Jiquan Long
f71651e294
Support column-based insert data in message stream (#15802) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-04 15:09:56 +08:00
Cai Yudong
3e862ecdfb
Merge msgChannelConfig and knowhereConfig into commonConfig (#15843) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-04 11:17:56 +08:00
jaime
7a3a721380
Reconstruct mqstream module (#15784) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-03-03 21:57:56 +08:00
cai.zhang
88527fc0a9
Fix metrics label conflict (#15839) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-03-03 16:05:57 +08:00
Cai Yudong
92c8e32ebd
Let MemoryKV.Load return error when key not exist (#15814) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-02 18:51:55 +08:00
bigsheeper
12eb8c3da5
Add prometheus metrics for QueryNode (#15649) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-03-02 14:49:55 +08:00
bigsheeper
6a48071a5c
Set BaseMsg for LoadSegmentRequest, prevent crashing in log printing (#15725) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-02-26 20:09:54 +08:00
godchen
fcf0887d92
Add and implement chunk manager interface. (#15541) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-02-24 23:53:53 +08:00
zhenshan.cao
142848fcc3
Abandon using protobuf to pass binaryset parameter (#15626) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-02-18 18:39:50 +08:00
congqixia
c7f55c2e34
Make SessionWatch keep watch even no Rewatch func when find ErrCompacted (#15497) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-02-15 15:07:48 +08:00
yah01
684110bc9a
Avoid to copy during converting C bytes to Go bytes (#15551) 
* Avoid to copy during converting C bytes to Go bytes

Signed-off-by: yah01 <yah2er0ne@outlook.com>

* Add BytesConverter to achieve no-copy converting C bytes to Go bytes

Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2022-02-15 14:17:48 +08:00
Xiaofan
a18d6b46a4
Fix watch dml channel fail because of no collection meta (#15436) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-02-10 13:19:46 +08:00
Cai Yudong
8255b713ac
Move ProxySubName/QueryNodeSubName/DataNodeSubName to msgChannelConfig (#15501) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-09 14:41:45 +08:00
jaime
307a8ce535
Support compile and run on Mac (#15491) 
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
 2022-02-09 14:27:46 +08:00
xige-16
55cdc5aa35
Get indexInfo and segment size by queryCoord (#14207) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-02-08 21:57:46 +08:00
Cai Yudong
1f337891e1
Rename base_param to service_param, rename global_param to component_param (#15463) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-08 20:57:47 +08:00
Ji Bin
d83f69bb21
Support windows compliation (#15448) 
- remove dl dependency while compiling some lib under MSYS
- int types aligement in golang
- core/src/utils adaptation for compile under MSYS

issue: #7706

Signed-off-by: Ji Bin <matrixji@live.com>
 2022-02-07 23:43:46 +08:00
congqixia
d830791e4f
Respect SegmentIDs in querynode.GetSegmentInfo (#15455) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-02-07 15:35:44 +08:00
Cai Yudong
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-07 10:09:45 +08:00
Cai Yudong
4bccc85534
Use MsgChannelConfig in GlobalParams for all components (#15163) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-02 00:35:43 +08:00
zhenshan.cao
5bc6ec7250
Fixbug: QueryNode search exceptions will cause memory leak (#15305) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-24 21:19:39 +08:00
xige-16
1cd2363bd8
Delete usless params SkipQueryChannelRecovery (#15289) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-21 21:43:40 +08:00
xige-16
57383c9f76
Delete Useless timetick channel (#15296) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-21 14:31:39 +08:00
xige-16
c132302129
Clean flowGraph if watchChannel failed (#15303) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-20 10:01:38 +08:00
xige-16
bbb672cb00
Remove state service in querynode (#15281) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-18 18:43:37 +08:00
xige-16
dfc6670f0f
Unsubscribe channel after query node down (#15230) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-17 17:37:37 +08:00
Jiquan Long
675e6d352b
QueryNodes send search/query results by rpc (#15223) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-01-17 14:41:35 +08:00
Xiaofan
f617c8887b
Time Tick Failed need log (#15225) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-01-14 23:55:34 +08:00
bigsheeper
0c98f21d4d
Remove global sealed segments in historical (#15177) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-12 17:01:38 +08:00
bigsheeper
ebed1a68ff
Add log for segcore search (#15159) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-11 18:07:34 +08:00
Cai Yudong
951249c6c1
Use KnowhereConfig for indexnode and querynode (#15112) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-11 09:35:34 +08:00
xige-16
99315ce00e
Optimize recentlyModified's lock (#15120) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-10 23:17:36 +08:00
bigsheeper
018f32847f
[skip e2e] Add comment for createSearchPlan (#15111) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-10 22:36:06 +08:00
bigsheeper
4174daee80
[skip e2e] Add comment for newPartition (#15110) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-10 22:34:09 +08:00
bigsheeper
67e8c09df5
[skip e2e] Add comment for removeSegmentID (#15109) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-10 22:32:14 +08:00
Cai Yudong
b6a48817b0
Add MinioConfig in GlobalParams for all components (#15099) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-10 17:29:34 +08:00
xige-16
97ea9786e1
[skip e2e]Improve getSegmentByIDPrivate log format (#15028) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-10 10:11:34 +08:00
xige-16
43b09c83d1
[skip e2e]Improve getPartitionByIDPrivate log format (#15027) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-10 10:09:39 +08:00
Cai Yudong
7efb02a4c5
Use PulsarConfig in GlobalParams for all components (#15046) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-09 23:45:33 +08:00
xige-16
708dfddba6
[skip e2e]Improve getSegmentInfosByColID log format (#15026) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-07 17:55:23 +08:00
bigsheeper
8d24428c4e
[skip e2e] Add comment for addSegmentID (#15020) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-07 17:47:48 +08:00
bigsheeper
a7ad3f2a76
[skip e2e] Add comment for getSystemInfoMetrics (#15019) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-07 17:45:56 +08:00
bigsheeper
36b9c498ab
[skip e2e] Add comment for appendIndex (#15018) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-07 17:44:04 +08:00
Cai Yudong
f8f61fb116
Use BaseParams etcd configuration for all components (#15012) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-07 16:15:26 +08:00
xige-16
f808390f32
[skip e2e]Improve getCollectionID error log (#14964) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-06 23:43:22 +08:00
xige-16
9dbb37c7ea
[skip e2e]Improve addCollection error log (#14963) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-06 23:41:28 +08:00
bigsheeper
f90d5395a1
[skip e2e] Add comment for appendFieldInfo (#14958) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-06 23:35:47 +08:00
bigsheeper
d38ad2f511
[skip e2e] Add comment for appendIndexParam (#14957) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-06 23:33:55 +08:00
xige-16
f7368e35a4
Add log for LoadSegmentsTask (#14703) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-06 23:26:18 +08:00
bigsheeper
c79cbd341a
[skip e2e] Add comment for deleteLoadIndexInfo (#14956) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-06 23:22:03 +08:00
xige-16
0004238669
[skip e2e]Improve AddQueryChannel log (#14962) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-06 23:17:26 +08:00
xige-16
851794598e
[skip e2e]Improve log format (#14886) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-05 21:17:21 +08:00
xige-16
b3d33a78f5
[skip e2e]Improve log format (#14887) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-05 21:15:20 +08:00
xige-16
d751357be1
[skip e2e]Improve log format (#14885) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-05 21:13:20 +08:00
bigsheeper
64a5db66e9
[skip e2e] Add comment for newLoadIndexInfo (#14883) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-05 21:05:20 +08:00
bigsheeper
fe730024ab
[skip e2e] Add comment for newIndexLoader (#14882) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-05 21:03:26 +08:00
bigsheeper
8b9ce5780d
[skip e2e] Add comment for setIndexInfo (#14881) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-05 20:59:30 +08:00
bigsheeper
12f37ffb57
Improve timeout log when query in QueryNode (#14766) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-05 10:35:31 +08:00
xige-16
abf1f58abe
Add log for watchDeltaChannelTask's nodeID (#14702) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-04 20:45:24 +08:00
godchen
9e51591b3a
Fix pulsar reader not close (#14543) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-01-04 14:45:19 +08:00
bigsheeper
bd7a1cd3d1
[skip e2e] Add comment for getIndexInfo (#14745) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-04 14:06:02 +08:00
bigsheeper
cda172ede2
[skip e2e] Add comment for estimateIndexBinlogSize (#14744) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-04 14:04:03 +08:00
bigsheeper
6bace04dd3
[skip e2e] Add comment for getIndexBinlog (#14743) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-04 14:02:12 +08:00
bigsheeper
2e6fe7d815
[skip e2e] Add comment for printIndexParams (#14694) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-12-31 19:09:19 +08:00
bigsheeper
c95deb2266
[skip e2e] Add comment for loadIndex (#14693) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-12-31 19:07:23 +08:00
bigsheeper
6b806fc850
[skip e2e] Add comment for getReadyLoad (#14692) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-12-31 19:05:24 +08:00
xige-16
148dad23ac
Format watchDmChannel's log (#14633) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-30 20:27:20 +08:00
bigsheeper
8a3a1b556a
Free OS memory in QueryNode and IndexNode (#14305) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-12-30 20:03:29 +08:00
bigsheeper
983d9b4b73
[skip e2e] Add comment for getIndexParams (#14580) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-12-30 16:57:33 +08:00
bigsheeper
26a8bac54c
[skip e2e] Add comment for getIndexPaths (#14579) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-12-30 16:56:04 +08:00
bigsheeper
168f05de3a
[skip e2e] Add comment for getFieldID (#14578) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-12-30 16:39:04 +08:00
Jiquan Long
ebb9b24b47
Improve name of flowgraph node (#14538) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-30 10:33:46 +08:00
xige-16
8b919f50c1
[skip e2e] Add debug log for watchDmChannelReq (#14551) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-29 21:51:45 +08:00