test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-05 05:18:52 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
9,478 Commits 96 Branches 105 Tags 186 MiB
235d736a49
Commit Graph

319 Commits

Author SHA1 Message Date
zhenshan.cao
8a1a841011
FixBug: Incorrect handling of time synchronization (#6814) 
* FixBug: proxy send wrong sync timetick and DataCoord did not filter channel

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-07-27 14:34:48 +08:00
dragondriver
3cc8ee298e
Filter NaN when reducing search results (#6806) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-27 10:19:21 +08:00
xaxys
e43b43e7d8
Refactor RangeExpr & CompareExpr (#6786) 
* Changed `RangeExpr` proto to `UnaryRangeExpr` & `BinaryRangeExpr`
Several unit test unpassed.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix bugs to pass unit test. Fix format.

Signed-off-by: xaxys <tpnnghd@163.com>

* Remove debug information.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix format.
Remove debug information.
Unify variable name.
Add error information.
Remove `CompareExpr` test in `test_c_api.cpp`.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix code format.

Signed-off-by: xaxys <tpnnghd@163.com>

* Update `Plan.cpp`.

Signed-off-by: xaxys <tpnnghd@163.com>
 2021-07-25 10:23:19 +08:00
zhenshan.cao
2962d31a5f
Fixbug: segment allocate but return value incorrect (#6788) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-07-24 20:49:20 +08:00
dragondriver
cf8e9d52b1
Reduce the log of proxy (#6766) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-23 20:33:34 +08:00
dragondriver
67c1fdd2c0
Show/Describe collections/partitions with created timestamp (#6700) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-21 18:00:14 +08:00
Cai Yudong
cbb4052fdb
Support search and query output fields using wildcard (#6671) 
* update wildcard polocy for search and query

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* mark xfail cases

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* mark xfail cases

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize debug log

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-21 14:52:12 +08:00
dragondriver
26f890b5f5
Remove too frequent timetick log (#6682) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-21 11:26:11 +08:00
congqixia
9b1708f6e5
Fix proxy crashes when retrieve task is called (#6656) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-07-20 22:33:09 +08:00
dragondriver
0e2329c7ad
Refactor snapshot of timestamp statistics (#6600) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-17 16:31:29 +08:00
dragondriver
2d9361e0ba
Fix bug: remove duplicated primary field id when retrieve entities (#6577) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-17 10:53:30 +08:00
Cai Yudong
a992dcf6a8
Support query return vector output field (#6570) 
* improve code readibility

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add offset in RetrieveResults

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add VectorFieldInfo into Segment struct

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add new interface for query vector

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update load vector field logic

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update load vector field logic

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fill in field name in query result

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add FieldId into FieldData

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add fillVectorOutputFieldsIfNeeded

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update data_codec_test.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add DeserializeFieldData

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* realize query return vector output field

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* disable query vector case

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-16 17:19:55 +08:00
紫晴
4c7b57ffc5
Upload codecov report in GitHub Actions (#6565) 
* Upload codecov report in GitHub Actions

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2021-07-16 14:52:21 +08:00
dragondriver
84b9791221
Fix snapshot of timestmap statistics (#6543) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-15 17:47:55 +08:00
dragondriver
5016e509be
Support wildcard match on search/query output fields (#6510) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-14 18:51:54 +08:00
Cai Yudong
1c29b42434
change output_fields to out_fields_id for RetrieveRequest (#6506) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-14 13:11:54 +08:00
dragondriver
d896e3119e
Fix 6419, check if num_rows is greater than zero in proxy (#6439) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-13 16:33:55 +08:00
xaxys
e5f8a77a2d
Extend grammar of boolean expression (#6460) 
* Extend grammar of boolean expression

Signed-off-by: xaxys <tpnnghd@163.com>
 2021-07-13 14:37:03 +08:00
dragondriver
bd317a5461
Check if field data is empty (#6404) 
* Check if field data is empty

Signed-off-by: dragondriver <jiquan.long@zilliz.com>

* FixBug: fast fail when output_fields contain fields that are not in schema

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Co-authored-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-07-11 19:39:52 +08:00
neza2017
8b89744c6b
search with exp (#6409) 
* process float vector and binary vector field
on the search result

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add more debug info on etcd

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add debug info when grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-10 10:21:52 +08:00
groot
19fc42c9eb
calc_distance typo (#6380) 
* calc_distance typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc_distance typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-07-09 14:53:52 +08:00
zhenshan.cao
b53699b846
Fixbug: distinguish the name of the subscription based on ProxyID (#6333) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-07-08 19:52:39 +08:00
yukun
33162ca40f
Fix query error message (#6344) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-07-08 15:05:52 +08:00
dragondriver
166548447b
Fix 6249, use more clear error message (#6316) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-06 14:40:04 +08:00
groot
a364d7303b
Implement calculate vectors distance in server (#6219) 
* calc distance stage 3

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc distance stage 5

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc distance stage 6

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* code style

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-07-01 18:56:17 +08:00
zhenshan.cao
ff4c6c7ff4
Fix travel timestamp and guarantee timestamp (#6234) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-30 21:02:13 +08:00
yukun
95aa3c85b6
Add index_name check for drop_index (#6217) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-30 17:56:12 +08:00
yukun
b87baa108a
Add topks in searchResult (#6168) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-28 15:28:11 +08:00
yukun
7df4bf8d93
Change strange expression err hint (#6128) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-28 15:18:12 +08:00
dragondriver
d3c503f3aa
Calculate the real topk in proxy (#6132) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-06-28 14:30:14 +08:00
yukun
ae66446f16
Fix issue-5992 (#6158) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-28 12:16:13 +08:00
yukun
effcbc7cb3
Fix issue-6143 (#6145) 
* Fix issue-6143

Signed-off-by: kun yu <kun.yu@zilliz.com>

* Return error when output_fields contains vector field

Signed-off-by: kun yu <kun.yu@zilliz.com>

* Fix when output_fields contain primarykey

Signed-off-by: kun yu <kun.yu@zilliz.com>

* Add primarykey

Signed-off-by: kun yu <kun.yu@zilliz.com>
 2021-06-28 10:12:13 +08:00
xige-16
ca4cba152c
return loaded collection when ShowCollectionsType_InMemory (#6149) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-27 12:10:08 +08:00
zhenshan.cao
42be531f9c
Add InsertCnt (#6131) 
* Add InsertCnt

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Enhance log

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-26 14:02:12 +08:00
yukun
39614aa8eb
Add rocksmq_path in config and paramtable (#6099) 
* Add rocksmq_path in config and paramtable

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add rocksdbPath in NewRmsFactory

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change rdb default path to /vat/lib/milvus/rdb_data

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-25 19:44:11 +08:00
yukun
eb818d05ab
Remove vector fields from output fields (#6112) 
* Remove vector fields from output fields

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add empty_collection error_code

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-25 16:52:11 +08:00
yukun
9b549e0fa4
Add primaryKey to output fields (#6094) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-24 21:08:14 +08:00
yukun
0f409da136
Fix standalone seek hang after restart (#6073) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-24 16:44:07 +08:00
yukun
b72e4c6372
Merge search_collection and retrieve_colletion into query_collection (#6037) 
* Merge search_collection and retrieve_colletion into query_collection

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix static-check

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-23 20:26:10 +08:00
bigsheeper
0f89f40488
Use virtual channel in search result and retrieve result (#6030) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-06-23 18:00:37 +08:00
sunby
46f86a0354
Return sealed segments when calling flush (#6011) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-23 16:56:11 +08:00
Cai Yudong
a09a3a1905
rename service to coord (#6020) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-23 16:14:08 +08:00
dragondriver
a493151f70
Fix #5951 (#6010) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-06-23 12:06:10 +08:00
godchen
99be4c09a5
change retry (#5996) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-23 09:24:10 +08:00
Cai Yudong
7dbf33b788
Update component names in config files (#5989) 
* rename master/indexService in .yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxyNode to proxy in config files

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move master.yaml to root_coord.yaml, move proxy_node.yaml to proxy.yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proto/query_service.proto to proto/query_coord.proto

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proxy_node_manager.go to proxy_manager.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add query_coord.pb.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 19:08:03 +08:00
yukun
792dba4ae3
Fix id field insert failed when auto_id is true (#5984) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-22 18:46:04 +08:00
FluorineDog
b51893d3f1
Enrich retrieve task error message (#5975) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-06-22 18:42:03 +08:00
zhenshan.cao
0f05622c09
Modify error msg when index is not created (#5978) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-22 18:04:07 +08:00
congqixia
7a2546c24a
Fix proxy panic if quit before init (#5981) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-06-22 17:40:07 +08:00
xige-16
2af1c27811
Rename queryservice to querycoordinator (#5931) 
* Rename queryservice to querycoordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix param table

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix unittest

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* service to coordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set querycoord in ci

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-22 16:44:09 +08:00
Cai Yudong
d5f4ee6f44
Rename proto master/index_service/proxy_service (#5973) 
* rename proto proxy_service to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proto index_service to index_coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proto master to root_coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 16:14:09 +08:00
dragondriver
fd57554d32
Add index params check in proxy (#5958) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-06-22 15:28:04 +08:00
Cai Yudong
2926a78968
Rename proxynode to proxy (#5961) 
* rename package name from proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/proxynode to distributed/proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/proxynode to internal/proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 14:40:07 +08:00
quicksilver
7fe061b846 Raneme init_devcontainer.sh to devcontainer.sh 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-15 14:38:36 +08:00
neza2017
56ab2bda2d Update proto:add partition id 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-15 11:53:22 +08:00
zhenshan.cao
63b21321d6 Refactor indexservice and update doc 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-15 13:50:27 +08:00
cai.zhang
3d885742ee Reopen ruleguard and format code 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-13 13:36:27 +08:00
bigsheeper
2d2af1505a Improve mutex usage in query node 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-12 18:03:24 +08:00
GuoRentong
f3d2afa4f4 Update doc:detailed interface definition 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2021-01-11 18:35:54 +08:00
quicksilver
a6690dbc99 Fix syntax error: Bad fd number 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-11 15:25:19 +08:00
yukun
18cfd31d40 Fix Load and Remove with prefix 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-01-11 15:17:06 +08:00
bigsheeper
4fad3b189c Fix search without insertion, improve nil hits behavior (#622) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-09 17:58:18 +08:00
zhenshan.cao
02df310fa5 Fix data race 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-09 12:30:22 +08:00
xige-16
f4566731fc Fix search error in regression test 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-01-09 09:47:22 +08:00
sunby
5dfe9448ae Modify test_index 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-08 16:00:16 +08:00
GuoRentong
82ad488555 Update doc: rocksmq 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2021-01-08 18:37:24 +08:00
dragondriver
018466a256 Avoid crash when index parameters are invalid 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-08 17:45:57 +08:00
XuanYang-cn
65089ea362 Fix flush sync test bug and remove unecessary lock in meta_table 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-08 17:20:59 +08:00
GuoRentong
c4599e26de Update doc: node api 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2021-01-08 16:59:19 +08:00
bigsheeper
e13822043d Fix search test when partition not exists, add binary vector search validation 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-08 16:41:27 +08:00
godchen
fa73f17f94 Add opentracing doc 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-01-08 15:32:38 +08:00
quicksilver
f6d4214bbe Optimize the workflow for cache go mod 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-08 15:00:58 +08:00
sunby
3b68bf22f3 Add pre-checks in create index task 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-08 11:06:56 +08:00
dragondriver
ced56c84f8 Add support to build binary vector index 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-07 14:56:17 +08:00
godchen
8f1f118b26 Add query opentracing 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-01-07 14:24:35 +08:00
bigsheeper
a1e2ff3c26 Add gcNode to write node 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-06 16:44:12 +08:00
neza2017
4015d7245d Merge operation 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-06 14:45:50 +08:00
zhenshan.cao
b06e01f523 Initmate querynode collection manager 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-06 11:31:36 +08:00
godchen
1c87faf8b3 Add insert request opentracing 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-01-06 11:17:35 +08:00
quicksilver
b1b8747477 Add logic of incremental check for go code 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-12-29 17:19:44 +08:00
dragondriver
243346247b Add unittest case which used in regression to index builder 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-12-29 16:31:03 +08:00
bigsheeper
1e3b7cd55e Fix binary vector metric type validation 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-12-29 16:14:52 +08:00
GuoRentong
e8ec0424d8 Update doc: service api 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2020-12-27 09:05:24 +08:00
XuanYang-cn
e316533a3a Add Flush Sync service 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-12-26 16:28:55 +08:00
bigsheeper
5acc9681d6 Fix search error about metric type 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-12-26 15:29:48 +08:00
cai.zhang
2031c54746 Add unittest about index in proxy 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-26 11:51:07 +08:00
XuanYang-cn
c0797333ce Add ddl binlog metaTable in writenode 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-12-24 20:55:40 +08:00
neza2017
4dbf4ade41 Add test for master 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-24 16:19:42 +08:00
zhenshan.cao
a0244b7683 Add segment expire logic for proxy 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-24 16:53:31 +08:00
cai.zhang
a8b78f11c3 Update proto about index 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-23 19:06:11 +08:00
sunby
0b9cffaf87 Remove index_name in IndexRequest and remove indexType in FieldIndexMeta 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-12-23 11:34:35 +08:00
cai.zhang
05918f55d2 Impl CreateIndex interface for proxy server 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-22 15:39:10 +08:00
cai.zhang
b582cf7b8e Add the interface of index in proto 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-21 19:28:54 +08:00
bigsheeper
762b1e1f1f Add ddService, fieldID, requestID and refactor params table, fix nil hits search result bug 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-12-10 16:31:09 +08:00
XuanYang-cn
32977e270c Add impl cgo of parquet 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-12-08 14:41:04 +08:00
zhenshan.cao
65ce1f97e7 Fix bug: pulsar dirty msg 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-07 19:41:39 +08:00
zhenshan.cao
7bbbc14637 Fix bug: address already used 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-07 15:22:20 +08:00
xige-16
37d7526d31 Fix search test failure 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-12-07 14:37:42 +08:00
neza2017
aeca8f85a5 Run cwrapper unittest in ci 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-05 17:39:58 +08:00
cai.zhang
806a97505c Add query node for CI progress 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-05 16:12:45 +08:00
neza2017
70710dee47 Add parquet payload 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-05 16:11:03 +08:00
FluorineDog
6412ebc0d4 Add support of metric type in schema, enable binary vector, fix segfault 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-12-05 06:46:01 +08:00
cai.zhang
18a9ffb617 Increase timeout for golangci-lint 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-04 17:57:24 +08:00
zhenshan.cao
0b6fe0a8cf Refactor paramtable 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-04 14:18:17 +08:00
godchen
7ab5b5d80d Add MinIO kv implements 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-12-03 19:00:11 +08:00
neza2017
cec903da19 Add parquet payload 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-02 18:31:56 +08:00
quicksilver
0530fdf62f Open regression test 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-12-03 14:05:52 +08:00
zhenshan.cao
569057251c Add support of custom ID 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-02 16:12:21 +08:00
zhenshan.cao
23aebe7e2a Fix proxy unittest 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-01 19:53:53 +08:00
neza2017
17cc7bc337 Use MetaRootPath instead 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-01 17:03:39 +08:00
dragondriver
84b15c1f5c Fix the bug of meta cache in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-12-01 16:41:25 +08:00
cai.zhang
c1fbc4f8fa Open the tests for insert 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-01 15:18:57 +08:00
FluorineDog
6b74d82259 Support some validation for dsl parser 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-12-01 02:16:53 +08:00
zhenshan.cao
fda8d62b38 Fix make error 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-30 22:14:19 +08:00
neza2017
d3858500c6 Add static check 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-30 19:38:23 +08:00
dragondriver
2358fae703 Check the status of search results before reduce in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-30 19:08:32 +08:00
bigsheeper
0cd3e8d86c Use exception instead of runtime error 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-30 17:58:23 +08:00
dragondriver
51a9f49d35 Fix the topk check when deal with the search result in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-30 17:46:00 +08:00
zhenshan.cao
24942c3d6d Fix insert failed to return correct id range 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-30 12:08:47 +08:00
bigsheeper
d88a654db8 Fix search result 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-30 11:22:59 +08:00
quicksilver
86573d0053 Create Jenkins pipeline 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-11-30 10:07:04 +08:00
FluorineDog
77fa75b1ec Add binary insert and warper of binary search, rename vector 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-30 05:18:44 +08:00
cai.zhang
85a544b79b Add dockerfile for each component 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-28 19:06:48 +08:00
cai.zhang
115d0732af Update docker-compose file for unittest 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-28 16:43:39 +08:00
dragondriver
eb6c0e0a28 Fix the bug when reduce the multiple search result from query nodes 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-28 15:57:49 +08:00
godchen
92bf09c7e6 Add ddstream and scheduler implements 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-11-28 15:26:39 +08:00
dragondriver
568cef0730 Fix InsertTask and SearchTask 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-28 10:48:29 +08:00
FluorineDog
c9fb34142c Enable primary_key switch 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-28 09:16:00 +08:00
dragondriver
235e723eb6 Read proxy id from param table instead of hardcode 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-27 11:17:12 +08:00
XuanYang-cn
3e605ae25f Rename reader to querynode 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-27 10:56:53 +08:00
bigsheeper
1decc1a4ca Add metaRootPath and kvRootPath 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-27 09:59:40 +08:00
dragondriver
72a7af3f4a Add time tick logic to Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-26 17:47:46 +08:00
neza2017
32445dd02b Add cpu profile 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-26 16:01:31 +08:00
cai.zhang
57da66ba72 Update read config logic in docker 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-26 15:18:36 +08:00
dragondriver
ab75438abf Fix bug of repack function of InsertTask in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-26 15:17:20 +08:00
neza2017
d9e5a8774d Add dimension validation 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-26 15:07:47 +08:00
FluorineDog
8ae573b580 Fix bool bug 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-26 14:56:58 +08:00
sunby
e8e21a0308 Add dimension validation. 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-26 14:54:03 +08:00
zhenshan.cao
045fc3d808 Fix segment fault 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-26 14:29:01 +08:00
XuanYang-cn
0a16a9a651 Add logic of getting milvus distributed config from master by grpc 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-26 13:21:06 +08:00
dragondriver
8ce0deca4e Add default partition tag to InsertTask in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-26 11:38:04 +08:00
xige-16
ae78aa1ac1 Warp cpp reduce and repack searchResultMsg to specified pulsar channel 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-11-26 11:12:33 +08:00
neza2017
ae26a81550 Change to use Marshal as text 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-26 10:13:23 +08:00
sunby
f4c643f1bd Add number limitation of partition and field. And Change default partition tag to "_default" 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-25 18:39:05 +08:00
zhenshan.cao
f12366342f Fix bug and delete unused code 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-25 16:45:42 +08:00
bigsheeper
4ed11d9775 Reopen segment test assertion 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-25 16:24:57 +08:00
bigsheeper
3b24c52a8c Catch cpp runtime error 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-25 16:20:07 +08:00
dragondriver
a7b3efecd7 Read query node num from param table instead of hardcode 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-25 16:17:33 +08:00
cai.zhang
4bcb460c98 Add clang-format 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-25 15:25:00 +08:00
FluorineDog
a6f950e5b6 Fix boost::dynamic_bitset misuse 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-25 15:17:17 +08:00