Commit Graph

86 Commits

Author SHA1 Message Date
dragondriver
31b400a9f7 Refactor the workflow of receiving search result from query node (#5527)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-15 15:59:04 +08:00
dragondriver
6ea11f67cb Dock channelsTimeTicker, channelsMgr with master service (#5509)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-15 15:59:04 +08:00
dragondriver
1f3c9d5dc7 Add statistics function to task scheduler (#5500)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-15 15:59:04 +08:00
dragondriver
59a3d83f97 Replace insertChannelsMap with channelsMgr (#5453)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-15 15:59:04 +08:00
bigsheeper
cdbc6d2c94
Refactor query node and query service (#5751)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-15 12:41:40 +08:00
yukun
313658767d
Add field_name and type in retrieve result (#5665)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-08 16:26:36 +08:00
zhenshan.cao
7dac20c35c
Add log for poxynode transform data and querynode segment insert (#5627)
* Add log for poxynode transform data and querynode segment insert

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Decrease print times

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-05 16:21:36 +08:00
cai.zhang
5037646cbd
Check dsl whether is None (#5616)
* Check dsl whether is None

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Format code

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
2021-06-05 14:57:34 +08:00
yukun
45e7d26b01
Fix retrieve when output_fields is nil (#5623)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-05 10:57:34 +08:00
yukun
57ece4a771
Fix retrieve_collection bugs (#5575)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-03 19:41:33 +08:00
dragondriver
99699b2021
Support to show collections which are loaded into memory (#5567)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-03 19:09:33 +08:00
dragondriver
e76830ab09
Support column-based insert request in proxy (#5560)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-03 15:03:34 +08:00
zhenshan.cao
b0b8f58192
Fix bug: search timeout (#5557)
* Fix bug: search timeout

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Add log and fix unittest bug

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-03 14:58:34 +08:00
Xiangyu Wang
95e762bb21
Add logs in retrieve request process (#5460)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-29 11:19:30 +08:00
zhenshan.cao
6766169878
Refactor repack logic for insertion (#5399)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-25 11:53:15 +00:00
yukun
156d5b9f73
Add RetrieveTask PostExecute function (#5336)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>

See also: #5257
2021-05-21 08:39:28 +00:00
yukun
f18dfb4ff6
Add RetrieveTask implementation (#5313)
Resolves: #5257 

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-20 07:02:31 +00:00
yukun
a7bb701f73
Add Retrieve method grpc definition (#5294)
See also: #5253 

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-19 10:45:15 +00:00
dragondriver
64ab4d740b
Add row_count to partition statistics (#5162)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-10 09:39:08 +00:00
dragondriver
b7977698a8
Change the codec style of expr plan from text to binary (#5129)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-07 11:27:17 +00:00
dragondriver
e5d4963ba0
Distinguish the dsl and expr in proxy and query node (#5118)
Pass a parameter `IsExpr` from proxy to query node, so query 
node can create search plan according to the variable `IsExpr`.
It makes `segcore` unnecessary to distinguish `dsl` or `expr`
using dynamic exception. When `IsExpr` is set to true, query
node will call `CreatePlanByExpr` according to the passed
information about expression. Otherwise query node will keep
still to use `CreatePlan` according to the `dsl` information. At
the same time, this pr adds some unittests to `CreatePlanByExpr`,
these unittests translate already exist case with `dsl` to case with
`expr`.

Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-07 07:20:47 +00:00
FluorineDog
88f5642603
Add plan proto and support basic boolean expr parser (#5088)
**What type of PR is this?**
- [x] Feature

**What this PR does / why we need it:**
This PR supports boolean expression as DSL.
1. The goal of this PR is to support predicates
    like `A > 3 && not B < 5 or C in [1, 2, 3]`. 
2. Defines `plan.proto`, as Intermediate Representation (IR) 
    used between go and cpp. 
3. Support expr parser, convert predicate expr to IR
    in proxynode, while doing static check there
4. Support IR to AST in cpp, enable the execution
2021-04-29 08:48:06 +00:00
godchen
004598f796
Remove field in desc index interface. (#5080)
* remove field in desc index interface

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* trigger GitHub actions

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-28 09:48:38 +00:00
godchen
94f0966225
Add get index build progress interface implementation (#5067)
Add get index build progress interface implementation.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-28 03:15:28 +00:00
Xiangyu Wang
82ccd4cec0
Rename module (#4988)
* Rename module

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
dragondriver
dc7db73251 Add copyright annotations to proxynode and proxyservice
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-04-19 10:09:43 +08:00
XuanYang-cn
e281f6a4a1 Remove useless configs in config files
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-04-13 10:04:39 +08:00
dragondriver
57831b9978 Add unittest to insertChannelsMap in proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-04-08 15:41:28 +08:00
dragondriver
41e1975611 Parallelize the processing of loading binlog and saving index files
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-26 11:19:02 +08:00
quicksilver
7ad9b36207 Update reviewdog/action-hadolint github action version to v1.16.1
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-25 14:41:46 +08:00
dragondriver
1b743e5c6c Parallelize the processing of SearchTask.PostExecute
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-25 10:14:09 +08:00
dragondriver
49c6eeb052 Add useful debug log in proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-22 19:28:43 +08:00
zhenshan.cao
c2734fa55f Fix bug and enchance system
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-22 16:36:10 +08:00
sunby
7bb806b5f6 Log msgID and role when log collection
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-13 11:59:24 +08:00
godchen
f3649f0419 Refactor interface and proto
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-12 14:22:09 +08:00
ThreadDao
ca916a5c47 Add ci nightly
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-03-11 14:14:29 +08:00
xige-16
09ae985daa Fix wrong error code in master_service_test.go
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-10 22:06:22 +08:00
neza2017
7b2d67242d Fix describe segment if index not exist
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-10 14:45:35 +08:00
quicksilver
455cc59dbb Update publish-test-images.yaml
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-09 13:55:35 +08:00
cai.zhang
aa5ecbdc02 Use the project log instead of standard log of proxyservice and proxynode
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-03-08 19:39:36 +08:00
Cai Yudong
c795cdbe2a Change minSegmentSizeToEnableIndex default to 1024
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2021-03-07 13:37:25 -06:00
neza2017
014c4fe8ce Add config of minSegmentSizeToEnableIndex
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-08 15:46:51 +08:00
ThreadDao
7a3223dc81 tags collection stats
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-03-08 10:09:48 +08:00
quicksilver
74154a11a4 Fix deploy error during regression stage
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-05 16:52:45 +08:00
sunby
ddddd65d10 Delete internal/errors package
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-05 10:15:27 +08:00
godchen
7b9fdd7f29 Add opentracing
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-26 17:44:24 +08:00
zhenshan.cao
bbc65e0b14 Remove checking of VectorFieldMetricType in create_collection
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-24 18:14:59 +08:00
bigsheeper
08a020798e Release collection and partitions
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-24 17:24:51 +08:00
XuanYang-cn
fd562f9f9c Update doc: add proxy graph
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-24 09:48:17 +08:00
sunby
ea1d9ea99a Replace log in dataservice
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-23 09:58:06 +08:00