Commit Graph

128 Commits

Author SHA1 Message Date
FluorineDog
88f5642603
Add plan proto and support basic boolean expr parser (#5088)
**What type of PR is this?**
- [x] Feature

**What this PR does / why we need it:**
This PR supports boolean expression as DSL.
1. The goal of this PR is to support predicates
    like `A > 3 && not B < 5 or C in [1, 2, 3]`. 
2. Defines `plan.proto`, as Intermediate Representation (IR) 
    used between go and cpp. 
3. Support expr parser, convert predicate expr to IR
    in proxynode, while doing static check there
4. Support IR to AST in cpp, enable the execution
2021-04-29 08:48:06 +00:00
godchen
004598f796
Remove field in desc index interface. (#5080)
* remove field in desc index interface

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* trigger GitHub actions

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-28 09:48:38 +00:00
godchen
94f0966225
Add get index build progress interface implementation (#5067)
Add get index build progress interface implementation.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-28 03:15:28 +00:00
godchen
060f7ca0d2
Add get index build progress proto (#5049)
Add get index build progress proto.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-27 07:46:45 +00:00
godchen
4f7e393bfd
Remove useless config (#4997)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-23 10:10:46 +08:00
bigsheeper
dadb02db75
Remove unused params in query node (#4987)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-23 10:07:45 +08:00
Xiangyu Wang
82ccd4cec0
Rename module (#4988)
* Rename module

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
sunby
fad94fb576
Remove unsed configs (#4990)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-22 03:04:59 +00:00
dragondriver
dc7db73251 Add copyright annotations to proxynode and proxyservice
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-04-19 10:09:43 +08:00
XuanYang-cn
e281f6a4a1 Remove useless configs in config files
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-04-13 10:04:39 +08:00
sunby
751c9d4e81 Refactor meta.go
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-09 09:55:04 +08:00
dragondriver
57831b9978 Add unittest to insertChannelsMap in proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-04-08 15:41:28 +08:00
dragondriver
846fd8a154 Add unittest to conf adapter in proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-04-08 09:51:04 +08:00
dragondriver
bfb7ca0df6 Add unittest to time tick logic in proxy service
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-04-07 10:06:17 +08:00
dragondriver
decc80a525 Add unittest to proxy service
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-04-06 14:12:57 +08:00
zhenshan.cao
c6950eb7eb Add log for allocator
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-04-01 13:37:18 +08:00
xige-16
c10b36f188 fix getting wrong offset when segment preinsert
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-31 16:16:58 +08:00
zhenshan.cao
efbf4452c5 Add log for port changed or proto unmarshal error
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-30 20:19:30 +08:00
sunby
ff8ebd5f42 Fix bug of estimating record size
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-29 15:14:51 +08:00
cai.zhang
c4a58d259a Add deploy mode env variable
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-03-27 11:56:57 +08:00
dragondriver
41e1975611 Parallelize the processing of loading binlog and saving index files
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-26 11:19:02 +08:00
quicksilver
7ad9b36207 Update reviewdog/action-hadolint github action version to v1.16.1
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-25 14:41:46 +08:00
dragondriver
1b743e5c6c Parallelize the processing of SearchTask.PostExecute
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-25 10:14:09 +08:00
zhenshan.cao
21ffc660b0 Get rid of memory panic
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-23 19:55:00 +08:00
dragondriver
49c6eeb052 Add useful debug log in proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-22 19:28:43 +08:00
zhenshan.cao
c2734fa55f Fix bug and enchance system
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-22 16:36:10 +08:00
groot
2280791128 Add memory message stream for search
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-03-19 20:16:04 +08:00
bigsheeper
ba65c38d40 Fix Deadline Exceeded
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-03-19 17:50:26 +08:00
zhenshan.cao
ec8ad89900 Delete uncessary print
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-15 19:47:13 +08:00
sunby
7bb806b5f6 Log msgID and role when log collection
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-13 11:59:24 +08:00
dragondriver
dd20ab44b8 Add interface of check param util
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-13 09:57:22 +08:00
cai.zhang
012f5f360e Add init log logic for index and proxy
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-03-12 19:47:37 +08:00
godchen
f3649f0419 Refactor interface and proto
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-12 14:22:09 +08:00
ThreadDao
ca916a5c47 Add ci nightly
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-03-11 14:14:29 +08:00
dragondriver
0f2a377b62 Delete redundant insert log
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-11 11:27:42 +08:00
xige-16
09ae985daa Fix wrong error code in master_service_test.go
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-10 22:06:22 +08:00
del-zhenwu
b1763c3690 Disable xdist in test cases
Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>
2021-03-10 15:27:26 +08:00
neza2017
7b2d67242d Fix describe segment if index not exist
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-10 14:45:35 +08:00
dragondriver
af32f442bb Split big insert message into serveral smaller
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-09 16:18:58 +08:00
quicksilver
455cc59dbb Update publish-test-images.yaml
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-09 13:55:35 +08:00
cai.zhang
aa5ecbdc02 Use the project log instead of standard log of proxyservice and proxynode
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-03-08 19:39:36 +08:00
Cai Yudong
c795cdbe2a Change minSegmentSizeToEnableIndex default to 1024
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2021-03-07 13:37:25 -06:00
neza2017
014c4fe8ce Add config of minSegmentSizeToEnableIndex
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-08 15:46:51 +08:00
XuanYang-cn
403212c5fa Fix describe_index test cases
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-03-08 15:00:08 +08:00
FluorineDog
ec0407d5f1 Support schema verifier
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-08 12:41:46 +08:00
ThreadDao
7a3223dc81 tags collection stats
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-03-08 10:09:48 +08:00
dragondriver
c68a8d35bf Remove timeout controlled by server, use timeout client passed instead
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-05 20:43:19 +08:00
Xiangyu Wang
e5d595564a Add log for singlenode
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-03-05 18:16:50 +08:00
quicksilver
74154a11a4 Fix deploy error during regression stage
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-05 16:52:45 +08:00
XuanYang-cn
a5c6f40c60 Enable tests in test_index.py
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-03-05 15:21:33 +08:00