yukun
ecaef24fea
Change should_not to must_not in dsl ( #5131 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-07 11:52:24 +00:00
FluorineDog
b1974aede2
Merge knowhere unittests ( #5139 )
...
Re-enable knowhere unittests and merge them all together.
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-07 11:50:13 +00:00
dragondriver
b7977698a8
Change the codec style of expr plan from text to binary ( #5129 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-07 11:27:17 +00:00
dragondriver
e5d4963ba0
Distinguish the dsl and expr in proxy and query node ( #5118 )
...
Pass a parameter `IsExpr` from proxy to query node, so query
node can create search plan according to the variable `IsExpr`.
It makes `segcore` unnecessary to distinguish `dsl` or `expr`
using dynamic exception. When `IsExpr` is set to true, query
node will call `CreatePlanByExpr` according to the passed
information about expression. Otherwise query node will keep
still to use `CreatePlan` according to the `dsl` information. At
the same time, this pr adds some unittests to `CreatePlanByExpr`,
these unittests translate already exist case with `dsl` to case with
`expr`.
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-07 07:20:47 +00:00
FluorineDog
396b3f33e9
Support TermExpr, NotExpr, LogicalExpr ( #5096 )
...
1. Support Term, like `A in [1, 2, 3]`
2. Support Not, like `! A < 3`
3. Support logical combination, like `A < 3 && B > 5 or C == 0`
Type: Feature
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-04-30 07:19:52 +00:00
shengjun.li
b46ae44087
Zero size allocation in StackDeviceMemory ( #5100 )
...
When the remaining space is empty, the zero size allocation will
get the pointer `end_`. However, `cudafree` the pointer `end_` will
cause to crash.
Fix : #5078 #4770 #4412 #4340 #3646
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-30 04:21:02 +00:00
FluorineDog
88f5642603
Add plan proto and support basic boolean expr parser ( #5088 )
...
**What type of PR is this?**
- [x] Feature
**What this PR does / why we need it:**
This PR supports boolean expression as DSL.
1. The goal of this PR is to support predicates
like `A > 3 && not B < 5 or C in [1, 2, 3]`.
2. Defines `plan.proto`, as Intermediate Representation (IR)
used between go and cpp.
3. Support expr parser, convert predicate expr to IR
in proxynode, while doing static check there
4. Support IR to AST in cpp, enable the execution
2021-04-29 08:48:06 +00:00
godchen
060f7ca0d2
Add get index build progress proto ( #5049 )
...
Add get index build progress proto.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-27 07:46:45 +00:00
shengjun.li
a3e4339027
improve rhnsw ( #5059 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-27 06:17:52 +00:00
neza2017
262c484cec
the return struct of "DescribeIndex" should contain "filed_name" ( #5055 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-04-27 02:30:55 +00:00
shengjun.li
a2875f9d95
Update knowhere ( #5006 )
...
Import performance of ivf::train and hnsw, and fix bugs
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-23 18:03:49 +08:00
Xiangyu Wang
82ccd4cec0
Rename module ( #4988 )
...
* Rename module
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
xige-16
1165db75f6
Optimize search performance
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-04-19 19:30:36 +08:00
cai.zhang
9ccaff8005
Add copyright
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-04-19 19:28:11 +08:00
FluorineDog
43b39cc9c9
Fix memory leak, temp solution
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-19 16:39:23 +08:00
FluorineDog
6059558698
Add license files
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-19 11:16:16 +08:00
cai.zhang
a54097708d
Adjust the DropIndex logic of the indexservice
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-04-16 15:37:13 +08:00
FluorineDog
ce7a5ea699
Support segcoreinit
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-16 14:02:49 +08:00
xige-16
22eda19bc4
Fix mem leak when load index
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-04-10 10:10:53 +08:00
XuanYang-cn
46d27e37d7
Skip install gtest when build with test
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-04-08 10:01:18 +08:00
FluorineDog
1446cd5453
Fix flat unsupported bug
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-07 10:39:35 +08:00
xige-16
a6f1de036b
Optimize search performance in query node
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-30 22:16:58 +08:00
FluorineDog
f39dcdb8f3
Support error code in segcore
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-26 16:18:30 +08:00
dragondriver
9d062b54ee
Add benchmark for indexbuilder, refactor test utils
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-23 18:44:57 +08:00
zhenshan.cao
c2734fa55f
Fix bug and enchance system
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-22 16:36:10 +08:00
dragondriver
7554b8afe7
Add default nbits when build ivf-pq index
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-19 16:37:13 +08:00
FluorineDog
2cec04ed90
Fix empty schema proto hack
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-17 11:35:28 +08:00
xige-16
8a5c039137
Fix search error when running single node
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-12 19:23:06 +08:00
FluorineDog
e33d0a797c
Migrate knowhere to segcore
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-12 15:54:59 +08:00
godchen
f3649f0419
Refactor interface and proto
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-12 14:22:09 +08:00
ThreadDao
ca916a5c47
Add ci nightly
...
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-03-11 14:14:29 +08:00
xige-16
09ae985daa
Fix wrong error code in master_service_test.go
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-10 22:06:22 +08:00
neza2017
7b2d67242d
Fix describe segment if index not exist
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-10 14:45:35 +08:00
FluorineDog
af1900b42a
Remove ConcurrentBitsetPtr in segcore
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-09 16:16:43 +08:00
quicksilver
455cc59dbb
Update publish-test-images.yaml
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-09 13:55:35 +08:00
Cai Yudong
c795cdbe2a
Change minSegmentSizeToEnableIndex default to 1024
...
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2021-03-07 13:37:25 -06:00
neza2017
014c4fe8ce
Add config of minSegmentSizeToEnableIndex
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-08 15:46:51 +08:00
neza2017
2835bcdc4e
Update masterservice unittest
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-05 20:41:34 +08:00
bigsheeper
447a15207e
Add zap log to query node
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-03-05 09:21:35 +08:00
dragondriver
801396e3ef
Disable register link logic, use proxy node directly
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-04 22:27:12 +08:00
FluorineDog
ef98dab2a9
Support segcore config
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-04 17:09:48 +08:00
FluorineDog
b7a00e30e2
Fix memory leak
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-01 11:14:51 +08:00
FluorineDog
66146223ca
Support flat
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-02-27 12:46:37 +08:00
FluorineDog
bf75c2fbb4
Fix bug ( #1053 )
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-02-25 17:56:43 +08:00
neza2017
d5631b09e8
Describe collection by id
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-02-25 16:08:56 +08:00
xige-16
4c491471ee
Add release collection and release partition interface for query node
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-24 15:58:55 +08:00
zhenshan.cao
6b392cbe58
Fix memory leak
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-23 14:35:00 +08:00
xige-16
7a7a73e89c
Fix high memory usage in pulsarTtStream
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-23 11:40:12 +08:00
FluorineDog
15dd17488e
Support benchmark
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-02-23 10:47:21 +08:00
dragondriver
68518fec38
Fix memory leak in indexnode
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-22 18:33:40 +08:00