Commit Graph

184 Commits

Author SHA1 Message Date
Cai Yudong
07aa453270
[skip ci] Update test_segcore (#8270)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-22 17:19:53 +08:00
yukun
82e48fb379
Add more error messages in segcore visitors (#8195)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-18 15:53:51 +08:00
Cai Yudong
2a946707b9
[skip ci] Update test_concurrent_vector.cpp (#8205)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-18 14:41:50 +08:00
zhenshan.cao
4c184921f0
Add comments and enchanme unittest for retrieve (#8114)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-16 23:43:49 +08:00
zhenshan.cao
5cd9ea5f04
Fixbug: init optional retrieve_ret_ when query result is empty (#8068)
Add unittest

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-16 20:11:49 +08:00
Cai Yudong
14ef405a6b
Rename chunk_size to chunk_rows for better code readability (#7953)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 15:15:52 +08:00
Cai Yudong
a0fd2707cb
Support config SIMD type (#7942)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 12:57:48 +08:00
Cai Yudong
e6c384b4d4
Move segcore chunk_size configuration to querynode.yaml (#7913)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 10:35:52 +08:00
Cai Yudong
b5923ff27d
Update segcore unittest format (#7860)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-14 11:22:57 +08:00
Cai Yudong
74ac528095
Improve segcore (#7851)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-14 10:53:04 +08:00
Cai Yudong
27dcf698d3
Support set segcore chunk_size via config file (#7635)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-11 14:40:01 +08:00
yukun
94272bba87
Support query by expression (#7386)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-09-03 17:12:55 +08:00
xige-16
76066b5659
Fix IVF_FLAT index's wrong meta_data (#7167)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-19 14:26:11 +08:00
Cai Yudong
6c75301c70
optimize search reduce logic (#7066)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-12 18:00:11 +08:00
xaxys
e43b43e7d8
Refactor RangeExpr & CompareExpr (#6786)
* Changed `RangeExpr` proto to `UnaryRangeExpr` & `BinaryRangeExpr`
Several unit test unpassed.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix bugs to pass unit test. Fix format.

Signed-off-by: xaxys <tpnnghd@163.com>

* Remove debug information.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix format.
Remove debug information.
Unify variable name.
Add error information.
Remove `CompareExpr` test in `test_c_api.cpp`.

Signed-off-by: xaxys <tpnnghd@163.com>

* Fix code format.

Signed-off-by: xaxys <tpnnghd@163.com>

* Update `Plan.cpp`.

Signed-off-by: xaxys <tpnnghd@163.com>
2021-07-25 10:23:19 +08:00
dragondriver
2821c08560
Add unittests for metric_type: tanimoto (#6773)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-23 20:59:33 +08:00
FluorineDog
aba21baf82
refactor expr executor to use single bitset (#6667)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-23 15:30:12 +08:00
Cai Yudong
744f2c7f51
optimize test_c_api.cpp (#6637)
* optimize test_c_api.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* clean redundant file

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* change DIM to const

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize test_c_api.cpp

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update reduce testcase

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-20 17:13:21 +08:00
FluorineDog
234954931f
remove deprecated (#6623)
* remove deprecated

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* fix timeout

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-20 15:18:08 +08:00
dragondriver
99249a0224
Fix bug: override the compare function of SearchResultPair (#6628)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-20 14:38:11 +08:00
Cai Yudong
724f10b9a0
Unify the usage of query and search (#6467)
Unify the usage of query and search

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-13 22:20:33 +08:00
xaxys
e5f8a77a2d
Extend grammar of boolean expression (#6460)
* Extend grammar of boolean expression

Signed-off-by: xaxys <tpnnghd@163.com>
2021-07-13 14:37:03 +08:00
FluorineDog
2ff072ea7b
Use larger dim for binary test to avoid false positive test failed (#6416)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-09 18:12:40 +08:00
FluorineDog
97b1426666
fix benchmark, add support for primary key in schemaHelper (#6281)
* fix benchmark

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* fix tests

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-06 09:50:01 +08:00
dragondriver
8dd2051a9a
Fix 5045, decrease the nb and nlist in unittest (#6282)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-02 18:20:14 +08:00
FluorineDog
bf8b2be4a7
Deprecate num_groups to simplify search API (#6230)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-07-01 10:32:15 +08:00
FluorineDog
255e3959af
support time travel (#5894)
* support time travel

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* lint

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-19 17:38:11 +08:00
FluorineDog
9a90313390
Support GetEntityByIDs in CGo, fix segcore bugs (#5563)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-04 10:38:34 +08:00
FluorineDog
b1a9aea6a6
support get entity by ids in segcore (#5456)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-28 10:39:30 +08:00
FluorineDog
3f42a9ed12
reduce unittest time (#5363)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-24 03:54:06 +00:00
yukun
ecaef24fea
Change should_not to must_not in dsl (#5131)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-07 11:52:24 +00:00
dragondriver
b7977698a8
Change the codec style of expr plan from text to binary (#5129)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-07 11:27:17 +00:00
dragondriver
e5d4963ba0
Distinguish the dsl and expr in proxy and query node (#5118)
Pass a parameter `IsExpr` from proxy to query node, so query 
node can create search plan according to the variable `IsExpr`.
It makes `segcore` unnecessary to distinguish `dsl` or `expr`
using dynamic exception. When `IsExpr` is set to true, query
node will call `CreatePlanByExpr` according to the passed
information about expression. Otherwise query node will keep
still to use `CreatePlan` according to the `dsl` information. At
the same time, this pr adds some unittests to `CreatePlanByExpr`,
these unittests translate already exist case with `dsl` to case with
`expr`.

Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-07 07:20:47 +00:00
FluorineDog
396b3f33e9
Support TermExpr, NotExpr, LogicalExpr (#5096)
1. Support Term, like `A in [1, 2, 3]`
2. Support Not, like `! A < 3`
3. Support logical combination, like `A < 3 && B > 5 or C == 0`

Type: Feature

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-04-30 07:19:52 +00:00
FluorineDog
88f5642603
Add plan proto and support basic boolean expr parser (#5088)
**What type of PR is this?**
- [x] Feature

**What this PR does / why we need it:**
This PR supports boolean expression as DSL.
1. The goal of this PR is to support predicates
    like `A > 3 && not B < 5 or C in [1, 2, 3]`. 
2. Defines `plan.proto`, as Intermediate Representation (IR) 
    used between go and cpp. 
3. Support expr parser, convert predicate expr to IR
    in proxynode, while doing static check there
4. Support IR to AST in cpp, enable the execution
2021-04-29 08:48:06 +00:00
FluorineDog
6059558698 Add license files
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-19 11:16:16 +08:00
FluorineDog
ce7a5ea699 Support segcoreinit
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-16 14:02:49 +08:00
XuanYang-cn
46d27e37d7 Skip install gtest when build with test
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-04-08 10:01:18 +08:00
dragondriver
9d062b54ee Add benchmark for indexbuilder, refactor test utils
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-03-23 18:44:57 +08:00
zhenshan.cao
c2734fa55f Fix bug and enchance system
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-22 16:36:10 +08:00
FluorineDog
2cec04ed90 Fix empty schema proto hack
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-17 11:35:28 +08:00
xige-16
8a5c039137 Fix search error when running single node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-12 19:23:06 +08:00
FluorineDog
e33d0a797c Migrate knowhere to segcore
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-12 15:54:59 +08:00
godchen
f3649f0419 Refactor interface and proto
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-12 14:22:09 +08:00
FluorineDog
ef98dab2a9 Support segcore config
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-04 17:09:48 +08:00
FluorineDog
66146223ca Support flat
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-02-27 12:46:37 +08:00
zhenshan.cao
6b392cbe58 Fix memory leak
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-23 14:35:00 +08:00
dragondriver
68518fec38 Fix memory leak in indexnode
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-22 18:33:40 +08:00
xige-16
f62078c027 Fix crash error when search
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-20 10:14:03 +08:00
xige-16
2ca53fa668 Fix msgstream deadlock when loadCollection
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-07 15:47:10 +08:00