FluorineDog
88f5642603
Add plan proto and support basic boolean expr parser ( #5088 )
...
**What type of PR is this?**
- [x] Feature
**What this PR does / why we need it:**
This PR supports boolean expression as DSL.
1. The goal of this PR is to support predicates
like `A > 3 && not B < 5 or C in [1, 2, 3]`.
2. Defines `plan.proto`, as Intermediate Representation (IR)
used between go and cpp.
3. Support expr parser, convert predicate expr to IR
in proxynode, while doing static check there
4. Support IR to AST in cpp, enable the execution
2021-04-29 08:48:06 +00:00
bigsheeper
88e1d651cb
Remove partition and segment ids properly in query node ( #5090 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
**What type of PR is this?**
- [ ] API-change
- [x] BUG
- [ ] Improvement
- [ ] Documentation
- [ ] Feature
- [ ] Test and CI
- [ ] Code Refactoring
**Which issue(s) this PR fixes:**
Fixes #
**What this PR does / why we need it:**
Not Available
2021-04-29 07:59:08 +00:00
XuanYang-cn
cebdfb34f7
Enable multiple datanode ( #5068 )
...
Now it's able to start multiple datanode, however, they will process the same insert data.
Further changes are needed to truly enable multiple datanode:
While registering, dataservice need to return different insert channels for different datanode.
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-04-28 18:43:48 +08:00
godchen
004598f796
Remove field in desc index interface. ( #5080 )
...
* remove field in desc index interface
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* trigger GitHub actions
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-28 09:48:38 +00:00
godchen
94f0966225
Add get index build progress interface implementation ( #5067 )
...
Add get index build progress interface implementation.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-28 03:15:28 +00:00
godchen
060f7ca0d2
Add get index build progress proto ( #5049 )
...
Add get index build progress proto.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-27 07:46:45 +00:00
shengjun.li
a3e4339027
improve rhnsw ( #5059 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-27 06:17:52 +00:00
neza2017
262c484cec
the return struct of "DescribeIndex" should contain "filed_name" ( #5055 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-04-27 02:30:55 +00:00
neza2017
d7c0a72611
index name is unique in collection scope ( #5046 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-04-26 15:53:47 +08:00
Cai Yudong
74f457bd14
add more testcase to improve code coverage for data service ( #5041 )
...
* fix TestChannel run error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* comment validateAllocRequest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add test APIs
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-04-26 01:45:54 +00:00
bigsheeper
4197b094bf
Use internal dsl and placeholder group ( #5033 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-25 06:08:28 +00:00
sunby
4d03da9c4f
Remove SetSegmentState
and seal segment in segment allocator ( #4994 )
...
Segment should be sealed once it exceeds the limited size. This operation
should be done in segment allocator. Watcher only check the status to
decide whether the segment will be flushed.
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-25 01:51:57 +00:00
neza2017
ada58b5bde
add unit test for master's grpc server, the coverage of package "internal/distributed/masterservice" increase from 46.6% to 82.9% ( #5019 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-04-24 09:23:35 +00:00
bigsheeper
c4b379be8b
Set search graceful time from config ( #5014 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-24 07:53:37 +00:00
sunby
b855c283cb
Remove meaningless log test ( #5025 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-24 05:07:58 +00:00
Cai Yudong
5a75e23795
improve data service code coverage ( #5020 )
...
* optimize TestAssignSegmentID
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update mockMasterService to improve code coverage
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename client to kvClient in Server
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update server.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add TestChannel
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update TestChannel
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update TestChannel
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update TestChannel
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-04-24 03:29:15 +00:00
bigsheeper
2b5bedf736
Use multiple search channels ( #5018 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-24 02:44:28 +00:00
bigsheeper
00bb1014cd
Add search channels to query node ( #5012 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-23 10:11:26 +00:00
shengjun.li
a2875f9d95
Update knowhere ( #5006 )
...
Import performance of ivf::train and hnsw, and fix bugs
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-23 18:03:49 +08:00
Cai Yudong
111376ba40
improve code coverage for data service ( #4998 )
...
* rename mock.go to mock_test.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add allocator_test.go to improve code coverage
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update meta_test.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update watcher_test.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix race
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-04-23 02:15:30 +00:00
godchen
4f7e393bfd
Remove useless config ( #4997 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-23 10:10:46 +08:00
bigsheeper
dadb02db75
Remove unused params in query node ( #4987 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-23 10:07:45 +08:00
Xiangyu Wang
82ccd4cec0
Rename module ( #4988 )
...
* Rename module
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
sunby
fad94fb576
Remove unsed configs ( #4990 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-22 03:04:59 +00:00
xige-16
3bb69430cb
delete contex timeout in queryService's load ( #4986 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-04-22 09:23:49 +08:00
godchen
139b334732
Add kv etcd unittest and remove useless code ( #4974 )
...
* Add kv etcd unittest and remove useless code
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-21 18:45:35 +08:00
Cai Yudong
51cae2c9ba
add datanode unittest to improve code coverage ( #4982 )
...
add datanode unittest to improve code coverage
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-04-21 18:41:37 +08:00
xige-16
1165db75f6
Optimize search performance
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-04-19 19:30:36 +08:00
sunby
b79a408491
Remove unused config item in dataservice and datanode
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-19 19:28:45 +08:00
cai.zhang
9ccaff8005
Add copyright
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-04-19 19:28:11 +08:00
FluorineDog
43b39cc9c9
Fix memory leak, temp solution
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-19 16:39:23 +08:00
XuanYang-cn
6deba1faa5
Add license in datanode package
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-04-19 15:16:33 +08:00
zhenshan.cao
b1f664d04f
Add copyright
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-04-19 15:15:33 +08:00
cai.zhang
8a037a404e
Add Copyright for indexnode and indexservice
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-04-19 13:50:12 +08:00
bigsheeper
71b8f309b2
Add licence to query node and query service
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-19 13:47:10 +08:00
Xiangyu Wang
c731e2df78
Add license header in util
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-19 13:42:47 +08:00
sunby
0f2f46f39d
Add copyright
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-19 11:35:38 +08:00
godchen
0dfcb90881
Add storage copyright
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-19 11:32:24 +08:00
xige-16
51b2b45e03
Add copyright for msgStream
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-04-19 11:30:19 +08:00
FluorineDog
6059558698
Add license files
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-19 11:16:16 +08:00
yukun
89c4bf82a0
Add copyright in kv module
...
Signed-off-by: kun yu <kun.yu@zilliz.com>
2021-04-19 11:13:52 +08:00
neza2017
83647e8503
Add copyright in master service module
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-19 11:12:56 +08:00
godchen
a5ad70a5ab
Add unittest for storage
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-19 10:36:19 +08:00
Cai Yudong
a2041abab4
improve code coverage for datanode
...
improve code coverage for collection_replica_test.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-04-19 10:34:56 +08:00
dragondriver
dc7db73251
Add copyright annotations to proxynode and proxyservice
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-04-19 10:09:43 +08:00
bigsheeper
08c5134286
Fix collection cannot be found when searching
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-16 17:37:50 +08:00
sunby
94c3fc9321
Add unit tests in dataservice
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-16 16:30:55 +08:00
cai.zhang
a54097708d
Adjust the DropIndex logic of the indexservice
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-04-16 15:37:13 +08:00
bigsheeper
9e7559b865
Make query node asynchronously load and release collection
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-16 14:40:33 +08:00
FluorineDog
ce7a5ea699
Support segcoreinit
...
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-16 14:02:49 +08:00