Commit Graph

6897 Commits

Author SHA1 Message Date
neza2017
a124568664
fix makefile (#5236)
just remove standalone and milvus from $GOPATH/bin,
not every thing, on command of make clean

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-15 02:02:48 +00:00
quicksilver
d17ed98fff
Allow jenkins slave pod to remain active for a while (#5232)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-14 14:09:40 +00:00
Cai Yudong
08bb1b2ec3
Resend unsuccessful ddMsg when master start (#5214)
Resend unsuccessful ddMsg when master start

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-14 21:26:06 +08:00
quicksilver
9ffb42d448
Deny jenkins slave pod to remain active for a while (#5225)
* Deny jenkins slave pod to remain active for a while

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-14 18:23:30 +08:00
quicksilver
0a21933d84
Specified Milvus Helm Chart path in E2E test (#5199)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-14 10:12:03 +00:00
godchen
168b917f5b
Add session util doc (#5229)
Add session util doc.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-14 09:09:14 +00:00
XuanYang-cn
9151e13480
Remove not using dependence and proto (#5226)
- FlushMsg proto message is no longer in use

- We don't depend on "github.com/prometheus/common/log"

Signed-off-by: yangxuan xuan.yang@zilliz.com
2021-05-14 08:50:55 +00:00
XuanYang-cn
aa9ed7e98f
add datanode design doc (#5206)
* add datanode design doc
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-05-14 14:56:32 +08:00
neza2017
b1e95ccf28
[skip-ci] master service recovery on power failure (#5216)
design doc about master service recover on power failure
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-14 06:25:46 +00:00
yukun
4e6e502df1
Add data sorter in storage (#5200)
GetEntityByID needs the flushed segment to be sorted by RowID field, 
then do binary search to get the target id and entities.

See also: #5177 

Signed-off-by: fishpenguin kun.yu@zilliz.com
2021-05-14 02:59:49 +00:00
godchen
b74afd7a0e
Add service registration (#5189)
Add service registration.
Part of Issue #5174.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-14 02:05:18 +00:00
紫晴
d35092cc09
Update check function (#5205)
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2021-05-14 01:27:41 +00:00
紫晴
ec3d8c98a4
update test code (#5197)
update test code
2021-05-13 04:17:15 +00:00
quicksilver
8b7181c584
Update install_milvus.sh (#5188)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

Delete milvus PVC does not affect E2E Test workflow
2021-05-13 01:47:26 +00:00
Cai Yudong
7b83b11e95
Save ddmsg info and type into ETCD (#5173)
Save ddmsg info and type into ETCD to support re-send ddmsg 
when system restart or recover from failure (#5172)

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-12 07:33:53 +00:00
Xiangyu Wang
d543e2c6cc
[skip ci]Update mergify (#5180)
Signed-off-by: scsven <wxyucs@gmail.com>
2021-05-12 10:36:00 +08:00
yanliang567
acc631d632
[skip ci] Change code owner for test folders (#5178)
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2021-05-12 09:42:26 +08:00
quicksilver
9e848b184e
Add publish-krte-images.yaml (#5179)
* Add publish-krte-images.yaml

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Update publish-krte-images.yaml

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-11 19:28:29 +08:00
紫晴
1c8717c2a3
add refactor test codes (#5171)
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2021-05-11 17:59:29 +08:00
Xiangyu Wang
2ae529a673
[skip ci]Update mergify rules (#5170)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-11 10:50:17 +08:00
yanliang567
b9d3d965e4
[skip ci] Add new tests directories (#5165)
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2021-05-11 10:18:13 +08:00
dragondriver
64ab4d740b
Add row_count to partition statistics (#5162)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-10 09:39:08 +00:00
sunby
a00422bac2
Remove unused interfaces in dataservice (#5157)
Remove unused interfaces in dataservice

Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-05-10 09:03:24 +00:00
Cai Yudong
6f3a460b4e
Add pulsar seek example in pulsar_client_test.go (#5154)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-10 02:32:10 +00:00
dragondriver
df71f4c77c
Migrate softTimeTickBarrier from proxyservice to timesync (#5146)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-10 01:28:59 +00:00
LocoRichard
8752cae5ee
Create README.md (#5152)
readme update

Signed-off-by: LocoRichard <lichen.wang@zilliz.com>
2021-05-08 10:37:16 +00:00
XuanYang-cn
eb557b289b
Add docs in package datanode (#5117)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-05-08 07:24:12 +00:00
Cai Yudong
5f0006d0f9
Improve code coverage for distributed/datanode (#5133)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-08 06:07:04 +00:00
yukun
ecaef24fea
Change should_not to must_not in dsl (#5131)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-07 11:52:24 +00:00
FluorineDog
b1974aede2
Merge knowhere unittests (#5139)
Re-enable knowhere unittests and merge them all together. 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-05-07 11:50:13 +00:00
dragondriver
b7977698a8
Change the codec style of expr plan from text to binary (#5129)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-07 11:27:17 +00:00
godchen
895037889e
Upgrade grpc version from 1.26 to 1.27 (#5128)
Upgrade grpc version from 1.26 to 1.27
Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-07 18:30:11 +08:00
zhenshan.cao
dab38f6c3d
Change cron job schedule (#5130)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-07 08:56:32 +00:00
Cai Yudong
d66a5acca3
improve code coverage for distributed/dataservice (#5123)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
improve code coverage for distributed/dataservice
2021-05-07 07:43:52 +00:00
dragondriver
e5d4963ba0
Distinguish the dsl and expr in proxy and query node (#5118)
Pass a parameter `IsExpr` from proxy to query node, so query 
node can create search plan according to the variable `IsExpr`.
It makes `segcore` unnecessary to distinguish `dsl` or `expr`
using dynamic exception. When `IsExpr` is set to true, query
node will call `CreatePlanByExpr` according to the passed
information about expression. Otherwise query node will keep
still to use `CreatePlan` according to the `dsl` information. At
the same time, this pr adds some unittests to `CreatePlanByExpr`,
these unittests translate already exist case with `dsl` to case with
`expr`.

Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-07 07:20:47 +00:00
quicksilver
eed04f6c0f
Update hadolint to v1 (#5125)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-05-07 15:07:02 +08:00
xige-16
1e7205fa03
fix querynode's port not set correctly when conflict with other node (#5066)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-05-07 12:03:53 +08:00
LocoRichard
172f416e8f
Update README.md (#5114)
Signed-off-by: <LocoRichard> <lichen.wang@zilliz.com>
2021-05-06 06:29:45 +00:00
LocoRichard
9a15a4fce5
Update README.md (#5104)
**What type of PR is this?**

- [ ] API-change
- [ ] BUG
- [ ] Improvement
- [x] Documentation
- [ ] Feature
- [ ] Test and CI
- [ ] Code Refactoring

**Which issue(s) this PR fixes:**

Fixes #

**What this PR does / why we need it:**

New readme doc
2021-05-06 02:41:24 +00:00
Xiangyu Wang
220cc30875
Update pull request template (#5103)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-03 11:21:35 +08:00
dragondriver
56dbbfe4cb
Add simple test case to search_with_expression (#5094)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-04-30 15:56:01 +08:00
FluorineDog
396b3f33e9
Support TermExpr, NotExpr, LogicalExpr (#5096)
1. Support Term, like `A in [1, 2, 3]`
2. Support Not, like `! A < 3`
3. Support logical combination, like `A < 3 && B > 5 or C == 0`

Type: Feature

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-04-30 07:19:52 +00:00
shengjun.li
b46ae44087
Zero size allocation in StackDeviceMemory (#5100)
When the remaining space is empty, the zero size allocation will
get the pointer `end_`. However, `cudafree` the pointer `end_` will
cause to crash.

Fix: #5078 #4770 #4412 #4340 #3646

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-04-30 04:21:02 +00:00
quicksilver
ad1c889824
Upload Milvus images to internal mirror repository when Push triggered (#5092)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

**What type of PR is this?**

- [x] enhancement

**What this PR does / why we need it:**

Upload Milvus images to internal mirror repository when Push triggered
2021-04-29 09:47:44 +00:00
FluorineDog
88f5642603
Add plan proto and support basic boolean expr parser (#5088)
**What type of PR is this?**
- [x] Feature

**What this PR does / why we need it:**
This PR supports boolean expression as DSL.
1. The goal of this PR is to support predicates
    like `A > 3 && not B < 5 or C in [1, 2, 3]`. 
2. Defines `plan.proto`, as Intermediate Representation (IR) 
    used between go and cpp. 
3. Support expr parser, convert predicate expr to IR
    in proxynode, while doing static check there
4. Support IR to AST in cpp, enable the execution
2021-04-29 08:48:06 +00:00
quicksilver
136cd7a704
Run KinD Inside A Kubernetes Cluster For Continuous Integration (#5085)
**What type of PR is this?**

- [x] Improvement

**Which issue(s) this PR fixes:**

Fixes #5038

**What this PR does / why we need it:**

Run KinD Inside A Kubernetes Cluster For Continuous Integration
2021-04-29 08:45:17 +00:00
bigsheeper
88e1d651cb
Remove partition and segment ids properly in query node (#5090)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

**What type of PR is this?**

- [ ] API-change
- [x] BUG
- [ ] Improvement
- [ ] Documentation
- [ ] Feature
- [ ] Test and CI
- [ ] Code Refactoring

**Which issue(s) this PR fixes:**

Fixes #

**What this PR does / why we need it:**

Not Available
2021-04-29 07:59:08 +00:00
quicksilver
7a188a8ae5
Update openblas images (#5082)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-04-29 11:28:27 +08:00
quicksilver
a042090b86
Fix publish pytest image bug (#5084)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-04-29 11:21:35 +08:00
Xiangyu Wang
d82f6d2764
[skip ci]Update mergify rules (#5083)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-29 10:39:28 +08:00