Commit Graph

5610 Commits

Author SHA1 Message Date
bigsheeper
39addf0a55 Update cgo interfaces and add query node id
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-02 10:38:08 +08:00
become-nice
8e323494a5 Add the interface about kv store of writenode
Signed-off-by: become-nice <995581097@qq.com>
2020-09-02 10:36:39 +08:00
xige-16
29d6a3ad0a Add pulsar cpp client
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-01 20:50:12 +08:00
become-nice
558a81dcbe Update the interface of writenode
Signed-off-by: become-nice <995581097@qq.com>
2020-09-01 18:11:43 +08:00
bigsheeper
bb9c906ef6 Use go mod instead of GO_PATH and add more cgo interfeces
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-01 16:23:39 +08:00
bigsheeper
5a57b62f0c Refactor collection and partition, wrap cgo interfaces
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-08-31 15:54:44 +08:00
bigsheeper
b6cc1df97e Refactor collection and partition
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-08-29 17:42:41 +08:00
cai.zhang
26805ebd3a Add interface for minio and add grpc proto for master
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-08-29 17:40:29 +08:00
bigsheeper
7d8ddf05a9 Add cgo building script and init ago insertion interface
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-08-29 17:37:53 +08:00
FluorineDog
35e45d5766 Support Segment timestamps
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-08-29 14:57:45 +08:00
bigsheeper
04c27b7ccf Sort messages by timestamp
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-08-28 18:39:00 +08:00
shengjh
59aee1e067 Add tikv storage,proxy pulsar thirdparty
Signed-off-by: shengjh <1572099106@qq.com>
2020-08-28 18:19:24 +08:00
bigsheeper
d69c925ba5 Implement the interfaces about insertion, deletion and search
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-08-28 17:29:26 +08:00
xige-16
3b10f74ce1 Use pulsar go client in query node and write node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-08-27 16:45:43 +08:00
become-nice
f1d6b62e1d Add mock unittest
Signed-off-by: become-nice <995581097@qq.com>
2020-08-27 11:06:17 +08:00
FluorineDog
08ee90e1de Add gtest dependencies
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-08-27 10:08:42 +08:00
become-nice
22a44c995d Add serialzation function
Signed-off-by: become-nice <995581097@qq.com>
2020-08-26 18:29:42 +08:00
FluorineDog
fc6e31c8b0 Add test for unique_ptr manual release
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-08-26 17:38:45 +08:00
FluorineDog
3c4a9f38b0 Fix compatibility of Gtest
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-08-26 17:30:32 +08:00
FluorineDog
996c591088 Enable Segment Naive and Base, support Collection
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-08-26 16:49:03 +08:00
bigsheeper
af1f67b9d2 Add collection and segment
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-08-25 15:45:19 +08:00
bigsheeper
6d777b7518 Init reader component
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-08-25 15:38:35 +08:00
zhenshan.cao
383da48ba1 Fix proxy logic
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-08-24 14:24:06 +08:00
become-nice
b8f012d8f0 Add interface of writenode
Signed-off-by: become-nice <995581097@qq.com>
2020-08-24 11:58:51 +08:00
zhenshan.cao
fc5f5c7b5a Initial commit 2020-08-20 11:39:46 +08:00
yefu.chen
49058d5dfb start 2.0
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-04-21 11:37:21 +08:00
shengjun.li
83cbe0f490
fix hamming (#3338)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-20 09:42:04 +08:00
MXDA
1962b6e78b
Specifying distance type at runtime for Flat index (#3273)
* modfied IndexIDMAP.cpp && SearchTask.cpp

Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>

* Specifying distance type at runtime for Flat index(CPU)

Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>

* Specifying distance type at runtime for Flat index(GPU)

Signed-off-by: Zhengda Wu <wuzhengda55@gmail.com>

Co-authored-by: Zhengda Wu <wuzhengda55@gmail.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-17 17:05:59 +08:00
shengjun.li
5f830293f9
rm find faiss (#3269)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-15 19:18:03 +08:00
jinhai
f59c240457 Update to 0.10.3
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-08-15 16:21:43 +08:00
BossZou
cd689fd703
[skip ci] Upgrade mishards for milvus v0.10.2 (#3267)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-08-15 14:32:07 +08:00
BossZou
8a239355e3
[skip ci] Fix mishards query result reduce error (#3256)
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-08-14 15:37:01 +08:00
shengjun.li
43c272fd13
fix annoy l2 (#3232)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-08-12 19:11:13 +08:00
BossZou
f9f597b257
[v0.10.2] (mishards) Fix mishards search bug (#3169)
* [skip ci]Reverse query result if metric is IP

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* [skip ci] Update version check

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-08-07 19:33:49 +08:00
Xiaohai Xu
058cdf03bb
Add ivf index nprobe logging (#3070)
* add nprobe logging

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* add all cases

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-08-01 09:46:53 +08:00
shengjun.li
09cf1b323e
fix crash when GPU search (#3074)
* fix crash when GPU search

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-31 09:46:55 +08:00
shengjun.li
b1b1165c56
Opt faiss builder (#3067)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-31 09:35:31 +08:00
del-zhenwu
68b9a033a2
[skip ci] disable ping case when using http handler (#3064)
* Update version in cases

Signed-off-by: zw <zw@milvus.io>

* update sdk in cases

Signed-off-by: zw <zw@milvus.io>

* [skip ci] disable ping case when using http handler

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-07-30 15:17:01 +08:00
del-zhenwu
845cf5000a
update sdk version on 0.10.2 (#3025)
* Update version in cases

Signed-off-by: zw <zw@milvus.io>

* update sdk in cases

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-07-27 18:55:03 +08:00
shengjun.li
1c36e6d83d
optimizer parallel policy (#3014)
* optimizer parallel policy

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* modify parallel policy

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-26 01:37:23 +08:00
del-zhenwu
7457438ba5
Update version in cases (#3007)
Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
2020-07-25 14:47:52 +08:00
BossZou
c394608d4f
[skip ci] Up to v0.10.2 (#3006)
Signed-off-by: yhz <413554850@qq.com>
2020-07-25 10:02:09 +08:00
cqy123456
91d3fe5cbc
Improve IVF search performance when NQ and nProbe are both large (#2984)
* fix indexflat  search

Signed-off-by: cqy <yaya645@126.com>

* add parallel_policy_threshold

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-24 15:56:47 +08:00
Tinkerrr
dd938878ea
fix (#2981)
Signed-off-by: Tinkerrr <xiaojun.lin@zilliz.com>
2020-07-23 17:02:28 +08:00
del-zhenwu
c1e00357f4
[skip ci] add cron (#2968)
* [skip ci] add cron

Signed-off-by: zw <zw@milvus.io>
2020-07-22 16:33:49 +08:00
shengjun.li
3908d10498
Fix the result merging of IVF_PQ IP (#2953)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-22 10:08:05 +08:00
shengjun.li
a88f5b6cbb
Fix index size (#2941)
* add virtual IF UpdateIndexSize

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* update ivf index size

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix PQ logic

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix index size of index hnsw, annoy and nsg

Signed-off-by: cmli <chengming.li@zilliz.com>

* add GetSize() interface 4 SPTAG

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix binary ivf

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: sahuang <xiaohai.xu@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-07-21 14:26:08 +08:00
JinHai-CN
1806e7e4b0 Update CHANGELOG.md
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-07-21 09:35:31 +08:00
BossZou
7a594470cb
[skip ci] Upgrade mishards for milvus 0.10.1 (#2933)
Signed-off-by: yhz <413554850@qq.com>
2020-07-20 16:28:05 +08:00
ThreadDao
bd02b19a71
add case nprobe>2048 (#2906) 2020-07-18 19:31:28 +08:00