Commit Graph

286 Commits

Author SHA1 Message Date
yukun
18cfd31d40 Fix Load and Remove with prefix
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-11 15:17:06 +08:00
bigsheeper
4fad3b189c Fix search without insertion, improve nil hits behavior (#622)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-09 17:58:18 +08:00
xige-16
004d0027b3 Fix error that different loadIndex messages have same indexParam
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-09 15:57:55 +08:00
zhenshan.cao
02df310fa5 Fix data race
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-09 12:30:22 +08:00
xige-16
f4566731fc Fix search error in regression test
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-09 09:47:22 +08:00
sunby
5dfe9448ae Modify test_index
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-08 16:00:16 +08:00
GuoRentong
82ad488555 Update doc: rocksmq
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 18:37:24 +08:00
XuanYang-cn
65089ea362 Fix flush sync test bug and remove unecessary lock in meta_table
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-08 17:20:59 +08:00
GuoRentong
c4599e26de Update doc: node api
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 16:59:19 +08:00
bigsheeper
e13822043d Fix search test when partition not exists, add binary vector search validation
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-08 16:41:27 +08:00
godchen
fa73f17f94 Add opentracing doc
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-08 15:32:38 +08:00
zhenshan.cao
6a3ec57fef Fix docker lib dependency
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-07 21:08:23 +08:00
dragondriver
a4860beae2 Parse type params and index params when buildindex is invoked
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-07 17:38:46 +08:00
xige-16
d9d2f33a23 Add binary test for loadIndex and fix loadIndexService can't close correctly
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-07 17:22:10 +08:00
dragondriver
ced56c84f8 Add support to build binary vector index
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-07 14:56:17 +08:00
godchen
8f1f118b26 Add query opentracing
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-07 14:24:35 +08:00
xige-16
8715cd1f0c Fix key error when loading index
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-06 18:19:44 +08:00
bigsheeper
a1e2ff3c26 Add gcNode to write node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-06 16:44:12 +08:00
neza2017
4015d7245d Merge operation
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-06 14:45:50 +08:00
bigsheeper
810be533ab Add gcNode, and remove msg's downstream index
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-06 14:02:25 +08:00
cai.zhang
1cfc2ff0a5 Add make clean in Makefile
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-06 13:50:48 +08:00
zhenshan.cao
b06e01f523 Initmate querynode collection manager
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-06 11:31:36 +08:00
godchen
1c87faf8b3 Add insert request opentracing
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-06 11:17:35 +08:00
FluorineDog
e16a7478da Add verifier
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-01-05 20:13:54 +08:00
bigsheeper
e9dc96f931 Fix bucket name in index builder and query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-05 15:58:13 +08:00
bigsheeper
d5d9fa03ea Disable the dropCollection filtering
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-04 20:46:00 +08:00
bigsheeper
1ba47ac433 Check system field in segCore
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-04 10:13:01 +08:00
quicksilver
1927eaf88b Add revive linter
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-31 16:38:37 +08:00
dragondriver
6cd8c2528d Add parameter check for almost all index type
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-31 15:16:03 +08:00
xige-16
29b21b4bf2 Refactor reduce strategy in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-31 14:49:27 +08:00
xige-16
be32a33eff Refactor loadIndexTest to test diffrent index params
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-29 14:43:40 +08:00
GuoRentong
e8ec0424d8 Update doc: service api
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-12-27 09:05:24 +08:00
XuanYang-cn
e316533a3a Add Flush Sync service
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-26 16:28:55 +08:00
bigsheeper
5acc9681d6 Fix search error about metric type
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-26 15:29:48 +08:00
xige-16
d599407e2b Add unittest for loadIndex service
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-26 14:16:51 +08:00
XuanYang-cn
c0797333ce Add ddl binlog metaTable in writenode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-24 20:55:40 +08:00
neza2017
4dbf4ade41 Add test for master
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-24 16:19:42 +08:00
xige-16
f5198bcaee Add LoadIndexService in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-24 14:51:55 +08:00
zhenshan.cao
11316525e5 Fix bug of running unittest in parallel
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-22 22:08:03 +08:00
bigsheeper
585d3f9831 Refactor param table, and add ddNode
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-11 17:20:14 +08:00
neza2017
8df05714a8 Add binlog unittest
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-11 12:01:38 +08:00
FluorineDog
e54d5ccf19 Fix push failed because git hook detects "wrong error"
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-11 14:59:13 +08:00
XuanYang-cn
d64aa37db3 Add KFlush msg type
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-11 12:01:20 +08:00
zhenshan.cao
ca34353e9b Add writernode client
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-11 11:38:32 +08:00
xige-16
0067e2d989 Add load index client in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-11 11:29:54 +08:00
bigsheeper
762b1e1f1f Add ddService, fieldID, requestID and refactor params table, fix nil hits search result bug
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-10 16:31:09 +08:00
XuanYang-cn
32977e270c Add impl cgo of parquet
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-08 14:41:04 +08:00
zhenshan.cao
7bbbc14637 Fix bug: address already used
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-07 15:22:20 +08:00
xige-16
37d7526d31 Fix search test failure
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-07 14:37:42 +08:00
neza2017
aeca8f85a5 Run cwrapper unittest in ci
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-05 17:39:58 +08:00
cai.zhang
806a97505c Add query node for CI progress
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-05 16:12:45 +08:00
neza2017
70710dee47 Add parquet payload
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-05 16:11:03 +08:00
FluorineDog
6412ebc0d4 Add support of metric type in schema, enable binary vector, fix segfault
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-05 06:46:01 +08:00
xige-16
acdf8cc9e1 Fix memory leak in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-04 19:32:30 +08:00
zhenshan.cao
0b6fe0a8cf Refactor paramtable
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-04 14:18:17 +08:00
godchen
7ab5b5d80d Add MinIO kv implements
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-03 19:00:11 +08:00
neza2017
cec903da19 Add parquet payload
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-02 18:31:56 +08:00
xige-16
36cf8a8ea7 Support return primary key when doing search
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-03 17:18:06 +08:00
bigsheeper
707a6a366e Fix issue about collection cannot be found
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-02 17:13:16 +08:00
zhenshan.cao
23aebe7e2a Fix proxy unittest
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-01 19:53:53 +08:00
neza2017
17cc7bc337 Use MetaRootPath instead
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-01 17:03:39 +08:00
dragondriver
84b15c1f5c Fix the bug of meta cache in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-01 16:41:25 +08:00
cai.zhang
c1fbc4f8fa Open the tests for insert
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-01 15:18:57 +08:00
FluorineDog
6b74d82259 Support some validation for dsl parser
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-01 02:16:53 +08:00
zhenshan.cao
fda8d62b38 Fix make error
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-30 22:14:19 +08:00
neza2017
d3858500c6 Add static check
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-30 19:38:23 +08:00
bigsheeper
0cd3e8d86c Use exception instead of runtime error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-30 17:58:23 +08:00
bigsheeper
d88a654db8 Fix search result
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-30 11:22:59 +08:00
quicksilver
86573d0053 Create Jenkins pipeline
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-30 10:07:04 +08:00
FluorineDog
77fa75b1ec Add binary insert and warper of binary search, rename vector
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-30 05:18:44 +08:00
cai.zhang
85a544b79b Add dockerfile for each component
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-28 19:06:48 +08:00
cai.zhang
115d0732af Update docker-compose file for unittest
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-28 16:43:39 +08:00
dragondriver
eb6c0e0a28 Fix the bug when reduce the multiple search result from query nodes
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-28 15:57:49 +08:00
godchen
92bf09c7e6 Add ddstream and scheduler implements
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-28 15:26:39 +08:00
dragondriver
568cef0730 Fix InsertTask and SearchTask
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-28 10:48:29 +08:00
FluorineDog
c9fb34142c Enable primary_key switch
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-28 09:16:00 +08:00
XuanYang-cn
3e605ae25f Rename reader to querynode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-27 10:56:53 +08:00
bigsheeper
1decc1a4ca Add metaRootPath and kvRootPath
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-27 09:59:40 +08:00
bigsheeper
f21c0ef2e9 Reduce cpu usage
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-26 17:58:08 +08:00
neza2017
32445dd02b Add cpu profile
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-26 16:01:31 +08:00
cai.zhang
57da66ba72 Update read config logic in docker
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-26 15:18:36 +08:00
zhenshan.cao
045fc3d808 Fix segment fault
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-26 14:29:01 +08:00
XuanYang-cn
0a16a9a651 Add logic of getting milvus distributed config from master by grpc
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-26 13:21:06 +08:00
dragondriver
8ce0deca4e Add default partition tag to InsertTask in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-26 11:38:04 +08:00
xige-16
ae78aa1ac1 Warp cpp reduce and repack searchResultMsg to specified pulsar channel
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-11-26 11:12:33 +08:00
sunby
f4c643f1bd Add number limitation of partition and field. And Change default partition tag to "_default"
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-25 18:39:05 +08:00