Commit Graph

321 Commits

Author SHA1 Message Date
godchen
92bf09c7e6 Add ddstream and scheduler implements
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-28 15:26:39 +08:00
dragondriver
568cef0730 Fix InsertTask and SearchTask
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-28 10:48:29 +08:00
FluorineDog
c9fb34142c Enable primary_key switch
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-28 09:16:00 +08:00
dragondriver
235e723eb6 Read proxy id from param table instead of hardcode
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-27 11:17:12 +08:00
XuanYang-cn
3e605ae25f Rename reader to querynode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-27 10:56:53 +08:00
neza2017
32445dd02b Add cpu profile
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-26 16:01:31 +08:00
cai.zhang
57da66ba72 Update read config logic in docker
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-26 15:18:36 +08:00
neza2017
d9e5a8774d Add dimension validation
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-26 15:07:47 +08:00
FluorineDog
8ae573b580 Fix bool bug
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-26 14:56:58 +08:00
zhenshan.cao
045fc3d808 Fix segment fault
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-26 14:29:01 +08:00
XuanYang-cn
0a16a9a651 Add logic of getting milvus distributed config from master by grpc
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-26 13:21:06 +08:00
dragondriver
8ce0deca4e Add default partition tag to InsertTask in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-26 11:38:04 +08:00
xige-16
ae78aa1ac1 Warp cpp reduce and repack searchResultMsg to specified pulsar channel
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-11-26 11:12:33 +08:00
sunby
f4c643f1bd Add number limitation of partition and field. And Change default partition tag to "_default"
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-25 18:39:05 +08:00
zhenshan.cao
f12366342f Fix bug and delete unused code
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-25 16:45:42 +08:00
bigsheeper
4ed11d9775 Reopen segment test assertion
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-25 16:24:57 +08:00
bigsheeper
3b24c52a8c Catch cpp runtime error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-25 16:20:07 +08:00
dragondriver
a7b3efecd7 Read query node num from param table instead of hardcode
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-25 16:17:33 +08:00
cai.zhang
4bcb460c98 Add clang-format
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-25 15:25:00 +08:00
FluorineDog
a6f950e5b6 Fix boost::dynamic_bitset misuse
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-25 15:17:17 +08:00
FluorineDog
a38f539b9b Move c headers to segcore folder
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-25 10:31:51 +08:00
FluorineDog
df1dcf81b9 Update cpplint.py and lint all files
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-24 21:28:38 +08:00
FluorineDog
83379977b2 Enable structured index
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-24 19:09:57 +08:00
cai.zhang
a13638b172 Add cpplint and optimize the check of c++ code
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-23 19:57:05 +08:00
bigsheeper
84f3d974fa Delete pulsar address test and refactor master param table
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-23 18:04:09 +08:00
cai.zhang
71beaadaf4 Update README for script
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-23 16:40:42 +08:00
neza2017
3277987898 Add segment threshold factor
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-23 11:41:53 +08:00
FluorineDog
9f35dee2df Support range executor
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-21 15:56:13 +08:00
GuoRentong
8b88a9c306 Update docs: master::syncMsgProducer
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-11-21 11:39:23 +08:00
zhenshan.cao
50d59d91ee Add segmentIDAssigner for proxy
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-19 21:02:31 +08:00
xige-16
cf11212932 Refactor reduce using cgo in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-11-19 14:13:39 +08:00
neza2017
ce89f64bb3 Set master config
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-19 10:46:17 +08:00
neza2017
c3de667bf5 Implement segment management in master
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-18 19:46:18 +08:00
bigsheeper
99ea7e9f05 Update param table
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-18 19:33:56 +08:00
sunby
9e4ce8454e Implement segment management in master
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-18 15:04:17 +08:00
FluorineDog
e7dd30a884 Add framework of ExecExprVisitor
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-18 17:32:52 +08:00
cai.zhang
c7861c2dba Add the check of C++ code in the CI progress
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-18 10:07:05 +08:00
dragondriver
b32e55d5f0 Add timeout logic to task in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-17 20:00:23 +08:00
XuanYang-cn
14ad7dc4a2 Add ccache and optimize index unittest compilation
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-17 11:05:15 +08:00
xige-16
833fee59d9 Add searchService for query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-11-17 10:07:42 +08:00
FluorineDog
8c48cf30c0 Format and and extra parameters for checking
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-16 15:41:56 +08:00
xige-16
d59f6ac6ca Add queryNodeSegStatsMsg for msgStream
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-11-16 10:55:49 +08:00
dragondriver
c2382adf04 Initialize the task scheduler of Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-14 11:24:49 +08:00
FluorineDog
f47fc7fef1 Using std::string instead of char * for PlaceholderGroup
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-13 19:37:59 +08:00
cai.zhang
0b478b614a Change Id to ID in go files according to golint check
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-13 15:17:18 +08:00
quicksilver
792f0679e5 Running as root is not permitted on build environment
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-13 12:27:41 +08:00
FluorineDog
f0ec7a8c78 Support Placeholder Parser and refine CreatePlan on predicate-less
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-12 12:18:07 +08:00
FluorineDog
5e67e5eb43 Enable Query Executor without predicates
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-10 13:17:31 +08:00
bigsheeper
be409b29c8 Refactor cgo collection, partition and segment
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-09 18:07:15 +08:00
bigsheeper
b441685635 Refactor segment, partition and collection, refactor search and services
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-09 16:27:11 +08:00
FluorineDog
3ff3a5b659 Add ShowPlanNodeVisitor under visitor pattern
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-06 15:34:39 +08:00
FluorineDog
e45df02874 Add Generator for visitor pattern (#89)
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-05 14:30:52 +08:00
neza2017
d18c17e786 Add Meta table implementation
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-04 16:28:14 +08:00
godchen
bade037fb2 Add meta_table implementation
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-04 16:01:28 +08:00
cai.zhang
4194cb5d56 Add cmake_build directory to gitignore and optimize the logic of golangci-lint
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-03 20:19:08 +08:00
FluorineDog
d7ef21c644 Remove message.pb and reformat
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-03 12:42:13 +08:00
FluorineDog
9d2fa4e430 Add SyntaxTree of QueryNode and Expr
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-03 11:45:48 +08:00
zhenshan.cao
3e596fa474 Update proto and doc
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-02 16:01:04 +08:00
GuoRentong
15b6963be0 Replace pdf figs with png figs
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-10-31 15:11:47 +08:00
zhenshan.cao
6eee7d1342 Fix bug and update proto
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-29 19:55:57 +08:00
zhenshan.cao
8324f8853e Fix knowhere build test cache
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-29 15:50:24 +08:00
quicksilver
d66d48c6b6 Enable UnitTest
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-27 15:51:16 +08:00
shengjh
77b2fcf015 Refactor manipulationreq and add tso(pre-alloc from master)
Signed-off-by: shengjh <1572099106@qq.com>
2020-10-27 12:01:27 +08:00
quicksilver
eb64839aef Update build environment
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-26 15:45:18 +08:00
FluorineDog
a48ca80286 Format Code and duplicate class Segment
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-10-24 18:04:57 +08:00
FluorineDog
e84b0180c9 Refactor cmake and build script and add timed benchmark
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-10-23 18:01:24 +08:00
zhenshan.cao
251bc2a19e Fix conf.LoadConfig failed to load yaml file
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-19 18:31:00 +08:00
GuoRentong
974496a2b2 Update issue templates
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-10-19 17:45:56 +08:00
zhenshan.cao
6a136c1a76 Change import path
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-19 17:39:51 +08:00
zhenshan.cao
4965a315ad Refact proto generating procedure
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-19 10:36:40 +08:00
zhenshan.cao
64295db471 Refact master and proxy and add etcdutil
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-15 21:31:50 +08:00