Commit Graph

210 Commits

Author SHA1 Message Date
godchen
0971cf65b2 Remove opentracing stdlog
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-15 15:28:27 +08:00
quicksilver
7fe061b846 Raneme init_devcontainer.sh to devcontainer.sh
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-15 14:38:36 +08:00
neza2017
56ab2bda2d Update proto:add partition id
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-15 11:53:22 +08:00
zhenshan.cao
63b21321d6 Refactor indexservice and update doc
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-15 13:50:27 +08:00
XuanYang-cn
fb63983eb2 Modify rocksdb compilation
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-14 15:12:08 +08:00
yukun
6e36f10a26 Fix rocksdb illegal instruction in some machine
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-14 14:24:14 +08:00
FluorineDog
63ca5f8031 Add span and segment interface, rename segment_growing and use interface as base
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-01-13 18:46:25 +08:00
GuoRentong
1104f059ee Update doc:module interfaces
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-13 11:08:03 +08:00
quicksilver
8e9d8e36e1 Update run_go_unittest.sh
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-13 10:40:46 +08:00
bigsheeper
2d2af1505a Improve mutex usage in query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-12 18:03:24 +08:00
GuoRentong
f3d2afa4f4 Update doc:detailed interface definition
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-11 18:35:54 +08:00
quicksilver
a6690dbc99 Fix syntax error: Bad fd number
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-11 15:25:19 +08:00
yukun
18cfd31d40 Fix Load and Remove with prefix
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-11 15:17:06 +08:00
quicksilver
0c2f40f580 Archive milvus distributed server logs in Jenkins CI
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-10 12:10:11 +08:00
zhenshan.cao
02df310fa5 Fix data race
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-09 12:30:22 +08:00
sunby
5dfe9448ae Modify test_index
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-08 16:00:16 +08:00
yukun
d11f00cd9f Add rocksdb in kv
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-08 19:07:57 +08:00
GuoRentong
82ad488555 Update doc: rocksmq
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 18:37:24 +08:00
XuanYang-cn
65089ea362 Fix flush sync test bug and remove unecessary lock in meta_table
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-08 17:20:59 +08:00
GuoRentong
c4599e26de Update doc: node api
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-08 16:59:19 +08:00
bigsheeper
e13822043d Fix search test when partition not exists, add binary vector search validation
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-08 16:41:27 +08:00
godchen
fa73f17f94 Add opentracing doc
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-08 15:32:38 +08:00
quicksilver
f6d4214bbe Optimize the workflow for cache go mod
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-08 15:00:58 +08:00
zhenshan.cao
6a3ec57fef Fix docker lib dependency
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-07 21:08:23 +08:00
dragondriver
a4860beae2 Parse type params and index params when buildindex is invoked
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-07 17:38:46 +08:00
quicksilver
c7d31825c6 Fix connect to multiple containers at once with VSCode bug
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-07 17:14:33 +08:00
quicksilver
6bcca0a9b7 Connect to multiple containers at once with VSCode
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-06 18:16:37 +08:00
quicksilver
ca89ece576 Fix go format bug
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-05 14:20:45 +08:00
bigsheeper
b7fc945aca Add flush msg unmarshal function register
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-31 17:25:45 +08:00
xige-16
bfb18df7e7 Parse result_id from target entry
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-31 16:53:57 +08:00
quicksilver
1927eaf88b Add revive linter
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-31 16:38:37 +08:00
quicksilver
b1b8747477 Add logic of incremental check for go code
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-29 17:19:44 +08:00
xige-16
be32a33eff Refactor loadIndexTest to test diffrent index params
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-29 14:43:40 +08:00
cai.zhang
37a55f3c1d Update sdk version
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-29 12:51:19 +08:00
cai.zhang
f80536ed77 Update the logic of running go unittest
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-29 11:56:37 +08:00
neza2017
0afeaa78c8 Fix unittest of flow graph
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-24 14:10:00 +08:00
dragondriver
d023c1afba Refactor index wrapper, use protobuf instead of json to pass data
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-21 16:36:07 +08:00
zhenshan.cao
9694203f8b Add writer client and metatable for writer
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-21 10:06:46 +08:00
zhenshan.cao
fc054874d3 Add index_builder
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-10 17:55:55 +08:00
XuanYang-cn
881be7f3e3 Impl minimum runable writenode and writenode flowgraph
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-09 20:07:27 +08:00
XuanYang-cn
e6f726e73a Add cache for thirdparty files cache
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-08 18:51:07 +08:00
zhenshan.cao
7bbbc14637 Fix bug: address already used
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-07 15:22:20 +08:00
xige-16
37d7526d31 Fix search test failure
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-07 14:37:42 +08:00
neza2017
32ec689510 Run storage unittest
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-06 16:58:15 +08:00
neza2017
aeca8f85a5 Run cwrapper unittest in ci
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-05 17:39:58 +08:00
neza2017
70710dee47 Add parquet payload
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-05 16:11:03 +08:00
FluorineDog
6412ebc0d4 Add support of metric type in schema, enable binary vector, fix segfault
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-05 06:46:01 +08:00
godchen
7ab5b5d80d Add MinIO kv implements
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-03 19:00:11 +08:00
neza2017
cec903da19 Add parquet payload
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-02 18:31:56 +08:00
zhenshan.cao
23aebe7e2a Fix proxy unittest
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-01 19:53:53 +08:00
FluorineDog
77fa75b1ec Add binary insert and warper of binary search, rename vector
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-30 05:18:44 +08:00
neza2017
32445dd02b Add cpu profile
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-26 16:01:31 +08:00
cai.zhang
57da66ba72 Update read config logic in docker
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-26 15:18:36 +08:00
zhenshan.cao
045fc3d808 Fix segment fault
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-26 14:29:01 +08:00
XuanYang-cn
0a16a9a651 Add logic of getting milvus distributed config from master by grpc
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-26 13:21:06 +08:00
sunby
f4c643f1bd Add number limitation of partition and field. And Change default partition tag to "_default"
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-25 18:39:05 +08:00
bigsheeper
4ed11d9775 Reopen segment test assertion
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-25 16:24:57 +08:00
bigsheeper
3b24c52a8c Catch cpp runtime error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-25 16:20:07 +08:00
cai.zhang
4bcb460c98 Add clang-format
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-25 15:25:00 +08:00
bigsheeper
41fb2d2991 fix lock usage
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-24 16:12:39 +08:00
bigsheeper
8ec7e4576e Add dropPartition and createPartition
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-24 15:59:51 +08:00
quicksilver
3ead70ac6e Add Code check workflow
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-24 11:20:44 +08:00
cai.zhang
a13638b172 Add cpplint and optimize the check of c++ code
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-23 19:57:05 +08:00
dragondriver
c7a49c97cc Add repack function of InsertTask in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-23 16:52:17 +08:00
cai.zhang
71beaadaf4 Update README for script
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-23 16:40:42 +08:00
neza2017
dab1afa3cc Add unittest and fix a bug in segment manager
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-21 17:53:05 +08:00
quicksilver
859ff62bc9 Unify Network for UnitTest
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-21 16:54:20 +08:00
cai.zhang
8ff82c2fd5 Add judgement when executing clang-format
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-21 16:37:48 +08:00
dragondriver
a18ac17a98 Increase timeout interval of task in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-18 15:44:17 +08:00
cai.zhang
3ae7cd59e5 Enable the unittest of proxy in the CI progress
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-18 10:07:33 +08:00
cai.zhang
c7861c2dba Add the check of C++ code in the CI progress
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-18 10:07:05 +08:00
FluorineDog
f47fc7fef1 Using std::string instead of char * for PlaceholderGroup
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-13 19:37:59 +08:00
godchen
4a3ca1632b Add master partition task implementation
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-13 17:20:13 +08:00
FluorineDog
ff843689ee Add show executor and dsl unittests
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-13 17:07:05 +08:00
XuanYang-cn
88cb274644 Refactor master scheduler: drop_collection
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-13 12:46:24 +08:00
godchen
4a11a6431b Add time sync producer
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-12 11:21:21 +08:00
bigsheeper
c9c8fb9def Close pulsar channel
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-12 11:18:23 +08:00
cai.zhang
3b2c86c42d Fix bug for cmake_build dir was changed
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-12 10:45:46 +08:00
XuanYang-cn
a2289d3ce6 Add softTimeTickBarrier and hardTimeTickBarrier
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-11 16:41:53 +08:00
cai.zhang
a2f2284932 Add code coverage for go files
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-10 15:56:57 +08:00
cai.zhang
62a59d094b Run unittest in CI
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-09 18:47:37 +08:00
zhenshan.cao
87a4495c59 Fix proxy bug
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-09 17:52:47 +08:00
neza2017
d18c17e786 Add Meta table implementation
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-04 16:28:14 +08:00
godchen
bade037fb2 Add meta_table implementation
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-04 16:01:28 +08:00
cai.zhang
4194cb5d56 Add cmake_build directory to gitignore and optimize the logic of golangci-lint
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-03 20:19:08 +08:00
quicksilver
5429614462 Add make all command in docker-compose.yml
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-31 16:30:20 +08:00
quicksilver
b5dd9ddd69 Change base image in Build environment Dockerfile
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-30 16:25:06 +08:00
zhenshan.cao
6eee7d1342 Fix bug and update proto
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-29 19:55:57 +08:00
quicksilver
d66d48c6b6 Enable UnitTest
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-27 15:51:16 +08:00
shengjh
77b2fcf015 Refactor manipulationreq and add tso(pre-alloc from master)
Signed-off-by: shengjh <1572099106@qq.com>
2020-10-27 12:01:27 +08:00
quicksilver
eb64839aef Update build environment
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-26 15:45:18 +08:00
FluorineDog
a48ca80286 Format Code and duplicate class Segment
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-10-24 18:04:57 +08:00
quicksilver
1b31b85ef7 Refactor the build and scripts folders
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-24 11:36:42 +08:00
zhenshan.cao
4965a315ad Refact proto generating procedure
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-19 10:36:40 +08:00
shengjh
3d7181617b Add ci and format code for proxy
Signed-off-by: shengjh <1572099106@qq.com>
2020-10-15 16:32:22 +08:00
xige-16
d7e6b99394 Add config reader
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-10-13 15:03:46 +08:00
neza2017
bb517eeca1 Add test for proxy-go
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-10-12 13:54:00 +08:00
bigsheeper
d4e485d37a Add pulsar authentication
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-10-10 11:06:07 +08:00
neza2017
b0189c2450 Update time sync
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-10-09 15:37:24 +08:00
xige-16
917dc677af Add time sync for query node and write node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-15 17:41:05 +08:00
cai.zhang
71950d44a8 Fix bug for aggregation
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-09-15 16:37:43 +08:00
FluorineDog
99ef484273 Format Unittest
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-09-15 16:23:29 +08:00
FluorineDog
7062b64fce Support blacklist using concurrentBitset
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-09-15 16:16:43 +08:00
bigsheeper
d7056ce046 Fix test when search failed
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-15 15:53:10 +08:00
zhenshan.cao
be58ccb65e Delete unused
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-09-12 16:57:37 +08:00
shengjh
4cf6e079bc Add etcd watcher
Signed-off-by: shengjh <1572099106@qq.com>
2020-09-11 18:55:43 +08:00
zhenshan.cao
7479aedf07 Add export path
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-09-10 20:23:51 +08:00
FluorineDog
b4e76c9490 Add testcase for deleted record
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-09-10 17:57:33 +08:00
zhenshan.cao
cae0f36bdd Add config of pulsar
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-09-07 16:56:57 +08:00
zhenshan.cao
8992611898 refactor proto logic
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-09-06 21:13:06 +08:00