Commit Graph

5857 Commits

Author SHA1 Message Date
xige-16
d7e6b99394 Add config reader
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-10-13 15:03:46 +08:00
neza2017
bb517eeca1 Add test for proxy-go
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-10-12 13:54:00 +08:00
bigsheeper
d4e485d37a Add pulsar authentication
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-10-10 11:06:07 +08:00
zhenshan.cao
70fc122338 Update proto
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-09 16:16:11 +08:00
neza2017
b0189c2450 Update time sync
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-10-09 15:37:24 +08:00
FluorineDog
466508332c Enable backtrace for better debugging
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-09-30 18:36:27 +08:00
shengjh
998e750468 Fix bug for multi proxys can not update collection info
Signed-off-by: shengjh <1572099106@qq.com>
2020-09-30 10:35:51 +08:00
xige-16
086d7849ec Fix conflict when choosing pulsar producer
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-29 23:05:35 +08:00
xige-16
fa3954eb0e Fix proxy send message to wrong pulsar group
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-29 20:20:04 +08:00
xige-16
eb3c55cd03 Fix write node consume busy
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-29 19:10:41 +08:00
xige-16
12e49781e6 Fix error when cover string to bytes in write node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-29 10:55:48 +08:00
shengjh
14d81f19cd Use json benchmark format log in proxy
Signed-off-by: shengjh <1572099106@qq.com>
2020-09-29 10:40:43 +08:00
shengjh
26860c1041 Change master address in conf file
Signed-off-by: shengjh <1572099106@qq.com>
2020-09-28 19:18:02 +08:00
xige-16
0547561f8b Fix the pulsar test failure
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-28 17:15:12 +08:00
shengjh
6797fd0b0b Update throughput log for proxy
Signed-off-by: shengjh <1572099106@qq.com>
2020-09-28 12:12:04 +08:00
bigsheeper
56fa20c5ab Add throughput log in writer
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-28 11:34:51 +08:00
cai.zhang
eb1d7d5cc4 Read bucket name from config yaml
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-09-28 10:23:43 +08:00
xige-16
af4375dd3e Accelerate the write speed of write node to minio
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-27 21:42:23 +08:00
shengjh
d054c0aa7b Add benchmark for proxy and writer
Signed-off-by: shengjh <1572099106@qq.com>
2020-09-27 20:56:23 +08:00
xige-16
5157cfe2ef Refactor query node to pass search test
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-27 20:55:08 +08:00
zhenshan.cao
02d935eb04 Fix sdk bug
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-09-27 18:31:27 +08:00
bigsheeper
0d2780a2eb Add reader writeLog, fix insert buffer out of range
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-27 18:26:33 +08:00
cai.zhang
a87b1a42bc Reset TimeRecord for sdk
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-09-27 16:11:54 +08:00
bigsheeper
105b64decf Add write node benchmark
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-27 14:43:04 +08:00
bigsheeper
a84bafd1fb Fix insertion miss
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-27 11:55:14 +08:00
bigsheeper
5e429b2a94 Fix segment insertion error, and improve search strategy
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-26 17:37:40 +08:00
bigsheeper
567232b10f Create segments by query node num
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-26 15:29:29 +08:00
FluorineDog
5d5a20dce2 Enhance random generator of unittest
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-09-25 17:09:53 +08:00
shengjh
6554b2cf16 Fix bug for s3 storage
Signed-off-by: shengjh <1572099106@qq.com>
2020-09-25 16:12:33 +08:00
shengjh
aa2ff7a971 Add s3 sriver type in storage
Signed-off-by: shengjh <1572099106@qq.com>
2020-09-25 15:30:15 +08:00
bigsheeper
649732c1b0 Fix search error about search time
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-25 14:53:06 +08:00
shengjh
3bd6c5417c Fix core dump
Signed-off-by: shengjh <1572099106@qq.com>
2020-09-25 11:46:30 +08:00
rain
90cd86de17 Update controller and fix kvbase bug
Signed-off-by: rain <boyan.wang@zilliz.com>
2020-09-25 10:23:48 +08:00
shengjh
09e43b0b6f Fix resource dead lock
Signed-off-by: shengjh <1572099106@qq.com>
2020-09-24 14:38:35 +08:00
bigsheeper
f4d29c97ed Fix search timestamp error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-24 14:19:29 +08:00
zhenshan.cao
32157159a2 Fix bug:only need to add unittest when build with -u option
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-09-24 11:18:31 +08:00
cai.zhang
046b74e8b8 Add the interface of S3 for storage
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-09-24 10:58:20 +08:00
xige-16
615400127a Set default config in config.yaml
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-23 19:51:14 +08:00
bigsheeper
efd3eaad9d Fix query node start time
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-23 15:12:14 +08:00
bigsheeper
4542ed38af Add unittest about timestamp, add client id
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-23 14:26:13 +08:00
FluorineDog
960b79b620 Fix bug of wrong byte size
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-09-23 04:44:56 +08:00
bigsheeper
fe5f0afe9a Fix query node service
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-23 17:38:15 +08:00
xige-16
d8b1a7cf8d Add config for write node and query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-22 21:10:51 +08:00
bigsheeper
a2ae3044b0 Fix segment close strategy
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-22 18:15:14 +08:00
bigsheeper
1323bdb8f4 Update segment close time
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-22 15:27:50 +08:00
rain
bb03b9bfde Read config from file in master
Signed-off-by: rain <boyan.wang@zilliz.com>
2020-09-22 15:26:38 +08:00
shengjh
7812eed091 Add count row for proxy
Signed-off-by: shengjh <1572099106@qq.com>
2020-09-22 15:16:51 +08:00
zhenshan.cao
bd696486c9 Fix etcd path bug
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-09-22 15:07:56 +08:00
bigsheeper
41297f89b5 Add segment stats functions
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-22 11:47:25 +08:00
bigsheeper
62bee091d6 Fix search failed about topK
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-22 11:21:19 +08:00