test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-11-30 10:59:32 +08:00
Code Issues Actions 11 Packages Projects Releases Wiki Activity
16,140 Commits 94 Branches 105 Tags 184 MiB
0700e56008
Commit Graph

355 Commits

Author SHA1 Message Date
congqixia
f7bd054adb
Set EnableGarbageCollection to true by default (#18305) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-07-18 16:34:28 +08:00
cai.zhang
0ad15a22c8
IndexCoord handle events correctly (#17878) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-07-07 14:44:21 +08:00
zhenshan.cao
1647bebaf4
Count growing segment number to estimate cpu usage (#17820) (#18027) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-07-04 15:10:20 +08:00
jaime
762e3b78a6
support configurable sasl mechanisms for kafka (#17542) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-06-29 10:32:17 +08:00
shaoyue
96b97f7f58
RESTful api use same port as metrics & healthcheck (#17732) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-06-24 15:34:14 +08:00
SimFG
f4c6a6734e
Fix rpc retry policy not taking effect (#17673) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-06-22 22:22:13 +08:00
Xiaofan
d70f483806
Support rocksmq dynamic lru cache size (#17626) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-06-20 10:56:12 +08:00
bigsheeper
92d06b2e30
Purge memory by the memory state and try to purge after each search (#17565) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-06-17 17:46:10 +08:00
Xiaofan
1f6fbf91b2
Fix pulsar unsubsribe issue (#17562) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-06-16 17:28:11 +08:00
Ten Thousand Leaves
65ab847815
Add segment reference lock for bulk load (#17457) 
So we can support DataQueryable and DataIndexed states

issue: #16607
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-06-15 12:20:10 +08:00
Bingyi Sun
b3f0bbadff
Adjust keepalive timeout to 20s as default (#17510) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2022-06-13 11:54:08 +08:00
yah01
a38790f586
Predict the loading memory usage more accurate (#17451) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-06-09 18:16:07 +08:00
shaoyue
76eaa3fc50
Support access s3 through AWS IAM role (#17292) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-06-02 19:42:03 +08:00
SimFG
0986c29d7f
proxy tls support one-way authentication (#17348) 
Signed-off-by: xiyichan <2863768433@qq.com>

Co-authored-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>

Co-authored-by: xiyichan <2863768433@qq.com>
 2022-06-02 18:56:04 +08:00
jaime
5698bf4236
Add sasl configurations for kafka (#17323) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-06-02 12:12:03 +08:00
Jiquan Long
6bd786bf50
Reduce default seal propotion (#17287) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-05-31 12:02:04 +08:00
congqixia
c88514bc49
Remove not used QueryChannel in Proxy and Query Cluster (#16856) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-05-30 19:50:04 +08:00
zhenshan.cao
2512e668f7
Update timestmap according to gracefultime for Bounded Consistency (#17171) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-05-24 12:05:59 +08:00
zhenshan.cao
08a4dff41d
Add logic for search merging and a simple task scheduler for read tasks (#17022) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
 2022-05-23 16:41:58 +08:00
zhenshan.cao
246b22b5ea
Configure indexSliceSize to 16MB (#17080) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-05-23 15:01:58 +08:00
ownbylichaobao
2f8a7e7793
Support tls/ssl connection to etcd (#7703) (#17012) 
Signed-off-by: lichaobao <1527563274@qq.com>
 2022-05-20 12:29:19 +08:00
Jiquan Long
99b4042f8c
Disable segment small index (#16935) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-05-18 15:27:56 +08:00
exia
4ee78eb5ad
proxy support tls (#16706) 
Signed-off-by: xiyichan <2863768433@qq.com>
 2022-05-10 20:05:53 +08:00
Enwei Jiao
67ce206cf0
make SegmentMaxLifetime configurable (#16783) 
Signed-off-by: Enwei Jiao <jiaoew2011@gmail.com>
 2022-05-06 23:41:51 +08:00
Ten Thousand Leaves
1acd256481
Add DataQueryable and DataIndexed states for bulk load tasks (#16725) 
issue: #16607

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-05-05 21:17:50 +08:00
Xiaofan
333b439a6c
Support config grpc log level (#16618) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-05-05 10:35:50 +08:00
shaoyue
fa97f86cda
Clean up not used id_cache related code (#16655) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-05-05 09:59:51 +08:00
Xiaofan
337ad53613
Support config small index nprobe and nlist (#16731) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-05-05 09:49:50 +08:00
Cai Yudong
6a62ff18bf
Support easylogging config for segcore and knowhere (#16751) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-05-03 08:39:49 +08:00
shaoyue
2f49db9d3c
Implements remaining rest APIs (#16387) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-04-29 15:15:47 +08:00
Xiaofan
ed51ffd50f
Fix Compact Entity ttl param (#16665) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-04-28 11:51:47 +08:00
Ten Thousand Leaves
4855ba6fa3
Optimize Mac M1 support some tweaks to embedded Milvus (#16650) 
issue: #16500
issue: #16621

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-26 14:21:46 +08:00
Ten Thousand Leaves
14724013ba
[skip e2e]Update config for embedded Milvus (#16614) 
issue: #15711

/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-25 14:17:45 +08:00
codeman
f5e1ded854
fix #16504 (#16523) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-19 16:35:39 +08:00
Ten Thousand Leaves
e76a8c5ec2
Update compile options and config for embedded Milvus (#16472) 
/kind enhancement

issue: #15711
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-14 19:57:34 +08:00
jaime
ed3c29eae7
Support Kafka (#16149) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-04-12 19:47:33 +08:00
Cai Yudong
71cd7ba67a
Add configuration common.indexSliceSize (#16438) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-04-08 20:29:33 +08:00
godchen
bb7a0766fe
Add dependency factory (#16204) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-04-07 22:05:32 +08:00
Ten Thousand Leaves
e2eed6fd94
Reduce ID cache duration from 60min to 5min. (#16409) 
/kind improvement

issue: #15593
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-07 12:21:31 +08:00
Ten Thousand Leaves
2bd0a9526a
Implement task expiring logic and make all deadlines configurable. (#16355) 
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-03 11:37:29 +08:00
godchen
478f6ca11e
Add cache for vector chunk (#15912) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-03-26 22:05:26 +08:00
Bingyi Sun
ca45e0bd00
Add new config file(not applied) (#15891) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2022-03-18 15:53:23 +08:00
Ten Thousand Leaves
a3a29fed06
Add entry point for embedded Milvus. (#16008) 
/kind feature

issue: #15711
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-03-16 16:51:22 +08:00
Ten Thousand Leaves
d5bae6710f
Make all logs configurable for standalone/embedded Milvus. (#15926) 
Resolves: #15919, #15708
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-03-10 10:35:59 +08:00
Cai Yudong
3e862ecdfb
Merge msgChannelConfig and knowhereConfig into commonConfig (#15843) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-04 11:17:56 +08:00
Nemo
cdcb3627b4
Make Etcd log level configurable. (#15737) 
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-02-25 15:03:53 +08:00
shaoyue
83fdc1da7c
Add web server in proxy with sample handler (#15647) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-02-23 14:37:52 +08:00
JunSung Park
f6873d3dc1
Implement automatic item expiration on compaction (#14418) 
* Implement automatic item expiration on compaction

Signed-off-by: JunSung Park <writtic@gmail.com>

* Change entityExpiration value comparison logic

Signed-off-by: JunSung Park <writtic@gmail.com>

* Add logging for the number of expired entity

Signed-off-by: JunSung Park <writtic@gmail.com>

* Set default value of CompactionEntityExpiration to off

Signed-off-by: JunSung Park <writtic@gmail.com>

* Fix errors for code checker

Signed-off-by: JunSung Park <writtic@gmail.com>

* Set default entityExpiration to max value

Signed-off-by: JunSung Park <writtic@gmail.com>
 2022-02-07 22:45:46 +08:00
Cai Yudong
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-07 10:09:45 +08:00
Cai Yudong
4bccc85534
Use MsgChannelConfig in GlobalParams for all components (#15163) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-02 00:35:43 +08:00
xige-16
1cd2363bd8
Delete usless params SkipQueryChannelRecovery (#15289) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-21 21:43:40 +08:00
XuanYang-cn
e69e7de9c2
[skip e2e]Remove not in use config proxy msgStream insert and search (#14877) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-06 15:13:20 +08:00
XuanYang-cn
06ae5b19a3
Remove not inuse configs (#14836) 
- segmentBinlgoSubPath
- collectionBinlogSubPath
- flushStreamPosSubPath
- statsStreamPosSubPath

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-06 14:49:20 +08:00
Cai Yudong
d01931d8d9
[skip e2e] Remove useless configuration rootcoord.timeout (#14852) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-05 19:05:25 +08:00
XuanYang-cn
c64ad70d43
[skip e2e]Correct comments for proxy config (#14855) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-05 15:31:20 +08:00
zhenshan.cao
32a5126705
Add the limitation of the traceable interval to timeTravel (#14498) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-12-29 21:29:45 +08:00
Cai Yudong
30382d8bf9
Let rootcoord share proxy.TimeTickInterval (#14326) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-27 21:38:45 +08:00
ThreadDao
1dd8d2f397
Enable auto compaction (#13086) 
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2021-12-10 14:41:14 +08:00
congqixia
aea5a61e9a
Add switch for auto compaction (#12974) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-08 19:47:05 +08:00
Bennu
cb4711425e
[skip ci] Add comment for milvus.yaml (#12759) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-08 15:02:09 +08:00
Bennu
d85240779f
[skip ci] Add comments for milvus.yaml (#12948) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-08 13:29:39 +08:00
Bennu
1d0847fb8a
[skip ci] Add comments for milvus.yaml (#12947) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-08 13:27:48 +08:00
XuanYang-cn
f1ac6e2092
Enable compaction in config.yaml (#12844) 
Helm chart and python tests enabled compaction, yet
the milvus.yaml disabled. This caused local smoke tests
failure

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-07 19:35:13 +08:00
yanliang567
e464708556
[skip ci]Refine comments for milvus yaml (#12866) 
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2021-12-07 14:45:45 +08:00
Bennu
4cd314d41c
[Skip ci] Add comments for milvus.yaml (#12842) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-07 14:14:08 +08:00
Bennu
86d3784277
[Skip ci] Add comments for milvus.yaml (#12841) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-07 14:08:12 +08:00
Bennu
bcef4a1711
[skip ci] Add comments for milvus.yaml (#12848) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-07 14:05:46 +08:00
Bennu
69902378cc
[skip ci] Add comment for milvus.yaml (#12760) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-06 18:05:32 +08:00
Bennu
519fb5d9a2
[skip ci] Add comment for milvus.yaml (#12758) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-06 18:02:50 +08:00
xige-16
7d723abdff
Start balanceLoop when Params.autoBalance equal to true (#12660) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-06 10:19:41 +08:00
Bennu
d1aeed2802
[skip ci] Add comments for milvus.yaml (#12676) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-03 13:34:06 +08:00
Bennu
d076f3629e
[skip ci] Add comments for milvus.yaml (#12675) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-03 13:32:12 +08:00
Bennu
864165689d
[skip ci] Add comments for milvus.yaml (#12674) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-03 13:30:16 +08:00
Bennu
d40f4a6c94
[skip ci] Add comment for milvus.yaml (#12610) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-02 18:19:33 +08:00
Bennu
856e2f4c9a
[skip ci] Add comment for milvus.yaml (#12609) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-02 18:17:37 +08:00
Bennu
db9387da0e
[skip ci] Add comment for milvus.yaml (#12608) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-02 18:15:44 +08:00
groot
22f04f90ff
Enlarge field number limitation (#12517) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-12-01 15:53:31 +08:00
Bennu
2ebe59e0b4
[skip ci] Add comment for milvus.yaml (#12510) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-01 13:17:31 +08:00
Bennu
b87756b54f
[skip ci] Add comment for milvus.yaml (#12508) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-01 13:15:35 +08:00
Bennu
da0088996b
[Skip ci] Add comments for milvus.yaml (#12429) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-01 13:09:49 +08:00
Bennu
191f6996f8
[Skip ci] Add comments for milvus.yaml (#12384) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-01 13:07:53 +08:00
Bennu
cbf877a5e2
[skip ci] Add comment for milvus.yaml (#12509) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-12-01 13:05:37 +08:00
Bennu
8ea9c00c8a
[Skip ci] Add comments for milvus.yaml (#12430) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-11-30 19:26:08 +08:00
groot
a4f11c9da5
Change proxy default rpc transfer limitation (#12351) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-11-30 15:44:19 +08:00
Bennu
aceb08a067
[Skip ci] Add comments for milvus.yaml (#12382) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-11-30 14:19:10 +08:00
Bennu
373290d351
[Skip ci] Add comments for milvus.yaml (#12381) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-11-30 14:17:12 +08:00
Bennu
f034f893c9
[Skip ci] Add comments for milvus.yaml (#12428) 
Signed-off-by: Bennu <yunmei.li@zilliz.com>
 2021-11-30 14:05:57 +08:00
congqixia
b99164f43d
Add datacoord GC configuration (#12061) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-18 22:29:40 +08:00
Xiaofan
d37fdf9379
Remove component.yaml (#11959) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-17 14:35:10 +08:00
Xiangyu Wang
12f50cb22c
[skip ci]Update OWNERS files (#11898) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-16 15:41:11 +08:00
shaoyue
5b50731ff4
Fix searchResultBufFlags & queryResultBufFlags memory leak (#11585) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-16 14:13:12 +08:00
Bingyi Sun
b8c5239784
Add compaction retention config (#11793) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-16 11:47:10 +08:00
Xiaofan
3cd47cd89e
Remove common.yaml and component.yaml (#11662) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-12 18:53:11 +08:00
xige-16
d857577a7b
Postpone the execution of handoff until index creation is complete (#11648) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-11-12 18:49:10 +08:00
Bingyi Sun
002b854590
Move compaction and garbage switch to milvus.yaml (#11654) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-11 23:38:42 +08:00
Cai Yudong
77b6439c65
[skip ci] Update configuration name (#11656) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-11 17:24:41 +08:00
yukun
f51ef71b51
Change default retentionSizeInMB to 8192(8GB) (#11436) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-11 17:18:43 +08:00
Xiaofan
5f08b67156
Move node.yaml to component.yaml (#11363) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-10 14:27:37 +08:00
yanliang567
a5305a482e
[skip ci]Update milvus yaml config (#11361) 
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2021-11-08 10:21:04 +08:00
yukun
8ec040a35c
Add rocksmqPageSize to config (#11113) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-08 10:17:18 +08:00