test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-05 05:18:52 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
20,382 Commits 96 Branches 105 Tags 186 MiB
134422eeaf
Commit Graph

808 Commits

Author SHA1 Message Date
wei liu
8965ea2a08
refine err msg about no available node in replica (#24256) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-22 11:59:26 +08:00
congqixia
7e9ef36de4
Fix TestConfigFromRemote/close_manager ut is not stable (#24279) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-22 09:59:25 +08:00
yihao.dai
3f96c335bb
Add receivedNQ metric and change receivedBytes metric to collection level (#24199) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-21 22:23:24 +08:00
smellthemoon
0b72cf2c2e
log out error (#24260) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-05-19 18:25:24 +08:00
congqixia
3a66e1de65
Use suite for integration test (#24253) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-19 15:57:24 +08:00
Jiquan Long
bd343550a5
Support to manage connections (#24224) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-19 12:51:23 +08:00
MrPresent-Han
7744573d3d
support parms for import maxfilesize(#24191) (#24192) 
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
 2023-05-18 18:59:27 +08:00
Jiquan Long
a98c79b6a6
Fix flat index can be created with invalid metric type (#24180) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-18 11:07:26 +08:00
cai.zhang
008285f849
Support dynamic schema for create collection (#24176) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-18 09:33:24 +08:00
yah01
99cc24b283
Fix compaction doesn't support JSON data (#24151) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-17 19:09:22 +08:00
yihao.dai
7384d83d2c
Support rate limit based on growing segments size (#24121) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-17 09:57:22 +08:00
congqixia
73a181d226
Fix get vector it timeout and improve some string const usage (#24141) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-16 17:41:22 +08:00
cai.zhang
ccd685013a
Json key must be enclosed in double quotes (#24113) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-16 16:19:22 +08:00
yah01
3ea4a39078
Fix insert node doesn't handle JSON data while merging (#24126) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-16 16:09:23 +08:00
congqixia
e68f5cf08e
Fix integration tests logic (#24063) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-15 14:45:21 +08:00
wei liu
4c956fab73
enable config collection level rate limit (#24012) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-05-12 18:13:26 +08:00
yah01
7d0c47dd65
Check the length of JSON (#24035) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-12 11:33:20 +08:00
yah01
400364483d
Improve predict the resource usage (#23968) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-05-11 15:33:24 +08:00
congqixia
5aa9db0d38
Add collection level auto compaction enabled config (#24013) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-10 17:45:20 +08:00
cai.zhang
9715a850fa
Support expr with json field (#23804) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-10 10:19:19 +08:00
congqixia
de4b4dafef
Refresh etcd source config with Searializable option (#23954) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-09 11:52:40 +08:00
yihao.dai
fc010ee86b
Improve the metric of stored binlog size to the level of collection and segment (#23859) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-07 20:52:38 +08:00
Enwei Jiao
086f3bd748
Add it for refresh config (#23773) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-05-06 17:34:39 +08:00
congqixia
2cacda0d95
Fix Int8~Int32 empty result set type (#23852) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-05-06 14:16:39 +08:00
Jiquan Long
7be7e6f360
Refactor check logic of index parameters (#23856) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-05-06 10:40:39 +08:00
MrPresent-Han
b517bc9e6a
refine balance mechanism including:(#23454) (#23763) (#23791) 
1. balance granuity to replica to avoid influence unrelated replicas
2. avoid balance back and forth

Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
 2023-05-04 12:22:40 +08:00
yihao.dai
8c060215e9
Add collection number quota per DB (#23656) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-04-28 11:02:35 +08:00
smellthemoon
45fbe1d1a7
Change proxy max shard num (#23777) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-04-27 22:20:35 +08:00
Gao
e467e0d451
Seperate reading build and load params for diskann (#23758) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2023-04-27 20:30:35 +08:00
yah01
eab94489ba
Refine the merge algorithm (#23767) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-27 18:26:35 +08:00
smellthemoon
912cf4ef0f
Change some configurations, include change the defaultChannelNum to 16 (#23617) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-04-27 14:26:35 +08:00
Xiaofan
016311ad48
Fix Has Collection Failed on datacoord (#23710) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-04-27 09:50:34 +08:00
yihao.dai
ed8836cd15
Add disk quota at the collection level (#23704) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-04-26 21:52:36 +08:00
SimFG
5cd21893c8
Fix superusers' password verification problem (#23733) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-04-26 21:16:34 +08:00
smellthemoon
f0ababb420
Use merr in querynodev2 (#23652) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-04-26 17:06:34 +08:00
foxspy
6f4ed517de
add growing segment index (#23615) 
Signed-off-by: xianliang <xianliang.li@zilliz.com>
 2023-04-26 10:14:41 +08:00
wei liu
4fb8919a97
support collection level rate limit (#22767) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-04-25 15:54:35 +08:00
yihao.dai
092d743917
Add support for getting vectors by ids (#23450) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-04-23 09:00:32 +08:00
zhenshan.cao
03ec804e68
Change default shard number to 1 (#23586) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-04-21 07:08:32 +08:00
congqixia
55d76f0cee
Fix rootcoord histgram metrics uses default buckets (#23556) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-20 14:08:30 +08:00
Enwei Jiao
967a97b9bd
Support json & array types (#23408) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
 2023-04-20 11:32:31 +08:00
Cai Yudong
2725d38b9e
Add COSINE metric type (#23350) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-04-20 10:20:31 +08:00
wei liu
4336ed8609
fix node up (#23415) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-04-20 09:52:31 +08:00
congqixia
4fe363c4b2
Add KNN cgo pool (#23526) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-19 23:56:31 +08:00
congqixia
eb690ef033
Fix querynodev2 stop logic (#23487) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-18 17:56:30 +08:00
aoiasd
695cc769df
Fix watch event timeout when IO Pool busy (#23293) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2023-04-17 11:02:30 +08:00
cqy123456
7ff6a3a246
Set query node thread pool size in milvus.yaml (#23286) 
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
 2023-04-17 10:44:29 +08:00
congqixia
ba84f52119
Fix watcher loop quit and channel shouldDrop logic (#23402) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-14 09:54:28 +08:00
yah01
dc0eb433ae
Add IoPoolSize config (#23360) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-04-13 14:50:28 +08:00
Cai Yudong
178559a875
Ignore gather c metrics fail (#23366) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-04-13 10:26:27 +08:00
Cai Yudong
49eb4b8af4
Clean ANNOY params (#23353) 
Signed-off-by: Yudong Cai <yudong.cai@zilliz.com>
 2023-04-11 17:54:35 +08:00
congqixia
5276529524
Make pkg code change trigger ci workflow (#23312) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-04-11 10:32:31 +08:00
Xiaofan
680ad482b7
Check balance checker chore to 10s (#23304) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2023-04-09 16:14:32 +08:00
dependabot[bot]
dbdd879de9
Bump golang.org/x/net from 0.6.0 to 0.7.0 in /pkg (#23256) 
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.6.0 to 0.7.0.
- [Release notes](https://github.com/golang/net/releases)
- [Commits](https://github.com/golang/net/compare/v0.6.0...v0.7.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-04-07 17:58:29 +08:00
Cai Yudong
55202ce7d9
Support show knowhere prometheus metrics (#23102) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2023-04-07 15:34:29 +08:00
jaime
c9d0c157ec
Move some modules from internal to public package (#22572) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-04-06 19:14:32 +08:00
Ten Thousand Leaves
a3a29fed06
Add entry point for embedded Milvus. (#16008) 
/kind feature

issue: #15711
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-03-16 16:51:22 +08:00
zhenshan.cao
64295db471 Refact master and proxy and add etcdutil 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-15 21:31:50 +08:00
shengjh
3d7181617b Add ci and format code for proxy 
Signed-off-by: shengjh <1572099106@qq.com>
 2020-10-15 16:32:22 +08:00
zhenshan.cao
9c15fc550e Enable CICD 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-14 17:46:16 +08:00
xige-16
d7e6b99394 Add config reader 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-10-13 15:03:46 +08:00
neza2017
bb517eeca1 Add test for proxy-go 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-10-12 13:54:00 +08:00
bigsheeper
d4e485d37a Add pulsar authentication 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-10-10 11:06:07 +08:00
zhenshan.cao
70fc122338 Update proto 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-09 16:16:11 +08:00
neza2017
b0189c2450 Update time sync 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-10-09 15:37:24 +08:00
bigsheeper
5e429b2a94 Fix segment insertion error, and improve search strategy 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-09-26 17:37:40 +08:00
bigsheeper
567232b10f Create segments by query node num 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-09-26 15:29:29 +08:00
bigsheeper
649732c1b0 Fix search error about search time 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-09-25 14:53:06 +08:00
shengjh
3bd6c5417c Fix core dump 
Signed-off-by: shengjh <1572099106@qq.com>
 2020-09-25 11:46:30 +08:00
rain
90cd86de17 Update controller and fix kvbase bug 
Signed-off-by: rain <boyan.wang@zilliz.com>
 2020-09-25 10:23:48 +08:00
bigsheeper
f4d29c97ed Fix search timestamp error 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-09-24 14:19:29 +08:00
xige-16
d8b1a7cf8d Add config for write node and query node 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-09-22 21:10:51 +08:00
rain
bb03b9bfde Read config from file in master 
Signed-off-by: rain <boyan.wang@zilliz.com>
 2020-09-22 15:26:38 +08:00
rain
93b9a06b3b Fix the bug of segment 
Signed-off-by: rain <boyan.wang@zilliz.com>
 2020-09-22 10:56:19 +08:00
zhenshan.cao
a3635b9cdc Update proto 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-09-21 17:53:59 +08:00
rain
a95f6843aa Add create index interface and update the proto of master 
Signed-off-by: rain <boyan.wang@zilliz.com>
 2020-09-21 15:10:54 +08:00
FluorineDog
c123b57e98 Support Benchmark 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-09-21 10:32:20 +08:00
shengjh
8c260e8112 Fix bug and add meta wrapper 
Signed-off-by: shengjh <1572099106@qq.com>
 2020-09-19 17:10:23 +08:00
rain
6bc7e6d372 Update collection and segment id type and Refactor channel controller 
Signed-off-by: rain <boyan.wang@zilliz.com>
 2020-09-18 15:55:33 +08:00
FluorineDog
74c0e3542c Remove tbb 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-09-18 15:44:09 +08:00
FluorineDog
fe9040f326 Fix BruteForce, add restriction for indexing builder 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-09-18 11:03:28 +08:00
zhenshan.cao
3acd55f675 Fix config path error 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-09-18 01:53:18 +08:00
FluorineDog
a177f48577 Support Query Dispatch, enable offset for bitset 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-09-17 18:37:54 +08:00
rain
7f798c5fce Synchronous creation of collection instead of goroutine 
Signed-off-by: rain <boyan.wang@zilliz.com>
 2020-09-17 10:00:03 +08:00
bigsheeper
2474d06a10 Add index building of segment 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-09-16 18:19:29 +08:00
rain
fa6e228a91 Update the proto of master 
Signed-off-by: rain <boyan.wang@zilliz.com>
 2020-09-16 11:46:52 +08:00
rain
455b3ace2f Update segment struct and change collection to collection id 
Signed-off-by: rain <boyan.wang@zilliz.com>
 2020-09-16 10:40:04 +08:00
rain
11125bc6eb Implement the marshal logic when data to kv store 
Signed-off-by: rain <boyan.wang@zilliz.com>
 2020-09-15 17:55:02 +08:00
bigsheeper
d7056ce046 Fix test when search failed 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-09-15 15:53:10 +08:00
FluorineDog
b80de55ac8 Add Testcase for indexing 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-09-15 10:00:00 +08:00
rain
13ebbdfcca Delete some useless mock code 
Signed-off-by: rain <boyan.wang@zilliz.com>
 2020-09-14 11:26:35 +08:00
zhenshan.cao
be58ccb65e Delete unused 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-09-12 16:57:37 +08:00
shengjh
4cf6e079bc Add etcd watcher 
Signed-off-by: shengjh <1572099106@qq.com>
 2020-09-11 18:55:43 +08:00
cai.zhang
34b670f654 Add interface for collect result 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-09-11 10:43:08 +08:00
rain
c10cf9bf8f Update the collection proto and add the go files generated by proto 
Signed-off-by: rain <boyan.wang@zilliz.com>
 2020-09-10 19:55:03 +08:00
neza2017
be35568af1 Add unittest for timesync when there is only one proxy 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-09-10 19:12:23 +08:00
rain
ef25004205 Update the frequence of getting message of informer 
Signed-off-by: rain <boyan.wang@zilliz.com>
 2020-09-09 16:52:35 +08:00
bigsheeper
1370da9498 Add message sending and key2segment, use hard code schema 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-09-09 15:24:07 +08:00
shengjh
8f9a8d83e4 Enable timesyc 
Signed-off-by: shengjh <1572099106@qq.com>
 2020-09-09 14:34:03 +08:00
rain
e704667bc5 Finish all feature and update the README of master 
Signed-off-by: rain <boyan.wang@zilliz.com>
 2020-09-08 16:57:48 +08:00
cai.zhang
815a6ca1cf Add aggregation for query result 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-09-08 14:16:03 +08:00
rain
c9c7c78340 Fix bug that max time cant be marshaled 
Signed-off-by: rain <boyan.wang@zilliz.com>
 2020-09-08 10:01:30 +08:00
xige-16
81e70ee6c9 Hash message to partitioned topic 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-09-07 21:07:36 +08:00
zhenshan.cao
a90b725ba8 Add timestamp for key2segment message 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-09-07 19:46:14 +08:00
rain
642554e7bd Refactor directory structure and update the default value of server 
Signed-off-by: rain <boyan.wang@zilliz.com>
 2020-09-07 19:19:50 +08:00
zhenshan.cao
cae0f36bdd Add config of pulsar 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-09-07 16:56:57 +08:00
zhenshan.cao
8992611898 refactor proto logic 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-09-06 21:13:06 +08:00
bigsheeper
bb9c906ef6 Use go mod instead of GO_PATH and add more cgo interfeces 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-09-01 16:23:39 +08:00