Commit Graph

14146 Commits

Author SHA1 Message Date
Xiaofan
a18d6b46a4
Fix watch dml channel fail because of no collection meta (#15436)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-02-10 13:19:46 +08:00
Jenny Li
9e85fa3aed
Update pytest image tag for QA cluster (#15502)
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-02-10 13:07:47 +08:00
sre-ci-robot
767b13f1ed Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-02-09 12:00:48 +00:00
Jenny Li
ed2741c2df
[skip e2e] Add jq into pytest docker image (#15511)
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-02-09 19:05:45 +08:00
Xiaofan
be42627ab2
Move Logutil to Util dir (#15447)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-02-09 18:55:46 +08:00
jaime
87dd4e8f92
Fix clean up data dir failed for TestEtcdRestartLoad (#15506)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-02-09 18:37:45 +08:00
ThreadDao
0ae0a1a75b
[skip e2e] Add L3 case to test compact after delete and index (#15512)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-02-09 18:01:46 +08:00
jaime
cb9c63d039
Remove index dir (#15467)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-02-09 16:07:45 +08:00
jingkl
b978d555ba
delete repeated partition testcase (#15500)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-02-09 14:53:46 +08:00
Cai Yudong
8255b713ac
Move ProxySubName/QueryNodeSubName/DataNodeSubName to msgChannelConfig (#15501)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-09 14:41:45 +08:00
jaime
307a8ce535
Support compile and run on Mac (#15491)
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
2022-02-09 14:27:46 +08:00
sre-ci-robot
d413f653b7
Update Pytest image changes (#15493)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-02-09 12:57:46 +08:00
min.tian
2b1625819d
[skip e2e] Check the grammar of segcore/timetravel.md (#15182)
Signed-off-by: min.tian <min.tian.cn@gmail.com>
2022-02-09 10:23:47 +08:00
min.tian
a0a88f1b48
[skip e2e] Check the grammar of segment_interface.md (#15174)
Signed-off-by: min.tian <min.tian.cn@gmail.com>
2022-02-09 10:21:52 +08:00
guoxiangzhou
f43d96b58d
[skip e2e] Modify code comments according to the naming conventions (#15173)
Signed-off-by: guoxiangzhou <xiangzhou.guo@zilliz.com>
2022-02-09 10:19:56 +08:00
guoxiangzhou
a157487f8c
[skip e2e] Modify code comments according to the naming conventions (#15172)
Signed-off-by: guoxiangzhou <xiangzhou.guo@zilliz.com>
2022-02-09 10:18:02 +08:00
min.tian
06535eb7eb
[skip e2e] Check the grammar of segment_growing.md (#15134)
Signed-off-by: min.tian <min.tian.cn@gmail.com>
2022-02-09 10:16:10 +08:00
guoxiangzhou
c7e93f95aa
[skip e2e] Modify code comments according to the naming conventions (#15171)
Signed-off-by: guoxiangzhou <xiangzhou.guo@zilliz.com>
2022-02-09 10:14:05 +08:00
congqixia
2263425cde
Fix EntriesNum is not passed in flush task (#15482)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-02-09 10:05:46 +08:00
Jenny Li
5bd0de4d81
Update CI for QA cluster (#15461)
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-02-09 09:57:46 +08:00
huangjincheng2022
3573c28af5
update pymilvus to 2.0.1.dev3 (#15487)
Signed-off-by: huangjincheng2022 <jincheng.huang@zilliz.com>
2022-02-09 09:49:46 +08:00
xige-16
55cdc5aa35
Get indexInfo and segment size by queryCoord (#14207)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-02-08 21:57:46 +08:00
Cai Yudong
1f337891e1
Rename base_param to service_param, rename global_param to component_param (#15463)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-08 20:57:47 +08:00
XuanYang-cn
43b6c295a4
Put logs of compaction elapse in defer (#15485)
Before this PR, time elapse are logged after `compact()` finished
normally. No elapse will be logged with any errors.

This PR put elapse logs in defer once time-consuming steps are finished.

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-02-08 19:15:45 +08:00
XuanYang-cn
46dea0f006
Add elapse logs in compaction (#15414)
See also: #15413

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-02-08 14:11:45 +08:00
sre-ci-robot
b6bf6b0cff Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-02-08 00:01:04 +00:00
Ji Bin
d83f69bb21
Support windows compliation (#15448)
- remove dl dependency while compiling some lib under MSYS
- int types aligement in golang
- core/src/utils adaptation for compile under MSYS

issue: #7706

Signed-off-by: Ji Bin <matrixji@live.com>
2022-02-07 23:43:46 +08:00
JunSung Park
f6873d3dc1
Implement automatic item expiration on compaction (#14418)
* Implement automatic item expiration on compaction

Signed-off-by: JunSung Park <writtic@gmail.com>

* Change entityExpiration value comparison logic

Signed-off-by: JunSung Park <writtic@gmail.com>

* Add logging for the number of expired entity

Signed-off-by: JunSung Park <writtic@gmail.com>

* Set default value of CompactionEntityExpiration to off

Signed-off-by: JunSung Park <writtic@gmail.com>

* Fix errors for code checker

Signed-off-by: JunSung Park <writtic@gmail.com>

* Set default entityExpiration to max value

Signed-off-by: JunSung Park <writtic@gmail.com>
2022-02-07 22:45:46 +08:00
sre-ci-robot
18b2753c09 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-02-07 12:00:44 +00:00
XuanYang-cn
5eef9886b3
Add more specific log when exiting BackGroundGC goroutine (#15273)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-02-07 16:55:44 +08:00
congqixia
d830791e4f
Respect SegmentIDs in querynode.GetSegmentInfo (#15455)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-02-07 15:35:44 +08:00
Cai Yudong
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-07 10:09:45 +08:00
Cai Yudong
4bccc85534
Use MsgChannelConfig in GlobalParams for all components (#15163)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-02 00:35:43 +08:00
sre-ci-robot
d7a961c7f8 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-01-31 12:01:01 +00:00
congqixia
b4bfe58fd9
[skip e2e] Fix component name for IndexCoordComponent comment (#15138)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-01-29 22:39:44 +08:00
sre-ci-robot
fffcef00d1 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-01-29 12:00:53 +00:00
Xiaofan
5a8ec1d1fa
Create README.md
add towhee in the acknowledgment list.
2022-01-29 15:38:56 +08:00
XuanYang-cn
eef295465a
Fix timetick inconsistency in drop collection (#15408)
When rootcoord drops a collection, it'll produce a `drop-collection DDL` msg
and one last timetick into DML channels of this collection.
So that when DataNode receives this msg, DN can release the resources for the specific collection.

Before this PR, RootCoord produced these two msgs with an older timestamp, generated
before many time-consuming RPCs.

Once these RPCs spend more time than timetick producing interval, the timetick of these 2 msgs are
older to the channel current timestamp, causing in-consistency in time, thus
making msgstream fail to consume the last `drop-collection DDL` msg.

This PR generates a new timestamp for `drop-collection DDL` msg and timetick msg after those time-consuming
RPCs

Fixes: #15406

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-28 20:49:41 +08:00
sre-ci-robot
4b83bbf8e7 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-01-28 12:00:57 +00:00
Jenny Li
8c50d2cfe4
Use local storage & update monitor interval (#15427)
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-01-28 16:15:53 +08:00
Jenny Li
3a105cfedf
[skip e2e] Fix issue for get logs (#15425)
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-01-28 14:57:42 +08:00
sre-ci-robot
8c7302d315
Update Pytest image changes (#15426)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-01-28 13:09:41 +08:00
sre-ci-robot
7236af6ae8
Update Builder image changes (#15410)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-01-28 13:07:46 +08:00
binbin
6d9612d224
Update pymilvus version (#15424)
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2022-01-28 11:51:40 +08:00
Volodymyr Stoiko
280ee2eee8
Add ca-certificates to Dockerfile (#15417)
Signed-off-by: vol <me@volodymyrstoiko.com>
2022-01-28 10:51:40 +08:00
binbin
d03d17444c
[skip e2e] Disable test cases for existing issue (#15422)
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2022-01-28 10:03:40 +08:00
sre-ci-robot
d3d26b388d Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-01-28 00:01:14 +00:00
Filipe Caixeta
dee1961b4d
Make SearchResults and QueryResults return collectionID (#15377)
* Make SearchResults and QueryResults return collectionID

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>

* add return collection name from QueryRequest and SearchRequest

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>

* remove comment

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
2022-01-27 22:55:41 +08:00
ThreadDao
a62e2ef05f
[skip e2e] Update milvus operator pulsar default image 2.8 (#15419)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-01-27 20:53:40 +08:00
binbin
55e7a8dd48
[skip e2e] Disable test cases for code issues (#15411)
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2022-01-27 16:15:40 +08:00