yah01
|
882ba6240b
|
Check whether CodecIndex is nil to avoid panic (#20816)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-11-25 10:45:12 +08:00 |
|
cai.zhang
|
889eb02172
|
Add goroutine pool for creating index (#20391)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
|
2022-11-08 19:41:02 +08:00 |
|
cai.zhang
|
8ea8f91334
|
Make index log better (#20327)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
|
2022-11-07 14:23:02 +08:00 |
|
Enwei Jiao
|
956c5e1b9d
|
Make Params singleton (#20088)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
|
2022-11-04 14:25:38 +08:00 |
|
Jiquan Long
|
e7103310b8
|
Fix log when building index (#20302)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
|
2022-11-03 18:19:35 +08:00 |
|
xige-16
|
5bb2626466
|
Set diskUsageRatio to 4.0 when build disk index (#20066)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-10-26 16:11:31 +08:00 |
|
jaime
|
b79687687d
|
Replace segment index file path with index file id within segment index meta (#19866)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-10-19 16:55:27 +08:00 |
|
SimFG
|
a55f739608
|
Separate public proto files (#19782)
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-10-16 20:49:27 +08:00 |
|
xige-16
|
a1db9038fb
|
Move disk index params to config file (#19714)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-10-14 17:51:24 +08:00 |
|
xige-16
|
8c9c1672ae
|
Assign different storage config for indexes (#19517)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-10-14 14:45:23 +08:00 |
|
zhenshan.cao
|
0ac4bc32a5
|
Add logic of autoindex (#19570)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-10-08 15:38:58 +08:00 |
|
congqixia
|
838a633584
|
Add ctx parameter for ChunkManager methods (#19546)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-29 16:18:56 +08:00 |
|
xige-16
|
3fb8e80147
|
Rename serializeDiskIndex to getIndexFileInfo (#19416)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-09-27 10:32:53 +08:00 |
|
cai.zhang
|
9e18645363
|
Optimize IndexCoord scheduler loop (#19375)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
|
2022-09-24 13:40:52 +08:00 |
|
Xiaofan
|
901d3fb367
|
Add more log when creating index, Finished/Failed index will not be counted in total index tasks (#19150)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-09-23 09:40:52 +08:00 |
|
xige-16
|
428840178c
|
Support diskann index for vector field (#19093)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-09-21 20:16:51 +08:00 |
|
SimFG
|
d7f38a803d
|
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-09-16 16:56:49 +08:00 |
|
cai.zhang
|
d6b0fdc944
|
Fill index size and fail reason when query index job (#19026)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
|
2022-09-06 17:19:11 +08:00 |
|
cai.zhang
|
c924f73105
|
Refactor for IndexCoord to support cloud (#18643)
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
|
2022-08-25 15:48:54 +08:00 |
|
congqixia
|
be6ca6358d
|
Use serialized size before compression in log meta (#18336)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-07-19 21:30:30 +08:00 |
|
cai.zhang
|
93d9dfad1a
|
Ignore task when IndexNode load empty index meta (#18266)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
|
2022-07-14 15:08:28 +08:00 |
|
cai.zhang
|
90faf4a212
|
Fix bug for IndexCoord recycles index files (#18168)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
|
2022-07-08 16:54:22 +08:00 |
|
cai.zhang
|
0ad15a22c8
|
IndexCoord handle events correctly (#17878)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
|
2022-07-07 14:44:21 +08:00 |
|
Xiaofan
|
a9b1d71a8f
|
change the etcd compareAndSwap interface (#18068)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-07-06 13:54:21 +08:00 |
|
cai.zhang
|
899a9bf86d
|
IndexNode still writes finished state to ETCD when task was deleted (#17761)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
|
2022-06-28 12:08:17 +08:00 |
|
cai.zhang
|
3685ff9e0c
|
Mark indexing task to retry when minio occurs error (#17153)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
|
2022-05-23 15:47:58 +08:00 |
|
cai.zhang
|
b37b87eb97
|
The GetIndexFilePaths interface judges whether the index is complete (#17052)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
|
2022-05-17 20:41:56 +08:00 |
|
xige-16
|
515d0369de
|
Support string type in segcore (#16546)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
|
2022-04-29 13:35:49 +08:00 |
|
zhenshan.cao
|
0a953948af
|
Simplify monitoring metrics (#16687)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-04-27 23:03:47 +08:00 |
|
Xiaofan
|
b657b10eb5
|
Remove useless log (#16624)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-04-27 10:01:47 +08:00 |
|
Xiaofan
|
89b4a34892
|
Fix Data race in NodeID (#16603)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-04-24 22:03:44 +08:00 |
|
godchen
|
bb7a0766fe
|
Add dependency factory (#16204)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
|
2022-04-07 22:05:32 +08:00 |
|
cai.zhang
|
04076393c5
|
Fix log error (#16363)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
|
2022-04-06 10:13:32 +08:00 |
|
Jiquan Long
|
f8d9bc919d
|
Unify interface of vector index & scalar index. (#15959)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
|
2022-03-21 14:23:24 +08:00 |
|
godchen
|
78557ca6d7
|
Replace minio kv with minio chunk manager (#15936)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
|
2022-03-17 18:03:23 +08:00 |
|
zhenshan.cao
|
f3eeecf146
|
Reduce the number of metrics (#16030)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-03-15 21:51:21 +08:00 |
|
cai.zhang
|
2512dff261
|
Fix misuse of timerecord (#15868)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
|
2022-03-04 15:45:56 +08:00 |
|
cai.zhang
|
09a27d1620
|
Add prometheus metrics for indexnode (#15640)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
|
2022-03-02 20:49:56 +08:00 |
|
zhenshan.cao
|
f1aec49a74
|
Fixbug: building index return nil by mistake when error not occur (#15809)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-03-02 09:41:56 +08:00 |
|
zhenshan.cao
|
3f48a40ab0
|
Load index meta in every retry (#15376)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-01-25 13:28:05 +08:00 |
|
zhenshan.cao
|
6bc2efe429
|
Fixbug: IndexNode should panic when save meta failed to MetaKV (#15347)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-01-24 17:18:46 +08:00 |
|
zhenshan.cao
|
871e093dc8
|
Call release memory in case error occured (#15237)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-01-17 14:43:38 +08:00 |
|
Jiquan Long
|
2819f6cc6f
|
Release memory to OS after index is built (#15196)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
|
2022-01-13 20:27:34 +08:00 |
|
zhenshan.cao
|
1aafb56694
|
Clarify the index building process (#15044)
Reduce peak memory usage
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-01-10 20:51:34 +08:00 |
|
congqixia
|
fc256e7924
|
Index parallel respect CPU quota (#14991)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-01-07 17:31:22 +08:00 |
|
cai.zhang
|
2327d53915
|
[skip e2e]Add comment for setID (#14841)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
|
2022-01-05 13:07:25 +08:00 |
|
cai.zhang
|
47b89ba84a
|
[skip e2e]Add comment for checkIndexMeta (#14842)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
|
2022-01-05 13:05:25 +08:00 |
|
cai.zhang
|
d4c325adbb
|
[skip e2e]Reorder head files for indexnode/task.go (#14661)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
|
2021-12-31 16:11:24 +08:00 |
|
xige-16
|
a8cb995216
|
Improve log for build index in indexNode (#14051)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2021-12-23 22:00:16 +08:00 |
|
Cai Yudong
|
891c202b73
|
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-12-23 18:39:11 +08:00 |
|