Commit Graph

184 Commits

Author SHA1 Message Date
Jiquan Long
f8d9bc919d
Unify interface of vector index & scalar index. (#15959)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-21 14:23:24 +08:00
godchen
78557ca6d7
Replace minio kv with minio chunk manager (#15936)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-03-17 18:03:23 +08:00
Ji Bin
3cd28420f1
Support compile under windows (#15786)
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
  * using gofrs/flock instead of syscall.Flock
  * using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`

issue #7706

Signed-off-by: Ji Bin <matrixji@live.com>
2022-03-17 17:17:22 +08:00
zhenshan.cao
f3eeecf146
Reduce the number of metrics (#16030)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-15 21:51:21 +08:00
cai.zhang
b435c422c1
Add prometheus metrics for IndexCoord (#15638)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-02-21 17:15:51 +08:00
congqixia
c7f55c2e34
Make SessionWatch keep watch even no Rewatch func when find ErrCompacted (#15497)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-02-15 15:07:48 +08:00
Cai Yudong
1f337891e1
Rename base_param to service_param, rename global_param to component_param (#15463)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-08 20:57:47 +08:00
Cai Yudong
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-07 10:09:45 +08:00
Xiaofan
f617c8887b
Time Tick Failed need log (#15225)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-01-14 23:55:34 +08:00
cai.zhang
3254d36609
[skip e2e]Add comment for msgIndexCoordIsUnhealthy (#15146)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-01-12 11:15:36 +08:00
Cai Yudong
b6a48817b0
Add MinioConfig in GlobalParams for all components (#15099)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-10 17:29:34 +08:00
cai.zhang
0a209e2579
[skip e2e]Add comment for errIndexNodeIsNotOnService (#14986)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-01-07 18:47:32 +08:00
Cai Yudong
f8f61fb116
Use BaseParams etcd configuration for all components (#15012)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-07 16:15:26 +08:00
cai.zhang
7b3b2ba94a
[skip e2e]Fix log message (#14984)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-01-07 14:03:43 +08:00
Jiquan Long
4f71fff388
Fix panic when close IndexCoord (#14611)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-01-04 10:19:18 +08:00
cxytz01
0437dadd75
[skip e2e] Grammar correction (#14514)
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-29 17:33:08 +08:00
cxytz01
1f62d5205f
[skip e2e] Grammar correction (#14513)
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-29 17:30:57 +08:00
Xiaofan
69087ff8dd
Support embedded etcd (#14333)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
cai.zhang
1dd909f3fa
[skip e2e]Reorder head files for task.go (#14488)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-12-29 12:04:03 +08:00
cai.zhang
cac2ee717a
[skip e2e]Reorder head files for priority_queue_test.go (#14487)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-12-29 12:02:16 +08:00
cai.zhang
85e1acb64e
[skip e2e]Reorder head files for node_manager.go (#14486)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-12-29 11:45:29 +08:00
Xiaofan
1408926cd9
Remove logs without enough info (#14440)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 10:06:47 +08:00
cai.zhang
523dbd69c2
[skip e2e]Reorder head files for metrics_info_test.go (#14421)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-12-28 19:31:27 +08:00
cai.zhang
c7ae7d93a3
[skip e2e]Reorder head files for meta_table_test.go (#14420)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-12-28 19:29:20 +08:00
cai.zhang
d760a94636
[skip e2e]Reorder head files for indexcoord_test.go (#14419)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-12-28 19:26:56 +08:00
cai.zhang
4d21874aab
[skip e2e]Reorder head files for indexcoord/indexcoord.go (#14296)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-27 17:20:06 +08:00
cai.zhang
3b5b8194cb
[skip e2e]Reorder head files for indexcoord/index_coord_mock_test.go (#14297)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-27 14:26:20 +08:00
cai.zhang
c4a4ef6f37
[skip e2e]Reorder head files for indexcoord/errors_test.go (#14295)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-27 14:24:22 +08:00
Jiquan Long
e18dac16f3
Fix close indexcoord panic (#14237)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-27 14:16:38 +08:00
cai.zhang
df82dcc783
[skip e2e]Add log for HasSameReq in indexcoord (#14233)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-25 23:14:50 +08:00
cai.zhang
74cf787c1d
[skip e2e]Format log for LoadMetaFromETCD in indexcoord (#14234)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-25 14:58:19 +08:00
cai.zhang
33afe1b576
[skip e2e]Add log for GetUnassignedTasks in indexcoord (#14232)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-25 14:56:24 +08:00
cai.zhang
0b77c4455e
[skip e2e]Add log for GetUnusedIndexFiles in indexcoord (#14223)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-25 11:42:21 +08:00
cai.zhang
8c0f96f8c1
[skip e2e]Add log for ListNode in indexcoord (#14222)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-25 11:40:29 +08:00
cai.zhang
410cf600be
[skip e2e]Add log for PeekClient in indexcoord (#14221)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-25 11:34:21 +08:00
cai.zhang
2e70326f31
[skip e2e]Format log for DeleteIndex in indexcoord (#14068)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-23 21:40:25 +08:00
cai.zhang
62b7e09163
[skip e2e]Add log for GetIndexFilePathInfo in indexcoord (#14067)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-23 21:38:34 +08:00
zhenshan.cao
3b7dad4486
Add node ctx mananger logic for IndexCoord (#13862)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-23 21:35:52 +08:00
Cai Yudong
891c202b73
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
cai.zhang
a53140bd39
[skip e2e]Add log for GetIndexStates in indexcoord (#14066)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-23 17:13:15 +08:00
JackLCL
bf66721ea3
[skip e2e]Fix error log output format in meta_table.go (#14027)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-23 14:25:53 +08:00
congqixia
ef3b71f22b
Use indexInfo SerializedSize when estimating segment size (#13969)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-22 20:27:34 +08:00
edward.zeng
5c003a023e
[skip e2e] Refine indexcoord util comment (#13998)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-22 20:03:38 +08:00
cai.zhang
f4ac7cbfd1
[skip e2e]Add log for indexcoord peek indexnode (#13855)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-21 16:08:59 +08:00
cai.zhang
f64a1a5bae
[skip e2e]Add comment for PeekClientV1 (#13857)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-21 15:48:17 +08:00
cai.zhang
1eb5645762
[skip e2e]Add comment for PeekClientV0 (#13856)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-21 15:46:13 +08:00
cai.zhang
04c210f4dd
[skip e2e]Add comment for PeekClientPolicy in indexcoord (#13759)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-20 18:09:06 +08:00
cai.zhang
2da7f528e8
[skip e2e]Add comment for getDimension in indexcoord (#13761)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-20 17:47:23 +08:00
cai.zhang
05919ed346
[skip e2e]Add comment for estimate in indexcoord (#13760)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-20 17:44:06 +08:00
cai.zhang
2ef2228ad0
Check component state before get index files (#13578)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-17 23:10:42 +08:00