milvus/internal/master
zhenshan.cao a0244b7683 Add segment expire logic for proxy
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-24 16:53:31 +08:00
..
client.go Refactor query node and query serviceMain changes:1. Add ddBuffer and save binLog. 2020-12-24 15:38:29 +08:00
collection_task.go Add field id when create collection 2020-12-21 19:31:24 +08:00
config_task.go Fix bug: address already used 2020-12-07 15:22:20 +08:00
config_test.yaml Fix bug: address already used 2020-12-07 15:22:20 +08:00
field_id.go Add data codec 2020-12-18 15:21:25 +08:00
flush_scheduler.go Save index meta to meta table 2020-12-23 15:13:45 +08:00
global_allocator_test.go Fix bug: pulsar dirty msg 2020-12-07 19:41:39 +08:00
global_allocator.go Fix bug: address already used 2020-12-07 15:22:20 +08:00
grpc_service.go Refactor query node and query serviceMain changes:1. Add ddBuffer and save binLog. 2020-12-24 15:38:29 +08:00
id.go Fix bug: address already used 2020-12-07 15:22:20 +08:00
index_builder_scheduler.go Save index meta to meta table 2020-12-23 15:13:45 +08:00
index_load_scheduler.go Add flush, build index, load index scheduler 2020-12-21 19:30:24 +08:00
index_task.go Refactor query node and query serviceMain changes:1. Add ddBuffer and save binLog. 2020-12-24 15:38:29 +08:00
master_test.go Refactor query node and query serviceMain changes:1. Add ddBuffer and save binLog. 2020-12-24 15:38:29 +08:00
master.go Add LoadIndexService in query node 2020-12-24 14:51:55 +08:00
meta_table_test.go Refactor query node and query serviceMain changes:1. Add ddBuffer and save binLog. 2020-12-24 15:38:29 +08:00
meta_table.go Add segment expire logic for proxy 2020-12-24 16:53:31 +08:00
param_table_test.go Add impl cgo of parquet 2020-12-08 14:41:04 +08:00
param_table.go Add impl cgo of parquet 2020-12-08 14:41:04 +08:00
partition_task.go Add ddService, fieldID, requestID and refactor params table, fix nil hits search result bug 2020-12-10 16:31:09 +08:00
persistence_scheduler_test.go Save index meta to meta table 2020-12-23 15:13:45 +08:00
persistent_scheduler.go Refactor segment manager 2020-12-19 12:55:24 +08:00
README.md Close pulsar channel 2020-11-12 11:18:23 +08:00
runtime_stats_test.go Add runtime stats to record field stats 2020-12-21 20:24:40 +08:00
runtime_stats.go Add index meta to meta table 2020-12-22 20:16:32 +08:00
scheduler_test.go Fix bug: address already used 2020-12-07 15:22:20 +08:00
scheduler.go Fix bug: address already used 2020-12-07 15:22:20 +08:00
segment_assigner_test.go Move expire timestamp to SegIDAssignment 2020-12-21 10:51:37 +08:00
segment_assigner.go Add segment expire logic for proxy 2020-12-24 16:53:31 +08:00
segment_manager_test.go Refactor query node and query serviceMain changes:1. Add ddBuffer and save binLog. 2020-12-24 15:38:29 +08:00
segment_manager.go Refactor query node and query serviceMain changes:1. Add ddBuffer and save binLog. 2020-12-24 15:38:29 +08:00
stats_processor_test.go Add runtime stats to record field stats 2020-12-21 20:24:40 +08:00
stats_processor.go Add runtime stats to record field stats 2020-12-21 20:24:40 +08:00
system_config_test.go Fix bug: address already used 2020-12-07 15:22:20 +08:00
system_config.go Fix bug: address already used 2020-12-07 15:22:20 +08:00
task_test.go Add timeout logic to task in Proxy 2020-11-17 20:00:23 +08:00
task.go Fix query node param table 2020-11-20 17:10:24 +08:00
time_snyc_producer_test.go Fix bug: address already used 2020-12-07 15:22:20 +08:00
time_sync_producer.go Refactor segment manager 2020-12-19 12:55:24 +08:00
timesync_test.go Add static check 2020-11-30 19:38:23 +08:00
timesync.go Add static check 2020-11-30 19:38:23 +08:00
tso.go Fix bug: address already used 2020-12-07 15:22:20 +08:00

How to start a master

Requirements

Start a etcdv3

./etcd -listen-peer-urls=http://192.168.1.10:12380 -advertise-client-urls=http://192.168.1.10:12379 -listen-client-urls http://0.0.0.0:12379,http://0.0.0.0:14001 -initial-advertise-peer-urls=http://192.168.1.10:12380

Start from code

go run cmd/master.go

Start with docker

What rules does master use to write data to kv storage?

1.find the root path variable ETCD_ROOT_PATH which defined in common/config.go 2.add prefix path segment if the resource is a segement 3.add prefix path collection if the resource is a collection 4.add resource uuid

example

if master create a collection with uuid 46e468ee-b34a-419d-85ed-80c56bfa4e90 the corresponding key in etcd is $(ETCD_ROOT_PATH)/collection/46e468ee-b34a-419d-85ed-80c56bfa4e90