milvus/internal/datacoord
sunby c26cd79532
Add compaction (#9906)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-05 22:25:00 +08:00
..
allocator_test.go [skip ci]Update license for dc channel manager (#10591) 2021-10-25 20:19:25 +08:00
allocator.go [skip ci]Fix allocator typo (#10998) 2021-11-01 16:54:07 +08:00
channel_manager_factory.go Change default balance policy (#10563) 2021-10-26 19:40:44 +08:00
channel_manager_test.go [skip ci]Update license for dc channel manager (#10591) 2021-10-25 20:19:25 +08:00
channel_manager.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
channel_store_test.go Split watch operations to many transactions (#10655) 2021-10-26 19:38:20 +08:00
channel_store.go [skip ci] Fix lint for datacoord/channel_store.og (#10964) 2021-10-30 21:08:00 +08:00
cluster_test.go Change channel's field to upper case to log details (#10567) 2021-10-26 20:15:41 +08:00
cluster.go Change channel's field to upper case to log details (#10567) 2021-10-26 20:15:41 +08:00
compaction_policy_test.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
compaction_policy.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
compaction_test.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
compaction_trigger_test.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
compaction_trigger.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
compaction.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
datanode_helper.go [skip ci]Update license for dc cluster (#10593) 2021-10-25 20:23:16 +08:00
errors_test.go [skip ci]Update license for dc cluster (#10593) 2021-10-25 20:23:16 +08:00
errors.go [skip ci]Update license for dc cluster (#10593) 2021-10-25 20:23:16 +08:00
meta_test.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
meta.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
metrics_info_test.go [skip ci]Fix datacoord package name missing (#10608) 2021-10-25 21:21:40 +08:00
metrics_info.go [skip ci]Update license for dc meta (#10592) 2021-10-25 20:21:18 +08:00
mock_test.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
OWNERS Remove unused label rules (#7929) 2021-09-18 18:19:51 +08:00
param_table_test.go [skip ci]Update license for dc policy (#10590) 2021-10-25 19:48:23 +08:00
param_table.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
policy_test.go Fix segments not removed from flushingCache (#10738) 2021-10-27 16:06:24 +08:00
policy.go [skip ci] Fix lint for AvgAssignRegisterPolicy (#10965) 2021-10-30 21:03:52 +08:00
README.md [skip ci]Change etcd to lowercase (#9983) 2021-10-15 18:58:37 +08:00
segment_allocation_policy_test.go [skip ci]Update license for dc policy (#10590) 2021-10-25 19:48:23 +08:00
segment_allocation_policy.go [skip ci]Update license for dc policy (#10590) 2021-10-25 19:48:23 +08:00
segment_info.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
segment_manager_test.go [skip ci]Update license for dc segmentinfo (#10588) 2021-10-25 19:44:37 +08:00
segment_manager.go [skip ci]Update license for dc segmentinfo (#10588) 2021-10-25 19:44:37 +08:00
server_test.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
server.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
services.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
session_manager.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
session.go [skip ci]Update license for dc server (#10589) 2021-10-25 19:46:28 +08:00
util_test.go [skip ci]Update license for dc server (#10589) 2021-10-25 19:46:28 +08:00
util.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00

Data Coordinator

Data cooridnator(datacoord for short) is the component to organize DataNodes and segments allocations.

Dependency

  • KV store: a kv store has all the meta info datacoord needs to operate. (etcd)
  • Message stream: a message stream to communicate statistics information with data nodes. (Pulsar)
  • Root Coordinator: timestamp, id and meta source.
  • Data Node(s): could be an instance or a cluster, actual worker group handles data modification operations.