milvus/internal/datacoord
edward.zeng 098e1375fb
[skip ci] Refine datacoord compaction trigger comment (#13491)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-16 09:59:12 +08:00
..
allocator_test.go [skip ci]Update license for dc channel manager (#10591) 2021-10-25 20:19:25 +08:00
allocator.go Improve import statements (#13435) 2021-12-15 20:49:10 +08:00
channel_manager_factory.go Change default balance policy (#10563) 2021-10-26 19:40:44 +08:00
channel_manager_test.go Improve import statements (#13437) 2021-12-15 19:57:13 +08:00
channel_manager.go Improve import statements (#13436) 2021-12-15 20:47:10 +08:00
channel_store_test.go Split watch operations to many transactions (#10655) 2021-10-26 19:38:20 +08:00
channel_store.go Correct spelling error in code comment (#13413) 2021-12-15 15:59:17 +08:00
cluster_test.go Unwatch dropped channel when init channel manager (#11986) 2021-11-17 23:25:12 +08:00
cluster.go [skip ci] Refine datacoord cluster comment (#13408) 2021-12-15 11:58:31 +08:00
compaction_policy_test.go Skip single compaction if there's no delta log in a segment (#11806) 2021-11-16 11:23:11 +08:00
compaction_policy.go [skip ci] Refine datacoord compaction policy comment (#13489) 2021-12-16 09:41:10 +08:00
compaction_test.go Add triggerInfo in compactionTask (#11517) 2021-11-11 15:54:42 +08:00
compaction_trigger_test.go Fix ci issue caused by only compact flushed segments (#13317) 2021-12-14 13:55:07 +08:00
compaction_trigger.go [skip ci] Refine datacoord compaction trigger comment (#13491) 2021-12-16 09:59:12 +08:00
compaction.go [skip ci] Add license for data coord compaction (#12561) 2021-12-01 19:33:32 +08:00
errors_test.go [skip ci]Update license for dc cluster (#10593) 2021-10-25 20:23:16 +08:00
errors.go [skip ci]Update license for dc cluster (#10593) 2021-10-25 20:23:16 +08:00
garbage_collector_test.go Limit datacoord gc scan prefixes (#12231) 2021-11-24 09:55:15 +08:00
garbage_collector.go [skip ci] Refine datacoord garbage collector comment (#13430) 2021-12-15 18:25:43 +08:00
handler.go [skip ci] Refine datacoord handler comment (#13113) 2021-12-09 22:10:23 +08:00
meta_test.go Add DropVirtualChannel for DataCoord (#12361) 2021-11-29 22:35:41 +08:00
meta.go [skip ci] Refine datacoord meta comment (#13432) 2021-12-15 16:57:23 +08:00
metrics_info_test.go [skip ci]Fix datacoord package name missing (#10608) 2021-10-25 21:21:40 +08:00
metrics_info.go [skip ci] Refine datacoord metrics info comment (#13114) 2021-12-09 22:14:14 +08:00
mock_test.go Fix ci issue caused by only compact flushed segments (#13317) 2021-12-14 13:55:07 +08:00
OWNERS [skip ci]Update OWNERS files (#11898) 2021-11-16 15:41:11 +08:00
param_table_test.go Move segment statistics update to datanode tt loop (#13233) 2021-12-15 10:53:16 +08:00
param_table.go Move segment statistics update to datanode tt loop (#13233) 2021-12-15 10:53:16 +08:00
policy_test.go Fix segments not removed from flushingCache (#10738) 2021-10-27 16:06:24 +08:00
policy.go [skip ci] Add comment for exported items (#12126) 2021-11-19 18:05:25 +08:00
README.md [skip ci]Change etcd to lowercase (#9983) 2021-10-15 18:58:37 +08:00
segment_allocation_policy_test.go [skip ci]Update license for dc policy (#10590) 2021-10-25 19:48:23 +08:00
segment_allocation_policy.go Move segment statistics update to datanode tt loop (#13233) 2021-12-15 10:53:16 +08:00
segment_info.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
segment_manager_test.go Move segment statistics update to datanode tt loop (#13233) 2021-12-15 10:53:16 +08:00
segment_manager.go [skip ci]Fix error log output format in segment_manager.go (#12856) 2021-12-07 14:36:27 +08:00
server_test.go Register the service when the component state is healthy (#13248) 2021-12-15 11:47:10 +08:00
server.go Register the service when the component state is healthy (#13248) 2021-12-15 11:47:10 +08:00
services.go Improve compaction log (#13394) 2021-12-15 16:07:10 +08:00
session_manager.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
session.go correct spelling error (#13409) 2021-12-15 16:47:13 +08:00
util_test.go Add compaction retention config (#11793) 2021-11-16 11:47:10 +08:00
util.go Add compaction retention config (#11793) 2021-11-16 11:47:10 +08:00

Data Coordinator

Data cooridnator(datacoord for short) is the component to organize DataNodes and segments allocations.

Dependency

  • KV store: a kv store has all the meta info datacoord needs to operate. (etcd)
  • Message stream: a message stream to communicate statistics information with data nodes. (Pulsar)
  • Root Coordinator: timestamp, id and meta source.
  • Data Node(s): could be an instance or a cluster, actual worker group handles data modification operations.