milvus/internal/datacoord
Bingyi Sun 3a2aace6f0
Fix ci issue caused by only compact flushed segments (#13317)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-14 13:55:07 +08:00
..
allocator_test.go [skip ci]Update license for dc channel manager (#10591) 2021-10-25 20:19:25 +08:00
allocator.go [skip ci] Refine datacoord allocator comment (#12985) 2021-12-08 17:35:06 +08:00
channel_manager_factory.go Change default balance policy (#10563) 2021-10-26 19:40:44 +08:00
channel_manager_test.go Unwatch dropped channel when init channel manager (#11986) 2021-11-17 23:25:12 +08:00
channel_manager.go [skip ci] Refine datacoord channel manager comment (#12989) 2021-12-08 17:53:22 +08:00
channel_store_test.go Split watch operations to many transactions (#10655) 2021-10-26 19:38:20 +08:00
channel_store.go [skip ci] Refine datacoord channel store comment (#12991) 2021-12-08 17:57:05 +08:00
cluster_test.go Unwatch dropped channel when init channel manager (#11986) 2021-11-17 23:25:12 +08:00
cluster.go [skip ci] Refine datacoord cluster comment (#12562) 2021-12-01 19:29:31 +08:00
compaction_policy_test.go Skip single compaction if there's no delta log in a segment (#11806) 2021-11-16 11:23:11 +08:00
compaction_policy.go Skip single compaction if there's no delta log in a segment (#11806) 2021-11-16 11:23:11 +08:00
compaction_test.go Add triggerInfo in compactionTask (#11517) 2021-11-11 15:54:42 +08:00
compaction_trigger_test.go Fix ci issue caused by only compact flushed segments (#13317) 2021-12-14 13:55:07 +08:00
compaction_trigger.go Fix ci issue caused by only compact flushed segments (#13317) 2021-12-14 13:55:07 +08:00
compaction.go [skip ci] Add license for data coord compaction (#12561) 2021-12-01 19:33:32 +08:00
errors_test.go [skip ci]Update license for dc cluster (#10593) 2021-10-25 20:23:16 +08:00
errors.go [skip ci]Update license for dc cluster (#10593) 2021-10-25 20:23:16 +08:00
garbage_collector_test.go Limit datacoord gc scan prefixes (#12231) 2021-11-24 09:55:15 +08:00
garbage_collector.go Limit datacoord gc scan prefixes (#12231) 2021-11-24 09:55:15 +08:00
handler.go [skip ci] Refine datacoord handler comment (#13113) 2021-12-09 22:10:23 +08:00
meta_test.go Add DropVirtualChannel for DataCoord (#12361) 2021-11-29 22:35:41 +08:00
meta.go [skip ci] Refine datacoord meta comment (#13112) 2021-12-09 22:07:10 +08:00
metrics_info_test.go [skip ci]Fix datacoord package name missing (#10608) 2021-10-25 21:21:40 +08:00
metrics_info.go [skip ci] Refine datacoord metrics info comment (#13114) 2021-12-09 22:14:14 +08:00
mock_test.go Fix ci issue caused by only compact flushed segments (#13317) 2021-12-14 13:55:07 +08:00
OWNERS [skip ci]Update OWNERS files (#11898) 2021-11-16 15:41:11 +08:00
param_table_test.go [skip ci]Update license for dc policy (#10590) 2021-10-25 19:48:23 +08:00
param_table.go Add switch for auto compaction (#12974) 2021-12-08 19:47:05 +08:00
policy_test.go Fix segments not removed from flushingCache (#10738) 2021-10-27 16:06:24 +08:00
policy.go [skip ci] Add comment for exported items (#12126) 2021-11-19 18:05:25 +08:00
README.md [skip ci]Change etcd to lowercase (#9983) 2021-10-15 18:58:37 +08:00
segment_allocation_policy_test.go [skip ci]Update license for dc policy (#10590) 2021-10-25 19:48:23 +08:00
segment_allocation_policy.go [skip ci]Update license for dc policy (#10590) 2021-10-25 19:48:23 +08:00
segment_info.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
segment_manager_test.go Add DropVirtualChannel for DataCoord (#12361) 2021-11-29 22:35:41 +08:00
segment_manager.go [skip ci]Fix error log output format in segment_manager.go (#12856) 2021-12-07 14:36:27 +08:00
server_test.go Fix empty segment compact and load (#12710) 2021-12-09 11:03:08 +08:00
server.go [skip ci]Improve log style (#13008) 2021-12-08 20:27:06 +08:00
services.go Fix empty segment compact and load (#12710) 2021-12-09 11:03:08 +08:00
session_manager.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
session.go [skip ci]Update license for dc server (#10589) 2021-10-25 19:46:28 +08:00
util_test.go Add compaction retention config (#11793) 2021-11-16 11:47:10 +08:00
util.go Add compaction retention config (#11793) 2021-11-16 11:47:10 +08:00

Data Coordinator

Data cooridnator(datacoord for short) is the component to organize DataNodes and segments allocations.

Dependency

  • KV store: a kv store has all the meta info datacoord needs to operate. (etcd)
  • Message stream: a message stream to communicate statistics information with data nodes. (Pulsar)
  • Root Coordinator: timestamp, id and meta source.
  • Data Node(s): could be an instance or a cluster, actual worker group handles data modification operations.