milvus/internal/datacoord
congqixia 2ee0c7c074
Add compacted segment into check list when drop collection (#12272)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-25 15:13:15 +08:00
..
allocator_test.go [skip ci]Update license for dc channel manager (#10591) 2021-10-25 20:19:25 +08:00
allocator.go [skip ci]Fix allocator typo (#10998) 2021-11-01 16:54:07 +08:00
channel_manager_factory.go Change default balance policy (#10563) 2021-10-26 19:40:44 +08:00
channel_manager_test.go Unwatch dropped channel when init channel manager (#11986) 2021-11-17 23:25:12 +08:00
channel_manager.go Unwatch dropped channel when init channel manager (#11986) 2021-11-17 23:25:12 +08:00
channel_store_test.go Split watch operations to many transactions (#10655) 2021-10-26 19:38:20 +08:00
channel_store.go [skip ci] Fix lint for datacoord/channel_store.og (#10964) 2021-10-30 21:08:00 +08:00
cluster_test.go Unwatch dropped channel when init channel manager (#11986) 2021-11-17 23:25:12 +08:00
cluster.go Change channel's field to upper case to log details (#10567) 2021-10-26 20:15:41 +08:00
compaction_policy_test.go Skip single compaction if there's no delta log in a segment (#11806) 2021-11-16 11:23:11 +08:00
compaction_policy.go Skip single compaction if there's no delta log in a segment (#11806) 2021-11-16 11:23:11 +08:00
compaction_test.go Add triggerInfo in compactionTask (#11517) 2021-11-11 15:54:42 +08:00
compaction_trigger_test.go Add triggerInfo in compactionTask (#11517) 2021-11-11 15:54:42 +08:00
compaction_trigger.go Add compaction retention config (#11793) 2021-11-16 11:47:10 +08:00
compaction.go Add triggerInfo in compactionTask (#11517) 2021-11-11 15:54:42 +08:00
errors_test.go [skip ci]Update license for dc cluster (#10593) 2021-10-25 20:23:16 +08:00
errors.go [skip ci]Update license for dc cluster (#10593) 2021-10-25 20:23:16 +08:00
garbage_collector_test.go Limit datacoord gc scan prefixes (#12231) 2021-11-24 09:55:15 +08:00
garbage_collector.go Limit datacoord gc scan prefixes (#12231) 2021-11-24 09:55:15 +08:00
handler.go Add compacted segment into check list when drop collection (#12272) 2021-11-25 15:13:15 +08:00
meta_test.go Add segment drop logic (#11621) 2021-11-12 00:22:42 +08:00
meta.go Clear dropped segment meta on etcd (#12191) 2021-11-23 11:23:15 +08:00
metrics_info_test.go [skip ci]Fix datacoord package name missing (#10608) 2021-10-25 21:21:40 +08:00
metrics_info.go Add more deploy metrics (#12248) 2021-11-24 15:43:15 +08:00
mock_test.go Unwatch dropped channel when init channel manager (#11986) 2021-11-17 23:25:12 +08:00
OWNERS [skip ci]Update OWNERS files (#11898) 2021-11-16 15:41:11 +08:00
param_table_test.go [skip ci]Update license for dc policy (#10590) 2021-10-25 19:48:23 +08:00
param_table.go Add datacoord GC configuration (#12061) 2021-11-18 22:29:40 +08:00
policy_test.go Fix segments not removed from flushingCache (#10738) 2021-10-27 16:06:24 +08:00
policy.go [skip ci] Add comment for exported items (#12126) 2021-11-19 18:05:25 +08:00
README.md [skip ci]Change etcd to lowercase (#9983) 2021-10-15 18:58:37 +08:00
segment_allocation_policy_test.go [skip ci]Update license for dc policy (#10590) 2021-10-25 19:48:23 +08:00
segment_allocation_policy.go [skip ci]Update license for dc policy (#10590) 2021-10-25 19:48:23 +08:00
segment_info.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
segment_manager_test.go Fix drop segment bug (#11709) 2021-11-12 17:31:11 +08:00
segment_manager.go Improve GetVChanPosistion and fix unit tests (#11888) 2021-11-16 21:41:50 +08:00
server_test.go Add compacted segment into check list when drop collection (#12272) 2021-11-25 15:13:15 +08:00
server.go Send SIGINT to runner goroutine after etcd disconnects (#12163) 2021-11-22 16:23:17 +08:00
services.go Add GetFlushState interface (#12170) 2021-11-23 10:55:14 +08:00
session_manager.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
session.go [skip ci]Update license for dc server (#10589) 2021-10-25 19:46:28 +08:00
util_test.go Add compaction retention config (#11793) 2021-11-16 11:47:10 +08:00
util.go Add compaction retention config (#11793) 2021-11-16 11:47:10 +08:00

Data Coordinator

Data cooridnator(datacoord for short) is the component to organize DataNodes and segments allocations.

Dependency

  • KV store: a kv store has all the meta info datacoord needs to operate. (etcd)
  • Message stream: a message stream to communicate statistics information with data nodes. (Pulsar)
  • Root Coordinator: timestamp, id and meta source.
  • Data Node(s): could be an instance or a cluster, actual worker group handles data modification operations.