milvus/internal/datacoord
congqixia 8f9e62fa18
Apply DropVirtualChannel and FlushManager drop mode (#12563)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-02 16:39:33 +08:00
..
allocator_test.go [skip ci]Update license for dc channel manager (#10591) 2021-10-25 20:19:25 +08:00
allocator.go [skip ci]Fix allocator typo (#10998) 2021-11-01 16:54:07 +08:00
channel_manager_factory.go Change default balance policy (#10563) 2021-10-26 19:40:44 +08:00
channel_manager_test.go Unwatch dropped channel when init channel manager (#11986) 2021-11-17 23:25:12 +08:00
channel_manager.go Apply DropVirtualChannel and FlushManager drop mode (#12563) 2021-12-02 16:39:33 +08:00
channel_store_test.go Split watch operations to many transactions (#10655) 2021-10-26 19:38:20 +08:00
channel_store.go Add DropVirtualChannel for DataCoord (#12361) 2021-11-29 22:35:41 +08:00
cluster_test.go Unwatch dropped channel when init channel manager (#11986) 2021-11-17 23:25:12 +08:00
cluster.go [skip ci] Refine datacoord cluster comment (#12562) 2021-12-01 19:29:31 +08:00
compaction_policy_test.go Skip single compaction if there's no delta log in a segment (#11806) 2021-11-16 11:23:11 +08:00
compaction_policy.go Skip single compaction if there's no delta log in a segment (#11806) 2021-11-16 11:23:11 +08:00
compaction_test.go Add triggerInfo in compactionTask (#11517) 2021-11-11 15:54:42 +08:00
compaction_trigger_test.go Add triggerInfo in compactionTask (#11517) 2021-11-11 15:54:42 +08:00
compaction_trigger.go Add compaction retention config (#11793) 2021-11-16 11:47:10 +08:00
compaction.go [skip ci] Add license for data coord compaction (#12561) 2021-12-01 19:33:32 +08:00
errors_test.go [skip ci]Update license for dc cluster (#10593) 2021-10-25 20:23:16 +08:00
errors.go [skip ci]Update license for dc cluster (#10593) 2021-10-25 20:23:16 +08:00
garbage_collector_test.go Limit datacoord gc scan prefixes (#12231) 2021-11-24 09:55:15 +08:00
garbage_collector.go Limit datacoord gc scan prefixes (#12231) 2021-11-24 09:55:15 +08:00
handler.go Apply DropVirtualChannel and FlushManager drop mode (#12563) 2021-12-02 16:39:33 +08:00
meta_test.go Add DropVirtualChannel for DataCoord (#12361) 2021-11-29 22:35:41 +08:00
meta.go Apply DropVirtualChannel and FlushManager drop mode (#12563) 2021-12-02 16:39:33 +08:00
metrics_info_test.go [skip ci]Fix datacoord package name missing (#10608) 2021-10-25 21:21:40 +08:00
metrics_info.go Add more deploy metrics (#12248) 2021-11-24 15:43:15 +08:00
mock_test.go Apply DropVirtualChannel and FlushManager drop mode (#12563) 2021-12-02 16:39:33 +08:00
OWNERS [skip ci]Update OWNERS files (#11898) 2021-11-16 15:41:11 +08:00
param_table_test.go [skip ci]Update license for dc policy (#10590) 2021-10-25 19:48:23 +08:00
param_table.go Add datacoord GC configuration (#12061) 2021-11-18 22:29:40 +08:00
policy_test.go Fix segments not removed from flushingCache (#10738) 2021-10-27 16:06:24 +08:00
policy.go [skip ci] Add comment for exported items (#12126) 2021-11-19 18:05:25 +08:00
README.md [skip ci]Change etcd to lowercase (#9983) 2021-10-15 18:58:37 +08:00
segment_allocation_policy_test.go [skip ci]Update license for dc policy (#10590) 2021-10-25 19:48:23 +08:00
segment_allocation_policy.go [skip ci]Update license for dc policy (#10590) 2021-10-25 19:48:23 +08:00
segment_info.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
segment_manager_test.go Add DropVirtualChannel for DataCoord (#12361) 2021-11-29 22:35:41 +08:00
segment_manager.go Fix alloc segment with dropped segment (#12572) 2021-12-01 22:39:37 +08:00
server_test.go Apply DropVirtualChannel and FlushManager drop mode (#12563) 2021-12-02 16:39:33 +08:00
server.go Send SIGINT to runner goroutine after etcd disconnects (#12163) 2021-11-22 16:23:17 +08:00
services.go Apply DropVirtualChannel and FlushManager drop mode (#12563) 2021-12-02 16:39:33 +08:00
session_manager.go Add compaction (#9906) 2021-11-05 22:25:00 +08:00
session.go [skip ci]Update license for dc server (#10589) 2021-10-25 19:46:28 +08:00
util_test.go Add compaction retention config (#11793) 2021-11-16 11:47:10 +08:00
util.go Add compaction retention config (#11793) 2021-11-16 11:47:10 +08:00

Data Coordinator

Data cooridnator(datacoord for short) is the component to organize DataNodes and segments allocations.

Dependency

  • KV store: a kv store has all the meta info datacoord needs to operate. (etcd)
  • Message stream: a message stream to communicate statistics information with data nodes. (Pulsar)
  • Root Coordinator: timestamp, id and meta source.
  • Data Node(s): could be an instance or a cluster, actual worker group handles data modification operations.