milvus/internal/datanode
congqixia c91bb0b015
Unify rootPath in configs and ChunkManager (#18808)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-08-25 19:32:53 +08:00
..
allocator_test.go Fix DataNode panic while allocating IDs (#17294) 2022-05-31 18:02:03 +08:00
allocator.go Fix DataNode panic while allocating IDs (#17294) 2022-05-31 18:02:03 +08:00
binlog_io_test.go Unify rootPath in configs and ChunkManager (#18808) 2022-08-25 19:32:53 +08:00
binlog_io.go Unify rootPath in configs and ChunkManager (#18808) 2022-08-25 19:32:53 +08:00
cache_test.go Make duplicate flush recalls success and other logic update (#16755) 2022-05-06 17:49:51 +08:00
cache.go Make duplicate flush recalls success and other logic update (#16755) 2022-05-06 17:49:51 +08:00
compaction_executor_test.go refactor compaction concurency logic (#18660) 2022-08-23 15:50:52 +08:00
compaction_executor.go refactor compaction concurency logic (#18660) 2022-08-23 15:50:52 +08:00
compactor_test.go refactor compaction concurency logic (#18660) 2022-08-23 15:50:52 +08:00
compactor.go refactor compaction concurency logic (#18660) 2022-08-23 15:50:52 +08:00
data_node_test.go refactor compaction concurency logic (#18660) 2022-08-23 15:50:52 +08:00
data_node.go Unify rootPath in configs and ChunkManager (#18808) 2022-08-25 19:32:53 +08:00
data_sync_service_test.go Clear segment cache when closing flowgraph (#17671) 2022-06-22 10:16:14 +08:00
data_sync_service.go Refine some datanode code (#18351) 2022-07-21 15:52:27 +08:00
errors_test.go [skip ci]Update license for datesync (#9959) 2021-10-15 18:01:38 +08:00
errors.go Normalize DataNode term in errors.go (#13688) 2021-12-20 12:20:50 +08:00
event_manager_test.go change the etcd compareAndSwap interface (#18068) 2022-07-06 13:54:21 +08:00
event_manager.go change the etcd compareAndSwap interface (#18068) 2022-07-06 13:54:21 +08:00
flow_graph_dd_node_test.go fix insert meets vChannels reuse pChannel (#18695) 2022-08-23 19:12:55 +08:00
flow_graph_dd_node.go fix insert meets vChannels reuse pChannel (#18695) 2022-08-23 19:12:55 +08:00
flow_graph_delete_node_test.go Unify rootPath in configs and ChunkManager (#18808) 2022-08-25 19:32:53 +08:00
flow_graph_delete_node.go Fix flush panic after compaction (#18677) 2022-08-17 17:08:49 +08:00
flow_graph_dmstream_input_node_test.go Fix pulsar unsubsribe issue (#17562) 2022-06-16 17:28:11 +08:00
flow_graph_dmstream_input_node.go Use vchannel name in datanode subName (#18519) 2022-08-03 17:10:36 +08:00
flow_graph_insert_buffer_node_test.go Handles DropPartitionMsg in datanode flowgraph (#18292) 2022-07-15 17:12:27 +08:00
flow_graph_insert_buffer_node.go Handles DropPartitionMsg in datanode flowgraph (#18292) 2022-07-15 17:12:27 +08:00
flow_graph_manager_test.go Support insert string data (#15993) 2022-03-25 14:27:25 +08:00
flow_graph_manager.go Refine some codes about the datanode (#17720) 2022-06-23 09:58:14 +08:00
flow_graph_message_test.go [skip ci]Update license for datanode (#9963) 2021-10-15 18:09:00 +08:00
flow_graph_message.go Handles DropPartitionMsg in datanode flowgraph (#18292) 2022-07-15 17:12:27 +08:00
flow_graph_node.go Handle errors in DataNode and QueryNode flow graph (#17096) 2022-05-24 21:11:59 +08:00
flow_graph_time_ticker_test.go Move segment statistics update to datanode tt loop (#13233) 2021-12-15 10:53:16 +08:00
flow_graph_time_ticker.go Handle errors in DataNode and QueryNode flow graph (#17096) 2022-05-24 21:11:59 +08:00
flush_manager_test.go Make DataNode not panic if stale segment is not found during flush (#18322) 2022-07-20 15:06:30 +08:00
flush_manager.go Unify rootPath in configs and ChunkManager (#18808) 2022-08-25 19:32:53 +08:00
flush_task_test.go Fix flush manager injection logic with multiple segments (#12260) 2021-11-24 18:41:16 +08:00
flush_task.go Improve logs to better cover segment flush lifecycle (#18157) 2022-07-08 14:50:21 +08:00
meta_service_test.go Support insert string data (#15993) 2022-03-25 14:27:25 +08:00
meta_service.go Refine some datanode code (#18351) 2022-07-21 15:52:27 +08:00
meta_util.go Make VChannelInfo read compatible with 2.0.2 (#17995) 2022-07-07 21:58:22 +08:00
metrics_info.go Add ShowConfigurations for all remaining session (#18594) 2022-08-12 13:20:39 +08:00
mock_test.go Move SegmentInfo out of VchannelInfo, leave Id only to decrease kv size. Get complete SegmentInfo through RPC (#17441) 2022-06-16 12:00:10 +08:00
OWNERS [skip ci]Update OWNERS files (#11898) 2021-11-16 15:41:11 +08:00
README.md [skip ci]Change uppercase of MinIO (#9539) 2021-10-09 11:22:58 +08:00
segment_replica_test.go Handles DropPartitionMsg in datanode flowgraph (#18292) 2022-07-15 17:12:27 +08:00
segment_replica.go Fix flush panic after compaction (#18677) 2022-08-17 17:08:49 +08:00
type_def.go [skip ci]Update license for datanode (#9963) 2021-10-15 18:09:00 +08:00

Data Node

DataNode is the component to write insert and delete messages into persistent blob storage, for example MinIO or S3.

Dependency

  • KV store: a kv store that persists messages into blob storage.
  • Message stream: receive messages and publish imformation
  • Root Coordinator: get the latest unique IDs.
  • Data Coordinator: get the flush information and which message stream to subscribe.