milvus/internal/datanode
yihao.dai dd2cb1d44a
Flush by flush channels (#26859)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-09-12 21:07:19 +08:00
..
allocator Add cpp-build and setenv for querynode mockery regen command (#26843) 2023-09-05 14:13:49 +08:00
binlog_io_test.go Use go-api/v2 for milvus-proto (#24770) 2023-06-09 01:28:37 +08:00
binlog_io.go Add compaction log (#24976) 2023-06-19 14:18:41 +08:00
buffer_test.go Decouple basetable and componentparam (#26725) 2023-09-05 10:31:48 +08:00
buffer.go Use go-api/v2 for milvus-proto (#24770) 2023-06-09 01:28:37 +08:00
cache_test.go
cache.go Use typeutil.ConcurrentMap instead of sync.Map (#25846) 2023-07-24 10:23:01 +08:00
channel_meta_test.go fix sync memory policy lose effect when inserting too many partitions(#25763) (#26154) 2023-08-07 09:59:07 +08:00
channel_meta.go Flush by flush channels (#26859) 2023-09-12 21:07:19 +08:00
compaction_executor_test.go Use typeutil.ConcurrentMap instead of sync.Map (#25846) 2023-07-24 10:23:01 +08:00
compaction_executor.go Use typeutil.ConcurrentMap instead of sync.Map (#25846) 2023-07-24 10:23:01 +08:00
compactor_test.go Add float16 vector (#25852) 2023-09-08 10:03:16 +08:00
compactor.go Add float16 vector (#25852) 2023-09-08 10:03:16 +08:00
data_node_test.go Decouple basetable and componentparam (#26725) 2023-09-05 10:31:48 +08:00
data_node.go Refine QueryNode errors (#27013) 2023-09-12 16:07:18 +08:00
data_sync_service_test.go Flush by flush channels (#26859) 2023-09-12 21:07:19 +08:00
data_sync_service.go Add timeout in dispatcher, AsConsumer and Seek (#26686) 2023-09-08 09:51:17 +08:00
event_manager_test.go
event_manager.go tikv integration (#26246) 2023-09-07 07:25:14 +08:00
flow_graph_dd_node_test.go Refactor logs in DataCoord & DataNode (#25574) 2023-07-14 15:56:31 +08:00
flow_graph_dd_node.go Remove unused hash value setting in DDNode (#26575) 2023-08-28 11:30:26 +08:00
flow_graph_delete_node_test.go Decouple basetable and componentparam (#26725) 2023-09-05 10:31:48 +08:00
flow_graph_delete_node.go Add timeout in dispatcher, AsConsumer and Seek (#26686) 2023-09-08 09:51:17 +08:00
flow_graph_dmstream_input_node_test.go Add timeout in dispatcher, AsConsumer and Seek (#26686) 2023-09-08 09:51:17 +08:00
flow_graph_dmstream_input_node.go Add timeout in dispatcher, AsConsumer and Seek (#26686) 2023-09-08 09:51:17 +08:00
flow_graph_insert_buffer_node_test.go Flush by flush channels (#26859) 2023-09-12 21:07:19 +08:00
flow_graph_insert_buffer_node.go Flush by flush channels (#26859) 2023-09-12 21:07:19 +08:00
flow_graph_manager_test.go Flush by flush channels (#26859) 2023-09-12 21:07:19 +08:00
flow_graph_manager.go Flush by flush channels (#26859) 2023-09-12 21:07:19 +08:00
flow_graph_message_test.go
flow_graph_message.go Use go-api/v2 for milvus-proto (#24770) 2023-06-09 01:28:37 +08:00
flow_graph_node.go
flow_graph_time_tick_node.go Flush by flush channels (#26859) 2023-09-12 21:07:19 +08:00
flow_graph_time_ticker.go
flush_manager_test.go Retry on SyncSegment failure (#25540) 2023-07-13 14:12:29 +08:00
flush_manager.go Make write binlog in parallel (#26325) 2023-08-17 15:44:18 +08:00
flush_task_test.go
flush_task.go Refactor logs in DataCoord & DataNode (#25574) 2023-07-14 15:56:31 +08:00
io_pool_test.go Fix copylocks linter errors (#26217) 2023-08-08 20:41:15 +08:00
io_pool.go use single instance ppol (#25159) 2023-06-28 14:54:45 +08:00
meta_service_test.go Use go-api/v2 for milvus-proto (#24770) 2023-06-09 01:28:37 +08:00
meta_service.go [Cherry-Pick] Support Database (#24769) 2023-06-25 17:20:43 +08:00
meta_util.go Use go-api/v2 for milvus-proto (#24770) 2023-06-09 01:28:37 +08:00
metrics_info.go Refine errors to remove changes breaking design (#26521) 2023-09-04 09:57:09 +08:00
mock_test.go Bulkinsert supports partition keys (#25284) 2023-07-11 15:18:28 +08:00
OWNERS
rate_collector_test.go
rate_collector.go
README.md
segment_sync_policy_test.go Flush by flush channels (#26859) 2023-09-12 21:07:19 +08:00
segment_sync_policy.go Flush by flush channels (#26859) 2023-09-12 21:07:19 +08:00
segment_test.go
segment.go Merge syncCPLagTooBehind policy into syncPeriodically policy (#26713) 2023-09-04 14:37:47 +08:00
services_test.go Flush by flush channels (#26859) 2023-09-12 21:07:19 +08:00
services.go Flush by flush channels (#26859) 2023-09-12 21:07:19 +08:00
timetick_sender_test.go Organize mocks from types.go (#25466) 2023-07-14 10:12:31 +08:00
timetick_sender.go Reduce log frequency in timetick_sender (#25532) 2023-07-13 14:38:29 +08:00
util.go

Data Node

DataNode is the component to write insert and delete messages into persistent blob storage, for example MinIO or S3.

Dependency

  • KV store: a kv store that persists messages into blob storage.
  • Message stream: receive messages and publish imformation
  • Root Coordinator: get the latest unique IDs.
  • Data Coordinator: get the flush information and which message stream to subscribe.