11 Commits

Author	SHA1	Message	Date
chyezh	bef06e5acf	enhance: add streaming coord and node grpc service register (#34655) ... issue: #33285 - register streaming coord service into datacoord. - add new streaming node role. - add global static switch to enable streaming service or not. Signed-off-by: chyezh <chyezh@outlook.com>	2024-07-25 12:19:44 +08:00
chyezh	86eff6e589	enhance: streaming node client implementation (#34653) ... issue: #33285 - add streaming node grpc client wrapper - add unittest for streaming node grpc client side - fix binary unsafe bug for message --------- Signed-off-by: chyezh <chyezh@outlook.com>	2024-07-19 17:37:40 +08:00
chyezh	3306bc2faf	fix: ut failure for grpc upgrade (#34726) ... issue: #34462 Signed-off-by: chyezh <chyezh@outlook.com>	2024-07-16 21:49:40 +08:00
chyezh	cc8f7aa110	fix: streaming service related fix patch (#34696) ... issue: #33285 - add idAlloc interface - fix binary unsafe bug for message - fix service discovery lost when repeated address with different server id --------- Signed-off-by: chyezh <chyezh@outlook.com>	2024-07-16 15:49:38 +08:00
chyezh	fda720b880	enhance: streaming service grpc utilities (#34436) ... issue: #33285 - add two grpc resolver (by session and by streaming coord assignment service) - add one grpc balancer (by serverID and roundrobin) - add lazy conn to avoid block by first service discovery - add some utility function for streaming service Signed-off-by: chyezh <chyezh@outlook.com>	2024-07-15 20:49:38 +08:00
chyezh	1bc3c0b925	enhance: implement balancer at streaming coord (#34435) ... issue: #33285 - add balancer implementation - add channel count fair balance policy - add channel assignment discover grpc service Signed-off-by: chyezh <chyezh@outlook.com>	2024-07-11 09:58:48 +08:00
chyezh	dfe0416a70	enhance: implement streaming node server service (#34166) ... issue: #33285 - implement producing and consuming server of message - implement management operation for streaming node server --------- Signed-off-by: chyezh <chyezh@outlook.com>	2024-07-09 07:58:14 +08:00
chyezh	ba04981a43	enhance: implement wal managerment on streaming node (#34153) ... issue: #33285 - add lifetime control for wal. - implement distributed-safe wal manager on streaming node. --------- Signed-off-by: chyezh <chyezh@outlook.com>	2024-07-05 14:29:42 +08:00
chyezh	7611128e57	enhance: wal adaptor implementation (#34122) ... issue: #33285 - add adaptor to implement walimpls into wal interface. - implement timetick sorted and filtering scanner. - add test for wal. --------- Signed-off-by: chyezh <chyezh@outlook.com>	2024-07-04 15:23:08 +08:00
chyezh	d2bc4a53be	enhance: implement rmq and pulsar as wal (#34046) ... issue: #33285 - use reader but not consumer for pulsar - advanced test framework - move some streaming related package into pkg --------- Signed-off-by: chyezh <chyezh@outlook.com>	2024-06-27 15:11:05 +08:00
chyezh	b9237280c2	enhance: wal interface definition (#33745) ... issue: #33285 --------- Signed-off-by: chyezh <chyezh@outlook.com>	2024-06-24 10:34:12 +08:00