Stream pipeline

in-progress

System in-charge of managing and processing websocket streams.

TSM tree

done

Time-structured merge tree. A timeseries optimised tree with a fast row-based memtable and a columnar disk format.

in-progress

Processes the temporal data from the stream and feeds it to the main compute execution. Sits between the ingestion pipeline, TSM and Wasm runtime.

done

Runs multi-tenanted durable functions that consume processed stream data and accesses TSM tree.

planned

Authenticated gateway and more streaming primitives for handling incoming data streams. Right now, we have plans for NATS and Kafka.

planned

Sync local data to the cloud with S3 or R2.

deferred

Ensures durability and consistency by logging system operations before commiting them.

planned

Fast, effecient, secure transport protocol over UDP. Replaces websocket for streams.