Session

Building next generation of stream computation engine using Component Model

Sehyo Chang - InfinyOn

Join us for an insightful journey into revolutionizing stateful stream processing engines! In this talk, we’ll unveil how we harnessed the power of the WebAssembly (WASM) Component model to pave the way for the next generation of stream processing. Traditional engines like Flink and Spark have long dominated the scene but have limitations in developer experience, efficiency, and runtime footprint. Our innovative approach transcends these constraints, unlocking the full potential of stream processing for everyone, irrespective of programming language. Delve into the core of our ‘stateful service’ engine as we dissect the architectural and design choices that make it stand out. Discover the transformative role of the WASM Component model in enabling any language to function as a stream processor, liberating us from the Java and SQL exclusivity of the past. We’ll navigate through the challenges and limitations encountered during this groundbreaking journey. Learn how we tackled crucial issues, including leveraging WIT to express stream processing semantics and optimizing resource models. Real-world use cases and live demos will illustrate how we overcame these challenges, providing a glimpse into the future of stream processing. Don’t miss out on this opportunity to be at the forefront of the stream processing revolution!