Name: Deploy AI in 20MB: Lightweight Containers for Open Source Developers - Miley Fu, Second State
Start: 2025-08-27T11:55:00+0200
End: 2025-08-27T12:35:00+0200

25-27, August 2025
Amsterdam, Netherlands
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for Open Source Summit Europe 2025 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Central European Summer Time, CEST (UTC +2). To see the schedule in your preferred timezone, please select from the drop-down menu to the right.

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

Wednesday August 27, 2025 11:55 - 12:35 CEST

Emerald Room

Containerization has enabled powerful deployment workflows—but traditional Linux containers can be heavyweight, especially for LLMs or AI workloads on resource-restraint environments.

This session introduces WebAssembly as an alternative for deploying small, single-purpose AI functions. We’ll demonstrate how to build a simple AI service in Rust, compile it to Wasm, and compare the runtime footprint and deployment model with a traditional Python or Linux container-based equivalent. The focus will be on practical constraints: image size, memory use, startup time, and runtime isolation. We’ll also walk through running them (along open source LLMs) in sandboxed environments, even without root access, and why this matters for cross-platform efficient and secure deployment. The session is geared toward beginners who may already be familiar with Docker but are looking for faster, more portable alternatives to run open source LLMs in real-world environments.

Ideal for devs exploring open-source AI tooling, local-first agents, or edge inferencing.

Speakers

Miley Fu

Founding Member, Second State

Miley is the co-chair and keynote speaker for KubeCon+Open Source Summit and AI Dev 2024. With over 6 years of experience working on WasmEdge runtime in CNCF sandbox as a founding member, she talks at KubeCon, KCD Shenzhen, CloudDay Italy, DevRelCon, Open Source Summit Japan, AWS... Read More →

Wednesday August 27, 2025 11:55 - 12:35 CEST
Emerald Room

Cloud & Containers

Audience Experience Level Beginner

Open Source Summit Europe 2025

Miley Fu

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!