Have you heard about Tansu?
Tomorrow, I will post the longest-ever podcast about it.
It’s an open-source (Apache), stateless, leaderless, single-binary Kafka broker supporting pluggable storage backends (S3, PostgreSQL, SQLite) with built-in schema registry and support for open-table formats (Iceberg/Delta)
It's the story of a one-man-show - Peter Morgan - a super-productive solo Rust developer with the desire to build a world-class ergonomic Kafka broker UX that's optimized for developers.
You can tell he's incredibly passionate about programming and Kafka from the super-engaging conversation we had. If you’d like to hear a no-bs techincal engineering conversation - watch me tomorrow as I interview him for 3 hours and 30 minutes straight.
The chat is full of nerd-snipes, where we talk about basically everything, including:
the characteristics and value prop of Tansu
our combined decade and a half experiences with Kafka
schemas and today's unnecessary complexity around them
low-level performance optimizations including in-depth flame graphs analysis
the need for proxies in Kafka
Kafka's java bias
SQL + Streaming
Rust for building low-level systems
a lot more than I can capture in a single post
I know it may sound like "yet another Kafka", but it's the one I'm genuinely most excited about. Trust me there's good reason why 🙌
Stay tuned on our YouTube Premiere tomorrow:✅ youtube.com/watch?v=pJQ…
PS: Happy New Year! 💥🎉