The JVM Thing 8.0 – Apache Kafka’s role in Modern Data Architecture

We welcomed Robin Moffatt, to our latest JVM meet-up last Thursday who introduced us to Apache Kafka.

Robin is an Apache Kafka evangelist & Dev Advocate @ Confluent. Robin has been a blogger since 2009, and has published over 100

articles; https://www.confluent.io/blog/author/robinhttp://rmoff.nethttp://ritt.md/rmoff, and http://rnm1978.wordpress.com. Robin is an international speaker & key organiser of the Leeds Apache Kafka meet-up.

Robin talked us through the following:

What is Apache Kafka:

-Messaging done right

  • Scalability
  • True Storage
  • Real-time processing

-Scalable streaming data pipelines

  • Kafka Streams
  • Kafka connect

-Foundation for stream processing

  • K-SQL

-The streaming platform:

  • Event Driven
  • Scalable
  • Decoupled

-What problems Kafka solves?

  • Event-centric thinking
  • System availability and event buffering
  • Varying latency requirements / Batch vs Stream
  • Technology code/algorithm changesAnd much more…Robin provided an example of kafka in production through real-time event driven / customer focused applications using Monzo bank as the case study. More can be found here on how Monzo have built a modern bank using modern technology – https://monzo.com/blog/2016/09/19/building-a-modern-bank-backend/.

Robin delivered an awesome talk, if you haven’t attended one of his sessions I would encourage you to follow him on Twitter and keep an eye out for his next presentation – @rmoff

The JVM Thing is a tech community group for the JVM language community, bringing together Software enthusiasts to show, tell, share knowledge and discuss key topics related to the JVM ecosystem.

Follow us on Twitter for upcoming news: @The_JVM_Thing

Join us on meet-up: https://www.meetup.com/Leeds-JVMThing/

Feel free to get in touch about speaking at future events: matt.wood@fruitionit.co.uk