What is Apache Kafka

I'd like to tell you what Apache Kafka is, but first, I wanna start with some background. For a long time now, we have written programs that store information in databases. Now, what databases encourage us to do is to think of the world in terms of things, things like, I don't know, users and maybe a thermostat. That's a thermometer, but you get the idea. Maybe a physical thing, like a train, let's see, here's a train. Things, there are things in the world. Database encourages us to think in those terms and those things have some state. We take that state, we store it in the database. This has worked well for decades, but now some people are finding that it's better, rather than thinking of things first, to think of events first. Now events have some state too, right? An event has a description of what happened with it, but the primary idea is that the event is an indication in time that the thing took place.

Motivations and Customer Use Cases, Apache Kafka

Let's look at some of the motivations people have for using a system like Apache Kafka, and what are some use cases? What are people in different industries doing with it? (upbeat music) Now, if you're watching this course, you're probably aware that there is a paradigm shift under way in favor of event-driven architectures. The basic idea here is that the way we've been building systems has been focused on state, on the current state of things, and really a focus When we design systems, we focus on data as things. There's very much a paradigm shift underway from that to a perspective of data as events. There are things that happen in the world, and our primary purpose is to process those events. This relates to a lot of different other architectural trends that are happening at the time, but it's a very real thing. And you can see by way of analogy, something like a newspaper, which is a static snapshot of the state of the world as of press time versus like a news feed, all the news tweets if you follow news accounts on Twitter, all those news tweets that might be happening in your timeline. Those tweets are more like events, little discreet descriptions of things that have happened rather than that summary that you'll see in a broadsheet newspaper, which is going to cause us to want a new kind of data infrastructure.

About Home Study

Technology and Life