Hi Ravi, thanks for the informative post. I had a question related to using Kafka. Where in the high level design does the Kafka component fit in? Is it between the temporary storage and the sender?
Yes. The queue will sit between the metadata layer & the sender. This will ensure that the sender (metadata layer) can write individual messages to a queue and the sender (independently) can read those messages and send them to the user downstream.
Hi Ravi, thanks for the informative post. I had a question related to using Kafka. Where in the high level design does the Kafka component fit in? Is it between the temporary storage and the sender?
Yes. The queue will sit between the metadata layer & the sender. This will ensure that the sender (metadata layer) can write individual messages to a queue and the sender (independently) can read those messages and send them to the user downstream.
Really informative blog. The one thing I like about your blogs is, it's easy to grasp for beginners like me.
Thank you Shreyas. Glad that you liked it :)