Are you interested in streaming data from various news sources to create an actionable search solution, and integrate news feed with your internal applications, using Kafka and Elasticsearch?
Elasticsearch is a highly scalable open-source full-text search and analytics engine. It allows you to store, search, and analyse large volumes of data quickly and in near real-time. It has been widely adopted by the biggest tech names, major world-renowned brands and research institutes alike. This list includes companies like eBay, LinkedIn, Facebook, Netflix, Slack, Uber, and more. Apache Kafka® is the leading streaming and queuing technology for large-scale, always-on applications.
In this webinar, we will provide a brief introduction to Elasticsearch, Kafka and Kafka Connect. We will then do a live demo of building a pipeline with Kafka Connect for streaming data from various news sources into Kafka topics. We will use Kafka sink connector to ingest to Elasticsearch and use Elasticsearch powerful search features to filter and analyze the latest news.
During the webinar, you will learn-
– What is Kafka
– What is Kafka Connect
– Basics about Elasticsearch
– How to use Kafka Connect to ingest data to Kafka topic from external sources i.e RSS Feed in our example
– How to read data from Kafka topic to ingest into Elasticsearch cluster.
Presenter: Mussa Shirazi
Mussa is working as a Senior Consultant with Instaclustr. With over 13 years of IT industry experience, Mussa specialises in the field of Big Data, Low Latency Monitoring, Network and Security Technologies, Network Solutions and have worked with large multinational corporations. He has a vast experience with open source technologies such as Elasticsearch and Kafka
and has been involved in designing and deployment of data solutions for big financial organisations. Mussa is a big fan of open source technologies and likes getting involved in all kinds of data projects that involve open source technologies.