Cloudera Hadoop Set to Deliver Real-time Value through Kafka Integration
CIOReview Team | Saturday, 27 June 2015, 05:35 IST
From the labs of LinkedIn, Kafka, a publish-subscribe messaging system, became a new entrant into the long list of open source project governed by the Apache group. Now, Apache Kafka has been comprehensively integrated into the Cloudera’s Big Data platforms empowering Hadoop to deliver production-ready, real-time analytics.
About Apache Kafka
LinkedIn addressed its technology challenges through Kafka to quickly write a separate data pipeline for each source and destination pairing. LinkedIn was able to standardize the data pipeline and enabled it to get data out of each system once and into each system once thus reducing cost and complexity. Kafka performs well both as a traditional message broker and a method of ingesting events into Hadoop.
Features of Kafka include: scalability; data partitioning; low latency; ability to handle large number of diverse consumer; support for batch processing with no latency; fault-tolerant.
Use cases of Kafka include: website activity tracking; operational metrics; log aggregation; stream processing.
“Now that Kafka is fully integrated into Cloudera’s platform, users can build complete end-to-end workloads, such as real-time streaming, together with components like Apache Spark Streaming and Apache HBase - all within a single system. With this integration, users have greater flexibility and performance for ingesting new and varied streams of data and exploring new use cases, for both faster processing and faster insights,” said Charles Zedlewski, VP, Products at Cloudera.
CIO Viewpoint
Artificial Intelligence & The Disruptive Chatbot
By Vishal Sinha, President & CIO, Tranzlease Holdings
IoT: Technology Trends to Watch Out for in 2021
By Sudeep Agrawal, AVP and Head IT, ReNew Power
Reskilling IT with IOT, Cloud & AI
By Uttam Kumar, Head - IT Innovations & New Technology, Aircel
CXO Insights
4 Must Have IT Security Skill sets To Counter...
By Sunil Sharma, Managing Director - Sales, India & SAARC, Sophos
How Low-Code Is Transforming The Future Of Work...
By Deepak Pargaonkar, VP - Solution Engineering, Salesforce
The Path To Managing Data As An Asset