Kafka Connect is a technology for linking Kafka with other services. One of the main challenges of an IT architecture is the batch process and a bunch of codes that transport or align data from one to another application. A small failure can cause ultimate data and business losses with
Every young technology enthusiast or someone who is looking for a new development path is asking a question to himself - what is the next trending programming language to be learned? After many years of Java being a market leader in back-end development, in the last couple of years seems
With the exponential growth in data, the biggest problem plaguing the telecom industry is how to process and aggregate huge volumes of call detail records (CDRs). Telcos are taking fresh approaches to get the real-time value of streaming data. They are shifting from heavy batch processing systems to faster, scalable
If you’re like me, you may be accustomed to reading articles about event streaming that are framed by large organizations and mountains of data. We’ve read about how the event streaming juggernaut Netflix uses Apache Kafka® to make sense of the viewing habits of 167 million subscribers, and understand how best
Hybrid cloud market has been growing significantly over the last five years because of flexible offering across private and public clouds. With businesses (from small to large scale, across all industries) moving more towards cloud deployments, security, protection of intellectual property, compliance and reliance on legacy infrastructure have become impedance
“The perfect kind of architecture decision is the one which never has to be made” Robert C. Martin From being a phenomenal trend to becoming one of the most essential IT designs considerations, event streaming has evolved to be pivotal for businesses due to an exponential increase in data and
Kibana makes data analytics easy. It is one of the elites in providing visualization solutions for enterprises for data sets including runtime data, server logs, market statistics, geo-spatial data mappings, density graphs. It works with Elasticsearch and supports machine learning. The tool can unravel secrets such as trends/patterns from the
Apache Kafka ecosystem is relevant to detect anomalies (failure detection) in the huge volume of data sets. These data sets can come from various industries including IoT, banking or insurance. In this article, we present a use case on how to use the cloud-native ecosystem with Kafka, MQTT, Kafka Connect,
There are levels of event recording in accordance with the use cases for which we are tracking like application logging (Log4j levels). Now a mission-critical application (like transactions) will generate a huge number of events, this will enable to debug/analyse in case of any failure or audits. For low to
