Event streaming in Kafka
Apache Kafka Articles Confluent Kafka Event Streaming Kafka Kafka Architecture Tutorials Videos

VIDEO: What is Event Streaming Platform? Session by Jay Kreps, CEO, Confluent


Event Streaming in Apache Kafka Event streaming platforms are the new revolution happening in the data infrastructure and application architecture. The infrastructure technology has concentrated chiefly on building one application, meaning one data store servicing one app. However, in a company, there are more than hundreds of applications, datastores, data warehouses. The

Articles Case Studies Data Engineering Data Pipeline Event Streaming Real time data Real time data streaming Real Time Streaming

CASE STUDY: Alight Solutions accelerates digital deliveries with unified platform of streaming data pipelines


Company: Alight Solutions is a leading technology-enabled health, wealth, and human capital management solutions company in the US. The company is providing its services in over 100 countries across five continents and serves over 4,300 clients. Alight has recently taken initiatives to align its internal organization with the next-generation digital

Articles Kafka Kafka Architecture Kafka as a Service Microservice Architecture Microservices

Microservices architecture – How does it work?


Decoupling microservices architecture with a streaming platform J.S. Haldane wrote about animals falling down mine shafts: "A rat is killed, a man is broken, a horse splashes." That means the bigger the object, the greater its fragility. Modern enterprises deal with numerous systems, data applications on a regular basis. Eventually

Machine learning on Google Cloud
AI/ML Articles Cloud Providers Google Cloud Tutorials Videos

VIDEO: Machine Learning on Google Cloud Platform by Sara Robinson


Machine learning involves teaching computers to recognize patterns in the same manner a human brain does. For example, it is effortless for us to differentiate between an apple and an orange or a cat and a dog. However, imagine if one has to teach a machine to do this. There

Advantages of Microservices Architecture
Articles Microservice Architecture Microservices

Examples and Advantages of Microservices Architecture


Ever since digitalization has taken over, enterprises are constantly in the race to deliver seamless, end-to-end services to customers. Therefore, business agility has become one of the core objectives for enterprises of all verticals. In this context, application architectures are seemingly shifting to flexible and scalable microservices. Corporate giants like

Data processing in IoT
Articles Data Engineering Popular Real time data Real time data streaming Real Time Streaming Tutorials

VIDEO: Data streaming in IoT


The world around us is turning smart. We have smart watches, smart homes, smart buildings, smart cities, and even intelligent toasters. We have heaps of sensors and actuators throughout our homes rolling out to improve our experiences of living in the house. Where are we heading with this? We are

AI for secure cryptocurrency exchange using Machine Learning
AI/ML Articles Artificial Intelligence AWS Case Studies

CASE STUDY: AI for secure cryptocurrency exchange using Machine learning tools


Company: Coinbase is a digital wallet and exchange platform based in San Francisco. The platform has been used by over 20 million merchants and consumers for cryptocurrency trading, worth over $150 billion since 2012. The cryptocurrency market has been growing faster than ever. Like all financial services companies, the company aims

Machine learning with Kafka
AI/ML Articles Artificial Intelligence Data Engineering Data Pipelines Kafka Kafka Architecture Kafka Streams

Machine Learning with Kafka


Machine learning with Kafka - The modern Stream Processing  platform for all data preprocessing needs Some bits about Kafka Kafka is a popular messaging platform based on pub-sub mechanism. It is a highly available, fault tolerant & distributed system. Most organisations are using Kafka in different use-cases, but the best

Rwal time data analytics using AWS Kinesis
Analytics Tools Articles Data Engineering DataOps/Analytics Event Streaming Real time data Real time data streaming Real Time Streaming Tutorials Videos

VIDEO: Why data streaming & Real-time data analytics became very popular recently?


Why is everyone these days talking about streaming analytics? Real-time data analytics has become one of the most valuable assets for any business. This is because the business community across all sectors now realizes that the new real-time insights are of greater value than those delayed by a few days

Apache Kafka Articles AWS Case Studies Event Streaming Real time data streaming Real Time Streaming

CASE STUDY: Virtual Car Launch on AWS – Lucid Motors and ZeroLight


Companies: ZeroLight is an automotive visualization specialist that integrates cutting-edge technologies and personalized media into a single market-leading platform. It offers SpotLight Suite, a cloud-based platform that brands, agencies, and dealers customize sales and marketing to each shopper. Lucid Motors is a nascent luxury electric carmaker. In 2020, the company

Data Pipelines and its types
Articles AWS Azure Data Engineering Data Pipeline Real time data

Types of Data Pipelines. When to use what?


A data pipeline is defined commonly as a set of bulk actions through which we extract data from a number of sources. This standardized, robotic process takes place when the system takes columns from different databases. They mould them with different columns with API as the target source. The combination

Data pipelines vs ETL pipelines
Articles Data Engineering Data Pipeline ETL Pipeline Real time data

ETL Pipeline vs Data Pipeline: An Overview


What Is an ETL Pipeline? Extract, Transform and Load, significantly known as ETL pipeline is a set of processes where you extract data from a particular source, and then transform it before you load it into the destination. The source can derive itself from anywhere, be it business systems or