Articles Data Engineering Data Pipeline

Why Scala and Apache Spark are key skills for Big data engineering?

0

Apache Spark is one of the most popular frameworks for big data analysis. This framework is written in Scala, because it is functional language and very scalable. It also can be quite fast because it's statically typed, and it compiles in a known way to the JVM. Hence, most of

Articles Data Engineering Data Pipeline Infographic Learning & Development

What are streaming data pipelines?

0

developers working on the computer
Apache Kafka Articles Data Engineering Data Pipeline Data Pipelines Microservice Architecture Microservices

Implementing MongoDB to Elastic Search 7.X Data Pipeline

0

In this article, we will see how to implement a data pipeline from an application to Mongo DB database and from there into an Elastic Search keeping the same document ID using Kafka Connect in a Microservice Architecture. In recent days and years, all the microservices architectures are asynchronous in