Data Engineering : Tutorials, Guides & Use cases

Data Pipeline
Articles Data Engineering Data Pipeline

Why Scala and Apache Spark are key skills for Big data engineering?

3h8k80

Apache Spark is one of the most popular frameworks for big data analysis. This framework is written in Scala, because it is functional language and very scalable. It also can be quite fast because it's statically typed, and it compiles in a known way to the JVM. Hence, most of

Read More
Articles Data Engineering Data Pipeline Infographic Learning & Development

What are streaming data pipelines?

3h8k80

Read More
developers working on the computer
Apache Kafka Articles Data Engineering Data Pipeline Data Pipelines Microservice Architecture Microservices

Implementing MongoDB to Elastic Search 7.X Data Pipeline

3h8k80

In this article, we will see how to implement a data pipeline from an application to Mongo DB database and from there into an Elastic Search keeping the same document ID using Kafka Connect in a Microservice Architecture. In recent days and years, all the microservices architectures are asynchronous in

Read More