RealTime StockStream is a streamlined, simulation system for processing live stock market data. It uses Apache Kafka for data input, Apache Spark for data handling, and Apache Cassandra for data storage, making it a powerful yet easy-to-use tool for financial data analysis

A .NET for Apache Spark docker image (3rdman/dotnet-spark)

👷🌇 Set up and build a big data processing pipeline with Apache Spark, 📦 AWS services (S3, EMR, EC2, IAM, VPC, Redshift) Terraform to setup the infrastructure and Integration Airflow to automate workflows🥊

Docker setup for Apache Spark and the R sparklyr package

Docker image to deploy a spark cluster in containers

Docker image with Apache Spark Master.

A spark cluster containing multiple spark masters based on docker-compose.

Serving layer for processing and preparing data intended for consumption in BI systems, developed with Spark, integrating automated extraction, transformation, and load (ETL).