Pinned Loading

1. global_partners_orders_aws_pipeline global_partners_orders_aws_pipeline Public

   End-to-end AWS data engineering pipeline using SQL Server, AWS Glue, S3 Delta Lake, Streamlit, CloudWatch observability, and GitHub Actions CI/CD.

   Python

2. walmart-sales-analytics-snowflake-dbt walmart-sales-analytics-snowflake-dbt Public

   End-to-end data engineering project using AWS S3, Snowflake, and dbt to implement Medallion Architecture with SCD Type 1 & Type 2 logic on Walmart sales data, followed by analytical visualizations …

   Python 1

3. aws-serverless-data-lake-nurse-staffing-pipeline aws-serverless-data-lake-nurse-staffing-pipeline Public

   End-to-end serverless data pipeline on AWS that ingests healthcare staffing data from Google Drive, processes it through a multi-layer data lake (raw → refined → curated), enforces data quality, an…

   Jupyter Notebook 1

4. real-time-data-pipeline-aws-snowflake real-time-data-pipeline-aws-snowflake Public

   Production-style real-time data ingestion pipeline built with AWS and Snowflake, featuring pre-stream validation, fault isolation, and automated Snowpipe ingestion.

   Python

5. aws-glue-snowflake-dbt-pipeline aws-glue-snowflake-dbt-pipeline Public

   Modern batch data pipeline using AWS Glue, S3, Snowflake, and dbt. Showcases secure ingestion, external stages, layered transformations, dbt testing, and production deployment with environment sepa…

   Python

6. containerized-lambda-cicd-data-ingestion containerized-lambda-cicd-data-ingestion Public

   A containerized AWS Lambda data ingestion pipeline with automated CI/CD using GitHub and AWS CodeBuild, extracting data from the Calendly API and storing it in Amazon S3

   Python