datapipelines

A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes

🏭 Mega Scale Multimodal DataPipeline for SOTA Foundation Models

A Machine Learning System that work on prediciton of flight Delay to take action Based on it

Python / Automation – Automates job scraping by keyword and location, filters duplicates, and emails listings daily. Python scripting, web scraping, scheduling, and data pipeline development.

Customer churn analysis and prediction for a telecom dataset — full ML pipeline covering EDA, SMOTE, feature selection, and Gradient Boosting (AUC = 0.81). SaiKet Systems Data Science Internship | Python · scikit-learn · Jupyter

This Ads Data Pipeline simulates and processes company and Google advertising data, calculating key performance metrics in real time. It stores the data in MongoDB, schedules regular updates, and saves processed statistics to CSV files for further analysis.

IBM AI Engineering Specialization AI Capstone Project with Deep Learning

Data Engineering 101

A DataFrame library inspired by Scio and Polars

This repository includes a small project that includes main ML topics as a reference.

This repository provides a hands-on introduction to the fundamentals of Apache Kafka using the KRaft (Kafka Raft) consensus protocol. This lab guides users through setting up a local Kafka environment, creating topics, and orchestrating a real-time data flow between a producer and a consumer without the need for Zookeeper.

Data pipeline using Databricks asset bundle & dbt

Repo that relates to the Medium blog 'Creating serverless data pipelines with Azure Functions and Azure Pipelines'

Building a four-step data pipeline using Airflow to download podcast episodes.

OBIX: Where Data Meets UI/UX

Automated billing data pipeline using Python — generates invoices, tracks payments, and produces summary reports from raw transaction data.

🛒 Automate price monitoring across e-commerce sites, receive real-time alerts for drops, and generate detailed analytics with this efficient web scraping pipeline.