Proactive data engineer and cloud architect specializing in high-volume data platforms, stream processing, and serverless architectures dedicated to building production-grade systems at scale.
⚡ Designing distributed ETL pipelines processing 100B+ records/month using Spark, Airflow, and Python
⚡ Building CDC replication pipelines from PostgreSQL and Kafka to AWS Data Lakehouses
⚡ Query optimization with Apache Iceberg, Presto/Trino, and Hive Metastore on EMR
⚡ Containerized extraction microservices on ECS Fargate and serverless Lambda compute
⚡ Provisioning and managing EMR clusters, S3 data lakes, Redshift warehouses, and Athena query layers
⚡ Infrastructure automation with Terraform and CI/CD pipelines
⚡ Designing data warehouse schemas in Amazon Redshift with partitioning and compression
⚡ ELK Stack integration for log discovery, Watcher alerts, and PagerDuty incident pipelines
⚡ Building REST APIs with FastAPI and managing multi-tenant data stores
B.Tech in Computer Science and Engineering (Artificial Intelligence)
Coimbatore, India | 2020 – 2024
A highly driven Cloud Data Engineer with a proven track record of architecting and building scalable backend systems capable of processing 100+ billion records. Specialized in designing robust ETL/ELT pipelines, modernizing cloud infrastructure, and orchestrating complex workflows across multiple distributed databases to drive enterprise efficiency.
Production-grade systems demonstrating real-time anomaly detection, distributed data platforms, and automated sentiment pipelines.
Developed an AWS-based platform for real-time stock analysis with Anomaly Alert to Email, integrating Twelve Data API for data collection, AWS Timestream for efficient storage, AWS Cognito for User Authentication, AWS API Gateway for dynamic user interfaces. Enabled real-time stock analysis, anomaly alerts, and secure user authentication.
Analyzed Twitter feed using Twitter V2 API and MongoDB, performing sentiment analysis and geolocation mapping. Outcome: Enriched data with insights through sentiment analysis and geolocation mapping.
I am always interested in discussing data engineering challenges, cloud architecture, high-scale stream processing, or new engineering opportunities. Feel free to reach out!
