Data Engineer, The British Petroleum
Designed and implemented robust data pipelines using Apache Spark and Python to process and transform large data volumes into Redshift. Collaborated with data scientists and analysts to understand business requirements and translate them into technical specifications. Implemented data quality checks and monitoring solutions to ensure the reliability and accuracy of data within the pipelines.
Technologies Used: Apache Spark, Redshift, CloudFormation, S3, Athena, Python, SQL, SQS
Data Engineer, The Coca-Cola Company
Designed, developed, and maintained scalable data pipelines using Apache Spark and Apache Beam to process, transform, and load large datasets from various sources into BigQuery for analytics and machine learning applications. Collaborated closely with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs. Implemented data quality checks, validation rules, and monitoring solutions to ensure data integrity, accuracy, and reliability across all pipelines.
Technologies Used: Apache Spark, Apache Beam, BigQuery, Cloud Build, Composer, Kubernetes, Docker, Cloud Run, Java, Python, SQL, PubSub
Solution Architect, Exastax Technology
Designed, developed, and maintained robust and scalable microservices using Java and Spring Framework. Built and optimized data pipelines using Apache Flink for real-time stream processing, handling large volumes of data with low latency and high throughput requirements. Implemented data storage solutions using MongoDB for NoSQL database requirements and Elasticsearch for search and analytics capabilities.
Technologies Used: Java, Spring Framework, Apache Flink, Docker, Kubernetes, Apache Kafka, MongoDB, Elasticsearch, SQL
Lead Software Developer, Taglette Micro Technologies
Led the end-to-end development and deployment of an IoT platform for retail stock management. Designed and implemented scalable and resilient microservices architecture using Java and Spring Boot. Integrated Apache Kafka for real-time data streaming, enabling seamless communication and data synchronization between IoT devices and backend systems. Developed and optimized data processing pipelines using Apache Flink for stream processing, handling real-time data ingestion, transformation, and analytics for inventory management and stock forecasting.
Technologies Used: Apache Flink, Java, Apache Kafka, Redshift, CloudFormation, Kubernetes, Docker, Python, SQL, MongoDB
Software Developer, Asset Global Logistics
Developed and maintained backend services and APIs for a customs agency management system using C#, .NET Core, and Microsoft SQL Server. Designed and implemented data warehouse solutions to consolidate and analyze customs data, facilitating reporting, analytics, and compliance monitoring. Optimized database performance, wrote complex SQL queries, stored procedures, and views to support data retrieval, manipulation, and reporting requirements.
Technologies Used: C#, .NET Core, Microsoft SQL Server, SQL, Python
Software Developer, Escort Technology
Developed and maintained backend services, APIs, and web applications using C#, .NET, and Microsoft SQL Server for intra-company applications, intranet, and mobile applications. Designed and implemented RESTful APIs to facilitate data exchange, integration, and communication between various internal systems, applications, and services. Optimized database schemas, wrote efficient SQL queries, stored procedures, and triggers to support data retrieval, manipulation, and reporting requirements.
Technologies Used: C#, .NET, Microsoft SQL Server, SQL
Software Developer, Petra Ad Agency
Developed and maintained web applications using C#, ASP.NET, and SQL Server. Collaborated with frontend developers, UX/UI designers, and business analysts to translate requirements into functional and user-friendly web applications. Designed and implemented database schemas, optimized SQL queries, stored procedures, and views to support data retrieval, manipulation, and reporting functionalities.
Technologies Used: C#, ASP.NET, Microsoft SQL Server, SQL