About the Role:

We are seeking a highly skilled Senior Data Engineer with 5–8 years of experience to join our dynamic team. The ideal candidate will have a strong background in building scalable and efficient data pipelines using AWS Glue, Lambda, and Python, with a focus on delivering end-to-end ETL solutions.

Key Responsibilities:

• Design, develop, and optimize robust and scalable data pipelines using AWS services like Glue and Lambda.
• Build reusable Python modules, APIs (FastAPI, Flask, or Django), and automation scripts for data processing workflows.
• Lead project teams in designing and delivering end-to-end data and ETL solutions.
• Troubleshoot and resolve data processing issues, ensuring optimal performance and reliability.
• Collaborate with cross-functional teams including data scientists, DevOps, and business stakeholders.

Technical Experience:

• Proven experience with Python for data processing, transformation, and modular development.
• Expertise in working with Python Notebooks and classical Python-based application development.
• Hands-on experience with AWS services including S3, Glue, Lambda, and Kinesis (KDS).
• Familiarity with data migration strategies and tools is a strong plus.
• Experience with DevOps practices and infrastructure automation/oversight is beneficial.

Qualifications:

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• 5–8 years of experience in Data Engineering with a strong focus on cloud-based solutions (preferably AWS).
• In-depth understanding of IAM roles and security best practices in cloud environments.

• Excellent analytical and problem-solving skills.
• Strong communication and leadership abilities to drive collaboration with stakeholders.
• Ability to handle multiple priorities and deliver high-quality results within deadlines.