Name of the position: Data Engineer
Location: Coimbatore/ Chennai/ Bangalore
No. of resources needed: 02
Mode: Contract (3 to 6 Months )
Years of experience: 8+ Years
Shift: UK shift (2pm to 11pm)
Overview:
We are seeking an experienced Senior Data Engineer with strong expertise in AWS Redshift and AWS Glue to design, develop, and maintain large-scale data solutions. The ideal candidate will have deep hands-on experience with AWS data ecosystem and will play a key role in building scalable, reliable, and high-performance data pipelines.
Key Responsibilities:
Design, develop, and maintain ETL pipelines using AWS Glue, Redshift, and other AWS services.
Optimize data models and queries for performance, scalability, and reliability.
Collaborate with data architects, analysts, and business teams to understand requirements and deliver data solutions.
Implement data quality, governance, and security standards across data pipelines.
Automate workflows, monitoring, and performance tuning in AWS environments.
Manage data ingestion from multiple structured and unstructured sources.
Troubleshoot and resolve data processing issues in production environments.
Required Skills:
Strong experience in AWS Redshift (performance tuning, schema design, and data warehouse optimization).
Hands-on expertise with AWS Glue, Glue Studio, Glue Catalog, and PySpark for ETL development.
Solid understanding of data warehousing concepts, ETL design patterns, and data modeling (Star/Snowflake schemas).
Experience with AWS S3, Lambda, Athena, Step Functions, and CloudWatch.
Proficient in SQL and Python for data transformation and automation.
Knowledge of CI/CD pipelines, Git, and infrastructure-as-code (CloudFormation / Terraform) is a plus.
Excellent problem-solving, communication, and analytical skills.