Data Engineer
Primary Skills
Athena, SNS, SQS, CloudWatch, Kinesis, Redshift
Job requirements
Experience Range: 1 - 3 years of experience, with hands-on expertise in AWS data engineering tools and services Key Responsibilities: 1. Design and implement scalable data pipelines using AWS services such as Kinesis, Redshift, and Athena 2. Develop and optimize ETL processes to ensure efficient data ingestion, transformation, and loading 3. Configure and manage AWS messaging services including SNS and SQS to facilitate real-time data processing 4. Monitor and troubleshoot data workflows using AWS CloudWatch to maintain high system reliability 5. Collaborate with data analysts and stakeholders to define data requirements and deliver actionable insights 6. Ensure data security and compliance in all AWS-based solutions, adhering to best practices and organizational standards 7. Automate data processing tasks to improve operational efficiency and reduce manual intervention 8. Maintain documentation for data architectures, pipelines, and operational procedures Required Skills: 1. Advanced proficiency in AWS Athena 2. Hands-on experience with Amazon SNS 3. Expertise in Amazon SQS 4. Strong skills in AWS CloudWatch monitoring and alerting 5. Proven experience with AWS Kinesis for real-time data streaming 6. Deep knowledge of Amazon Redshift for data warehousing 7. Proficiency in designing and managing ETL pipelines on AWS 8. Ability to implement data security and compliance in AWS environments 9. Experience with AWS IAM for access control 10. Familiarity with AWS Lambda for serverless data processing Preferred Skills: 1. Experience with AWS Glue for data cataloging and ETL 2. Knowledge of AWS Data Lake architecture 3. Familiarity with Python or Scala for data engineering tasks 4. Understanding of Apache Spark on AWS 5. Experience with infrastructure-as-code tools such as AWS CloudFormation 6. Exposure to DevOps practices in cloud data engineering Desired Qualifications: 1. Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field 2. AWS Certified Data Analytics – Specialty or other relevant AWS certifications (preferred)