3M has a long-standing reputation as a company committed to innovation. We provide the freedom to explore and encourage curiosity and creativity. We gain new insight from diverse thinking, and take risks on new ideas. Here, you can apply your talent in bold ways that matter.

Job Description

Associate Developer (AWS) - Data Engineering (Bangalore)

Associate Developer - Data Engineering is a part of the Data & Analytics function to work on designing, developing, testing, and supporting Digital Data Core pipelines and complex data models development in Amazon Web Services (AWS), Databricks and deliver insights to the business.

Primary Responsibilities include but are not limited to the following:

• Designs, develops, and maintains scalable data pipelines with delta mechanism in AWS Lake using AWS services and PySpark.
• Analyzes, designs, develops, tests, deploys and supports Data models in AWS S3 using Spark SQL based on extracts from various sources based on functional design specifications
• Stay up to date with industry trends and best practices in data engineering, AWS services, AWS Lake, PySpark and Athena
• Reviews business requirements, helps to create functional design, and develops technical design documents and data lineage, data dictionaries, and metadata management.
• Understands the functionality of business processes and data that will be required to build, test and implementation.
• Performs SQL scripting.
• Participates actively in local and global teams.
• Databricks expertise in managing the Platform Engineering tasks
• Most recent experience in Databricks building Data Ingestion Frameworks, PySpark SQL, Admin work.

Requirements:

• Bachelor’s degree in computer science, Engineering or Technology from an accredited university
• A minimum of 2-4 years of solid experience in data warehousing including data pipelines and data modeling particularly on AWS and Databricks platform
• 2-4 of years strong experience in Python, PySpark with SQL scripting
• 2-3 years Solid experience with AWS services such as S3, Amazon EKS, Amazon EMR, CloudFormation, AWS Secrets Manager, Glue and Athena
• Good experience in Relational Databases and concepts
• Extensive working knowledge on any of the business processes including sales, finance, supply chain, manufacturing, Master Data etc.
• Detail oriented, self-directed and have strong independent problem-solving, analytical and multi-tasking skills with English fluency
• Have a strong background and interest in technology

Learn more about 3M’s creative solutions to the world’s problems at www.3M.com or on Twitter @3M.

3M Global Terms of Use and Privacy Statement

Carefully read these Terms of Use before using this website. Your access to and use of this website and application for a job at 3M are conditioned on your acceptance and compliance with these terms.

Please click on the following links and select the country where you are applying for employment to review the applicable Terms of Use (link here) and Privacy Policy (link here). Before submitting your application, you will be asked to confirm your agreement with the terms.