Jobs Companies Caterpillar Data Specialist (Senior Data Engineer)

À propos de ce poste Data Specialist (Senior Data Engineer) chez Caterpillar

Caterpillar · Sur site · Bangalore, Karnataka

Career Area:

Technology, Digital and Data

Job Description:

Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other.  We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

Your Impact Shapes the World at Caterpillar Inc

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

 Job Summary

We are seeking a skilled Data Specialist (Senior Data Engineer) join our Financial Systems Tech Support -CAT IT Division

We are seeking a highly motivated and detail-oriented Junior Data Engineer to join our dynamic team. The ideal candidate will have a good foundation in data engineering principles, a keen analytical mindset, and the ability to work collaboratively in a fast-paced environment. As a Junior Data Engineer, you will play a critical role in designing, developing, and maintaining data pipelines and infrastructure to support our organization's data needs.

The preference for this role is to be based out of Bangalore – Caterpillar PSN

What you will do

Data Pipeline Development

  • Design, develop, and maintain scalable and reliable data pipelines to ingest, process, and store large volumes of data from various sources.
  • Implement data workflows using ETL (Extract, Transform, Load) processes to ensure data quality and integrity.

Data Integration and Management

  • Collaborate with data architects, product owners, business analysts, and other stakeholders to understand data requirements and deliver data solutions that meet their needs.
  • Integrate data from multiple sources, including databases, APIs, and external data providers, into a unified data platform.
  • Manage and optimize data storage solutions, ensuring efficient data retrieval and processing.

Data Quality and Governance

  • Implement data quality checks and validation processes to ensure the accuracy and consistency of data.
  • Adhere to data governance policies and best practices to maintain data security and compliance.

Performance Optimization

  • Monitor and optimize data pipeline performance to ensure timely and efficient data processing.
  • Identify and resolve performance bottlenecks and system issues to maintain data pipeline reliability.

Documentation and Collaboration

  • Document data engineering processes, workflows, and solutions for future reference and knowledge sharing.
  • Collaborate with cross-functional teams to support data-driven decision-making and project initiatives.

What you will have 

Education and Experience

  • Bachelor’s degree in computer science, Information Technology, Data Science, or a related field.
  • 5-8  years of experience in data engineering, data analysis, or software development.

Technical Skills

  • Strong experience on advanced SQL any Database. (Oracle, Teradata, snowflake).
  • Experience in data integration area and hands on experience in any of the ETL tools like Datastage , Informatica , Snaplogic etc.
  • Able to transform technical requirements into data collection query.
  • Should be capable of working with business and other IT teams and convert the requirements into queries.
  • Good understanding of ETL architecture and design.
  • Good knowledge in Databases, SQL, or PL/SQL
  • Good experience with CI/CD tools such as Github Actions (AzDO pipelines)
  • Good to have knowledge on Unix commands
  • Good to have an experience on AWS Glue
  • Good to have knowledge on Qlik replication tool
  • This position requires candidate to work a 5-day -a -week schedule in the office.
  • Shift Timing: 01:00-10:00PM IST

Soft Skills

  • Good analytical and problem-solving skills with attention to detail.
  • Excellent communication and interpersonal skills to collaborate effectively with cross-functional teams.
  • Ability to manage multiple tasks and prioritize workload in a fast-paced environment.
  • Eagerness to learn new technologies and stay updated with industry trends.

Skills desired:


Value Realization: Knowledge of value realization methods; ability to plan, execute, monitor and manage business activities and resources to determine and achieve the actual value from a business initiative as estimated in an associated business case.
Level Basic Understanding:
• Describes the importance of Value Realization milestones for long-term projects.
• Assists in measuring and attaining post-project implementation value.
• Identifies process changes or business value integration in change initiative plans and activities.
• Contributes to project team communication regarding the linkage of a change initiative to its associated business goals and case.

Communicating Complex Concepts: Knowledge of effective presentation tools and techniques to ensure clear understanding; ability to use summarization and simplification techniques to explain complex technical concepts in simple, clear language appropriate to the audience.
Level Working Knowledge:
• Uses comparisons to familiar ideas when introducing a technical or novel feature.
• Separates fundamental concepts from supporting details in explaining a product or service.
• Explains products and services with little or no use of technical jargon or advanced vocabulary.
• Emphasizes the most important facts or features of a product or service.
• Perceives lack of audience comprehension; further simplifies explanation when needed.

Agile Development: Knowledge of agile methodologies and the agile development lifecycle; ability to utilize formal agile methodologies, disciplines, practices and techniques for the delivery of new and enhanced applications.
Level Working Knowledge:
• Explains a specific agile process and its associated checkpoints and deliverables.
• Works with a specific agile development methodology.
• Interprets metrics used to measure progress and effectiveness.
• Defines key selection and qualifying criteria for projects suitable for agile development.
• Applies major tools and techniques associated with the specific methodology.

Cloud Computing: Knowledge of cloud-based solutions and their applications; ability to design, implement, and manage cloud-based solutions to meet business needs and improve operational efficiency.
Level Working Knowledge:
• Designs and implements a cloud-based solution to meet a specific business need or requirement.
• Configures and deploys cloud-based infrastructure, such as virtual machines, storage, and networks.
• Migrates applications and data to a cloud-based environment, including data migration and integration.
• Implements cloud-based security measures, such as access controls, encryption, and firewalls.
• Troubleshoots and resolves common cloud-based issues, such as connectivity problems and performance degradation.
Database Design (Physical): Knowledge of database systems; ability to establish a data model for designing an organization's database that runs effectively and efficiently for better business outcome.
Level Working Knowledge:
• Researches relationships between different business data sets.
• Participates in the establishment of data structures based on their relationships.
• Adheres to an organization's database design policies.
• Utilizes database design tools and techniques.
• Tests the effectiveness of the database before its release for business use.

ETL Process: Knowledge of the extraction, transformation and loading (ETL) process; ability to develop a database through the ETL process.
Level Working Knowledge:
• Ensures the accuracy and effectiveness of data provided for the warehouse.
• Loads selected data into the warehouse on a regular basis.
• Derives necessary business or technical information from original data.
• Acquires a large amount of data from different sources/systems.
• Solves technical and administrative problems during the ETL process.

Information Management: Knowledge of an organization's existing and planned Information Architecture and Information Management (IM) methodology; ability to collect and manage information from different sources, and distribute this information to enhance operational efficiency.
Level Extensive Experience:
• Directs the implementation of information processing and operation standards to protect and manage information assets.
• Develops capabilities, features and uses for major IM platforms.
• Coaches others on issues and considerations for managing structured vs. unstructured data.
• Advises on improvement plans for existing and forecasted information architecture.
• Consults on all major information management platforms and practices.
• Consults on information architecture concepts, disciplines and practices.

Modeling: Data, Process, Events, Objects: Knowledge of data, process and events; ability to use tools and techniques for analyzing and documenting logical relationships among data, processes or events.
Level Working Knowledge:
• Defines common types of data, processes or event models.
• Participates in model reviews and walkthroughs.
• Explains existing models to clients and describes their associated business processes.
• Focuses on modifying Data Structure, Access and Entity Relationship Diagrams.
• Prepares reports to recap current findings and issues in data, processes or event models.

What you will get:

  • Work Life Harmony
  • Earned and medical leave.
  • Relocation assistance

Holistic Development

  • Personal and professional development through Caterpillar ‘s employee resource groups across the globe
  • Career developments opportunities with global prospects

Health and Wellness

  • Medical coverage -Medical, life and personal accident coverage
  • Employee mental wellness assistance program

 Financial Wellness

  • Employee investment plan
  • Pay for performance -Annual incentive Bonus plan.

Additional Information:

Caterpillar is not currently hiring individuals for this position who now or in the future require sponsorship for employment visa status; however, as a global company, Caterpillar offers many job opportunities outside of the U.S. which can be found through our employment website at www.caterpillar.com/careers

Caterpillar is an Equal Opportunity Employer (EEO)

EEO/AA Employer. All qualified individuals, including minorities, females, veterans and individuals with disabilities - are encouraged to apply.

This position requires working onsite five days a week.

 

Visa Sponsorship is not available for this position.

Posting Dates:

Caterpillar is an Equal Opportunity Employer.  Qualified applicants of any age are encouraged to apply

Not ready to apply? Join our Talent Community.

Prêt à postuler chez Caterpillar ?
Postuler chez Caterpillar

À propos de Caterpillar

There’s more to work at Caterpillar than just the work itself. We hire smart, friendly people and it shows in our culture. We hold ourselves to high standards and make sure our values of integrity, excellence, teamwork, commitment and sustainability come to life in the way we work. We make sure our employees feel continuously challenged while also supported. We provide professional growth opportunities, including leadership programs. We celebrate the diversity of our team, while also working together as one Caterpillar. Our culture, like everything at our company, is made possible by each employee’s contribution. Person by person, we create the environment we work in, and we are proud of the

Voir tous les emplois chez Caterpillar →

Emplois similaires

Take-Two Interactive Software, Inc.
Senior Data Engineer
Take-Two Interactive Software, Inc.
⚡ Postuler tôt Bangalore, Karnataka, India Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 10 h
Caterpillar
IT Analyst Applications ( Data Engineer – AI & Analytics )
Caterpillar
⚡ Postuler tôt Bangalore, Karnataka Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 17 h
Caterpillar
Senior Data Specialist (Lead Data Engineer)
Caterpillar
⚡ Postuler tôt Bangalore, Karnataka Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 17 h
2K
Data Quality Engineer
2K
⚡ Postuler tôt Bangalore, Karnataka, India Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 1 j
Quince
Software Development Engineer II (Data Engineering)
Quince
⚡ Postuler tôt Bengaluru, Karnataka, India Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 1 j
Kyndryl
Senior Data Engineer
Kyndryl
⚡ Postuler tôt Greater Noida, Uttar Pradesh,... Hybride
● Nouveau 👁 Vu ✓ Postulé il y a 1 sem.
Kyndryl
Data Analyst / Engineer
Kyndryl
⚡ Postuler tôt Bangalore, Karnataka, India Hybride
● Nouveau 👁 Vu ✓ Postulé il y a 1 sem.
OS
Senior Technical Consultant (Data Engineer) - RDAF
o9 Solutions
⚡ Postuler tôt Bangalore, Karnataka, India Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 1 sem.
Baxter
Data Engineer
Baxter
⚡ Postuler tôt Bangalore, Karnataka Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 1 sem.

Inscrivez-vous pour des suggestions adaptées aux emplois que vous ouvrez et aux recherches que vous enregistrez.

Plus d’emplois chez Caterpillar

Voir tous les emplois chez Caterpillar →

Postuler maintenant
🤖

Doucement — un instant

JobsRadar a été conçu pour de vraies personnes qui traversent une période difficile dans leur recherche d’emploi — pas pour des requêtes automatisées. Vous cliquez beaucoup trop vite et vous êtes maintenant temporairement bloqué.

Revenez plus tard. Si vous cherchez réellement un emploi, nous sommes de votre côté — agissez simplement comme un être humain.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Prenez une longueur d’avance dans votre recherche d’emploi.

Rejoignez notre canal Telegram pour ce qui vous aide à décrocher le poste — références salariales, le pouls hebdomadaire du marché et les annonces de nouveautés. Pas de spam, que du signal.

Rejoindre le canal — c’est gratuit