Project Role : Application Support Engineer
Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems.
Must have skills : Data Engineering
Good to have skills : NA
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education

Job Role Summary

In this role, the candidate will serve as a Monitoring Data Pipeline Engineer, responsible for designing, building, and maintaining robust, scalable, and highly observable data pipelines that ensure reliable data flow across the enterprise. The position emphasizes end to end observability, including metrics, logs, traces, data quality checks, and pipeline performance monitoring—to enable timely diagnostics, proactive issue prevention, and overall operational excellence.

Job Role Responsibilities

Build and maintain monitoring dashboards for data pipelines (latency, failures, SLAs).
Design, develop, monitor, and troubleshoot Apache NiFi data flows for enterprise-scale data integration and ingestion.
Implement distributed tracing and logging across ingestion, processing, and storage layers.
Configure real time alerts using tools like Grafana, Datadog, Azure Monitor, CloudWatch, etc.
Enhance pipeline performance through profiling, optimization, and scalability improvements.
Ensure consistent metadata capture using Data Catalog tools.
Investigate pipeline failures and performance issues.
Conduct RCA and implement preventive automation.
Work closely with Data Engineers, SRE/DevOps, Platform Teams, and Product Owners.
Provide insights into pipeline health to business stakeholders.
Influence the development of platform-wide observability standards.


Job Role Requirements
Bachelor's/master s degree in computer science or equivalent with score 6 GPA and above
4–8 years of experience in Data Engineering, Observability, or Platform Engineering
Strong understanding of modern data pipelines (batch and streaming).
Experience with at least one cloud ecosystem: Azure / AWS / GCP.
Proficiency in monitoring/observability platforms:
Datadog, Grafana, CloudWatch, Azure Monitor, Dynatrace, etc.
Hands-on experience with:
o Streaming frameworks (Kafka, Spark Streaming, EventHub, etc.)
Mandatory hands-on experience with Apache NiFi, including:
o Flow design and development, Performance tuning, Troubleshooting and production support.
o Monitoring and observability, Error handling and flow optimization
Hands-on experience with: Apache NiFi , Kafka, Spark Streaming, EventHub or equivalent streaming technologies
Good understanding of CI/CD, Docker, Kubernetes, APIs & Microservices.
Programming/scripting skills in Python, SQL, Bash, or similar
Experienced in modern monitoring tools in IT Ops domain
Proficient in tools for logging, alerting and monitoring onprem/cloud infrastructure, services and performance
Good understanding of analysis, design, implementation, testing, monitoring - SDLC
Strong knowledge of the version control system (e.g. GitHub)
Good database knowledge. Understanding concept of RDBMS i.e. nested queries, records maintenance.
Knowledge of IT Operations space and Site Reliability Engineer job role is an added advantage

Soft skills
Excellent written and verbal communication skills
Agile methodologies and project execution


Technical Skills

Apache NiFi (Mandatory)
Kafka
Data Pipeline Monitoring & Observability
AWS / Azure / GCP
Python & SQL
Grafana / Datadog / CloudWatch / Azure Monitor
CI/CD, Docker & Kubernetes
RCA, Alerting & Troubleshooting
Data Engineering (Batch & Streaming)
GitHub



Additional Information:
- The candidate should have minimum 5 years of experience in Data Engineering.
- This position is based at our Bengaluru office.
- A 15 years full time education is required.

15 years full time education

About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.

Visit us at www.accenture.com 

Equal Employment Opportunity Statement

We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.