À propos de ce poste Data Specialist - R01569531 chez Brillio
About the Role
We are looking for an experienced GCP Data Engineer to design, develop, and optimize scalable data pipelines and cloud-based data solutions on Google Cloud Platform.
The ideal candidate should have strong hands-on experience in GCP Data Engineering, BigQuery, Dataflow, Dataproc, Python/PySpark, and SQL, along with good knowledge of data warehousing and ETL processes.
Primary Skills
🔑 Key Responsibilities
- Design and develop scalable ETL/ELT data pipelines on GCP.
- Build and optimize data solutions using BigQuery, Dataflow, Dataproc, Cloud Storage, and Pub/Sub.
- Develop data processing applications using Python, PySpark, and SQL.
- Perform data ingestion, transformation, cleansing, and validation.
- Design efficient data models and data warehouse solutions in BigQuery.
- Implement batch and real-time data processing pipelines.
- Optimize pipeline performance and BigQuery queries for scalability and cost efficiency.
- Integrate data from multiple sources into cloud-based data platforms.
- Implement data quality, security, monitoring, and governance practices.
- Work closely with Data Scientists, Architects, Analysts, and business stakeholders.
- Support cloud migration and modernization initiatives.