À propos de ce poste Data Engineer chez ITnova
ITnova is seeking a Data Engineer to support the Port Authority of New York and New Jersey (PANYNJ) Aviation Department’s Aviation Data Analytics Warehouse (ADAW). The ideal candidate will have hands-on experience developing and maintaining data pipelines, building ELT workflows, and integrating data using Microsoft Azure services, including Synapse Analytics, Data Factory, Azure SQL, and Databricks. This role will support data transformation, database development, pipeline optimization, and Power BI semantic modeling to ensure accurate, reliable data is available for business intelligence and reporting. Strong SQL and Microsoft SQL Server experience is required.
Responsibilities
- Develop new and maintain existing data pipelines supporting the Aviation Data Analytics Warehouse (ADAW).
- Configure automated data extraction processes and troubleshoot data ingestion failures and connectivity issues.
- Design, develop, and maintain Extract, Load, Transform (ELT) workflows.
- Clean, standardize, and transform data according to established data governance standards and business rules.
- Build reusable data transformation frameworks using Azure Synapse Analytics.
- Optimize data pipelines for performance, efficiency, and processing speed.
- Create and maintain database objects, including tables, views, and stored procedures.
- Support serverless and dedicated SQL pools and SQL Server databases.
- Design and maintain Power BI semantic data models to support reporting, dashboards, and analytical requirements.
- Integrate new data sources and enhance existing data processing workflows.
- Document data pipelines, transformations, database objects, and technical processes.
- Collaborate with the Cloud Architecture/Team Lead, Program Manager, and QA/QC Specialist to deliver reliable data solutions.
Required Qualifications
- Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field preferred
- Demonstrated experience developing and maintaining data pipelines and data integration solutions.
- Experience with Microsoft Azure data services, including Synapse Analytics, Data Factory, Azure SQL, and Databricks.
- Experience with relational databases, including Microsoft SQL Server.
- Proficiency in SQL and experience developing database objects such as tables, views, and stored procedures.
- Experience designing and implementing ELT or ETL workflows.
- Experience with data transformation, data cleansing, and data quality practices.
- Experience with Microsoft Power BI and semantic data modeling.
- Experience using Azure DevOps or similar tools for development coordination, version control, and work tracking.
- Ability to troubleshoot data processing issues and document technical solutions.
Preferred Experience
- Experience developing enterprise data warehouse or lakehouse solutions.
- Experience integrating data from APIs, batch feeds, streaming sources, and SFTP file transfers.
- Experience optimizing large-scale data pipelines and SQL queries.
- Experience with Power Apps and Power Automate.
- Experience supporting business intelligence dashboards and enterprise reporting.
- Experience working in an Agile development environmen
Must be US Citizen
Full-time remote ( Mon – Fri, 9:00 am – 5:00 pm EST)
Benefits:
- Medical, Dental, and Vision coverage
- Short Term Disability, AD&D and Life insurance
- 401(k) Program
- Paid Time Off
- 11 Paid Holidays
- Employee Assistance Program
ITnova is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, age, national origin, disability, status as a protected veteran, or any other protected characteristic.