Apache Spark Jobs in Calgary.
All active Apache Spark roles based in Calgary.
Pick a job to read the details
Tap any role on the left — its description and apply link will open here.
Meet Benevity
Benevity is the way the world does good, providing companies (and their employees) with technology to take social action on the issues they care about. Through giving, volunteering, grantmaking, employee resource groups and micro-actions, we help most of the Fortune 100 brands build better cultures and use their power for good. We’re also one of the first B Corporations in Canada, meaning we’re as committed to purpose as we are to profits. We have people working all over the world, including Canada, Spain, Switzerland, the United Kingdom, the United States and more!
As a senior technology leader, you will help build our technology platform to enable 10 million change-makers to deliver a billion acts of goodness by 2025. We seek a platform-first Architect to lead enterprise patterns for reliable, governed, AI-driven, and cost-effective solutions at scale across our technology portfolio. You will design how data flows across the company, from ingestion to consumption, while ensuring our AI systems are secure, auditable, and maintainable. This role requires practical systems thinking and the ability to influence senior engineers and leadership toward consistent, enterprise-wide architecture outcomes that align our data and AI strategy with broader business goals.
If you're passionate about leveraging modern technology, data and AI for positive impact and eager to contribute to a mission-driven organization, we want to hear from you.
What you will do:
- Develop and maintain end-to-end tracks with our data and AI focus technology strategy and architectural portfolio
- Mentor engineers and technical leadership by providing clear patterns, ensuring adherence to architectural patterns, and offering hands-on guidance for complex implementations
- Lead architecture decisioning through Architecture Decision Records (ADRs), standards, and design reviews
- Oversee architectural reviews, code reviews, and system performance analysis to ensure quality standards and sustainable delivery momentum
- Foster a culture of collaboration, knowledge sharing, and continuous learning through mentorship, team collaboration, and workshops
- Enable governed data consumption through clear data contracts, curated datasets, and consistent serving patterns including domain marts
- Standardize end-to-end data flow patterns including ingestion, transformation, storage, serving, and retirement with repeatable templates
- Set platform standards for orchestration and reliability including SLAs, retries, idempotency, backfills, runbooks, and operational dashboards
- Establish enterprise data quality practices including critical data elements, quality rules, validation layers, monitoring, and issue triage workflows
- Drive governance-by-design by embedding metadata, lineage, classification, and ownership into platform patterns
- Drive adoption of AI governance architecture for agentic solutions including controls for data privacy and model lifecycle
- Define AIOps standards ensuring AI systems have traceability, quality measurement, incident response readiness, and cost guardrails
- Collaborate with stakeholders and product management to identify, prioritize, and mitigate technical risks and challenges
- Stay informed about industry regulations, security standards, and compliance requirements to ensure solutions meet necessary standards
What you’ll bring:
- Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field
- 7+ years in software development methodologies, architecture, and implementation of large scale enterprise systems
- 4+ years focused on data engineering, data management, or data platform architecture and designing AI solutions including AIOps practices
- Structured problem solving to turn ambiguous requirements into scalable, low-cost solution patterns
- Ability to think strategically while paying close attention to technical details
- Proven experience building or evolving an enterprise data platform including standards and adoption across multiple teams
- Demonstrated ability to design governance-ready AI solutions including evaluation strategies, privacy safeguards, and auditability
- Strong expertise in system architecture, cloud computing, distributed systems, and integration technologies
- High bar for operational readiness, actionable documentation, and treating governance as a built-in platform feature
- Deep experience across modern data platform capabilities including AWS Glue, Step Functions, Airflow, dbt, Spark, and Snowflake
- Proficiency in programming and analytics using Python, SQL, and Jupyter Notebooks
- Experience with agentic frameworks such as LangChain, LlamaIndex, or LangGraph and AIOps tooling like LangFuse
- Familiarity with Agile development methodologies and the ability to adapt to a fast-paced environment
- Strong understanding of security principles, performance optimization, scalability, and reliability
- Demonstrated influence towards simplicity and repeatability in architecture
Nice to Have:
- Experience operating in regulated environments, (SOC2, ISO 27001, or GDPR).
- Familiarity with federated domain ownership models, where domains ship data products while the platform provides shared standards and tooling.
- Experience designing and scaling platform observability for data pipelines, streaming systems, and AI services.
- Familiarity with medallion architecture patterns
- Experience in modern data platform capabilities, including:
- Streaming: Apache Kafka, AWS MSK, AWS Kinesis, GCP Pub/Sub
- Metadata and governance: DataHub, Atlan or similar
Discover your purpose at work
We’re not employees, we’re Benevity-ites. From all locations, backgrounds and walks of life, who deserve more …
Innovative work. Growth opportunities. Caring co-workers. And a chance to do work that fills us with a sense of purpose.
If the idea of working on tech that helps people do good in the world lights you up ... If you want a career where you’re valued for who you are and challenged to see who you can become …
It’s time to join Benevity. We’re so excited to meet you.
Where We Work
At Benevity, we embrace a flexible hybrid approach to where we work that empowers our people in a way that supports great work, strong relationships, and personal well-being. For those located near one of our offices, while there’s no set requirement for in-office time, we do value the moments when coming together in person helps us build connection and collaboration. Whether it’s for onboarding, project work, or a chance to align and bond as a team, we trust our people to make thoughtful decisions about when showing up in person matters most.
Join a company where DEIB isn’t a buzzword
Diversity, equity, inclusion and belonging are part of Benevity’s DNA. You’ll see the impact of our massive investment in DEIB daily — from our well-supported employee resources groups to the exceptional diversity on our leadership and tech teams.
We know that diverse backgrounds, experiences, skills and passions are what move our business and our people forward, so we're committed to creating a culture of belonging with equal opportunities for everyone to shine.
That starts with a fair and accessible hiring process. If you want to feel seen, heard and celebrated, you belong at Benevity.
Candidates with disabilities who may require accommodations throughout the hiring or assessment process are encouraged to reach out to accommodations@benevity.com.
Ready to apply?
Apply to Benevity
Software Engineer, Integrations Services
Share this job
StackAdapt is the leading technology company that empowers marketers to reach, engage, and convert audiences with precision. With 465 billion automated optimizations per second, the AI-powered StackAdapt Marketing Platform seamlessly connects brand and performance marketing to drive measurable results across the entire customer journey. The most forward-thinking marketers choose StackAdapt to orchestrate high-impact campaigns across programmatic advertising and marketing channels.
We're seeking a Software Engineer to help our growing backend engineering team. We’re working on an exciting new data engineering initiative to solve a hard and complex big data problem, leveraging new technologies, at the core of what StackAdapt is built upon. We are seeking experienced software engineering candidates to help us design and build this from the ground up! Our real-time advertising bidding system handles over 3,000,000 requests per second and stores several terabytes of data every day. Our technologies include Go, Ruby on Rails, Aerospike, Redis, Elasticsearch, Kafka, RocksDB, Redshift, ScyllaDB, GraphQL and others. We're not afraid to test and try new technologies.
Watch our talk at Amazon Tech Talks: https://www.youtube.com/watch?v=lRqu-a4gPuU
StackAdapt is a Remote First company, we are open to candidates located anywhere in Canada for this position.
What You'll Be Doing:
- Work with a team of engineers to build first-party and third-party data integration with external data sources
- Build and architect scalable low-latency backend systems and big data pipelines
- Provide technical guidance in designing scalable solutions and best practices
- Make a positive impact on the team's productivity and growth
- Promote software development best-practices and conduct rigorous code reviews
- Rigorously identify and solve technical challenges
- Write performance efficient and memory optimized code that can scale with the volume of data that we ingest
What You'll Bring to the Table:
- Proven track record of building scalable data pipelines and services
- Experience with working with large data in low-latency environments
- Software development experience in distributed systems, architecting scalable microservices and data pipelines in a successful high-growth technology company
- A strong understanding of computer science fundamentals, data structures, and algorithms
- Up to date knowledge and experience in the latest technologies, tools, and frameworks
- Experience with data engineering tools and frameworks (Spark, Flink, Apache Beam, BigQuery, Redshift, dbt, etc)
- Experience with Go and high performance databases is a plus
- Adtech or Martech experience is an asset
StackAdapter's Enjoy:
- Highly competitive salary
- Retirement/ 401K/ Pension Savings globally
- Competitive Paid time off packages including birthday's off!
- Access to a comprehensive mental health care program
- Health benefits from day one of employment
- Work from home reimbursements
- Optional global WeWork membership for those who want a change from their home office and hubs in London and Toronto
- Robust training and onboarding program
- Coverage and support of personal development initiatives (conferences, courses, books etc)
- Access to StackAdapt programmatic courses and certifications to support continuous learning
- An awesome parental leave program
- A friendly, welcoming, and supportive culture
- Our social and team events!
Please note: Benefits and perks may vary depending on your country of employment and the nature of your engagement. In locations where StackAdapt does not have a legal entity, employment and benefits are administered in accordance with local regulations and partner policies.
2026 Best Workplaces™ for Young Talent and in Canada by Great Place to Work®
#1 DSP on G2 and leader in a number of categories including Cross-Channel Advertising
Ready to apply?
Apply to StackAdapt
Senior Software Engineer, Stats & Analytics - Data Platform
Share this job
StackAdapt is the leading technology company that empowers marketers to reach, engage, and convert audiences with precision. With 465 billion automated optimizations per second, the AI-powered StackAdapt Marketing Platform seamlessly connects brand and performance marketing to drive measurable results across the entire customer journey. The most forward-thinking marketers choose StackAdapt to orchestrate high-impact campaigns across programmatic advertising and marketing channels.
StackAdapt is a Remote First company, and we are open to candidates located anywhere in the United States or Canada.
What You'll Be Doing:
- Design and build scalable data pipelines, batch jobs, and streaming processes that power analytics and machine learning.
- Implement and optimize data storage systems (warehouses, lakes, analytical databases) with a focus on reliability, lineage, and governance.
- Develop tools and frameworks to support data orchestration, ETL workflows, and big data processing.
- Collaborate with engineers, data scientists, and product managers to align platform capabilities with business needs.
- Ensure data systems meet requirements for quality, scalability, and cost efficiency in cloud environments.
- Contribute to technical discussions, code reviews, and system design sessions.
- Take ownership of features and projects, driving them from concept to production.
What You'll Bring to the Table
- Strong background in software engineering, data engineering and distributed systems, ideally at scale (terabytes+).
- Hands-on experience with modern data warehouses, lakes, and compute/storage technologies (e.g., Snowflake, Pinot, TiDB, Spark, Airflow, Kafka, Trino/Presto).
- Experience designing and building robust ETL pipelines and real-time streaming processes.
- Solid understanding of data governance, lineage, and cost optimization in cloud environments.
- Ability to write clean, maintainable, and performant code in production systems.
- Strong problem-solving skills and ability to collaborate across teams.
StackAdapter's Enjoy:
- Highly competitive salary
- Retirement/ 401K/ Pension Savings globally
- Competitive Paid time off packages including birthday's off!
- Access to a comprehensive mental health care program
- Health benefits from day one of employment
- Work from home reimbursements
- Optional global WeWork membership for those who want a change from their home office and hubs in London and Toronto
- Robust training and onboarding program
- Coverage and support of personal development initiatives (conferences, courses, books etc)
- Access to StackAdapt programmatic courses and certifications to support continuous learning
- An awesome parental leave program
- A friendly, welcoming, and supportive culture
- Our social and team events!
Please note: Benefits and perks may vary depending on your country of employment and the nature of your engagement. In locations where StackAdapt does not have a legal entity, employment and benefits are administered in accordance with local regulations and partner policies.
2026 Best Workplaces™ for Young Talent and in Canada by Great Place to Work®
#1 DSP on G2 and leader in a number of categories including Cross-Channel Advertising
Ready to apply?
Apply to StackAdapt
Embracing a growth mindset where curiosity thrives, we celebrate excellence and value individuals who inspire and mentor others, elevating the collective. Our driving force lies in personal and business growth. We go above and beyond to surprise and delight our clients, delivering tangible business value. In facing challenges, we make tough choices and solve complex problems to positively influence our clients, their customers, and the world at large.
As a Microsoft services partner, we hold ourselves to the highest standards of technical excellence. This commitment to quality is evident not only in our work but also in how we support and empower our employees. At Lantern, our culture mirrors our core values and unwavering dedication to realizing our purpose and vision, making it a dynamic and fulfilling workplace. Together, we transcend the ordinary and achieve extraordinary results.
Data Architect
We are seeking an experienced Data Architect to join our team at Lantern. In this role you will play a crucial role in designing and implementing solutions that drive business insights for our clients. This role will be a key resource in our Business Analytics Practice. This role will be client facing, innovating with solutions from the Microsoft Data Platform stack including Fabric, Azure Synapse, Power BI, and SSAS.
The primary objective of this role is to assist our clients in establishing a data platform and data culture that enables them to leverage advanced reporting, analytics, and AI. The Data Architect will be responsible for working with our clients to understand their business and technical requirements, architecting analytics solutions, and providing technical guidance to our consulting team.
Key Responsibilities
• Strategic Advisory, Technical Advisory, and Solution Architecting
• Collaborate with customers to understand their business needs, data challenges, and technical requirements.
• Provide strategic guidance on leveraging Microsoft Data Platform technologies (such as Fabric, Azure Synapse, Power BI, etc.) for data warehousing, data engineering, semantic modeling, analytics, reporting, and machine learning.
• Conducting customer-facing strategic workshops and assessments of existing data platforms to create recommendations on how to best modernize their data platform using the Fabric and Azure Synapse.
• Architect end-to-end solutions that align with customer goals and maximize Fabric and Power BI capabilities.
• Solution Development
• Creating highly performant and scalable Data Warehouses and Lakehouses using Microsoft Fabric and Azure Synapse.
• Designing and building scalable and efficient data pipelines using Data Factory.
• Adding data validation and quality checks throughout data pipelines.
• Developing enterprise grade Power BI / Analysis Services semantic models.
• Optimizing existing ETL process and data transformations.
• Create technical documentation for solutions that have been built.
• Troubleshoot production systems, address technical issues, etc.
• Team leadership
• Staying up-to-date on the latest features and capabilities being released across Microsoft Fabric.
• Coaching team members around Microsoft Data Platform technology stack.
• Assisting in technical Sales conversations.
• Create growth and opportunity for our clients utilizing technical solutions from our partner, Microsoft.
Skills, Knowledge and Expertise
• Has strong consulting skills gained through experience in a consulting organization.
• Excellent communication and customer service skills.
• Proven track record of working closely with clients to determine their needs and ensure their ongoing satisfaction.
• Genuine interest and ability to quickly switch between multiple clients and initiatives on a frequent basis.
• Experience in Agile software development as a team member.
• Strong meeting facilitation skills.
• Experience in all phases of product, software, and testing lifecycles.
• Able to serve as a liaison between both business and technical teams
• Strong proficiency in T-SQL and Data Warehousing
• Strong proficiency in Apache Spark and Delta Lake for Data Engineering
• Strong proficiency in Fabric or Azure Data Factory pipelines
• DAX, M/Power Query
• Data modeling – Kimball dimensional modeling, semantic/tabular models.
Benefits
- A culture that both wows our customers and employees;
- Variety of challenging projects, and the ability to work with leading-edge technologies;
- Competitive salary & group benefits;
- Generous training and education opportunities;
- Diverse team social events;
- Be part of a team that believes in diversity, inclusion, and a fun atmosphere!
Lantern is committed to fair and equitable compensation practices. Actual compensation will depend upon an individual’s skills, experience, qualifications, location, and other relevant factors. The salary pay range is subject to change and may be modified at any time.
Ready to apply?
Apply to Lantern