Apache Spark Jobs in Detroit.
All active Apache Spark roles based in Detroit.
Pick a job to read the details
Tap any role on the left — its description and apply link will open here.
Senior Data Engineer
Share this job
WHO ARE WE?
Launch Potato is a profitable digital media company that reaches over 30M+ monthly visitors through brands such as FinanceBuzz, All About Cookies, and OnlyInYourState.
As The Discovery and Conversion Company, our mission is to connect consumers with the world’s leading brands through data-driven content and technology.
Headquartered in South Florida with a remote-first team spanning over 15 countries, we’ve built a high-growth, high-performance culture where speed, ownership, and measurable impact drive success.
WHY JOIN US?
At Launch Potato, you’ll accelerate your career by owning outcomes, moving fast, and driving impact with a global team of high-performers.
BASE SALARY: $150,000 to $190,000 per year, paid semi-monthly
MUST HAVE:
- 5+ years of experience in data engineering within fast-paced, cloud-native environments
- Deep expertise in Python, SQL, Docker, and AWS (S3, Glue, Kinesis, Athena/Presto)
- Experience building and managing scalable ETL pipelines and data lake infrastructure
- Familiarity with distributed systems, Spark, and data quality best practices
- Strong cross-functional collaboration skills to support BI, analytics, and engineering teams
EXPERIENCE: 5+ years of data engineering experience in an AWS-based environment where data powers decision-making across product, marketing, and operations.
YOUR ROLE
Lead scalable data engineering efforts that empower cross-functional teams with reliable, timely, and actionable data, ensuring Launch Potato’s analytics and business intelligence infrastructure fuels strategic growth.
OUTCOMES
- Build and optimize scalable, efficient ETL and data lake processes that proactively catch issues before they impact the business
- Own the ingestion, modeling, and transformation of structured and unstructured data to support reporting and analysis across all business units
- Partner closely with BI and Analytics to deliver clean, query-ready datasets that improve user acquisition, engagement, and revenue growth
- Maintain and enhance database monitoring, anomaly detection, and quality assurance workflows
- Serve as the internal point of contact for reporting infrastructure—delivering ad hoc data analyses and driving consistent data integrity
- Drive adoption and advancement of Looker dashboards by ensuring robust and scalable backend data support
- Contribute to the future of Launch Potato’s data team by mentoring peers and shaping a high-performance, quality-first engineering culture
COMPETENCIES
- Data Engineering Mastery: Demonstrates technical excellence in building data pipelines, troubleshooting distributed systems, and scaling infrastructure using AWS and open-source tools
- Cross-Functional Collaboration: Communicates clearly across technical and non-technical teams, translating business needs into robust data solutions
- Proactive Ownership: Operates with a strong sense of accountability; identifies and solves data issues independently and efficiently
- Quality-Driven Execution: Holds a high bar for data accuracy, auditability, and documentation throughout all systems and workflows
- Strategic Thinking: Anticipates how data infrastructure impacts wider company OKRs and proactively suggests improvements and innovations
- Growth Mindset: Seeks out opportunities to elevate team capabilities, mentor others, and stay ahead of evolving best practices in data engineering
TOTAL COMPENSATION
Base salary is set according to market rates for the nearest major metro and varies based on Launch Potato’s Levels Framework. Your compensation package includes a base salary, profit-sharing bonus, and competitive benefits. Launch Potato is a performance-driven company, which means once you are hired, future increases will be based on company and personal performance, not annual cost of living adjustments.
Want to accelerate your career? Apply now!
Since day one, we've been committed to having a diverse, inclusive team and culture. We are proud to be an Equal Employment Opportunity company. We value diversity, equity, and inclusion.
We do not discriminate based on race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.
Ready to apply?
Apply to Launch Potato
Lead Data Engineer
Share this job
WHO ARE WE?
Launch Potato is a profitable digital media company that reaches over 30M+ monthly visitors through brands such as FinanceBuzz, All About Cookies, and OnlyInYourState.
As The Discovery and Conversion Company, our mission is to connect consumers with the world’s leading brands through data-driven content and technology.
Headquartered in South Florida with a remote-first team spanning over 15 countries, we’ve built a high-growth, high-performance culture where speed, ownership, and measurable impact drive success.
WHY JOIN US?
At Launch Potato, you’ll accelerate your career by owning outcomes, moving fast, and driving impact with a global team of high-performers.
BASE SALARY: $150,000 to $190,000 per year, paid semi-monthly
MUST HAVE:
- 5+ years of experience in data engineering within fast-paced, cloud-native environments
- Deep expertise in Python, SQL, Docker, and AWS (S3, Glue, Kinesis, Athena/Presto)
- Experience building and managing scalable ETL pipelines and data lake infrastructure
- Familiarity with distributed systems, Spark, and data quality best practices
- Strong cross-functional collaboration skills to support BI, analytics, and engineering teams
EXPERIENCE: 5+ years of data engineering experience in an AWS-based environment where data powers decision-making across product, marketing, and operations.
YOUR ROLE
Lead scalable data engineering efforts that empower cross-functional teams with reliable, timely, and actionable data, ensuring Launch Potato’s analytics and business intelligence infrastructure fuels strategic growth.
OUTCOMES
- Build and optimize scalable, efficient ETL and data lake processes that proactively catch issues before they impact the business
- Own the ingestion, modeling, and transformation of structured and unstructured data to support reporting and analysis across all business units
- Partner closely with BI and Analytics to deliver clean, query-ready datasets that improve user acquisition, engagement, and revenue growth
- Maintain and enhance database monitoring, anomaly detection, and quality assurance workflows
- Serve as the internal point of contact for reporting infrastructure—delivering ad hoc data analyses and driving consistent data integrity
- Drive adoption and advancement of Looker dashboards by ensuring robust and scalable backend data support
- Contribute to the future of Launch Potato’s data team by mentoring peers and shaping a high-performance, quality-first engineering culture
COMPETENCIES
- Data Engineering Mastery: Demonstrates technical excellence in building data pipelines, troubleshooting distributed systems, and scaling infrastructure using AWS and open-source tools
- Cross-Functional Collaboration: Communicates clearly across technical and non-technical teams, translating business needs into robust data solutions
- Proactive Ownership: Operates with a strong sense of accountability; identifies and solves data issues independently and efficiently
- Quality-Driven Execution: Holds a high bar for data accuracy, auditability, and documentation throughout all systems and workflows
- Strategic Thinking: Anticipates how data infrastructure impacts wider company OKRs and proactively suggests improvements and innovations
- Growth Mindset: Seeks out opportunities to elevate team capabilities, mentor others, and stay ahead of evolving best practices in data engineering
TOTAL COMPENSATION
Base salary is set according to market rates for the nearest major metro and varies based on Launch Potato’s Levels Framework. Your compensation package includes a base salary, profit-sharing bonus, and competitive benefits. Launch Potato is a performance-driven company, which means once you are hired, future increases will be based on company and personal performance, not annual cost of living adjustments.
Want to accelerate your career? Apply now!
Since day one, we've been committed to having a diverse, inclusive team and culture. We are proud to be an Equal Employment Opportunity company. We value diversity, equity, and inclusion.
We do not discriminate based on race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.
Ready to apply?
Apply to Launch Potato
Help empower our global customers to connect to culture through their passions.
Why you'll love this role
As a Senior Data Engineer, you will be empowered to leverage data to drive amazing customer experiences and business results. You will own the end to end development of data engineering solutions to support analytical needs of the business. The ideal candidate will be passionate about working with disparate datasets and be someone who loves to bring data together to answer business questions at speed. You should have deep expertise in the creation and management of datasets and the proven ability to translate the data into meaningful insights through collaboration with analysts, data scientists and business stakeholders.You will partner with accounting and finance business teams in expanding Financial Data Repository to support new business initiatives. Sr Data Engineer of Finance Data Repository is most challenging and exciting role to work for, with new business initiative launches in payments, finance , tax and ordering platform. Its highly critical to manage the changes on daily basis for proper accounting to keep our books clean and accurate.
What you'll do
- Design and build mission critical data pipelines with a highly scalable distributed architecture - including data ingestion (streaming, events and batch), data integration, data curation
- Help continually improve ongoing reporting and analysis processes, simplifying self-service support for business stakeholders
- Build and support reusable framework to ingest, integration and provision data
- Automation of end to end data pipeline with metadata, data quality checks and audit
- Build and support a big data platform on the cloud
- Define and implement automation of jobs and testing
- Optimize the data pipeline to support ML workloads and use cases
- Support mission critical applications and near real time data needs from the data platform
- Capture and publish metadata and new data to subscribed users
- Work collaboratively with business analysts, product managers, data scientists as well as business partners and actively participate in design thinking session
- Participate in design and code reviews
- Motivate, coach, and serve as a role model and mentor for other development team associates/members that leverage the platform
About you
- 5 to 7 years experience in data warehouse / data lake house technical architecture
- 3+ years of experience in using programming languages (Python / Scala / Java / C#) Minimum
- 3 years of Big Data and Big Data tools in one or more of the following: Batch Processing (e.g. Hadoop distributions, Spark), Real time processing (e.g. Kafka, Flink/Spark Streaming)
- Minimum of 2 years' experience with AWS or engineering in other cloud environments
- Strong Knowledge of Databricks SQL/Scala - Data Engineering Pipelines
- Experience with Database Architecture/Schema design
- Strong familiarity with batch processing and workflow tools such as dbt, AirFlow, NiFi
- Ability to work independently with business partners and management to understand their needs and exceed expectations in delivering tools/solutions
- Strong interpersonal, verbal and written communication skills and ability to present complex technical/analytical concepts to executive audience
- Strong business mindset with customer obsession; ability to collaborate with business partners to identify needs and opportunities for improved data management and delivery
- Experience providing technical leadership and mentoring other engineers for best practices on data engineering
- Bachelor's degree in Computer Science, or a related technical field
StockX is proud to be a Detroit-based technology leader focused on the large and growing online market for sneakers, apparel, accessories, electronics, collectibles, trading cards, and more. StockX's powerful platform connects buyers and sellers of high-demand consumer goods from around the world using dynamic pricing mechanics. This approach affords access and market visibility powered by real-time data that empowers buyers and sellers to determine and transact based on market value. The StockX platform features hundreds of brands across verticals including Jordan Brand, adidas, Nike, Supreme, BAPE, Off-White, Louis Vuitton, Gucci; collectibles from brands including LEGO, KAWS, Bearbrick, and Pop Mart; and electronics from industry-leading manufacturers Sony, Microsoft, Meta, and Apple. Launched in 2016, StockX employs 1,000 people across offices and verification centers around the world. Learn more at www.stockx.com.
Ready to apply?
Apply to StockX
Help empower our global customers to connect to culture through their passions.
Why you'll love this role
As a Senior Data Engineer, you will be empowered to leverage data to drive amazing customer experiences and business results. You will own the end to end development of data engineering solutions to support analytical needs of the business. The ideal candidate will be passionate about working with disparate datasets and be someone who loves to bring data together to answer business questions at speed. You should have deep expertise in the creation and management of datasets and the proven ability to translate the data into meaningful insights through collaboration with analysts, data scientists and business stakeholders.You will partner with accounting and finance business teams in expanding Financial Data Repository to support new business initiatives. Sr Data Engineer of Finance Data Repository is most challenging and exciting role to work for, with new business initiative launches in payments, finance , tax and ordering platform. Its highly critical to manage the changes on daily basis for proper accounting to keep our books clean and accurate.
What you'll do
- Design and build mission critical data pipelines with a highly scalable distributed architecture - including data ingestion (streaming, events and batch), data integration, data curation
- Help continually improve ongoing reporting and analysis processes, simplifying self-service support for business stakeholders
- Build and support reusable framework to ingest, integration and provision data
- Automation of end to end data pipeline with metadata, data quality checks and audit
- Build and support a big data platform on the cloud
- Define and implement automation of jobs and testing
- Optimize the data pipeline to support ML workloads and use cases
- Support mission critical applications and near real time data needs from the data platform
- Capture and publish metadata and new data to subscribed users
- Work collaboratively with business analysts, product managers, data scientists as well as business partners and actively participate in design thinking session
- Participate in design and code reviews
- Motivate, coach, and serve as a role model and mentor for other development team associates/members that leverage the platform
About you
- 5 to 7 years experience in data warehouse / data lake house technical architecture
- 3+ years of experience in using programming languages (Python / Scala / Java / C#) Minimum
- 3 years of Big Data and Big Data tools in one or more of the following: Batch Processing (e.g. Hadoop distributions, Spark), Real time processing (e.g. Kafka, Flink/Spark Streaming)
- Minimum of 2 years' experience with AWS or engineering in other cloud environments
- Strong Knowledge of Databricks SQL/Scala - Data Engineering Pipelines
- Experience with Database Architecture/Schema design
- Strong familiarity with batch processing and workflow tools such as dbt, AirFlow, NiFi
- Ability to work independently with business partners and management to understand their needs and exceed expectations in delivering tools/solutions
- Strong interpersonal, verbal and written communication skills and ability to present complex technical/analytical concepts to executive audience
- Strong business mindset with customer obsession; ability to collaborate with business partners to identify needs and opportunities for improved data management and delivery
- Experience providing technical leadership and mentoring other engineers for best practices on data engineering
- Bachelor's degree in Computer Science, or a related technical field
StockX is proud to be a Detroit-based technology leader focused on the large and growing online market for sneakers, apparel, accessories, electronics, collectibles, trading cards, and more. StockX's powerful platform connects buyers and sellers of high-demand consumer goods from around the world using dynamic pricing mechanics. This approach affords access and market visibility powered by real-time data that empowers buyers and sellers to determine and transact based on market value. The StockX platform features hundreds of brands across verticals including Jordan Brand, adidas, Nike, Supreme, BAPE, Off-White, Louis Vuitton, Gucci; collectibles from brands including LEGO, KAWS, Bearbrick, and Pop Mart; and electronics from industry-leading manufacturers Sony, Microsoft, Meta, and Apple. Launched in 2016, StockX employs 1,000 people across offices and verification centers around the world. Learn more at www.stockx.com.
Ready to apply?
Apply to StockX