Databricks Jobs in Porto.
All active Databricks roles based in Porto.
Pick a job to read the details
Tap any role on the left — its description and apply link will open here.
Lead Data Engineer
Share this job
Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On projects, they will be leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution.
Job responsibilities
- You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration.
- You will collaborate with stakeholders to understand their strategic objectives and identify opportunities to leverage data and data quality.
- You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions.
- You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems.
- You will collaborate with data scientists to design scalable implementations of their models.
- You write clean and iterative code based on TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines.
- You will lead and advise clients on how to use different distributed storage and computing technologies from the plethora of options available.
- You will develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack.
- You will be responsible for data governance, data security and data privacy to support business and compliance requirements.
- You will define the strategy for and incorporate data quality into your day-to-day work.
Job qualifications
Technical Skills
- You have experience with databricks
- Working with data excites you; You have created Big Data architecture, can build and operate data pipelines, and maintain data storage, all within distributed systems.
- You have a deep understanding of Gen/AI and LLMs
- You have experience in writing clean, high-quality code using the preferred programming language.
- You have built and deployed large-scale data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting.
- You have experience with data visualization techniques and can communicate the insights as per the audience.
- You have experience with data-driven approaches and can apply data security and privacy strategy to solve business problems.
- You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.).
- Advanced English is required
Professional Skills
- You understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy-in and gaining trust along the way.
- You are resilient in ambiguous situations and can adapt your role to approach challenges from multiple perspectives.
- You don’t shy away from risks or conflicts, instead you take them on and skillfully manage them.
- You coach, mentor and motivate others and you aspire to influence teammates to take positive action and accountability for their work.
- You enjoy influencing others and always advocate for technical excellence while being open to change when needed.
- You are a proven leader with a track record of encouraging teammates in their professional development and relationships.
- Cultivating strong partnerships comes naturally to you; You understand the importance of relationship building and how it can bring new opportunities to our business.
Other things to know
Learning & Development
There is no one-size-fits-all career path at Thoughtworks: however you want to develop your career is entirely up to you. But we also balance autonomy with the strength of our cultivation culture. This means your career is supported by interactive tools, numerous development programs and teammates who want to help you grow. We see value in helping each other be our best and that extends to empowering our employees in their career journeys.
About Thoughtworks
Thoughtworks is a dynamic and inclusive community of bright and supportive colleagues who are revolutionizing tech. As a leading technology consultancy, we’re pushing boundaries through our purposeful and impactful work. For 30+ years, we’ve delivered extraordinary impact together with our clients by helping them solve complex business problems with technology as the differentiator. Bring your brilliant expertise and commitment for continuous learning to Thoughtworks. Together, let’s be extraordinary.
#LI-Onsite
Ready to apply?
Apply to Thoughtworks
Location: UK or Portugal
Department: Engineering
Employment Type: Permanent
About YLD:
Our goal is to help our clients keep moving forward. We work with them to build the skills and capabilities they need to stay ahead of the competition, and we know our success only happens when they succeed. We’re a team of curious, talented people, and we’re committed to making YLD a place where great people want to work, grow, and stay. We’re a remote-first consultancy specialising in software engineering, product design, and data. Our teams are based across London, Lisbon, and Porto, and we create digital solutions that continue to deliver value long after our work is done.
About the role:
As a Senior Data Engineer, you’ll be part of a client team building innovative products. We expect you to be curious, passionate, driven, and enthusiastic. You’ll be proficient at problem-solving, and crafting scalable, resilient, and fault-tolerant architectures. You’ll be an effective communicator and a team player. You and your team will move in a fast-paced engineering environment, achieving outstanding results and delivering exciting projects.
About you:
A YLD Senior Data Engineer is a highly skilled engineer who spans across data engineering and analytics engineering, and knows where the boundaries sit. You've built pipelines and transformation layers. You've inherited messy data projects and made them good. You have opinions about how data teams should work and the humility to adapt them to context.
You have a real passion for the craft and are an active learner who gets excited by the variety that consultancy brings: different clients, different stacks, different problems.
Your day-to-day responsibilities will look like this:
- Delivering data work on client engagements: pipelines, transformation layers, models, and the infrastructure around them
- Adapting to different client contexts, legacy warehouse migrations, greenfield lakehouses, struggling transformation layers that need rescuing
- Defining and evolving our internal standards for data work: testing, documentation, project structure, code review
- Mentoring and growing data engineers across the company
- Showing up for client team moments (internal speakers, learning sessions, social events) to build strong working relationships.
- Contributing to proposals and helping shape engagements during the sales process
- Representing YLD externally through writing, speaking, and contributing to the wider data community.
You’ll have the following skills and experience:
- SQL as engineering: You write SQL that's reviewable, testable, and performs at scale. You understand query planning, engine quirks, and how materialisation choices affect cost and performance
- Python for data: You write typed, testable Python for pipelines and tooling. You've built and maintained production data systems, not just notebooks
- Data modelling: You've made deliberate choices between dimensional, Data Vault, normalised, and denormalised designs. You can explain those trade-offs in terms of flexibility, query performance, and maintainability
- Transformation architecture: You design transformations that are idempotent, incremental, and dependency-aware. You think in DAGs, not scripts
- Pipeline design: You understand batch, streaming, and micro-batch trade-offs. You consider latency, complexity, cost, and reprocessability. And choose the right approach for the problem
- Data testing: You write tests as code, schema contracts, assertions, and transformation logic. You know what to catch at build time vs. defer to observability
- Data observability: You treat data reliability like site reliability. Measurable indicators, alerting, incident response, and root cause analysis
- CI/CD for data: You version, test, and deploy pipelines like software. Environment promotion, rollback strategies, and infrastructure as code for reproducible environments
- Data governance: You've implemented lineage, cataloguing, sensitive data classification, or access control. Not just built pipelines, but made them auditable and secure
- Cost-conscious: You've optimised warehouse spend, storage strategies, or job efficiency. You treat compute as a resource to manage, not ignore
- Platform fluency: You've worked across the modern stack. Orchestration (Airflow, Dagster), warehouses (Snowflake, BigQuery, Databricks), ingestion (Fivetran, Airbyte, custom), and transformation (dbt, Spark)
- Cross-functional fluency: You translate engineering constraints into business terms and negotiate realistic commitments
You’ll be:
- Self-motivated and proactive
- Comfortable with ambiguity, experimentation, and iteration
- Collaborative by default. You work well in teams and across teams
- Analytical and detail-oriented in your approach to problems
- Comfortable context-switching across clients, stacks, and problem types
- Willing to shape engagements, not just deliver them: contributing to proposals, scoping, and client relationships
- Active in the wider data community: writing, speaking, or open-source contribution
- Genuinely committed to diversity, equity, and inclusion
Benefits you'll get:
- Company Private Health care
- Enhanced fully paid maternity and paternity leave for up to 6 months
- Company’s Pension Scheme (UK Only)
- 25 days annual holiday (excluding Public Holidays)
- £2000/€2000 annual allowance for Training/Conferences
- £300/€300 annual allowance for additional hardware
- Wellbeing & Performance Support via Oli including Therapy and Coaching
- Discretionary Bonus (depending on Company performance and results)
- Company laptop
- Generous referral schemes
Our typical Recruitment Process looks like this:
- 1st Interview with someone from the Talent team (30-45 Minutes)
- Technical Interview with our Senior Developers (90 Minutes)
- Call with the Head of Engineering (60 Minutes)
Get a glimpse of what it's like working at YLD! 🤳
We live and breathe our values, and know you will too:
- Growing every day
- Including everyone
- Relationships built on honesty and ethics
- Inspiring solutions
- Winning together
We’re an equal-opportunity employer and value diversity in all its forms. We do not discriminate based on race, religion, colour, national origin, gender, sexual orientation, pregnancy or maternity, age, marital status, or disability. We also offer a remote-first working environment, with flexible working and work–life balance as standard for all employees.
Ready to apply?
Apply to YLDSenior Machine Learning Engineer - Refer
Share this job
Senior Machine Learning Engineers at Thoughtworks build, maintain and test the architecture and infrastructure for managing machine learning applications. They are involved in supporting and contributing to the design of the end-to-end applications and products. They are responsible for building core capabilities including technical and functional machine learning systems and applications, being the anchor for functional streams of work and are accountable for timely delivery.
As a senior machine learning engineer, you will work on the latest tools, frameworks and offerings while also being involved in enabling credible and collaborative problem solving to execute on a strategy.
Job responsibilities
- You will contribute to design and drive the development of robust scalable architectures and infrastructure for deploying and managing machine learning (ML) applications, ensuring high availability, performance and security
- You will collaborate with data scientists and engineers to translate business needs into effective and efficient ML systems and applications
- You will own the development and maintenance of core functionalities within ML applications, including ML pipelines, model training and deployment, and monitoring and evaluation
- You will drive the functional stream of work by providing technical expertise, handling team discussions and ensuring timely delivery of assigned tasks
- You will stay ahead of the curve by actively exploring and implementing the latest tools, frameworks and offerings in the ML landscape
- You will facilitate collaborative problem solving within the team by actively listening, communicating effectively and mentoring other engineers
- You will contribute to the development and execution of the team's overall ML strategy, aligning technical capabilities with business objectives
- You will proactively identify and address challenges related to ML systems and applications, proposing solutions and implementing improvements
Job qualifications
Technical Skills
- You have experience in writing clean, maintainable and testable code, demonstrating attention to refactoring and readability of the code
- You are proficient in scripting languages such as Python or Shell for automation and task streamlining
- You have knowledge of distributed systems and scalable architectures to handle large-scale ML applications
- You have experience with building, deploying, and maintaining ML systems using relevant ML techniques and platforms, i.e.: Scikit-learn, Tensorflow, MLFlow, Kubeflow, Pytorch
- You have experience with building, deploying and maintaining ML systems and experience with application of MLOps principles and CI/CD to ML
- You have experience in machine learning engineering and data science, are familiar with key ML concepts, algorithms and frameworks, and understand ML model lifecycles
- You have experience with designing and operating the infrastructure required to run different types of ML training and serving workloads, i.e.: on-premise vs. cloud infrastructure, infrastructure as code, monitoring, etc.
- You have hands-on experience with on-premise and cloud services for building and deploying ML pipelines, i.e.: Azure, AWS, GCP or Databricks and associated ML managed services
Professional Skills
- You understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy-in and gaining trust along the way
- You are resilient in ambiguous situations and can adapt your role to approach challenges from multiple perspectives
- You don’t shy away from risks or conflicts, instead you take them on and skillfully manage them
- You are eager to coach, mentor and motivate others and you aspire to influence teammates to take positive action and accountability for their work
- You enjoy influencing others and always advocate for technical excellence while being open to change when needed
Other things to know
Learning & Development
There is no one-size-fits-all career path at Thoughtworks: however you want to develop your career is entirely up to you. But we also balance autonomy with the strength of our cultivation culture. This means your career is supported by interactive tools, numerous development programs and teammates who want to help you grow. We see value in helping each other be our best and that extends to empowering our employees in their career journeys.
Travel
While we’ve traditionally been a traveling consultancy, we have adopted a hybrid working model with the majority of work being completed remotely from either home or local Thoughtworks offices. However, business travel to client locations should be expected when required by Thoughtworks or our clients’ needs.
Company Policies
We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, disability status, genetic information, protected veteran status, or any other characteristic protected by law.
About Thoughtworks
Thoughtworks is a global technology consultancy that integrates strategy, design and engineering to drive digital innovation. For 30+ years, our clients have trusted our autonomous teams to build solutions that look past the obvious. Here, computer science grads come together with seasoned technologists, self-taught developers, midlife career changers and more to learn from and challenge each other. Career journeys flourish with the strength of our cultivation culture, which has won numerous awards around the world.
Join Thoughtworks and thrive. Together, our extra curiosity, innovation, passion and dedication overcomes ordinary.
#LI-Remote
Ready to apply?
Apply to Referrals OnlyAre you passionate about working with the most cutting-edge technologies, including AI, big data analytics, LLMs, data mining, and business intelligence (BI)? Are you looking to become part of a world-class engineering team? Do you aspire to contribute to a globally recognized, pre-IPO leader in technology?
As a Senior Software Engineer, you will contribute to the design and development of AI-driven architectures that power our next-generation intelligent customer engagement platforms. Your contributions will help shape AI-powered customer experiences, enhancing the intelligence and efficiency of our service platforms.
Job Responsibilities:
- Develop and enhance a cloud-based data foundation system and AI agent platform. This involves leveraging AI/ML models, applying prompt engineering techniques, and conducting data analysis across structured, semi-structured, and unstructured data. Utilize technologies such as data and pattern mining, business intelligence (BI), and data transformation and processing.
- Collaborate with cross-functional teams, including data scientists, software engineers, product managers, and business stakeholders, to deliver a high-performance, reliable, scalable service with assured AI quality.
- Contribute to architectural discussions, providing technical design input and ensuring alignment with the overall technology roadmap while adopting best practices effectively and independently.
- Participate in shaping the engineering roadmap, ensuring solutions are scalable and extensible while meeting business needs.
- Support and mentor junior engineers, fostering a collaborative and innovative development culture.
- Stay up-to-date with industry trends, emerging technologies, and advancements in AI and data engineering.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 5+ years of experience in backend development for cloud-based services, with a strong focus on scalability, reliability, and performance.
- Proficiency in Java, Python, C++, C#, Kotlin, Scala, or similar languages.
- Experience building and optimizing data-intensive services, including data processing, transformation, storage, and retrieval at scale.
- Strong problem-solving skills and ability to design scalable solutions for AI-driven services.
- Strong written and verbal English communication skills.
- Prior experience with data platforms and/or AI services is highly desirable.
- Experience working with distributed data platforms and modern data architectures, such as Apache Spark, Databricks, Kafka, Delta Lake, or similar is a desirable.
- Experience in data science and practical experience applying AI/ML models is a plus.
Additional Notes:
This position will follow a hybrid work model.
Talkdesk is pioneering a new era of Customer Experience Automation (CXA), redefining how the world’s most admired brands interact with their customers through AI. Our global team of courageous innovators is customer-obsessed, building AI-first solutions that put empathy, trust, and transparency at the center of every interaction. We foster an inclusive culture where diverse perspectives drive our success and every voice belongs. Combining the stability of a global leader with the agility of a disruptor, Talkdeskers are empowered with the autonomy to drive meaningful impact, while giving back to the communities and environment around us.
Talkdesk has been recognized as a Leader in the Gartner® Magic Quadrant™ for Contact Center as a Service (CCaaS) and in the G2 Overall Grid® Reports for AI Agents and Contact Center. With seven consecutive years on the Forbes Cloud 100 and multiple AI Breakthrough awards, there has never been a more exciting time to join us as we shape the future of customer experience automation!
Work Environment and Physical Requirements:
Primarily office-environment work, extended periods of sitting or standing, computer-based work. Limited lifting, and equipment usage limited to computer-related equipment (keyboards, mouse, etc.)
The Talkdesk story hinges on empathy and acceptance. It is the shared goal among all Talkdeskers to empower a new kind of customer hero through our innovative software solution, and we firmly believe that the best path to success for our mission is inclusivity, diversity, and genuine acceptance. To that end, we will hire, promote, work along, cheer for, bond with, and warmly welcome into the Talkdesk family all persons without regard to ethnic and racial identity, indigenous heritage, national origin, religion, gender, gender identity, gender expression, sexual orientation, age, disability, marital status, veteran status, genetic information, or any other legally protected status.
Ready to apply?
Apply to Talkdesk