Airflow Jobs in Japan.
All active Airflow roles based in Japan.
Pick a job to read the details
Tap any role on the left — its description and apply link will open here.
Senior Data Engineer
Share this job
|
About Paidy Inc. |
|
Paidy is Japan's pioneer and leading BNPL service with the mission to spread trust through society and to give people room to dream. Paidy offers instant, monthly-consolidated credit to consumers by removing hassles from payment and purchase experiences. Paidy uses proprietary models and machine learning to underwrite transactions in seconds and guarantee payments to merchants. Paidy increases revenue for merchants by reducing the number of incomplete transactions, increasing conversion rates, boosting average order values, and facilitating repeat purchases from consumers. Paidy has reached an agreement to join PayPal, the global payments company. Paidy will continue to operate its existing business, maintain its brand and support a wide variety of consumer wallets and marketplaces by providing convenient and innovative services. Paidy continues to innovate to make shopping easier and more fun both online and offline. For more information, please visit http://www.paidy.com. Please note that you must already hold valid working rights to work in Japan. |
|
About Position |
|
The Data Engineering Department provides the technical service around the company’s business data and information, and its derivatives. This service is a crucial part of Paidy's external surface and internal business intelligence. The Department provides services including capturing datasets from any business activities, performing curation, maintaining its availability, deriving strategy and implementing solutions covering integrity, resilience and scalability. In addition, by assisting business initiatives on data analytics and reporting. As per the component stack, the Data Engineering Department and its services will depend on most, if not all activities within Paidy. |
|
Key Role and Responsibilities |
|
The Senior Data Engineer should be able to understand the business, technical requirements and implement solutions accordingly. (S)he should also have hands-on experience in application development, in-depth knowledge in programming languages and data storage technologies. Duties and responsibilities include: ● Supporting the well-being of deployed data services. ● Enhancing the operation and monitoring facilities. ● Implement scalable data pipeline from various Paidy platforms, data warehouse, or 3rd party services. ● Following business or technical initiatives, implement data solutions accordingly. ● Being domain expert in data semantic, providing advisory on business intelligence requests. ● Managing reporting facilities; implementing and promoting self-service reporting tools. ● Performing evaluation of technology, POC and feasibility analysis. ● Support and manage a growing team of Data Engineers |
|
Skills and Requirements |
|
● A bachelor’s degree in computer science, Information Technology or a related subject ● 5+ years of experience in software development. ● Strong software development skills in OOP languages. ● Good knowledge of resource constraints analysis and performing tuning. ● Good knowledge of data structures. ● Strong knowledge and experience on various RDMS, NoSQL and big data platforms including Cassandra, kafka, DynamoDB, Postgres, Prefect, Airflow etc… ● Able to follow SDLC methodologies, deliver proper documentation. ● Effective communication skills, able to communicate project status and problem effectively. ● Creative yet detail oriented, good at solving problems and deriving solutions. ● Willing to work in a dynamic environment and pick up new technologies. ● Experience leading a team of 3 or more engineers The Paidy team will ask about your user experiences with Paidy Apps during the interview. Please download the Paidy App and try it out! ● iOS: https://apps.apple.com/jp/app/paidy/id1220373112 ● Android: https://play.google.com/store/apps/details?id=com.paidy.paidy&hl=en&gl=US For those who are not able to download Paidy App, due to the regional restrictions, please be advised that you download the similar App, such as Klarna, Afterpay, Affirm and so forth, and come up with your opinions on these applications and services. |
|
What We Offer You |
|
● Diversified team with 230+ colleagues from 30+ countries ● Exciting work opportunities in a rapid-growing organization ● Cross-functional collaboration ● Hybrid remote work model - minimum 2 times in office per week (subject to change at company discretion) ● Competitive salary and benefits |
|
Paidy Values |
|
Be a winner / 勝ちにこだわる ● Always seek to beat expectations. / 期待値を超える為に常に努力する。 ● Display surprising speed and resourcefulness. / 人をスピードと機知で驚かす。 ● Overcome weaknesses by leveraging the strength and help of others to win. / 仲間の強みを活かしたり協力を得ることで、自身の弱みや足りない点を克服する。 Own it and deliver, together / 共に結果を出す ● Fully support the final decision even if at times you may disagree. / たとえ意見が対立することがあったとしても、最終決定を全面的に受け入れ支持する。 ● Acknowledge and gather the power of others, by communicating and collaborating with them. / 仲間の力を認めて活用し、積極的にコミュニケーションをとり、協力する。 ● Show a will to own actions and go the extra mile without being asked. / 行動について強いオーナーシップを持ち、言われずとも業務を遂行しきる覚悟を持つ。 Be a valuable team member / 価値を認められるメンバーになる ● Strive to play an integral role. / 替えの効かない役割を果たす。 ● Embrace and bridge differences in perspective, language, and culture. / 異なる意見・考え方、言語と文化の架け橋になる。 ● Don’t compromise - raise the bar for yourself and others. / スタンダードを上げ続けることに妥協しない。 |
Ready to apply?
Apply to Paidy Inc/Paidy合同会社
Senior Data Engineer - Databricks (m/f/*)
Share this job
Ultra Tendency is a global data and AI consultancy with teams across Europe, Asia, and the Americas. As we continue expanding our presence in Japan, we are looking for a Senior Data Engineer – Databricks to join our growing Tokyo team and contribute to the development of scalable data platforms for international clients.
In this role, you will work closely with engineers, data scientists, and architects to design and implement robust data solutions using modern cloud and data technologies.
Competitive compensation will be provided in line with the Japanese technology market, based on experience and qualifications.
YOUR RESPONSIBILITIES
- Design, implement, and maintain scalable data pipelines using the Databricks Lakehouse Platform using technologies such as Apache Spark and Delta Lake.
- Develop and optimize batch and streaming data workflows supporting analytics, machine learning, and business intelligence applications.
- Collaborate with cross-functional teams to translate business and data requirements into reliable, production-ready data solutions.
- Improve performance and cost efficiency of data processing workloads within the Databricks environment.
- Support the implementation of best practices for data quality, governance, and security.
- Contribute to knowledge sharing within the team and support the development of junior engineers.
YOUR EXPERIENCE
- Strong experience with Databricks and Apache Spark (PySpark, SQL or Scala).
- Experience building data platforms on major cloud providers (AWS, Azure, or GCP).
- Solid understanding of distributed data processing, data modeling, and performance optimization.
- Experience with CI/CD pipelines and version control tools such as Git.
- Familiarity with orchestration frameworks such as Airflow or Databricks Workflows.
- Strong communication skills in English and Japanese for collaboration in an international environment.
- A collaborative mindset and interest in building reliable, scalable data systems.
WHAT WE OFFER
- Competitive salary aligned with Japanese market standards.
- Hybrid work options, combining office and remote work (candidates must be based in Japan).
- The opportunity to collaborate with experienced colleagues in an international engineering environment.
- Exposure to large-scale data and AI projects for global organizations.
- Professional development opportunities, including certifications and continuous learning resources such as Udemy Business.
- Regular feedback cycles and structured performance reviews to support your career development.
- A collaborative culture that values knowledge sharing and long-term professional growth.
- Team events and opportunities to connect with colleagues globally.
Interested?
We would be happy to hear from you. Please apply or reach out if you would like to learn more about the role and our team in Japan.
ABOUT US
Ultra Tendency is a leading international Data Engineering consultancy specializing in Big Data, Cloud, Streaming, IIoT, and Microservices. We design, build, and operate large-scale, data-driven applications for major enterprises including the European Central Bank, HUK-Coburg, Deutsche Telekom, and Europe’s largest car manufacturer. Founded in Germany in 2010, Ultra Tendency has grown to 8 offices across 10 countries on 3 continents, serving a trusted and expanding client base.
We don’t just use technology—we create it. Our team contributes to over 20 open-source projects, including Ansible, Terraform, NiFi, and Kafka, making a visible impact on both technology and business. Enterprises choose Ultra Tendency because we solve the problems others cannot.
We thrive on challenges. Here, you’ll work on unique projects you won’t find elsewhere and become part of a knowledge-driven, supportive community—not a rigid hierarchy. Continuous learning, feedback, and collaboration drive both personal and professional growth, while maintaining a healthy work-life balance.
Ultra Tendency evaluates applications based on skills and business fit. We welcome candidates from all backgrounds, regardless of race, ethnicity, national or social origin, disability, sex, sexual orientation, or age.
Data privacy statement: Data Protection for Applicants – Ultra Tendency
Ready to apply?
Apply to Ultra Tendency
Risk Portfolio Insights Expert
Share this job
|
About Paidy Inc. |
|
Paidy is Japan's pioneer and leading BNPL service company. At Paidy, we believe in creating simple, instant experiences to take the hassle out of shopping with a touch of magic. Paidy offers instant, monthly-consolidated credit to consumers by removing hassles from payment and purchase experiences. Paidy uses proprietary models and machine learning to underwrite transactions in seconds and guarantee payments to merchants. Paidy increases revenue for merchants by reducing the number of incomplete transactions, increasing conversion rates, boosting average order values, and facilitating repeat purchases from consumers. Paidy has reached an agreement to join PayPal, the global payments company. Paidy will continue to operate its existing business, maintain its brand and support a wide variety of consumer wallets and marketplaces by providing convenient and innovative services. Paidy continues to innovate to make shopping easier and more fun both online and offline. For more information, please visit http://www.paidy.com. |
|
About Position |
|
At the heart of Paidy’s real-time underwriting is our Credit Risk Department —a cross-functional team of data scientists and analysts building cutting-edge risk models and strategies. Our mission is to calibrate Paidy’s risk frameworks against our corporate vision, ensuring we navigate the optimal balance between risk-taking and sustainable profitability. We are looking for a data-driven expert to take ownership of our Credit Risk Business Intelligence. You will be responsible for engineering the data marts and reporting layers that track customer credit lifecycles, fraud patterns, and debt recovery. Your work will provide the foundational insights required to iterate on our models and drive "step-change" improvements in how we manage risk and product growth. |
|
Key Role and Responsibilities |
|
|
Skills and Requirements |
The Paidy team will ask about your user experiences with Paidy Apps during the interview. Please download the Paidy App and try it out!
For those who are not able to download the Paidy App, due to the regional restrictions, please be advised that you download the similar App, such as Klarna, Afterpay, Affirm and so forth, and come up with your opinions on these applications and services. Please note that you must be eligible to work in Japan. |
|
What We Offer You |
|
|
Paidy Values |
|
Be a winner / 勝ちにこだわる
Own and deliver, together / 共に結果を出す
Be a valued team member / 価値を認められるメンバーになる
|
Ready to apply?
Apply to Paidy Inc/Paidy合同会社
Machine Learning Engineer Lead, Vulcan (Global)
Share this job
About the role
We are seeking an experienced Machine Learning Lead to helm our Machine Learning team.
In this pivotal role, you will be the engineering architect behind Vulcan’s core AI capabilities. You will act as the nexus between Research, Platform, and Product. Your mission is to translate cutting-edge findings on GenAI threats into robust, production-ready machine learning models that power our GenAI Security Guardrails (Blue Team) and Automated Vulnerability Assessment (Red Team).
Crucially, you will serve as the bridge between deep tech and business strategy, articulating technical constraints (like FLOPS and latency) to leadership and clients while guiding the engineering direction.
Key Responsibilities
1. Model Development & Optimization (Training & Fine-tuning):
- Research to Production: Collaborate with the Security Research Team to operationalize new threat detection techniques. They identify the "what" (e.g., new prompt injection patterns); you determine the "how" (model architecture, training strategy).
- Fine-tuning & Adaptation: Lead the fine-tuning of Language Models (e.g., using LoRA/PEFT) to optimize for our supported muti-lingual languages and specific security intents.
- Multimodal Readiness: Prepare the system for Multimodal (Text + Image/Audio) capabilities. Evaluate and implement models to detect visual prompt injections and non-textual threats as the product evolves.
2. MLOps& Data Infrastructure:
- Enhance & Scale MLOps: Take ownership of our existing ML pipelines. Focus on optimizing and scaling CI/CD/CT workflows to improve training efficiency and deployment velocity.
- Data Governance: Implement and enforce rigorous Data Versioning strategies (e.g., DVC) to ensure complete reproducibility of model artifacts and datasets.
- Monitoring & Reliability: Maintain rigorous monitoring for model drift and performance, ensuring high reliability in a production security environment.
3. Cross-Functional Implementation & Leadership:
- Platform Collaboration: Work closely with the Platform Engineering Team to integrate ML models into the broader product architecture. Ensure seamless interaction between model inference services and the main platform logic.
- Team Leadership: Lead and mentor Machine Learning Engineers, fostering a culture of engineering rigor, code quality, and operational excellence.
- Resource Management: Manage GPU resources and compute budgets effectively for both training and inference workloads.
4. Technical Strategy & Stakeholder Management:
- Translating Tech to Business: Act as the technical voice of the ML team. You must effectively explain complex ML concepts (e.g., FLOPS, quantization trade-offs, model latency vs. accuracy) to executive leadership and clients.
- Cost-Benefit Analysis: Justify compute resource investments. Articulate the trade-off between infrastructure costs (GPU hours) and performance gains to non-technical stakeholders.
Qualifications
- Experience: 5+ years in Machine Learning Engineering, with specific experience in leading technical projects or mentoring engineers.
- Communication & Business Acumen: Exceptional ability to distill complex technical topics (e.g., compute complexity, infrastructure costs) into clear, business-relevant insights for decision-makers.
- MLOps Proficiency: Proven experience in optimizing ML pipelines and infrastructure. Familiarity with tools like MLflow, Kubeflow, Airflow, and Data Versioning tools (DVC, etc.).
- Engineering First: Proficient in Python, Docker, and Kubernetes. You treat ML models as software artifacts that need testing and version control.
- NLP & LLM Expertise: Experience with Transformer architectures, Embeddings, and LLM fine-tuning. Familiarity with frameworks like PyTorch, Hugging Face, and vLLM.
- Language Support: Experience processing or fine-tuning models for multi-lingual environments.
Nice to Have
- Multimodal Expertise: Experience working with Multimodal models (Image-to-Text, Text-to-Image, VLMs like CLIP, LLaVA).
- Security Awareness: Understanding of GenAI security threats (e.g., Prompt Injection).
- High-Performance Computing: Experience optimizing inference speed (quantization, distillation, vLLM) for real-time applications.
- Vector Database: Experience with Vector DBs for RAG applications.
Why Join Us?
- Innovative Environment: Be part of a company at the forefront of technology to provide security in GenAI, with opportunities to work on groundbreaking projects.
- Growth Opportunities: Take your career to new heights with our career development programs and growth-focused culture.
- Dynamic Team: Join a multi-cultural and dynamic team of dedicated professionals who inspire and support each other.
- Compensation: Competitive salary and benefits package, commensurate with experience and performance.
Application Process
- If you're ready to embark on this exciting journey and contribute to shaping the future of GenAI security, please submit your resume outlining your relevant experience and motivation for applying.
- If you prefer a direct connection or have specific questions about our vision, feel free to reach out to our Co-founder, Alvin Kwock, via LinkedIn.
Ready to apply?
Apply to AIFT
About Appier
Appier is a software-as-a-service (SaaS) company that uses artificial intelligence (AI) to power business decision-making. Founded in 2012 with a vision of democratizing AI, Appier’s mission is turning AI into ROI by making software intelligent. Appier now has 17 offices across APAC, Europe and U.S., and is listed on the Tokyo Stock Exchange (Ticker number: 4180). Visit www.appier.com for more information.
About the role
Appier’s solutions are powered by proprietary deep learning and machine learning technologies to empower every business to use AI to turn data into business insights and decisions. As a Software Engineer, Data Backend, you will be involved in helping to build critical components of this platform.
Responsibilities
- Design, develop, and maintain RESTful APIs using Python.
- Build and manage robust data warehouses utilizing Trino/Presto and Pinot.
- Design and develop data pipelines using Apache Airflow and Apache Spark.
- Work closely with cross-functional teams to develop automation tools that streamline daily operations.
- Implement state-of-the-art monitoring and alerting systems to ensure optimal system performance and stability.
- Address queries from applications in a timely and effective manner, ensuring high client satisfaction.
- Work on cloud platforms such as AWS and GCP, leveraging their capabilities to optimize data operations.
- Utilize Kubernetes (k8s) for container orchestration to facilitate efficient deployment and scaling of applications.
About you
[Minimum qualifications]
- BS/MS degree in Computer Science
- 3+ years of experience in building and operating large-scale distributed systems or applications
- Experience in Kubernetes development, Linux/Unix
- Experience in managing data lake or data warehouse
- Expertise in developing data structures, algorithms on top of Big Data platforms
- Ability to operate effectively and independently in a dynamic, fluid environment
- Ability to work in a fast-moving team environment and juggle many tasks and projects
- Eagerness to change the world in a huge way by being a self-motivated learner and builder
[Preferred qualifications]
- Contributing to open source projects is a huge plus (please include your github link)
- Experience working with Python, Scala/Java is a plus
- Experience with Hadoop, Hive, Flink, Presto/Trino and related big data systems is a plus
- Experience with Public Cloud like AWS or GCP is a plus
#LI-AK1
Ready to apply?
Apply to Appier