PayPay’s growth is driving a rapid expansion of PayPay product teams and the need for a robust Data Engineering Platform to support our growing business needs is more critical than ever. We are looking for a Data Engineer for the Data Insights department. The Data Insights department's mission is to drive product improvements by engineering systems founded on a scientific understanding of user and merchant behavior.
Main Responsibilities
- Design, develop, and maintain scalable data ingestion pipelines using AWS Glue, Step Functions, Lambda, and Terraform
- Design, build, and maintain infrastructure to continuously support the improvement and deployment of ML models
- Optimize and manage large scale data pipelines to ensure high performance, reliability, and efficiency
- Implement data processing workflows using Hudi, Delta Lake, Spark, and Scala
- Maintain and enhance Lakeformation and Glue Data Catalog for effective data management and discovery
- Collaborate with cross-functional teams to ensure seamless data flow and integration across the organization
- Implement best practices for observability, data governance, security, and compliance
Qualifications
- 5+ years experience as a Data Engineer or in a similar role
- Some familiarity with building machine learning systems, or data infrastructures supporting machine learning development and deployment is preferable
- Hands-on experience with Apache Hudi, Delta Lake, Spark, and Scala
- Experience designing, building, and operating a DataLake or Data Warehouse
- Knowledge of Data Orchestration tools such as Airflow, Dagster, Prefect
- Strong expertise in AWS services, including Glue, Step Functions, Lambda, and EMR
- Familiarity with change data capture tools like Canal, Debezium, and Maxwell
- Experience with data warehousing tools like AWS Athena, BigQuery, Databricks
- Proficiency in Python and SQL (any variant), preferably experience in Scala and/or Java
- Experience with data cataloging and metadata management using AWS Glue Data Catalog, Lakeformation, or Unity Catalog
- Proficiency in Terraform for infrastructure as code (IaC)
- Overall understanding of machine learning technologies and deep learning concepts
- Strong problem-solving skills and ability to troubleshoot complex data issues
- Excellent communication and collaboration skills
- Ability to work in a fast-paced, dynamic environment and manage multiple tasks simultaneously
About PayPay
PayPay, a FinTech company that has achieved more than 69M users (as of May 2025) within around six years since its launch in 2018, is rapidly expanding its business scale as a payment platform used by approximately one out of every two smartphone users in Japan.
The company has a diverse team of professionals from more than 50 countries and is building a world-class engineering organization.
PayPay's biggest competitor is "cash". They are seeking people who can accept this challenge positively, brush up on the product at a tremendous speed that other companies could never achieve, and who are passionate about promoting and spreading such a financial life platform in a short time along with professionalism.
Get Job Alerts
Sign up for our newsletter to get hand-picked tech jobs in Japan – straight to your inbox.