Data Engineer, Data Insights

  • Remote OK - Anywhere in Japan
  • Full-time
  • May 22, 2025
Conditions
location-icon
Apply from Anywhere 👍
visa-icon
Relocation to Japan 👍
(Overseas visa sponsorship supported)
Requirements
language-icon
Language Requirements
Japanese: Not Required 👍
English: Business Level
career-icon
Minimum Experience
Senior or above

PayPay’s growth is driving a rapid expansion of PayPay product teams and the need for a robust Data Engineering Platform to support our growing business needs is more critical than ever. We are looking for a Data Engineer for the Data Insights department. The Data Insights department's mission is to drive product improvements by engineering systems founded on a scientific understanding of user and merchant behavior.

 

Main Responsibilities

  • Design, develop, and maintain scalable data ingestion pipelines using AWS Glue, Step Functions, Lambda, and Terraform
  • Design, build, and maintain infrastructure to continuously support the improvement and deployment of ML models
  • Optimize and manage large scale data pipelines to ensure high performance, reliability, and efficiency
  • Implement data processing workflows using Hudi, Delta Lake, Spark, and Scala
  • Maintain and enhance Lakeformation and Glue Data Catalog for effective data management and discovery
  • Collaborate with cross-functional teams to ensure seamless data flow and integration across the organization
  • Implement best practices for observability, data governance, security, and compliance

 

Qualifications

  • 5+ years experience as a Data Engineer or in a similar role
  • Some familiarity with building machine learning systems, or data infrastructures supporting machine learning development and deployment is preferable
  • Hands-on experience with Apache Hudi, Delta Lake, Spark, and Scala
  • Experience designing, building, and operating a DataLake or Data Warehouse
  • Knowledge of Data Orchestration tools such as Airflow, Dagster, Prefect
  • Strong expertise in AWS services, including Glue, Step Functions, Lambda, and EMR
  • Familiarity with change data capture tools like Canal, Debezium, and Maxwell
  • Experience with data warehousing tools like AWS Athena, BigQuery, Databricks
  • Proficiency in Python and SQL (any variant), preferably experience in Scala and/or Java
  • Experience with data cataloging and metadata management using AWS Glue Data Catalog, Lakeformation, or Unity Catalog
  • Proficiency in Terraform for infrastructure as code (IaC)
  • Overall understanding of machine learning technologies and deep learning concepts
  • Strong problem-solving skills and ability to troubleshoot complex data issues
  • Excellent communication and collaboration skills
  • Ability to work in a fast-paced, dynamic environment and manage multiple tasks simultaneously

PayPay, a FinTech company that has achieved more than 69M users (as of May 2025) within around six years since its launch in 2018, is rapidly expanding its business scale as a payment platform used by approximately one out of every two smartphone users in Japan.

The company has a diverse team of professionals from more than 50 countries and is building a world-class engineering organization.

PayPay's biggest competitor is "cash". They are seeking people who can accept this challenge positively, brush up on the product at a tremendous speed that other companies could never achieve, and who are passionate about promoting and spreading such a financial life platform in a short time along with professionalism.

View PayPay's company page

↑ Back to top ↑

Data Engineer, Data Insights at PayPay
APPLY NOW  ➜