Cloud Platform Engineer (Kafka Specialist)

  • Remote OK - Anywhere in Japan
  • Full-time
  • February 18, 2026
Conditions
location-icon
Apply from Anywhere 👍
visa-icon
Relocation to Japan 👍
(Overseas visa sponsorship supported)
Requirements
language-icon
Language Requirements
Japanese: Not Required 👍
English: Business Level
career-icon
Minimum Experience
Mid-level or above

We are looking for someone who is not only hands-on with Kafka internals, but also confident operating it at scale in production environments that is processing millions of payments daily for 70M+ users.

At the core of our architecture is Apache Kafka. As we continue to scale, we’re:
- Migrating our self-hosted Kafka clusters to KRaft mode
- Operating Kafka across both self-managed environments and AWS MSK
- Strengthening reliability, security, and observability
- Driving deeper adoption of a truly event-driven architecture

Main Responsibilities

  • Tech leadership, architecture, development, and operations for Apache Kafka, including both self-hosted clusters and AWS MSK
  • Ensure deployment, management, and smooth operation of highly available Kafka infrastructure
  • Monitoring and alerting of Kafka for reliability, throughput, and latency
  • Performance tuning and instrumentation of Kafka clusters and pipelines
  • Partner with application teams to guide Kafka topic design, schema management, and best practices
  • Contribute to the development of scalable, secure, and observable data pipelines
  • Automate infrastructure and operations workflows using infrastructure-as-code tools

Tech Stack

  • Java, Python, Go
  • Kafka, Elasticsearch/Opensearch, AWS MSK, Athena, Glue
  • Docker, Kubernetes, ArgoCD, Argo rollouts, Argo workflows, Artifactory, AWS, GCP
  • GitHub, GitHub Actions, Jenkins, Terraform, Ansible, Microservices, GitOps
  • Logstash, Fluent-bit, Vector, Victoria Metrics, Grafana, Prometheus
  • Slack, Zoom, Confluence, JIRA

Qualifications

  • Minimum of 3 years of engineering experience with Apache Kafka in production environments
  • Minimum of 3 years of experience in AWS, Terraform, Ansible and Linux Administration
  • Strong hands-on experience with Kafka cluster operations, including setup, tuning, and maintenance
  • Experience with Kafka authentication and authorization operations
  • Familiarity with AWS cloud platform, especially Amazon MSK (Managed Streaming for Kafka)
  • We heavily rely on AWS, so those without previous AWS experiences must expect to catch up with it after joining us
  • Proficiency in one or more general-purpose programming languages (e.g., Python, Java, Go)
  • Experience with infrastructure automation and configuration management tools, such as Terraform or Ansible
  • Understanding of modern system design using microservice architecture
  • Working knowledge of Git and CI/CD tools

Preferred Qualifications

  • Deep expertise in running and scaling Apache Kafka both self-hosted and in managed cloud environments (e.g., AWS MSK)
  • Experience migrating or operating Kafka in KRaft mode (no ZooKeeper)
  • Experience in data replicate between Kafka clusters, enabling seamless data migration, disaster recovery, and cross-region data synchronization
  • Exposure to Kafka security, including ACLs, TLS, SASL, and IAM-based auth on MSK
  • Deep expertise in Kafka internals, including broker tuning, partitioning, replication, and fault tolerance
  • Contributions to Kafka-related open source projects or community involvement
  • Experience with Kafka Connect, Kafka Streams, or other stream processing frameworks
  • Experience guiding cross-team adoption of Kafka in microservice architectures
  • Experience in operating distributed systems
  • Working experience in a full remote environment
  • Bachelor’s or Master’s Degree in Computer Science or a related field

PayPay, a FinTech company that has achieved more than 69M users (as of May 2025) within around six years since its launch in 2018, is rapidly expanding its business scale as a payment platform used by approximately one out of every two smartphone users in Japan.

The company has a diverse team of professionals from more than 50 countries and is building a world-class engineering organization.

PayPay's biggest competitor is "cash". They are seeking people who can accept this challenge positively, brush up on the product at a tremendous speed that other companies could never achieve, and who are passionate about promoting and spreading such a financial life platform in a short time along with professionalism.

View PayPay's company page

↑ Back to top ↑

Cloud Platform Engineer (Kafka Specialist) at PayPay
APPLY NOW  ➜