Data Engineer, DaaS

Remote OK - Anywhere in Japan
Full-time
October 22, 2024

PayPay's growth is driving a rapid expansion of PayPay product teams and the need for a robust Data Engineering Platform to support our growing business needs is more critical than ever. We are looking for a Data Engineer for the DaaS team. The DaaS team’s responsibility is to design, implement, and operate this platform by using cutting edge technologies such as Spark, Hudi, Delta Lake, Scala, and AWS suite of data tools. We are looking for talented Data Engineers to join our team and help us scale our platform across the organizations.

Main Responsibilities

Design, develop, and maintain scalable data ingestion pipelines using AWS Glue, Step Functions, Lambda, and Terraform
Optimize and manage large scale data pipelines to ensure high performance, reliability, and efficiency
Implement data processing workflows using Hudi, Delta Lake, Spark, and Scala
Maintain and enhance Lakeformation and Glue Data Catalog for effective data management and discovery
Collaborate with cross-functional teams to ensure seamless data flow and integration across the organization
Implement best practices for observability, data governance, security, and compliance

Qualifications

5+ years experience as a Data Engineer or in a similar role
Hands-on experience with Apache Hudi, Delta Lake, Spark, and Scala
Experience designing, building, and operating a DataLake or Data Warehouse
Knowledge of Data Orchestration tools such as Airflow, Dagster, Prefect
Strong expertise in AWS services, including Glue, Step Functions, Lambda, and EMR
Familiarity with change data capture tools like Canal, Debezium, and Maxwell
Experience with data warehousing tools like AWS Athena, BigQuery, Databricks
Experience in at least one primary language (e.g. Scala, Python, Java) and SQL (any variant)
Experience with data cataloging and metadata management using AWS Glue Data Catalog, Lakeformation, or Unity Catalog
Proficiency in Terraform for infrastructure as code (IaC)
Strong problem-solving skills and ability to troubleshoot complex data issues
Excellent communication and collaboration skills
Ability to work in a fast-paced, dynamic environment and manage multiple tasks simultaneously

APPLY NOW ➜

About PayPay

2018年にサービスを開始してからわずか2年4か月でユーザー数3600万人を突破したフィンテック企業であるPayPayは現在35か国以上の国から集まった多様なメンバーで構成されています。従業員は1000名をすでに超えていますが、まだまだ会社は成長段階であり「未完成」です。「PayPay」の提供に当たっては、インド最大の決済サービス事業者であるPaytm社と連携し、同社の顧客本位のテクノロジーを活用して日本におけるスマホ決済を構築しサービスを拡大していきます。

わたしたちの最大のライバルは“現金”です。この困難な課題に前向きに取り組み、他社に真似できない圧倒的なスピードでプロダクトを磨き上げ、日本のキャッシュレス決済、またそれを使用した金融ライフプラットフォームとしての普及を一気に推進することにプロフェッショナルとして情熱を持って取り組み、自ら課題発見し、周囲と協力して新しい価値創出を共に推進する仲間を募集します。

また、働き方に関してもWFA（Working From Anywhere)制度など、新しい人事制度を採り入れてます。当社は基本的にフルリモートでの勤務となる為、勤務場所や現在の居住地は問いません。地方に暮らしながらも国際都市水準の給料・福利厚生を得ながら、世界レベルの仲間と仕事をする。そんな働き方もPayPayでは実現できます。

【言語要件】日本語 / 英語どちらかが流暢（ビジネスレベル以上）であれば応募いただけます！

Japanese Language Policy
At PayPay, there is a mixture of Japanese and English spoken. Around 80% of their product team’s discussions happen in English, and they have technical interpreters and translators on staff to facilitate any translation necessary. Some members can speak both English and Japanese, but some can only speak either English or Japanese.

PayPay doesn’t have an official shared language, but in practice English tends to be the primary language used for internal communications and technical discussions like code reviews.

Instead of requiring that everyone be able to speak a specific language, PayPay expects an ability to communicate with mutual respect and a drive to ensure that you’re understood. The product team values proactive communication highly.
Visa Sponsorship
PayPay sponsors visas for applicants from overseas.
Paid Leave
- Days Off: Saturdays and Sundays. National holidays. Year-end holidays from December 29th to January 4th.
- Holidays: Annual paid leave, congratulatory or condolence leave, maternity leave and etc.
Benefits
🌎 Translation/interpretation support (EN<>JP)

🧡 Support for translation or other administrative tasks in Japanese

👍 Support from bilingual PIC for engineers

🇯🇵 Free Japanese lessons on company time

🏠 Work from home allowance (100,000JPY/year)

💻 PC and phone are given (based on the company’s regulations)

👩‍🎓 Training Program: We have various training programs for different kinds of needs

💜 Social security/insurance benefits included

💛 Defined contribution pension system (TBC)

🏥 Health insurance

🚃 Transportation coverage (up to ¥150,000/mo)
Engineer Interview Process
PayPay's Hiring process are as below:
- Application Review (English CV is required)
- Coding Test or Take Home Assignment (only applied to required positions)
- 3-4 Interviews (including both technical and behavioral interviews)
- Offer Meeting
Remote Work
PayPay had introduced a new personnel system called WFA (Working From Anywhere*). At PayPay, we work fully remotely in Japan. Therefore, the working place or your living place doesn't matter. Even if you are living in a local area, the salary and benefit package will be at an international level while you enjoy working with world class colleagues.

*This WFA policy is applicable only within Japan.
Work style
- Super Flex Time with no core time
- In principle, from 10:00am-6:45pm (actual working hours: 7h45m + 1h break)