Engineering Manager, Data Platform

Job Mission

SmartNews is a leading mobile app of news aggregation services. It analyzes millions of articles to deliver the most engaging information with high quality in near-real-time fashion to millions of users around the world. Our Data Solution team is crucial for achieving SmartNew’s vision of delivering high-quality content through personalized discovery.

The team missions are the following:

1. Leading data platform engineering Tokyo team to build state-of-the-art big data analytic framework, as well as supporting toolings such as quality monitoring.
2. Construct core company data sets and key ETL pipelines. Scale solutions and infrastructure as the company grows
3. Provide data engineering service to other teams to achieve business goals
4. Build toolings for other teams to use the SmartNews data platform efficiently, and ensure data quality.

Responsibilities

1. Lead and build a strong Data Platform engineering team. Motivate engineers and establish strong engineering practice to ensure speedy and quality outputs.
2. Worked with other DP geo teams to construct ultra-low latency, scalable stream and batch data processing framework, query engine, OLAP BI based on latest open source technologies, such as Kafka, Flink, Spark, Hive, Presto/Clickhouse/Pinot/Druid etc.
3. Partner with internal technology and business leaders to identify, develop optimal data processing architecture
4. Build toolings to improve the efficiency of users who operate on data platforms. Manage production systems to maintain high SLAs
5. Develop strong ownership of core company data sets and improve data quality & reliability
6. Define data strategies with business leaders and other stakeholders
7. Together with data science, machine learning teams to provide data solutions leveraging in-house data platforms
8. Work across the teams/organizations to align with company/division objectives and drive through key initiatives.

Requirements

1. 5+ years of experience with engineering and big data platforms. Well versed in programming in one of following languages: Java/Scala, Python, Go, C/C++
2. In depth knowledge of 2+ big data toolsets, such as Hive, Hadoop/HDFS, Spark/Flink, Airflow, Presto, Kafka, Druid/Clickhouse etc.
3. Hands-on coding experience, being able to develop platform/solutions and perform code reviews when necessary. Demonstrated capability in SQL, data modeling, ETL development, and data warehousing.
4. 1+ years of experience managing engineering or data platform teams, capable of mentoring/growing engineers, and ensuring data engineering best practices
5. Penchant for technical know hows and demonstrated capability in building start-of-art technical infrastructure that fits SmartNews use cases and growth trajectory
6. The ability to effectively communicate with both business and technical teams to design data schema/semantics and deliver data solutions for business impact
7. Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field