Senior Data Platform Engineer

Background

estie has built one of the largest office real estate data bases in Japan, and is developing and operating multiple products based on this data.

We are building an in-house data management infrastructure to enable multiple product teams to collect, process, and store data at high quality and high speed, and to create an environment in which the data built by other products can be used securely.

To build and continuously improve these infrastructures, we are looking for a data analysis infrastructure engineer to build a high-level infrastructure based on their knowledge and experience in data engineering.

Responsibilities

The following tasks will be divided among the team members. 
The team may be assigned to work on a specific area as the primary responsibility, or to work on a wide range of tasks across the entire region. 
The assignment will be adjusted in consideration of experience and preferences.

• Build and continuously improve data management infrastructure that meets the following
  
  • Enables each development team to quickly collect, process, and verify the quality of various types of data centered on real estate
  • Able to realize analysis by many employees based on user activity logs and real estate data accumulated in the company.
  • Environment: Snowflake, dbt, Fivetran, BI based infrastructure
• Design and operation of security and governance of data management infrastructure
• Create a mechanism for employees (CS, product managers, software engineers) who want to do analysis and software engineers who 　want to build data pipelines for products to do what they want to do safely and without hurdles
• Build and operate a company-wide KPI dashboard using BI tools.
  
  

Requirements

• Experience in system development using cloud services
• Experience in one or more of the following
  
  • Experience in building and operating data infrastructure using languages such as -SQL and Python
  • Experience in building and operating infrastructure such as web systems and batch systems
    
    

Preferred Skills

• Experience in data manipulation using advanced SQL
• Experience in security and governance design and operation of data infrastructure and infrastructure
• Knowledge of IaC such as Terraform and practical experience in its operation
• Knowledge of AWS and practical experience in development
• Knowledge of Snowflake and practical experience in its development
• Knowledge of RDBMS, table design, database tuning experience
• Experience in using and selecting BI tools such as Tableau and Looker
• Experience using and building data processing tools such as dbt