Senior Machine Learning Engineer, LLMs & Prompt Engineering (New project)

  • Remote OK - Anywhere in Japan
  • Full-time
  • February 22, 2024
8,000,000 - 10,000,000 JPY /yr
Apply from Anywhere 👍
Relocation to Japan 👍
(Overseas visa sponsorship supported)
Language Requirements
Japanese: Not Required 👍
English: Business Level
Minimum Experience
Junior or above

Why we are hiring

Since its official release in October 2019, Autify has been implemented by numerous clients, and our client base is continuing to grow. While we provide all the essential functions required in a test automation platform, we continue to receive requests for new functions and improvements. Autify is working on growing the product further by adding new features. Also, we are looking for opportunities beyond the existing Autify services. To expand our product lineup, we are looking for a senior machine learning engineer who mainly focuses on prompt engineering to join our team that works for new services.

You will mainly be responsible for developing a new product utilizing machine learning techniques and generative AI from a proof of concept into a releasable product.



  • Create effective prompts to maximize the quality of the output from LLMs based on the product specifications.
  • Build our machine learning models using data relevant to the software testing if needed.
  • Work with other engineers, designers, and product leads to implement various features while considering performance, security, and reliability.
  • Create PoC Web/CLI applications that use LLMs or ML under the hood to validate the feasibility of ideas.
  • Proactively identify functions that can be improved, and suggest possible solutions in the technical aspects and product-related ideas.
  • Participate in on-call rotations for incident & alert handling



  • Being able to work in Japan standard time (Working partially in JST can be discussed)
  • Over two years of experience in training and customizing deep learning models, especially LLMs.
  • Over a year of experience in prompting open-source and closed-source LLMs.
  • Experience in developing APIs with FastAPI and Python.
  • Up to date with the latest Machine Learning Research especially on LLMs and Prompt Engineering.
  • Experience in building metrics for evaluating various tasks LLMs.
  • Ability to communicate and work in English



  • Knowledge of natural language processing and visual recognition
  • Proficient in the process of analyzing, hypothesizing, and testing
  • Experience in MLOps
  • Modern development experience with Agile or Scrum.
  • Experience in E2E test automation with Selenium and Appium

Autify, Inc. is a start-up company founded in San Francisco by a team of engineers who were the first Japanese team to graduate from the top US accelerator Alchemist Accelerator. With the mission to increase creativity with the power of tech, we develop and provide Autify, an AI-based software test automation platform.

Markets are changing rapidly, and there is a demand for quick software releases. Agile development has become mainstream; on a global scale, 92% of developer teams adopt agile development, 71% of which aim to release at least once a week. With such a rapid cycle, manual verification is too time-consuming, and there is an urgent need for automation. Our services can solve these critical challenges and make our clients a competitive advantage in software development.

Over 300 companies have begun using their service since its official release in October 2019, and that number is continuing to grow.

QA’s global budget is said to reach over $1 trillion. We are rapidly expanding our service reach internationally to win this vast global market.

Autify’s policies during COVID-19 are as follows:

  • They’ve adopted a policy of working fully remotely (previously they allowed one day a week of remote work)

  • They no longer have a physical Japan office (previously they had one in Tokyo)

View Autify's company page

Search jobs from Autify in Japan
Senior Machine Learning Engineer, LLMs & Prom... at Autify