Overview
| Global Market for QA
Markets are changing rapidly, and there is a demand for quick software releases. Agile development has become mainstream; on a global scale, 92% of developer teams adopt agile development, 71% of which aim to release at least once a week. With such a rapid cycle, manual verification is too time-consuming, and there is an urgent need for automation. Our services can solve these critical challenges and make our clients a competitive advantage in software development. QA’s global budget is said to reach over $1 trillion. We are rapidly expanding our service reach internationally to win this vast global market.
| About Us
Autify, Inc. is a start-up company founded in San Francisco by a team of engineers who were the first Japanese team to graduate from the top US accelerator, Alchemist Accelerator. With the mission to increase creativity with the power of tech, we develop and provide Autify, an AI-powered software testing automation platform.
In October 2019, we… officially released Autify for Web, our test automation software that targets web applications. Also, in October 2021, Autify for Mobile for mobile app testing was officially launched, and we closed our $10M Series A. Although the product lineup is continuing to expand, and we have been able to provide all basic functions needed in a test automation platform, we continue to receive requests for new features and improvements.
| About This Role
Job Purpose
Since its official release in October 2019, Autify has been implemented by numerous clients, and our client base is continuing to grow. While we provide all the essential functions required in a test automation platform, we continue to receive requests for new functions and improvements. Autify is working on growing the product further by adding new features. Also, we are looking for opportunities beyond the existing Autify services. To expand our product lineup, we are looking for a senior machine learning engineer who mainly focuses on prompt engineering to join our team that works for new services.
You will mainly be responsible for developing a new product utilizing machine learning techniques and generative AI from a proof of concept into a releasable product.
Responsibilities
• Create effective prompts to maximize the quality of the output from LLMs based on the product specifications
• Build our machine learning models using data relevant to the software testing if needed
• Work with other engineers, designers, and product leads to implement various features while considering performance, security, and reliability
• Create PoC Web/CLI applications that use LLMs or ML under the hood to validate the feasibility of ideas
• Proactively identify functions that can be improved, and suggest possible solutions in the technical aspects and product-related ideas
• Participate in on-call rotations for incident & alert handling
Required Qualifications
• Being able to work in Japan standard time (Working partially in JST can be discussed)
• Over two years of experience in training and customizing deep learning models, especially LLMs
• Over a year of experience in prompting open-source and closed-source LLMs
• Experience in developing APIs with FastAPI and Python
• Up to date with the latest Machine Learning Research especially on LLMs and Prompt Engineering
• Experience in building metrics for evaluating various tasks LLMs
• Ability to communicate and work in English
Nice-to-Have
• Knowledge of natural language processing and visual recognition
• Proficient in the process of analyzing, hypothesizing, and testing
• Experience in MLOps
• Modern development experience with Agile or Scrum
• Experience in E2E test automation with Selenium and Appium
¥8,000,000 – ¥10,000,000 a year
Reviewed twice a year
Selection Process
1. Submission of online coding test (take-home)
2. Submission of technical assignment (take-home)
3. Technical interview & HR interview: 90 mins
4. Final interview: 60 mins
Note:
– We will request to provide references after the final interview.
– The interview steps might change depending on the hiring status in our pipeline.
– We can arrange casual interviews before the coding test upon the candidate’s request. (Subject to availability of both parties)
| About the Engineering Team
Our Team
Autify’s engineering team is international, with more than half of the engineers being foreign nationals and all developers being English speakers. We have a good culture where members respect each other’s backgrounds. Since we have two products, Autify for Web and Autify for Mobile, our development engineers are divided into two teams corresponding to each product. We have about 30 front-end, back-end, and technical support engineers who work closely with engineering managers, product managers, QA managers, designers, and machine learning engineers. The product manager is in charge of the general roadmap. The product manager develops a rough roadmap and works with the engineers and designers on the details of each feature and bug fixes before implementation. Depending on the size of the feature, we appoint a feature lead from among the engineers to be in charge of the project and give them the discretion to make technical decisions.
Our Development Process
We create a ticket about what kind of function we will develop. In some cases, the product owner creates it based on user feedback; in other cases, each team creates bugs and investigation requests directly.
The development cycle consists of one Sprint, which takes two weeks. Development tasks are assigned during the planning stage on the first day of the Sprint, and we hold a daily standup meeting to check the overall progress and any problems. (If there is a time difference, it is done at lunchtime).
We review code on GitHub. After the review, the merged branches are automatically deployed to the staging environment, and E2E tests are performed (which Autify does itself).
After testing on the integrated branch, it’s deployed to the production environment. Deployment is done several times a week as needed. We also hold sprint ceremonies like Sprint planning, feature refinement and sprint retrospective sessions. The developer will demonstrate the developed function to all employees at the end of the Sprint in the Sprint Demo.
Tech Stack
– Backend: Ruby, Ruby on Rails, Go
– Frontend: JavaScript, TypeScript, React, Redux, Styled Components
– Machine learning: Python, PyTorch, Kubernetes, GPT-4
– Database: PostgreSQL, Redis
– Test: Appium, Selenium, WebdriverIO, Puppeteer
– Infrastructure: AWS, Docker, Terraform, Packer, MacStadium, GoogleCloud
– Monitoring: Datadog, New Relic, Sentry
– CI/CD: CircleCI, GitHub Actions
– Source code management: GitHub
– Project management: Jira
– Misc.: G Suite, Slack, Notion, Gather, Zoom, Miro, 1Password, Mixmax, Calendly, etc.
| Employment Conditions
Employment Status
– Regular employees
– Probation period: 3 months after joining the company (conditions are the same as permanent employment)
Work Location
– Tokyo office or Remote (Hybrid)
Work Hours
– Full flextime system
Note: The determination of working hours (start and end times) must be made to the extent that one’s own duties (including guidance and supervision of subordinates) are properly performed and that there are no obstacles to work in terms of coordination and communication with other employees.
Bonus
– Twice a year
Holidays/PTO
– Complete a five-day workweek system (National holidays, year-end and New Year holidays, etc.)
– Unlimited paid time off
Benefits
– Equipped with various social insurance
– Regular health checkups
– Stock option
– A laptop PC will be rented when joining the company
– Remote work allowance
– English learning support
– Skill-up support
– Visa sponsorship
– Relocation bonus
– Relocation housing support
| Resources
– Company Deck
https://speakerdeck.com/autifyhq/autify-company-deck-efd29263-1045-43c2-b2a0-17328638b0fe
– Autify CEO’s Blog
https://chikathreesix.com/
– Autify Blog
https://autify.com/blogs/
– Autify Podcast
https://podcasters.spotify.com/pod/show/autifyhq
Company:
Autify, Inc.
Qualifications:
Language requirements:
Specific requirements:
Educational level:
Level of experience (years):
Senior (5+ years of experience)
How to apply:
Please mention NLP People as a source when applying
https://jobs.lever.co/Autify/7e93efb0-0089-4a5d-b8fe-1f6fb99f8a6e?utm_campaign=nlppeople&utm_source=nlppeople&utm_medium=organic
