ARMAbout this role
Job Overview:We have a phenomenal opportunity to help shape the future of Machine Learning and Artificial Intelligence on Arm platforms. Arm technology is used wherever computing matters. Are you passionate about ML systems and keen to influence how generative AI and other machine-learning workloads run efficiently on next-generation hardware?
Then we should talk!
We are growing our ML framework integrations team and seek dedicated and motivated engineers to join us. You will work with teams across Arm and with leading technology companies building products based on Arm technologies. You will share ideas, learn from outstanding engineers, and make contributions that have a real impact. This role offers the opportunity to provide develop the software that connects widely used machine-learning frameworks and runtimes to Arm acceleration technologies.
Responsibilities:Responsibilities include developing and optimizing C++, C, and Python software that integrates machine-learning platforms and execution environments with Arm hardware acceleration. This work entails integration with open-source LLM software such as llama.cpp. You will design and implement integrations between ML frameworks, runtimes, and hardware-acceleration technologies, as well as analyse and improve the performance of ML and LLM workloads. The role also involves leading significant work from design through delivery, mentoring junior engineers, and supporting technical decisions.
We are looking for someone with strong analytical and problem-solving skills who enjoys finding innovative solutions to complex technical challenges. You will be comfortable working in a fast-paced environment and collaborating across complementary teams to achieve shared goals.
Required Skills and Experience :Strong C++, C, and Python programming and software-design skillsExperience delivering significant software features across multiple teamsFamiliarity with Git, GitLab, continuous integration, and automated testingEffective technical leadership and communication skillsKnowledge of LLM inference, including tokenization, attention, KV caches, batching and quantisation“Nice To Have” Skills and Experience :Experience with llama.cpp or other open-source ML or LLM runtimesExperience with profiling and optimizing ML workloadsExperience with compiler or ML graph technologiesExperience with Vulkan, GPU compute, or other hardware-acceleration APIsExperience using AI-assisted software-development tools effectivelyIn Return:All Arm employees are provided with vital training to succeed in their respective roles, as well as a friendly and high-performance working environment.
You will be working with a bunch of enthusiastic and brilliant colleagues. We are proud to have a set of behaviours that reflect our DEI (Diversity, Equity & Inclusion) culture and guide our decisions, defining how we work together to shape extraordinary!
Please note that no relocation package is available for this role.
#LI-CM1
|Develop C++, C and Python integrations connecting ML frameworks and LLM runtimes like llama.cpp with Arm acceleration technologies, optimising AI workloads for next-generation hardware.!
Accommodations at ArmAt Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email 
. To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.
Hybrid Working at ArmArm’s approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team’s needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.
Equal Opportunities at ArmArm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Company:
ARM
Level of experience (years):
Senior (5+ years of experience)
How to apply:
Please mention NLP People as a source when applying