About this role
Summary: Lead camera-based perception for motion capture by establishing deep learning and computer vision pipelines to estimate human pose from images. Develop models for 2D/3D pose estimation, calibration, and evaluation pipelines while collaborating with sensor fusion experts.
Do you get excited about building cutting-edge perception systems that work reliably in the real world? Do you have a strong foundation in computer vision, robotics, or sensor fusion? Are you interested in shaping new technology capabilities within a growing and innovative high-tech company, where people and fun are part of our core values? We’d love to have you!
### Who is Xsens
Xsens is a leading full-stack provider of sensors, software, and analytics that enable the digitization of movement. Xsens serves entertainment, humanoid robotics, health & sports and automation & mobility markets. By turning complex motion data into actionable insight, we help our partners accelerate development, improve control and learning, and bring physically intelligent systems to life. We collaborate with leading global innovators including Boston Dynamics, Toyota, Siemens, Electronic Arts, Epic Games, Netflix, and 20th Century Studios, alongside more than 1,000 research institutions, humanoid robotics companies and universities worldwide.
### Your role as a Computer Vision Engineer at Xsens
As a Computer Vision Engineer, you will lead camera-based perception for Xsens motion capture. Your role is to establish Deep Learning and Computer Vision pipelines to turn camera images into human pose estimate. You will learn from the highly-skilled team of sensor fusion experts, biomechanists and mathematicians. You will be its computer vision specialist, and report to the Technology Manager. The position is open to hybrid / remote working.
Key challenges:
- Select, adapt and fine-tune deep learning models for 2D and 3D human pose estimation from cameras, that perform robustly in challenging real-world conditions.
- Develop camera models and calibration routines for a range of camera and lens configurations.
- Evaluation of motion capture output and developing compensatory algorithms and techniques to handle camera /vision failure modes.
- Build training and evaluation pipelines from camera and optical motion capture recordings. Use synthetic data where real data is insufficient.
- Track the computer vision research landscape and assess whether new techniques are feasible for Xsens products.
- * *
Xsens is looking for a hands-on Computer Vision Engineer who combines strong theoretical foundations with a proven ability to build and ship working systems.
Required
- MSc/PhD in Computer Science, Electrical Engineering, Robotics or a related field, with years of relevant industry or applied research experience.
- Hands-on experience training and fine-tuning deep learning models for human pose estimation, with results evaluated on public benchmarks.
- Solid understanding of camera and lens models, including wide field-of-view optics, intrinsic and extrinsic calibration, and multi-view geometry.
- Familiarity with the output representations of common pose models, such as keypoint sets and SMPL-family parameters.
- Experience with tools in markerless eco-system such as OpenCV, Sapiens, and SAM3D.
- Proficiency in Python. Working knowledge of C++ for integrating models into an existing C++ codebase.
Preferred
- Experience with synthetic data generation and rendering pipelines.
- Experience optimizing models for real-time deployment, for example with ONNX, TensorRT or quantization.
- Experience building datasets and benchmarks for human motion.
### Working at Xsens
*We value* ingenious ideas, no matter where they come from. We believe diverse thoughts, voices, and backgrounds make us stronger as a company. We know that it is through collaboration with people from all walks of life that we make the most positive impact as an organization.
*Join Xsens’ innovative, ambitious, and international team, where your ideas and talents make an impact. Along with a competitive compensation package, we offer a range of benefits designed to support your well-being and help you thrive.*
- 28 paid vacation days with an option to buy, sell, or carry over days, giving you flexibility to manage your time off as appropriate to your situation
- *Tax perks* *for your sports memberships and bicycle purchase; so staying active is easier than ever.*
- *Flexible working hours* *and the option to work from home, helping you balance life and work*
- Paid volunteer time: Through our partnership with Stichting Present, you have the opportunity to give back to the community during office hours
- *Our partnership with Equip gives you* *on-demand access to a dedicated financial planner* *who provides clear guidance and a concrete plan for wealth building, pensions, and major life events.*
- *Enjoy* company social events as well as fun, informal activities organized by our staff association. From movie nights and sports clinics to cooking classes and LAN parties, there’s always something happening to connect and have fun