Research Engineer, Multimodal Sensing Systems and Machine Learning (ML)

Summary:

At Meta's Reality Labs Research, our goal is to make world-class consumer virtual, augmented, and mixed reality experiences. Come work alongside industry-leading scientists and engineers to create the technology that makes VR and AR pervasive and universal. Join the adventure of a lifetime as we make science fiction real and change the world. We are a world-class team of researchers and engineers creating the future of augmented and virtual reality, which together will become as universal and essential as smartphones and personal computers are today. And just as personal computers have done over the past 45 years, AR and VR will ultimately change everything about how we work, play, and connect.The ML/Signals Team for Interactions Research is exploring and designing novel human-computer interaction technologies for the next generation of AI and augmented reality experiences. We are looking for a resourceful, skilled and motivated Research Engineer with expertise in machine learning, software engineering, and systems bring-up to join our team and work on advancing the state-of-the-art for multimodal sensing and gesture recognition. This role will work with a diverse and interdisciplinary team of research scientists and engineers in a fast-paced multidisciplinary environment and will have access to cutting edge technology, resources, and testing facilities.

Required Skills:

Research Engineer, Multimodal Sensing Systems and Machine Learning (ML) Responsibilities:

1. Design and implement ML pipelines and systems that collect and process datasets and enable algorithm experimentation.

2. Build and bring-up complex prototype wearable sensor software and hardware systems for multimodal data collection.

3. Develop machine learning and computer vision models for applications such as gesture recognition, hand pose estimation, object detection, contextual understanding, and physiological signal processing.

4. Collaborate across an interdisciplinary team of researchers and engineers to collect multimodal training datasets and to develop real-time interaction demos.

Minimum Qualifications:

Minimum Qualifications

1. 3+ years of experience developing ML pipelines with a focus on dataset preprocessing, model experimentation and evaluation, software integration, and real-time deployment.

2. 2+ years of experience developing and evaluating ML/CV models.

3. 3+ years of experience coding with Python and software engineering best practices (version control, code reviews).

4. Experience bringing-up and debugging prototype/scientific software-hardware systems (e.g., multi-camera sensing/tracking solutions like OptiTrack, wearable sensing systems like electromyography (EMG) etc.).

5. Experience working and communicating in a diverse, collaborative, interdisciplinary team environment.

6. Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.

Preferred Qualifications:

Preferred Qualifications

1. Master's degree and 5+ years of industry experience or PhD degree and 3+ years of industry experience.

2. Experience in computer vision, multimodal representation learning, self-supervised learning, adaptive ML, reinforcement learning, transfer learning, or other advanced ML/CV techniques.

3. Experience with Human-Computer Interaction (HCI) and real-time applications of ML.

4. Experience designing data collection protocols and constructing high quality diverse machine learning datasets.

Public Compensation:

$70.67/hour to $208,000/year + bonus + equity + benefits

Industry: Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at ~~~.