Data Scientist, Evaluations - Meta Superintelligence Labs

Meta is seeking a Data Scientist to join the Evaluations team within Meta Superintelligence Labs (MSL). Evaluations are the core of AI progress at MSL, determining what capabilities get built, which features get prioritized, and how fast our models improve. As a Data Scientist on this team, you will be responsible for the scientific rigor behind our frontier AI benchmarks.

You will work in tandem with world-class Research Scientists and Engineers to design, validate, and analyze novel evaluations that shape the future of AI capability measurement. This role is for a technical Data Science expert who can bridge the gap between abstract model capabilities and rigorous, unbiased measurement.

You will lead the charge on sampling strategies for various AI tasks, critically examine benchmark quality and validity, and perform deep-dive analysis on current frontier models’ failures and limitations. You will have the opportunity to conduct novel research, think creatively about measurement in uncharted territories, and contribute to the global AI community.

The Facebook company is now Meta. Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology.

We want to give people the power to build community and bring...