TLDR: We are hiring! Specifically, we are hiring PhDs graduating in 2025, professionals with industry experience, and managers. We are NOT hiring new graduates with a bachelor's or master's degree. Our summer internship positions have been filled. Candidates please email us at "codesign AT meta DOT com". Curious about Meta's fascinating hyperscale infrastructure? Check out our brief article for an inside look.

The AI and Systems Co-Design team at Meta (formerly known as Facebook), led by Chunqiang Tang (a.k.a. CQ Tang), consists of over 100 employees, mostly PhDs, including many world-class research scientists and engineers. As reflected in our team name "co-design", we conduct interdisciplinary research and development across AI, hardware, and software, with a focus on performance, efficiency, and scalability.

• We own the company's overall strategy for exploring innovative hardware technologies for CPUs, GPUs, memory, storage, and Meta's custom AI chips, and we productionize them in Meta's hyperscale fleet of O(1,000,000) servers and O(100,000) GPUs, powering all Meta products such as Facebook, Instagram, and Meta AI.
• We apply novel optimizations across the whole stack---hardware, ML models, ML systems, applications, and the Linux kernel---to achieve optimal performance.
• We develop innovative AI technologies for large language models (Llama), ranking systems, and more.

In addition to the real-world impact on billions of users of the Meta products, our team members have won Best Paper Awards at prestigious conferences such as ISCA, ASPLOS, SOSP, and OSDI, with multiple papers selected for IEEE Micro Top Picks. Additionally, we regularly publishe in ICML, NeurIPS, SC, HPCA, NSDI, VLDB, MLSys, and more. Overall, our work largely corresponds to the research communities of systems in general and especially systems for ML (MLSys, SOSP, OSDI, SIGCOMM, NSDI), hardware architecture (ISCA, ASPLOS), ML (NeurIPS, ICML, ICLR) and supercomputing (SC, ICS).

Here are selected publications that showcase our work in diverse areas:

• Systems for ML
  • [OSDI'25] WLB-LLM: Workload-Balanced 4D Parallelism for Large Language Model Training
  • [ISCA'25] Scaling Llama 3 Training with Efficient Parallelism Strategies
  • [OSDI'24] MAST: Global Scheduling of ML Training across Geo-Distributed Datacenters at Hyperscale
  • [ISCA'22] Software-Hardware Co-design for Fast and Scalable Training of Deep Learning Recommendation Models
  • [VLDB'23] PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel
  • The Llama 3 Herd of Models. Our contributions include much of the work described in the paper's Section 3.3 "Infrastructure, Scaling, and Efficiency", Section 6 "Inference", and Section 7.3 "Model Scaling".
• AI chip
  • [ISCA'25] Meta's Second Generation AI Chip: Model-Chip Co-Design and Productionization Experiences
  • [ISCA'23] MTIA: First Generation Silicon Targeting Meta's Recommendation Systems
• ML models and kernels
  • [ICML'24] Wukong: Towards a Scaling Law for Large-Scale Recommendation
  • Deep Learning Recommendation Model for Personalization and Recommendation Systems
  • FBGEMM: Enabling High-Performance Low-Precision Deep Learning Inference
• ML numerics, pruning, distillation, and optimizer
  • [ISCA'23] Shared Microexponents: A Little Shifting Goes a Long Way
  • Microscaling Data Formats for Deep Learning
  • Pruning and Distillation to Enable Llama 3.2 1B and 3B Models Suitable for Mobile Devices
  • PyTorch Distributed Shampoo Winning the MLCommon Training Algorithms Competition
• HPC and collective communications library (MPI, NCCL, RCCL)
  • [SC'24] Accelerating Communication in Deep Learning Recommendation Model Training with Dual-Level Adaptive Lossy Compression
  • [DLP-KDD'20] Training Deep Learning Recommendation Model with Quantized Collective Communications
• Performance benchmarking and projection for both AI and non-AI workloads
  • [ISCA'25] DCPerf: An Open-Source, Battle-Tested Performance Benchmark Suite for Datacenter Workloads
  • DLRM: An advanced, open source deep learning recommendation model
• Hardware and software co-design
  • [ISCA'23 Best Paper] Contiguitas: The Pursuit of Physical Memory Contiguity in Datacenters
  • [ISCA'23] TPP: Transparent Page Placement for CXL-Enabled Tiered-Memory
  • [ISCA'19] SoftSKU: Optimizing Server Architectures for Microservice Diversity @Scale

Like research labs, our team consists primarily of PhDs. However, we differ from traditional research labs in several key ways:

• Direct ownership: Like traditional research labs, we build strong partnerships with numerous teams across diverse areas for broad influence. However, what sets us apart is our direct ownership of the hardware strategy for Meta's hyperscale fleet. This enables us to lead in many areas while fostering seamless partnerships in others.
• Production systems: Our primary goal is to develop forward-looking innovations in AI, hardware, and software, and directly implement them in production systems that serve billions of people. The billions of users of Meta products and Meta's hyperscale fleet of O(1,000,000) servers and O(100,000) GPUs are, in effect, our lab. In contrast, traditional research labs often rely on technology transfer for a less direct impact.
• Impact: Our impact is widely acknowledged within the company and throughout the industry. We drive Meta's hardware strategy to save billions of dollars, and directly develop innovative technologies in Meta's flagship products like Llama and Ads ranking models.

Open Source Projects

• DCPerf: An open source benchmark suite for hyperscale compute applications
• DLRM: An advanced, open source deep learning recommendation model
• FBGEMM: ML kernels
• Pytorch distributed Shampoo optimizer. This work won the competition of the external tuning track of the inaugural AlgoPerf training algorithms benchmark.

2025

• [OSDI'25] WLB-LLM: Workload-Balanced 4D Parallelism for Large Language Model Training
• [ISCA'25] DCPerf: An Open-Source, Battle-Tested Performance Benchmark Suite for Datacenter Workloads
• [ISCA'25] Meta's Second Generation AI Chip: Model-Chip Co-Design and Productionization Experiences
• [ISCA'25] Scaling Llama 3 Training with Efficient Parallelism Strategies
• [HPCA'25] Machine Learning-Guided Memory Optimization for DLRM Inference on Tiered Memory
• [Communications of the ACM] Meta's Hyperscale Infrastructure: Overview and Insights
• [ARITH'25] An Empirical Study of Microscaling Formats for Low-Precision LLM Training
• [MLSys'25] Context Parallelism for Scalable Million-Token Inference
• [MLSys'25] Lumos: Efficient Performance Modeling and Estimation for Large-scale LLM Training

2024

• The Llama 3 Herd of Models
• [IEEE Micro Top Picks'24] End-to-End Cloud Application Cloning With Ditto
• [IEEE Micro Top Picks'24] Contiguitas: The Pursuit of Physical Memory Contiguity in Datacenters
• [SOSP'24 Best Paper] FBDetect: Catching Tiny Performance Regressions at Hyperscale through In-Production Monitoring
• [OSDI'24 Best Paper] ServiceLab: Preventing Tiny Performance Regressions at Hyperscale through Pre-Production Testing
• [OSDI'24] MAST: Global Scheduling of ML Training across Geo-Distributed Datacenters at Hyperscale
• [OSDI'24] Optimizing Resource Allocation in Hyperscale Datacenters: Scalability, Usability, and Experiences
• [SC'24] Accelerating Communication in Deep Learning Recommendation Model Training with Dual-Level Adaptive Lossy Compression
• [ASPLOS'24] Expanding Datacenter Capacity with DVFS Boosting: A safe and scalable deployment experience
• [ICML'24] Wukong: Towards a Scaling Law for Large-Scale Recommendation
• [MLSys'24] Disaggregated Multi-Tower: Topology-aware Modeling Technique for Efficient Large Scale Recommendation
• [WWW'24] Rankitect: Ranking Architecture Search Battling World-class Engineers at Meta Scale
• [NeurIPS'24] CoMERA: Computing- and Memory-Efficient Training via Rank-Adaptive Tensor Optimization
• [NeurIPS'24] Task Me Anything
• [NSDI'24] QuickUpdate: a Real-Time Personalization System for Large-Scale Recommendation Model
• [RecSys'24] Toward 100TB Recommendation Models With Embedding Offloading
• Movie Gen: A Cast of Media Foundation Models
• DCPerf: An open source benchmark suite for hyperscale compute applications
• PyTorch Distributed Shampoo Winning the MLCommon Training Algorithms Competition

2023

• Llama 2: Open Foundation and Fine-Tuned Chat Models
• [ISCA'23 Best Paper] Contiguitas: The Pursuit of Physical Memory Contiguity in Datacenters
• [IEEE Micro Top Picks'23] IOCost: Block IO Control for Containers in Datacenters
• [ISCA'23] MTIA: First Generation Silicon Targeting Meta's Recommendation Systems
• [ISCA'23] Shared Microexponents: A Little Shifting Goes a Long Way
• [ISCA'23] TPP: Transparent Page Placement for CXL-Enabled Tiered-Memory
• [ISCA'23] Mystique: Enabling Accurate and Scalable Generation of Production AI Benchmarks
• [MLSys'23] RecD: Deduplication for End-to-End Deep Learning Recommendation Model Training Infrastructure
• [OSDI'23] AdaEmbed: Adaptive Embedding for Large-Scale Recommendation Models
• [ISPASS'23] Characterization of Data Compression in Datacenters,
• [ASPLOS'23] Ditto: End-to-End Application Cloning for Networked Cloud Services,
• [VLDB'23] PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel
• Microscaling Data Formats for Deep Learning
• FlexShard: Flexible Sharding for Industry-Scale Sequence Recommendation Models

2022

• [ASPLOS'22 Best Paper] TMO: Transparent Memory Offloading in Datacenters
• [ASPLOS'22] RecShard: Statistical Feature-Based Memory Optimization for Industry-Scale Neural Recommendation
• [OSDI'22] Unity: Accelerating DNN Training Through Joint Optimization of Algebraic Transformations and Parallelization
• [ISCA'22] Software-Hardware Co-design for Fast and Scalable Training of Deep Learning Recommendation Models
• [NSDI'22] Check-N-Run: a Checkpointing System for Training Deep Learning Recommendation Models
• [ICDCS'22] Supporting Massive DLRM Inference through Software Defined Memory
• [DLP-KDD'22] DHEN: A deep and hierarchical ensemble network for large-scale click-through rate prediction

2021

• [IEEE Micro Top Picks'21] Understanding Acceleration Opportunities at Hyperscale
• [Micro'21] Low-Precision Hardware Architectures Meet Recommendation Model Inference at Scale
• [Big Data'21] Efficient Soft-Error Detection for Low-precision Deep Learning Recommendation Models
• [ATC'21] Improving Performance of Flash Based Key-Value Stores Using Storage Class Memory as a Volatile Memory Extension
• First-Generation Inference Accelerator Deployment at Facebook
• FBGEMM: Enabling High-Performance Low-Precision Deep Learning Inference

2020

• [ASPLOS'20] Accelerometer: Understanding Acceleration Opportunities for Data Center Overheads at Hyperscale
• [DLP-KDD'20] Training Deep Learning Recommendation Model with Quantized Collective Communications
• Mixed-Precision Embedding Using a Cache
• FioSynth: A representative I/O benchmark and data visualizer for data center workloads,
• Accelerometer and SoftSKU: Improving hardware platform performance for diverse microservices

2019

• Deep Learning Recommendation Model for Personalization and Recommendation Systems
• [ISCA'19] SoftSKU: Optimizing Server Architectures for Microservice
• [MLSys'19] Post-Training 4-bit Quantization of Embedding Tables
• [MLSys'19] Bandana: Using Non-Volatile Memory for Storing Deep Learning Models
• [ATC'19] Who's Afraid of Uncorrectable Bit Errors? Online Recovery of Flash Errors with Distributed Redundancy
• A Study of BFLOAT16 for Deep Learning Training