awesome-lego-machine-learning
github.com/360er0/awesome-lego-machine-learning ↗A curated list of resources dedicated to Machine Learning applications to LEGO bricks
Use this list with your AI agent
Add the Context Awesome MCP server to Claude, Cursor, or any MCP client, then ask:
"Show me papers resources from awesome-lego-machine-learning"
Installation instructions →What's inside
ML at LEGO Group
- AI Summit London: Lego’s Brian Schwab on Interaction Design [2023.06]
A short talk with Brian Schwab without many details about the augmented reality for playing with Lego bricks.
- A One-Stop Data Shop: The Lego Group’s Anders Butzbach Christensen [2023.03]
Podcast (and transcript) about LEGO data platform.
- Building a GenAI Solution — A Hackathon Success Story! [2023.11]
Description of the winning project of the internal Generative AI Hackathon at the LEGO Group. It focuses on generating a set description based on metadata and an image.
- Building Blocks of Machine Learning at LEGO with Francesc Joan Riera [2021.11]
Podcast about using ML at LEGO. In particular, their ML infrastructure, content moderation system, and classifying images of LEGO models into thematical categories.
- How LEGO plays with data: An interview with chief data officer Orlando Machado [2022.12]
- Inside the annual LEGO Brick Hack [2022.11]
Short description of internal Data Science hackathon.
Generating Sets
- Automatic Generation of Vivid LEGO Architectural Sculptures [2019]Papers
It introduces an automatic system to convert an architectural model into a LEGO sculpture while preserving the original model’s shape features like repeating components, shape details and planarity.
- Brick-by-Brick: Combinatorial Construction with Deep Reinforcement Learning [2021.10]Papers
Generating sets step by step from the 2D images using RL.
- BrickHubDatasets
Almost 500 original and custom sets.
- Brick Yourself within 3 Minutes [2022.05]Papers
Given the input portrait, it uses several deep neural networks to extract the attributes to describe the human appearance shown in the image. Built on these attributes, the model generates the corresponding uncolored brick model by iteratively searching for brick components with the coordinate descent algorithm. Finally, it assigns a color to every brick to get the final brick model.
- Image2Lego: Customized LEGO® Set Generation from Images [2021.08]Papers
The system takes an image as an input, encodes it as embedding, generates a voxelized 3D model, and finally convert it into LEGO bricks. The model jointly trains a 3D model autoencoder and a 2D-to-3D encoder.
- LDraw Official Model RepositoryDatasets
LDraw repository of over 1800 official LEGO sets.
Parts Classification
- Automatic Lego Sorting MachineSorting Machines
Students' report containing the design of the sorting machine. Mostly related to the mechanical side of the machine.
- B200C LEGO Classification Dataset [2021.08]Datasets
Dataset for parts classification. It contains 800k high-quality renders for 200 different parts.
- B200 LEGO Detection Dataset [2024.03]Datasets
Dataset for parts detection. It contains 2k high-quality renders for 200 different parts.
- Big Robot [2022.06]Sorting Machines
Initiative to build Lego AI Open Source Sorting Machine.
- BrickBanker [2020.12]Applications
Mobile application which detects up to 2k different parts.
- Brickinspector [2023.02]Papers
The paper describes the process of using synthetic data for training semantic segmentation model for detecting Lego parts.
Other lists
- Awesome LEGO
General list of LEGO resources.
Assembling Sets
- Break and Make: Interactive Structural Understanding Using LEGO Bricks [2022.07]Papers
Introduction of a new task for visual understanding, 3D simulator to manipulate LEGO models, and a model to solve the proposed task of recreating the LEGO model.
- Building LEGO Using Deep Generative Models of Graphs [2020.12]Papers
It proposes a way to represent the LEGO model as graphs and learn how to generate them step-by-step.
- Planning Assembly Sequence with Graph Transformer [2022.10]Papers
A graph transformer-based framework for ASP problem, with a heterogeneous graph attention network to encoder the models, which are decoded with the attention mechanism to generate assembly sequence.
- Robotic LEGO Assembly and Disassembly from Human Demonstration [2023.05]Papers
This paper presents a system that automates LEGO assembly and disassembly by learning from human demonstration.
- Translating a Visual LEGO Manual to a Machine-Executable Plan [2022.07]Papers
Understanding the assembly process using manual.
Generating images of LEGO
- Generating LEGO Pirates sets and minifigures [2023.01]Posts
Generating LEGO Pirates sets and minifigures using Stable Diffusion.
- Lego Brickheadz XL [2023.09]Models
Stable Diffusion model for generating Brickheadz.
- Lego Minifig XL [2023.08]Models
Stable Diffusion model for generating Minifigures.
- LEGO Stable Diffusion [2023.01]Posts
Fine-tuned stable diffusion model for generating images in the LEGO style.
- Reimagining LEGO sets [2023.03]Posts
Generating realistic versions of LEGO sets.
- The AI Revolution: How Artificial Intelligence Is Impacting the LEGO Community [2023.11]Posts
The post discusses how AI-generated “LEGO” sets are sparking a debate between inspiration and imitation within the AFOL community.
Price Prediction
- Lego Learning: Using Machine Learning to Predict the Future Value of Lego Sets [2023.11]Code
Using machine learning algorithms to predict future prices of sets.
3D Reconstruction
- MobileBrick: Building LEGO for 3D Reconstruction on Mobile Devices [2023.03]Papers
A dataset of 153 Lego sets focusing on detailed 3D object reconstruction with a unique data modality of high-resolution RGB images with low-resolution depth maps captured on a mobile device.
Showing a sample of 90 resources. View the full list on GitHub →