Matterport and Facebook AI Research to release the world’s largest dataset of 3D spaces

An image of Matterport and Facebook, News, Matterport and Facebook AI Research to release the world’s largest dataset of 3D spaces

The collaboration enables researchers to advance Habitat, Facebook AI’s simulation platform for research in Embodied AI, to help robots better understand and interact with the physical world.

Matterport, the spatial data company leading the digital transformation of the built world, which has entered into a definitive agreement to enter into a business combination with Gores Holdings VI has announced a collaboration with Facebook AI Research (FAIR) through which it will make the largest-ever dataset of 3D indoor spaces available exclusively for academic, non-commercial uses. The Habitat-Matterport 3D Research Dataset (HM3D) is an unprecedented collection of 1,000 high-resolution Matterport digital twins made up of residential, commercial, and civic spaces generated precisely from real-world environments. HM3D will play a significant role in advancing embodied AI research which seeks to teach robots and virtual AI assistants to understand and interact with the complexities of the physical world.

“Until now, this rich spatial data has been glaringly absent in the field, so HM3D has the potential to change the landscape of embodied AI and 3D computer vision,” said Dhruv Batra, Research Scientist at Facebook AI Research. “Our hope is that the 3D dataset brings researchers closer to building intelligent machines, to do for embodied AI what pioneers before us did for 2D computer vision and other areas of AI.”

HM3D is free and available now for academic, non-commercial research. Researchers can use it with FAIR’s Habitat simulator to train embodied agents, such as home robots and AI assistants, at scale. HM3D is a foundational step towards helping these agents navigate through real-world environments and better understand the variations of spaces such as bedrooms, bathrooms, kitchen and hallways, as well as the different configurations of those rooms within every structure. It can also assist robots in recognizing how objects within rooms are typically arranged so that instructions are correctly understood. This research could one day be used in production applications like robots that can retrieve medicine from a bedroom nightstand or AR glasses that can help people remember where they left their keys.

“We are excited to collaborate with Facebook as we provide the academic and research communities access to this unique spatial dataset that is sure to impact how we work and live,” said Conway Chen, Vice President of Business Development and Alliances at Matterport. “With more than five million spaces captured with the Matterport platform, we are the only company that can offer a diverse library of high-resolution, data-rich digital twins of various styles, sizes, and complexities from across the world. HM3D can also be used more broadly by academia, and we can’t wait to see what innovations emerge.”

“We’ve been challenged with a lack of spatial data to advance innovation in real estate, construction, robotics, augmented reality, and more. But with the HM3D dataset from the collaboration between Matterport and Facebook AI, we’re excited about the significant progress we’ll make in advancing research in indoor scene reconstruction, generation, and analysis at a house-scale for the first time,” said Yasutaka Furukawa, Associate Professor of Computing Science at Simon Fraser University.

Matterport has defined the spatial data category for the built world with its market-leading platform that transforms any physical space into an accurate and immersive digital twin. Today, many industries leverage Matterport’s digital twins and spatial data insights to change the way business fundamentally is done. Real estate agents gain a deeper understanding of every property that gets digitised and gain the ability to see what is most important to thousands of prospective buyers. Retailers can digitise multiple stores at any point in time to track fixed assets and inventory. Developers and property owners can use Matterport to document every stage of construction and create a robust digital system of record over the entire lifecycle of the building. Matterport’s rapidly expanding developer platform makes it easy for partners and developers to create powerful new tools and draw new property insights, fueling industry-wide innovation that makes every space more valuable, accessible and useful.

For more information about HM3D and its use in embodied AI research with the Habitat simulator, read the Facebook AI blog. Click here to learn more about the possibilities spatial data libraries can unlock.


About Matterport
Matterport is leading the digital transformation of the built world. Our groundbreaking spatial computing platform turns buildings into data making every space more valuable and accessible. Millions of buildings in more than 150 countries have been transformed into immersive Matterport digital twins to improve every part of the building lifecycle from planning, construction, and operations to documentation, appraisal and marketing. Learn more at and browse a gallery of digital twins.

For more news from Top Business Tech, don’t forget to subscribe to our daily bulletin!

Follow us on LinkedIn and Twitter

An image of Matterport and Facebook, News, Matterport and Facebook AI Research to release the world’s largest dataset of 3D spaces

Luke Conrad

Technology & Marketing Enthusiast

What will gaming look like when it goes into the...

James Ponter • 08th July 2022

One of the biggest hurdles in cloud gaming is the reluctance of ‘gamers’ to adopt the system, but developers and tech giants aren’t slowing down their move to the cloud. So, what is cloud gaming? How can we expect the landscape to look in a few years? And most importantly, what are the limitations? By...

The cost of living crisis.

TBT Newsroom • 29th June 2022

What Communication Service Providers can do to help their customers cope with the cost-of-living crisis. We’re all familiar with the rip roaring marketing slogans of our U.K. Communication Service Providers – ‘together we can’, ‘The future is bright’, ‘It’s all about you’…but sadly, these no longer appear to ring true for the millions of consumers...

Thriving In The 5G Era.

TBT Newsroom • 26th June 2022

As consumer demand rises, and network availability expands, 5G is becoming more viable for widespread use — by 2027 it’s expected to cover 75 per cent of the world’s population. However, it’s still no secret that 5G uptake is dawdling and many enterprises still aren’t enjoying its benefits.

Why Low-Latency Is So Important.

TBT Newsroom • 23rd June 2022

Consumer interest in 5G technology has been fueled by the arrival of glamorous, speedy handsets such as Apple’s iPhone 12, with 5G networks now rolled out to many towns and cities across the country.