Matterport and Facebook AI Research to release the world’s largest dataset of 3D spaces
The collaboration enables researchers to advance Habitat, Facebook AI’s simulation platform for research in Embodied AI, to help robots better understand and interact with the physical world.
Matterport, the spatial data company leading the digital transformation of the built world, which has entered into a definitive agreement to enter into a business combination with Gores Holdings VI has announced a collaboration with Facebook AI Research (FAIR) through which it will make the largest-ever dataset of 3D indoor spaces available exclusively for academic, non-commercial uses. The Habitat-Matterport 3D Research Dataset (HM3D) is an unprecedented collection of 1,000 high-resolution Matterport digital twins made up of residential, commercial, and civic spaces generated precisely from real-world environments. HM3D will play a significant role in advancing embodied AI research which seeks to teach robots and virtual AI assistants to understand and interact with the complexities of the physical world.
“Until now, this rich spatial data has been glaringly absent in the field, so HM3D has the potential to change the landscape of embodied AI and 3D computer vision,” said Dhruv Batra, Research Scientist at Facebook AI Research. “Our hope is that the 3D dataset brings researchers closer to building intelligent machines, to do for embodied AI what pioneers before us did for 2D computer vision and other areas of AI.”
HM3D is free and available now for academic, non-commercial research. Researchers can use it with FAIR’s Habitat simulator to train embodied agents, such as home robots and AI assistants, at scale. HM3D is a foundational step towards helping these agents navigate through real-world environments and better understand the variations of spaces such as bedrooms, bathrooms, kitchen and hallways, as well as the different configurations of those rooms within every structure. It can also assist robots in recognizing how objects within rooms are typically arranged so that instructions are correctly understood. This research could one day be used in production applications like robots that can retrieve medicine from a bedroom nightstand or AR glasses that can help people remember where they left their keys.
“We are excited to collaborate with Facebook as we provide the academic and research communities access to this unique spatial dataset that is sure to impact how we work and live,” said Conway Chen, Vice President of Business Development and Alliances at Matterport. “With more than five million spaces captured with the Matterport platform, we are the only company that can offer a diverse library of high-resolution, data-rich digital twins of various styles, sizes, and complexities from across the world. HM3D can also be used more broadly by academia, and we can’t wait to see what innovations emerge.”
“We’ve been challenged with a lack of spatial data to advance innovation in real estate, construction, robotics, augmented reality, and more. But with the HM3D dataset from the collaboration between Matterport and Facebook AI, we’re excited about the significant progress we’ll make in advancing research in indoor scene reconstruction, generation, and analysis at a house-scale for the first time,” said Yasutaka Furukawa, Associate Professor of Computing Science at Simon Fraser University.
Matterport has defined the spatial data category for the built world with its market-leading platform that transforms any physical space into an accurate and immersive digital twin. Today, many industries leverage Matterport’s digital twins and spatial data insights to change the way business fundamentally is done. Real estate agents gain a deeper understanding of every property that gets digitised and gain the ability to see what is most important to thousands of prospective buyers. Retailers can digitise multiple stores at any point in time to track fixed assets and inventory. Developers and property owners can use Matterport to document every stage of construction and create a robust digital system of record over the entire lifecycle of the building. Matterport’s rapidly expanding developer platform makes it easy for partners and developers to create powerful new tools and draw new property insights, fueling industry-wide innovation that makes every space more valuable, accessible and useful.
For more information about HM3D and its use in embodied AI research with the Habitat simulator, read the Facebook AI blog. Click here to learn more about the possibilities spatial data libraries can unlock.
READ MORE:
- How to successfully reopen your office in a post-Covid-19 world
- Founder Feature: Neil Purcell, founder and CEO, Talent Works
- Ensuring a secure digital transformation journey
- Build these five habits to reduce the risk of ransomware
About Matterport
Matterport is leading the digital transformation of the built world. Our groundbreaking spatial computing platform turns buildings into data making every space more valuable and accessible. Millions of buildings in more than 150 countries have been transformed into immersive Matterport digital twins to improve every part of the building lifecycle from planning, construction, and operations to documentation, appraisal and marketing. Learn more at matterport.com and browse a gallery of digital twins.
For more news from Top Business Tech, don’t forget to subscribe to our daily bulletin!
Follow us on LinkedIn and Twitter
