Researchers From Microsoft and ETH Zurich Introduce LightGlue
In the realm of computer vision, matching corresponding points between images plays a vital role in applications like camera tracking and 3D mapping. But these methods have limitations and that’s where a new deep network called LightGlue comes to play.
A result of a collaborative research effort between ETH Zurich and Microsoft, LightGlue leverages a deep network that combines image matching and outlier rejection. It incorporates the Transformer model, which learns to match challenging image pairs by leveraging vast datasets. This innovative approach demonstrates remarkable robustness in both indoor and outdoor environments.
Where LightGlue excels in visual localization under challenging conditions and exhibits promising performance in tasks like aerial matching, object pose estimation, and fish re-identification. This new approach is aimed at solving the limitations of “SuperGlue” which suffered from computational inefficiency and the demand for substantial computing resources.
To solve this issue the team developed LightGlue as a more accurate, efficient, and easier-to-train alternative. The team achieved state-of-the-art accuracy within a few GPU days through meticulous architectural modifications and the distillation of a recipe for training high-performance deep matches with limited resources.
LightGlue also presents a Pareto-optimal solution. That means it can strike an ideal balance between efficiency and accuracy. Unlike previous approaches, LightGlue adapts to the difficulty of each image pair. This is done by predicting correspondences after each computational block and assessing confidence for further computation, unmatchable points are discarded early on.
This allows it to focus computational efforts on the areas of interest and improve efficiency. So far, experimental results showcase LightGlue’s superiority over existing sparse and dense matches. It also offers matches from local features while significantly reducing runtime.
The development of LightGlue can empower the deployment of deep matches in latency-sensitive applications such as simultaneous localization and mapping or SLAM for short. It also can reconstruct more substantial scenes from crowd-sourced data.
Excitingly, the LightGlue model and training code will be made publicly available under a permissive license. This release not only grants researchers and practitioners access to LightGlue’s capabilities but also encourages contributions toward advancing computer vision applications that require efficient and accurate image matching.
Originally posted on OpenDataScience.com
Read more data science articles on OpenDataScience.com, including tutorials and guides from beginner to advanced levels! Subscribe to our weekly newsletter here and receive the latest news every Thursday. You can also get data science training on-demand wherever you are with our Ai+ Training platform. Subscribe to our fast-growing Medium Publication too, the ODSC Journal, and inquire about becoming a writer.
