Hyperbolic Geometry: the solution?

The current challenge lies in how AI networks classify objects. Unlike humans, who naturally organize objects into intuitive hierarchies (e.g., apple tree → fruit tree → tree → living organism), AI networks build their classifications in ways that often remain mysterious to us. These classifications exist in a "latent space," typically modeled using Euclidean geometry, which limits the networks' ability to handle hierarchical data effectively.

 

Mettes proposes incorporating hyperbolic geometry, which grows exponentially like natural hierarchies, into these networks. Early research has already demonstrated that deep learning models enhanced with hyperbolic geometry outperform traditional networks in making complex hierarchical classifications. This breakthrough could revolutionize AI applications in fields like biology, where data on rare species or molecules is scarce. It could also improve scientific research in medicine and chemistry, as well as enhance the performance of language models like ChatGPT.