Reviewed by Lexie CornerApr 15 2024
A recent Bar-Ilan University study has reached a watershed moment in the field of artificial intelligence (AI) by answering a fundamental question: Can deep learning systems attain well above-average confidence for a major fraction of inputs while retaining overall average confidence?
The study’s findings give an unequivocal “YES” to this question, indicating a significant improvement in AI's capacity to recognize and respond to various levels of confidence in classification tasks. By exploiting insights into the confidence levels of deep architectures, the research team has opened up new pathways for real-world applications ranging from autonomous vehicles to healthcare.
A team of researchers led by Prof. Ido Kanter from Bar-Ilan University’s Department of Physics and the Gonda (Goldschmied) Multidisciplinary Brain Research Center published their findings in Physica A.
Understanding the confidence levels of AI systems allows us to develop applications that prioritize safety and reliability. For instance, in the context of autonomous vehicles, when confidence in identifying a road sign is exceptionally high, the system can autonomously make decisions. However, in scenarios where confidence levels are lower, the system prompts for human intervention, ensuring cautious and informed decision-making.
Ella Koresh, Graduate Student, Bar-Ilan University
Improving AI system confidence has far-reaching ramifications, ranging from AI-based writing and image recognition to important decision-making processes in healthcare and autonomous vehicles. This study raises the bar for AI performance and safety by allowing AI systems to make more sophisticated and reliable judgments in the face of ambiguity.
Advanced confidence AI applications in autonomous vehicles
Advanced confidence AI applications in autonomous vehicles. Video Credit: Bar-Ilan University
Journal Reference:
Meir, Y., et al. (2024) Advanced Confidence Methods in Deep Learning. Physica A. doi:10.1016/j.physa.2024.129758