Selecting and combining UWB localization algorithms : insights and recommendations from a multi-metric benchmark

van Herbruggen, Ben; Vanhie-van Gerwen, Jono; Luchie, Stijn; Durodie, Yuri; Vanderborght, Bram; Aernouts, Michiel; Munteanu, Adrian; Fontaine, Jaron; De Poorter, Eli

doi:10.1109/ACCESS.2024.3358274

Title

Selecting and combining UWB localization algorithms : insights and recommendations from a multi-metric benchmark

Author

van Herbruggen, Ben

Vanhie-van Gerwen, Jono

Luchie, Stijn

Durodie, Yuri

Vanderborght, Bram

Aernouts, Michiel

Munteanu, Adrian

Fontaine, Jaron

De Poorter, Eli

Abstract

Ultra-wideband (UWB) localization has emerged in GPS-denied environments as a crucial facilitator for diverse industries, including logistics, healthcare applications, and societal domains. Despite notable progress, UWB algorithms from the scientific literature are often evaluated in isolation in very specific conditions and hence difficult to compare. This paper introduces a novel benchmark platform designed to assess the performance of 11 prominent UWB accuracy-enhancing algorithms, both independently and in combination. A key feature of the platform is its incorporation of multiple diverse evaluation metrics, including mean average error, latency, and spatial error. We showcase the significance of adopting alternative metrics such as spatial error, which often, depending on the use case, offers greater relevance than the prevalently used mean average error. Furthermore, we show that "more is better" does not hold true when combining multiple accuracy-improving algorithms for UWB systems: combining multiple accuracy-improving algorithms reveals instances of diminishing returns and can even result in overall performance decline. Additionally, we caution against blind reliance on accuracy outcomes reported in the scientific literature when designing UWB systems for use cases that are different in terms of requirements or environment. Finally, we also provide algorithmic recommendations for distinct surroundings, exemplary applications, and usage contexts, assisting in driving efficient design in future UWB research and adoption.

Language

English

Source (journal)

IEEE access. - New York, N.Y., 2013, currens

Publication

New York, N.Y. : IEEE , 2024

ISSN

2169-3536

DOI

10.1109/ACCESS.2024.3358274

Volume/pages

12 (2024) , p. 16881-16901