11 - The EvAAL evaluation framework and the IPIN competitions

No standard methods for evaluating indoor localization systems are generally accepted and used by researchers and industry. The lack of common test beds is a problem when evaluating the relative performance of different systems. As a step towards tackling this problem, the EvAAL Indoor Localization competition was launched in 2011, followed by the ongoing series of IPIN competitions. The EvAAL evaluation framework defines tools and metrics usable for comparing both real-time systems and off-line methods based on recorded data. The EvAAL framework is discussed in its incarnation along the various editions of the EvAAL and IPIN competitions, together with a discussion on the performance and technologies used by the competing systems.