Title |
Benchmarking Brain-Computer Interfaces Outside the Laboratory: The Cybathlon 2016
|
---|---|
Published in |
Frontiers in Neuroscience, January 2018
|
DOI | 10.3389/fnins.2017.00756 |
Pubmed ID | |
Authors |
Domen Novak, Roland Sigrist, Nicolas J. Gerig, Dario Wyss, René Bauer, Ulrich Götz, Robert Riener |
Abstract |
This paper presents a new approach to benchmarking brain-computer interfaces (BCIs) outside the lab. A computer game was created that mimics a real-world application of assistive BCIs, with the main outcome metric being the time needed to complete the game. This approach was used at the Cybathlon 2016, a competition for people with disabilities who use assistive technology to achieve tasks. The paper summarizes the technical challenges of BCIs, describes the design of the benchmarking game, then describes the rules for acceptable hardware, software and inclusion of human pilots in the BCI competition at the Cybathlon. The 11 participating teams, their approaches, and their results at the Cybathlon are presented. Though the benchmarking procedure has some limitations (for instance, we were unable to identify any factors that clearly contribute to BCI performance), it can be successfully used to analyze BCI performance in realistic, less structured conditions. In the future, the parameters of the benchmarking game could be modified to better mimic different applications (e.g., the need to use some commands more frequently than others). Furthermore, the Cybathlon has the potential to showcase such devices to the general public. |
X Demographics
As of 1 July 2024, you may notice a temporary increase in the numbers of X profiles with Unknown location. Click here to learn more.
Geographical breakdown
Country | Count | As % |
---|---|---|
United Kingdom | 2 | 29% |
Australia | 1 | 14% |
Unknown | 4 | 57% |
Demographic breakdown
Type | Count | As % |
---|---|---|
Members of the public | 6 | 86% |
Science communicators (journalists, bloggers, editors) | 1 | 14% |
Mendeley readers
Geographical breakdown
Country | Count | As % |
---|---|---|
Unknown | 84 | 100% |
Demographic breakdown
Readers by professional status | Count | As % |
---|---|---|
Student > Ph. D. Student | 19 | 23% |
Student > Master | 12 | 14% |
Student > Bachelor | 10 | 12% |
Researcher | 6 | 7% |
Student > Doctoral Student | 4 | 5% |
Other | 13 | 15% |
Unknown | 20 | 24% |
Readers by discipline | Count | As % |
---|---|---|
Engineering | 25 | 30% |
Computer Science | 8 | 10% |
Neuroscience | 6 | 7% |
Nursing and Health Professions | 4 | 5% |
Unspecified | 4 | 5% |
Other | 15 | 18% |
Unknown | 22 | 26% |