Why user testing is essential for biological control of pests

Two men standing in a field facing the camera discussing biological control of pests. One hold up an ipad to compare with a plant which is in front of them both

In September 2020, CABI conducted user testing of the Portal CABI de Bioprotección in Kenya as part of a broader project funded by the Banco Africano de Desarrollo. The testing aimed to assess the ease of use and effectiveness of the tool at the user’s level and was conducted across three counties in Kenya, namely Meru, Kirinyaga and Nakuru, which are among the major farming areas producing farm produce for export. A mix of users along the agriculture value chain were selected to be respondents. These included farmers, extension agents, agro-dealers and agronomists from the private and public sectors.

Uno de los participantes es guiado a lo largo de la sesión de prueba en Nakuru, Kenia.
Uno de los participantes es guiado a lo largo de la sesión de prueba en Nakuru, Kenia.

Cada sesión de prueba duró aproximadamente una hora. Durante la sesión, los administradores de la prueba explicaron los objetivos de la sesión de prueba, el rol del usuario, los escenarios de usabilidad y la información necesaria en la breve sección de antecedentes del cuestionario. Se pidió a los usuarios que completaran una serie de tareas preparadas previamente y los administradores observaron a cada participante mientras navegaban por el portal realizando tareas. Se tomaron notas para registrar cuando el usuario tuvo problemas para realizar las tareas o cuando los usuarios asintieron con la cabeza en reconocimiento de áreas específicas del portal. Una vez completadas todas las tareas, el administrador de la prueba le pidió al participante que calificara el portal utilizando una escala Likert de 5 puntos. Las medidas iban desde totalmente en desacuerdo hasta totalmente de acuerdo en ocho factores subjetivos, incluidos; Frecuencia de uso anticipada, complejidad del sistema y facilidad de uso

Most of the participants found the portal comprehensive, very useful and easy to use and comprehensive in terms of addressing advisors’ challenges of making recommendations for an identified pest problem in the field. Other feedback to improve the portal included, i) issues related to locating the ‘find a product’ button owing to too many details on the home page, ii) filling in the search terms (not straight-forward), iii) lack of clear instruction to navigate through the results, a ‘back button’ to start a new search or clear previous search results, and iv) lack of a visible and understandable feedback process.

 "This is a great and rare opportunity we have been given as users of the tool to try the portal before it is fully rolled out. We have in the past been left out in the development of such support decision support tools and as a result, they are often difficult to use or learn about. More importantly, we find them lacking in so many aspects that we could have given feedback on,” said Mr. David Kariuki, an extension officer in Kirinyaga county.

One of the key lessons drawn from the exercise is that a sense of ownership is acquired when users are recognised and allowed to give input to the development of digital tools. The users were very positive and proud to provide the very first feedback on a product for which they are the target users. They were clear that in instances when they are not involved from the start, learning to use the end product is usually slow and, in most cases, the product fails to include what they as users consider important in supporting and making their work easy.

Another valuable lesson learned from the user testing study was that to ensure a valuable outcome from user testing, it is important to always be very clear in terms of the tasks that the users are expected to perform to avoid making the testing a Q&A session. Some of the hurdles faced included a language barrier and lack of technical know-how (especially the farmers who had difficulty in using the computer or digital platforms). This called for administrators to be slow and clear in communicating and giving instructions related to the tasks.

The COVID-19 pandemic posed challenges, but the prior preparation and adherence to the COVID-19 guidelines, including providing users with the right personal protective equipment, helped build their confidence to participate in the user testing exercise. 

In conclusion, the usability testing of the CABI BioProtection Portal was an important exercise that allowed users to interact with the portal before its full roll out. It is evident that this process has built ownership and trust among the target user groups and will lead to the development of a product that is more in line with user requirements and expectations. This, in turn, will aid the portal in achieving its goal of raising awareness and uptake of biopesticides in agriculture.

Read more