Why user testing is essential for biological control of pests

Two men standing in a field facing the camera discussing biological control of pests. One hold up an ipad to compare with a plant which is in front of them both

In September 2020, CABI conducted user testing of the Portal CABI de BioProteção in Kenya as part of a broader project funded by the Banco Africano de Desenvolvimento. The testing aimed to assess the ease of use and effectiveness of the tool at the user’s level and was conducted across three counties in Kenya, namely Meru, Kirinyaga and Nakuru, which are among the major farming areas producing farm produce for export. A mix of users along the agriculture value chain were selected to be respondents. These included farmers, extension agents, agro-dealers and agronomists from the private and public sectors.

Um dos participantes está sendo guiado através da sessão de prova em Nakuru, Quênia.
Um dos participantes está sendo guiado através da sessão de prova em Nakuru, Quênia.

Cada sessão de teste durou aproximadamente uma hora. Durante a sessão, os administradores de teste explicaram os objetivos da sessão do teste, a função do usuário, os cenários de usabilidade e as informações necessárias na breve seção de histórico do questionário. Os usuários foram solicitados a completar uma série de tarefas pré-preparadas e os administradores observaram cada participante enquanto navegavam pelo portal executando as tarefas. Foram feitas anotações para registrar quando o usuário se esforçou para realizar as tarefas ou quando os usuários acenaram com a cabeça em apreciação de áreas específicas do portal. Depois que todas as tarefas foram concluídas, o administrador do teste pediu ao participante que avaliasse o portal usando uma escala Likert de 5 pontos. As medidas variaram de discordo totalmente a concordo totalmente para oito fatores subjetivos, incluindo; Frequência de uso prevista, Complexidade do sistema e Facilidade de uso

Most of the participants found the portal comprehensive, very useful and easy to use and comprehensive in terms of addressing advisors’ challenges of making recommendations for an identified pest problem in the field. Other feedback to improve the portal included, i) issues related to locating the ‘find a product’ button owing to too many details on the home page, ii) filling in the search terms (not straight-forward), iii) lack of clear instruction to navigate through the results, a ‘back button’ to start a new search or clear previous search results, and iv) lack of a visible and understandable feedback process.

 "AThis is a great and rare opportunity we have been given as users of the tool to try the portal before it is fully rolled out. We have in the past been left out in the development of such support decision support tools and as a result, they are often difficult to use or learn about. More importantly, we find them lacking in so many aspects that we could have given feedback on,” said Mr. David Kariuki, an extension officer in Kirinyaga county.

One of the key lessons drawn from the exercise is that a sense of ownership is acquired when users are recognised and allowed to give input to the development of digital tools. The users were very positive and proud to provide the very first feedback on a product for which they are the target users. They were clear that in instances when they are not involved from the start, learning to use the end product is usually slow and, in most cases, the product fails to include what they as users consider important in supporting and making their work easy.

Another valuable lesson learned from the user testing study was that to ensure a valuable outcome from user testing, it is important to always be very clear in terms of the tasks that the users are expected to perform to avoid making the testing a Q&A session. Some of the hurdles faced included a language barrier and lack of technical know-how (especially the farmers who had difficulty in using the computer or digital platforms). This called for administrators to be slow and clear in communicating and giving instructions related to the tasks.

The COVID-19 pandemic posed challenges, but the prior preparation and adherence to the COVID-19 guidelines, including providing users with the right personal protective equipment, helped build their confidence to participate in the user testing exercise. 

In conclusion, the usability testing of the CABI BioProtection Portal was an important exercise that allowed users to interact with the portal before its full roll out. It is evident that this process has built ownership and trust among the target user groups and will lead to the development of a product that is more in line with user requirements and expectations. This, in turn, will aid the portal in achieving its goal of raising awareness and uptake of biopesticides in agriculture.

Read more