Zero-shot Bilingual App Reviews Mining with Large Language Models - IMT Mines Alès
Communication Dans Un Congrès Année : 2023

Zero-shot Bilingual App Reviews Mining with Large Language Models

Jialiang Wei
Anne-Lise Courbis
Thomas Lambolais
Binbin Xu
  • Fonction : Auteur
  • PersonId : 747446
  • IdHAL : binbinxu
Gérard Dray

Résumé

App reviews from app stores are crucial for improving software requirements. A large number of valuable reviews are continually being posted, describing software problems and expected features. Effectively utilizing user reviews necessitates the extraction of relevant information, as well as their subsequent summarization. Due to the substantial volume of user reviews, manual analysis is arduous. Various approaches based on natural language processing (NLP) have been proposed for automatic user review mining. However, the majority of them requires a manually crafted dataset to train their models, which limits their usage in real-world scenarios. In this work, we propose Mini-BAR, a tool that integrates large language models (LLMs) to perform zero-shot mining of user reviews in both English and French. Specifically, Mini-BAR is designed to (i) classify the user reviews, (ii) cluster similar reviews together, (iii) generate an abstractive summary for each cluster and (iv) rank the user review clusters. To evaluate the performance of Mini-BAR, we created a dataset containing 6,000 English and 6,000 French annotated user reviews and conducted extensive experiments. Preliminary results demonstrate the effectiveness and efficiency of Mini-BAR in requirement engineering by analyzing bilingual app reviews.

Dates et versions

hal-04371019 , version 1 (03-01-2024)

Identifiants

Citer

Jialiang Wei, Anne-Lise Courbis, Thomas Lambolais, Binbin Xu, Pierre Louis Bernard, et al.. Zero-shot Bilingual App Reviews Mining with Large Language Models. ICTAI 2023 - IEEE 35th International Conference on Tools with Artificial Intelligence, Nov 2023, Atlanta, United States. pp.898-904, ⟨10.1109/ICTAI59109.2023.00135⟩. ⟨hal-04371019⟩
37 Consultations
0 Téléchargements

Altmetric

Partager

More