The aim of this study is to examine the effect of the partial replacement of sand by Glass Fiber-Reinforced Polymer (GFRP) waste on the mechanical properties of cement mortars. Compressive and flexural tests were carried out on mortars containing 0, 3, 5, 10, and 15% (by volume) of GFRP waste. It appears that the incorporation of 3% GFRP waste did not significantly affect the mechanical strength. However, further increasing the GFRP waste content led to a reduction in the mechanical strength. The flexural strength seemed less affected than the compressive strength, since the decrease in flexural strength at a 10% replacement was only 37%, while it was 54% for the compressive strength. However, an improvement in the toughness of the mortar with an increase in the substitution rate was observed. The reference sample displayed a flexural toughness of 0.351 N·m, while the mortar incorporating 15% of GFRP exhibited a flexural toughness of 0.642 N·m. The reuse of GFRP waste in cementitious materials, therefore, constitutes an interesting recycling solution.