Stourbridge went out of the league cup at Rugby Town despite leading by two goals twice in the game.
The Glassboys only had themselves to blame for letting their opponents back into this tie, which should have been over at half time.
Youth team prospect Adam Ward gave Stourbridge the lead on 16 minutes with a great finish.
John Griffin fired in number two on 27 minutes when he got on the end of an Aaron Drake cross.
Seb Lake-Gaskin pulled a goal back for Rugby on 36 but Stourbridge had enough first-half chances to bury them.
Griffin made it 3-1 on 53 with another neat finish but Luke Keen reduced the deficit on 67 from close range.
Second choice Stourbridge goalkeeper John Bateman was called upon to make two excellent saves as Rugby tried to get back in the game.
And former Halesowen Town defender Nik Preston got the equaliser just one minute from time, with Keen getting the winner for Rugby on 91 minutes.
Comments: Our rules
We want our comments to be a lively and valuable part of our community - a place where readers can debate and engage with the most important local issues. The ability to comment on our stories is a privilege, not a right, however, and that privilege may be withdrawn if it is abused or misused.
Please report any comments that break our rules.
Read the rules here