Judges 20:36

20:36 Then the Benjaminites saw they were defeated.

The Israelites retreated before Benjamin, because they had confidence in the men they had hid in ambush outside Gibeah.