A minute’s silence was observed before kick off in honour of HM Queen Elizabeth II.
Horbury began on the front foot with Benjamin Agu coming close early on.
Soon afterwards David Birch made impressive stops to keep out powerful strikes from Gibril Bojang and Samuel Awty.
The Zebras then improved, forcing corners as well as enjoying more possession. Kevan Kahoussi was causing problems on the right and had a shot deflected just wide.
The first goal came from the penalty spot on 43 minutes after Awty was upended by Luke Sellers. Bojang’s firm spot kick found the corner of the net.
Horbury could have doubled their lead on the stroke of half time when Agu fired over the crossbar.
The visitors continued to look dangerous in the second half with an effort from Bojang flying inches wide.
At the other end Jack Richardson’s shot was blocked inside a crowded box.
In the last 15 minutes Brigg seized the initiative after Horbury’s Joe Penn was dismissed for a foul on Kahoussi.
The introduction of Martin Pembleton and Alfie Usher brought more constructive play and a free kick from the former led to Brigg’s equalizer in the 86th minute. His delivery from the left was headed home at the far post by Fraser Papprill.
Just 4 minutes later, the other sub Usher latched on Stephen McCarron’s through ball to slot in the winner.
Horbury had no time to reply and Brigg ran out winners thanks to a great ending. The Zebras made their numerical advantage count late on to win for the fourth time in a row.