It was the second time this season Sherman has come off the bench to lead the team in scoring, as he hit 8 of 10 shots from the field and 2 of 2 from the free-throw line.
Jerian Grant added 13 points for Notre Dame (4-1), which led 32-21 at halftime.
Isaiah Armwood led the Colonials (1-2) with 12 points.
Jack Cooley had only two points in the first half, but scored Notre Dame’s first six points after the break. He hit two short jumpers off feeds into the low post, then took an offensive charge, and capped the run with a jumper from just inside the arc.
Irish point guard Eric Atkins then hit a jumper, finishing off an 8-2 run and extending the Irish lead to 17.