Preheat the oven to 350 degrees F. Grease a 13 by 9 by 2-inch pan.

Mix together granulated sugar, eggs, and milk in a bowl; add vanilla. Pour over cubed bread and let sit for 10 minutes.

In another bowl, mix and crumble together brown sugar, butter, and pecans.

Pour bread mixture into prepared pan. Sprinkle brown sugar mixture over the top and bake for 35 to 45 minutes, or until set. Remove from oven.

For the sauce:

Mix together the granulated sugar, butter, egg, and vanilla in a saucepan over medium heat. Stir together until the sugar is melted. Add the brandy, stirring well. Pour over bread pudding. Serve warm or cold.