Pour the coffee into a medium saucepot and add the sugar, cinnamon stick and vanilla bean. Bring to a boil, remove from heat and stir in the vodka. Let cool, then transfer to a glass container and refrigerate.
Combine the chilled coffee-vodka mixture and the milk in a punch bowl. Serve in punch glasses over ice.