For the punch: Add the maple syrup and rosemary to a small pot. Let steep over low heat for 20 minutes, then let cool. Remove the rosemary and pour the maple syrup into a pitcher. Add the apple cider, bourbon and lemon juice. Whisk to combine.
To serve: Serve punch over ice with rosemary stalks and apple slices as garnish.