Heat the oven to 350 degrees F. Butter a 9-inch loaf pan.
Place the egg in a medium bowl; whisk in the milk and 4 tablespoons butter. (It's okay if there are still small chunks of butter remaining after whisking.)
In a large bowl, mix together the flours, baking powder, rosemary and salt with a fork. Add the egg mixture and stir with a wooden spoon just until combined. Sprinkle the raisins and goat cheese over the batter; gently fold in with just 2 or 3 strokes.
Pour into the prepared pan and bake until a toothpick inserted into the middle of the bread comes out clean, 50 to 55 minutes. Cool slightly, and slice.