Preheat the oven to 475 degrees F.
Put the cod in an ovenproof baking dish and season with salt and pepper, to taste. Top each fillet with 3 lime slices, the olives, capers and rosemary. Drizzle with olive oil.
Bake until the fish is cooked through, about 10 minutes. Remove the fish from the oven and serve with lime wedges.