Rub the pieces of provolone all over with the olive oil and season with the rest of the ingredients. Let marinate refrigerated for 1 hour. Grill the cheese on the hot grill over moderately-high heat for about 2 minutes per side until grill marks appear and the cheese just begins to soften.
Transfer the cheese to a metal plate or baking dish on top of the grill. Cook until the cheese just barely starts to melt and begins to brown on the bottom, about 3 to 5 minutes.
Serve hot with crusty bread or grilled bread slices.