Cut the potatoes in half and scoop out the center leaving a 1/8-inch rim. Cut each potato skin half into thirds and drizzle with olive oil. Sprinkle with paprika and salt and pepper. Place the skins, flesh side down in a hot pan with 1 tablespoon of oil. Cover the pan. Let cook for 1 minute on each side or until crispy. Add grated cheese to the skins and let them melt. Transfer to a serving plate. Serve with sour cream and chopped scallions.