Rub the pepper into the swordfish steaks and let sit for 5 minutes.
Meanwhile, combine the orange slices, onion, cilantro and olive oil in a bowl. Heat the vegetable oil in a heavy, large skillet over medium-high heat. Add the swordfish steaks and cook until well browned, about 3 minutes per side. Serve the fish with the salsa.