In a small bowl, whisk together the mayonnaise, garlic, zests, thyme, paprika, honey and season with salt and pepper, to taste. Cover and refrigerate for at least 30 minutes before serving.
Put the potatoes in a pot of cold water, add 2 tablespoons of salt and cook over medium heat until the potatoes are tender, but still firm, about 10 minutes. Drain, let cool and cut each potato lengthwise into 8 slices.
Heat the grill to medium. Brush the potatoes with the oil and season with salt and pepper, to taste. Grill until golden brown and cooked through, about 2 to 3 minutes per side. Transfer to a serving platter or bowl and serve with the mayonnaise.