Soak 8 wooden skewers in water 15 to 20 minutes to prevent them from scorching on the grill. Pull back the corn husks about halfway and remove the silk. Pull the husks back to cover the kernels.
Preheat a grill to high. Meanwhile, melt the butter with the hot sauce and celery seeds in a small saucepan over medium heat, whisking. Set aside.
Thread the bell peppers, scallions and chicken, alternating, onto the skewers. Season with salt and pepper.
Brush the grill grates generously with vegetable oil. Grill the corn and kebabs, turning often, until the corn husks are charred and the chicken is just cooked through, 15 to 20 minutes. Transfer the corn to a platter. Brush the kebabs with some of the spicy butter (add a little at a time to avoid flare-ups). Continue grilling, turning, until the butter is sizzling, 2 more minutes.
Transfer the kebabs to a platter and brush with a little more spicy butter. Serve the kebabs and corn with the remaining spicy butter.