Be sure to turn on an exhaust fan if grilling the chicken indoors. If you don’t have a fan, you can keep excess smoke from filling your kitchen (and maybe activating your smoke alarm) by grilling the chicken on the hot grill pan for 5 minutes, then flipping it and placing the pan in a preheated 425-degree-F oven for 20 to 25 minutes.