On a large baking sheet with sides, add the jalapenos, serranos, bell peppers, onions and tomatoes. Place the garlic under the cavities of the peppers to shield them from direct heat. Roast in the oven for 15 to 20 minutes.
In a medium pot set over high heat, add the vegetables from the roasting pan, the vinegar, and enough water to just cover the vegetables. Bring to a hard boil, and boil until the liquid is reduced by half, 15 to 20 minutes.
Remove the pepper stems from the pot. Pour the remaining vegetables and liquid from the pot to a blender, and blend until smooth. Wet a paper towel with water and squeeze out as much water as possible. Line the bottom of a fine mesh sieve with the paper towel in one layer. Place the sieve over a large bowl. Pour in the puree from the blender and let the puree slowly drip into the bowl beneath, about 30 minutes.
Discard any remaining pulp. Add the sugar and stir. Taste the hot sauce and add salt, if needed. Refrigerate for up to 2 weeks.
When blending hot liquid, first let it cool for five minutes or so, then transfer it to a blender, filling only halfway. Put the lid on, leaving one corner open. Cover the lid with a kitchen towel to catch splatters, and pulse until smooth.