Add a little at a time until your frosting is the consistency you’d like. … When this is the case, start by adding a little extra powdered sugar to thicken the frosting. If it starts to get too sweet, add about 1 teaspoon of cornstarch which will also act as a thickener for the frosting.