To protect clothes, I put my husband's old undershirts on my kids over their clothes before they eat popsicles. For smaller kids you can use a clothespin to clip the neck closed in the back, so no drips get through. And to protect the house, they eat the popsicles outside!
Less mess, works for me!
Find more tips at We are THAT Family.