Easy Ways to Remove Labels from Glass Jars - Roetell It's also great for removing sticker labels off of glass jars. Here's how to do it: 1. Fill up a sink with hot water. Alternatively, you can also use a basin or a bucket. Make sure that there's enough water to submerge the glass jars in. 2. Add ½ cup of baking soda to the water. Mix well until the baking soda dissolves.