There are multiple issues that can cause the burnt taste, the most common is the wicks... i think, i don't use them so i don't know. Here is my take.
1. Wick, remove it or trim it, problem solved,
2. Stuff, if you have it in your pocket or purse, you might be getting some dust or something in...