Welp... Adding sugar and vanilla didn't really help much. Can't really taste it. The bread came out the same way as last time. I should try again with yeast next time. Not sure how much to add though in a case like this...

@lucifargundam Is this a wild experiment or do you have good cause to believe this works?
I am interested in the results, please do post the result!