The influence of annealing on gate-defined quantum dot devices