When you take it off charge it starts automatically

When I take dyson off charge it starts to run without pressing the red button. When you press the red button the blut light comes one so button is registering. Only way to stop it is put back on charge or take battery out.

Only just installed a new battery this week.