The Cabinet Office said it was seeking assurances from YouTube's owner Google that its messages would be displayed in a "safe and appropriate way" in future.
The Guardian, Channel 4 and the BBC have also pulled ads citing similar worries.
Google said it would review its controls.
YouTube: UK government suspends ads amid extremism concerns
Google has removed audio about the movie Beauty and the Beast which played out unprompted on Google Home.
"By the way, Disney's live action Beauty and the Beast opens today," the smart speaker said after listing the time, weather and travel update.
In a video posted on Twitter, it then talked about the plot and suggested asking it about main character Belle for "more movie fun".
Google denied that the material on Home was an advertisement.
Google pulls Beauty and the Beast 'ad' from Home