Google Home is rolling out a new Gemini-powered automation feature that can trigger smart home routines based on what your security cameras see. This is one of several updates announced yesterday for Gemini for Home, including enhanced voice command support and general stability improvements following its Early Access launch in October.
“We’re introducing a brand-new Starter that lets you design automations based on visual insights,” Google said in its announcement. “Because your cameras can now actually understand what they see, your smart home can automatically react to almost anything happening around your home.”
The feature is currently supported for Nest cameras and select third-party cameras with “Gemini built-in” and is currently only available in English for US users enrolled in the Google Home Public Preview program. You’ll also need to enable AI descriptions for your cameras through “Gemini for Home Camera Features” and subscribe to the Google Home Premium Advanced plan ($20 per month or $200 per year).
To set up the feature, Google says you can simply describe the exact event you want to trigger the automation using natural language, and then choose which cameras inside or outside your home should look for it. Google recommends that you describe objects that are clearly visible on your camera, and says that the camera “needs a brief moment to process what it sees,” and so it should not be used for “urgent alerts, time-sensitive situations, or safety and security purposes.”
For example, you can ask Gemini for Home to look for “raccoons near the trash can,” then start a routine that turns on the security light to scare them away, or ask it to notify you when it detects mail has been delivered. You can also tell it to say “red BMW enters the driveway” or to watch for specific people (provided you have the Friendly Faces feature enabled), and then activate routines inside your home, like opening smart blinds or controlling your heating system.
Google also announced that Gemini for Home users can now ask the voice assistant to trigger multiple actions in a single verbal command, such as asking it to close the blinds, dim the lights, set a 20-minute timer, and start your favorite podcast. Gemini should also now respond more quickly to voice commands, and provide more “consistent and predictable” responses to natural language commands, such as asking it to turn its room lights “a little warmer.”
<a href