Want Mark Zuckerberg’s Jarvis? Now You Can With Josh, the AI for Your Home

Image for post
Image for post
Zuckerberg using his Jarvis app (photo credit)

Last January, Mark Zuckerberg took on the challenge to create his own personal AI. Modeled after Jarvis from Iron Man, his AI’s goal was to make life at home a little easier. He wanted to “start teaching it to understand [his] voice to control everything in [his] home — music, lights, temperature and so on.” Last month Zuckerberg gave an update on his project, showing his success at building a rudimentary AI capable of controlling various aspects of his home including lighting, music, and more.

Image for post
Image for post
Zuckerberg giving a voice command (photo credit)

Zuckerberg interacts with his AI through a Facebook Messenger bot and a custom voice control app. The messenger bot lets him type commands to turn things on and off, such as the lights. One of his big insights was the fact that typing, not always speaking, was critical for communicating with Jarvis, particularly when he didn’t want to bother those around him. Zuck built a custom iPhone app he speaks to for voice commands, though it is “decidedly more inconsistent” than the Messenger bot.

In addition to turning on/off lights, Zuck demos some really cool capabilities. He set up alerts based on facial recognition through a camera that would help, among other things, with security and surveillance. He also developed a feature that chooses music depending on who’s using the system. He is running a Crestron controller that he hooks into, and takes advantage of simple smart switches to automate appliances like his toaster.

What Zuck can do with his AI is pretty exciting, and the great thing is you can get almost the same experience for yourself today. Here at Josh.ai we’ve developed, designed, and refined Josh, a personal AI designed specifically for home control. Because we have a team on this, not just a single developer, today Josh can do almost everything Jarvis can do, with quite a few more capabilities.

Image for post
Image for post
Tim Gill, Josh.ai Co-Founder & CTO

Josh, much like Jarvis, was the brainchild of a successful tech entrepreneur — in this case Tim Gill, founder of Quark. Wanting to build his own AI inspired by science fiction of the late 20th century, Gill partnered with Alex Capecelatro to create an immersive experience capable of auto-discovering devices and configuring on the fly for just about any home. The tech behind Josh started about 5 years ago with the product launching in late 2016.

With Josh, you can interact by talking, typing, and even texting commands from any mobile device or computer. The long-term vision is to move beyond the need to speak, with Josh automating tasks based on a machine learning model.

Want to tell Josh to turn on your lights or schedule your sprinklers? No problem. You can even play that show you’ve been binge watching on Netflix in the living room. Josh is also the only AI that lets you combine multiple commands at once, allowing for a more natural conversational experience. For example, saying this to Josh will work today:

“Josh, please set the temperature in the house to 72 degrees, play Frank Sinatra on the patio, turn off all the bedroom lights, and dim the lights everywhere else to 75%.”

Sure thing, boss.

Image for post
Image for post
Typing a command to Josh.ai

Josh also picks up on your habits to help automate parts of your life you didn’t know were needed. The system will learn how bright you like the lights at night, what music you want to wake up to, and can automatically turn on NPR in the kitchen when you get home from work because that’s the way you like it.

Image for post
Image for post
Josh controlling a large home in California

Josh works across iPhone, iPad, Android and desktop applications making it easier to access and control your home from anywhere as long as you’ve got internet. You can speak Josh commands through almost any stand-alone microphone, such as an Amazon Echo, Google Home, or even the microphone in your smartphone or iPad.

Image for post
Image for post
Josh iPhone app

Want to get Josh for yourself? Check out our website for more information at http://josh.ai or send us an email at belikezuck@jstar.ai.

Written by

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store