xAI Grok Chatbot Gains Vision Capabilities

xAI's Grok Gains Visual Question Answering Capabilities

xAI’s Grok chatbot has been updated with the ability to interpret and respond to queries regarding the content captured by a smartphone camera.

This functionality mirrors similar real-time vision features currently offered by competing platforms such as Google’s Gemini and ChatGPT.

Introducing Grok Vision

xAI announced the release of Grok Vision on Tuesday. This new feature empowers users to direct their phone’s camera towards various items – including merchandise, signage, and written materials – and then pose questions about what is being viewed.

Currently, Grok Vision is available exclusively through the Grok application for iOS devices. Support for the Grok Android app is forthcoming.

Additional New Features

Alongside Grok Vision, several other enhancements have been introduced to Grok today.

These include support for multilingual audio input and the implementation of real-time search functionality within Grok’s voice interaction mode.

Access to these features is presently limited to Android users who have an active subscription to xAI’s SuperGrok plan, priced at $30 per month.

Recent Grok Developments

The Grok chatbot has been undergoing continuous development and receiving new features at a consistent pace.

Earlier in the month, xAI integrated a “memory” function into Grok. This allows the chatbot to reference and utilize information from previous interactions.

Furthermore, a canvas-style tool was added, enabling users to create documents and applications directly within the Grok environment.