ChatGPT can now access your Google Chrome tabs to complete tasks

OpenAI has released a major update that makes ChatGPT much smarter for people who use Google Chrome. Rolled out recently, the popular AI chatbot can now look at your open Chrome tabs, read the information on them, and even complete tasks for you right inside the browser. Alongside this browser integration, OpenAI has also introduced a major update to ChatGPT's voice features, adding support for new languages, including Hindi.

ChatGPT can now read and control your Chrome tabs

Instead of just answering questions, ChatGPT can now act like a personal assistant directly in your browser. It operates in two ways, known as Chat mode and Work mode. In Chat mode, ChatGPT can look through your open tabs and collect relevant information. For example, if you are looking to buy a new sofa and have three different websites open, you can ask the AI to compare them based on size, materials, delivery time, and return policies.

It can also explain an article in simple language or compare subscription plans without you having to constantly switch between different windows.

In Work mode, the AI takes things a step further by actually taking control of your tabs to get work done. You can ask it to fill out long online registration forms, draft emails, send messages, download files, and organise your messy tabs into neat groups. It can even collect information from different websites and arrange the details in a simple comparison sheet.

How to use ChatGPT with your open tabs

To use these new browser features, you need the ChatGPT desktop app and the official Chrome extension developed by OpenAI. First, open your ChatGPT desktop app settings and turn on the "Computer Use" feature. Next, install the ChatGPT extension from the Chrome Web Store, which currently has around 7 million users.

Once that is done, open a new chat in Work mode, type the "@" symbol to select your browser, and give ChatGPT a command. For instance, you can simply ask it to look at your open tabs and compare phone prices. This feature also works with other browsers like Microsoft Edge, Brave, and Opera.

Is it safe to give AI access to your browser?

While giving an AI access to your browser sounds exciting, security experts advise users to be careful. Because the AI can read whatever is on your screen, it is highly recommended not to keep sensitive tabs open, such as your bank account or private work emails, while ChatGPT is controlling your browser.

OpenAI has added safety measures where the AI asks for your permission before interacting with a new website or downloading a file. However, there is always a small risk of malicious websites trying to trick the AI, a concept known as "prompt injection", so it is best to only use this feature on websites you fully trust.

ChatGPT gets new voices and better language support

Alongside the Chrome upgrade, OpenAI has announced a new update called GPT-Live-1.1 for ChatGPT, Codex, and Dots. This update brings 13 new voices and improves performance across several languages, including Hindi, French, German, Mexican Spanish, Korean, and Japanese.

These improvements are designed to make voice interactions sound much more natural for people who prefer speaking to the AI in languages other than English. OpenAI says these updated voice capabilities are currently rolling out to all users and will be available for developers soon.