Bottom line: Gemini can now select and analyze content directly from the Chrome screen, advancing deeper integration of AI and browser functionality.
Google has introduced the “Select from screen” tool for Gemini in Chrome, enabling the AI assistant to analyze marked screen content directly in the browser. This underscores Google’s strategic transformation of Chrome into an AI-centric platform.
The new “Select from screen” tool is accessible via the plus menu in Chrome and functions as an integrated screenshot tool. Users can mark text, images, or specific sections of web pages and send them directly to Gemini. The system thereby receives the exact context of the current screen display for more precise answers. The prerequisite is explicit user approval.
The feature is part of a broader strategy to expand Chrome as the primary interface for AI functionality. Gemini is being integrated more deeply into the browser to capture web content directly and automate tasks in real time. The system can search open tabs as well as access location and microphone. With Gemini 3.5 Flash (introduced on June 24, 2026), developers have access to advanced computer-use capabilities that allow AI agents to interact independently with browsers, desktop applications, and mobile apps.
For CTOs and security officers, this development warrants critical evaluation: the far-reaching access rights to screen content, tabs, location, and input devices create new attack surfaces. Security researchers explicitly warn that these permissions could be abused as surveillance tools in the event of a compromise. Organizations should regulate the use of these features and review the implications for data protection and security policies.
Regionally, the feature is available in the USA, Canada, Germany, France, Japan, and India. The United Kingdom remains excluded – an unusual step given its 50 percent market share in the period from May 2025 to May 2026.
Source: www.it-daily.net · Published July 4, 2026
Lumi AI News — AI-assisted curation pursuant to Article 50 EU AI Act. Paraphrase and classification by Lumi News Pipeline v1.7.3.