agent tooling · Updated 2026-07-09
Agent Tooling Browser Capabilities Matrix — 2026
Source-backed comparison of Hermes browser and research capabilities against coding-agent browsers, MCP browser tools, cloud browser infrastructure, structured-extraction services, and consumer AI browsers.
Hermes, coding-agent browsers, MCP tools, browser infra, RPA agents, and consumer AI browsers
Vendor docs and source-of-record pages captured on 2026-07-09
Deterministic local browser control and CI-style verdict artifacts
Current verdict
Use Hermes as the default research workbench; add Playwright MCP and BrowserBash for deterministic browser QA; buy cloud/RPA browser infrastructure only for paid-infra needs.
Best starting point for research and knowledge-work orchestration because it combines search, extraction, rendered browser interaction, screenshots/vision, console inspection, files, terminal, skills, cron, memory, profiles, and MCP support.
Playwright MCP fills file upload, storage, console/network, trace/video/PDF, and broad interaction gaps; BrowserBash adds reviewable markdown tests and NDJSON pass/fail runs for agent-callable smoke tests.
Use when Hermes needs managed cloud browsers, session replay, persistence, stealth/proxy/captcha features, or Playwright/Puppeteer/Selenium-compatible infrastructure.
Best fit when the problem is repeatable business-process browser automation with credentials, profiles, file blocks, artifacts, human-interaction steps, and auditability.
Executive synthesis
The browser-agent landscape splits into five practical buckets.
- Integrated agent workbenches: Hermes, Codex, Claude Code, and ChatGPT Agent/Atlas combine model/tool orchestration with browser affordances. Hermes is the broadest provider-agnostic research workbench. Claude Code’s Chrome integration is the strongest captured option for real logged-in browser QA/debugging. Codex’s app browser is intentionally scoped to unauthenticated public/local/file pages.
- Open local browser control: Playwright MCP, Browser MCP variants, and BrowserBash are the best free or BYOM candidates. Playwright MCP is the deterministic baseline; Browser MCP variants are attractive for real Chrome-profile reuse but require serious permission review; BrowserBash is useful when agents need a reviewable browser-flow verdict.
- Cloud browser infrastructure and frameworks: Browserbase/Stagehand, Browser Use, and Steel provide managed browser runtime, sessions, recording, proxy, stealth, and captcha features. These claims are plan-sensitive and should be rechecked before purchase.
- Production workflow/RPA browser agents: Skyvern and MultiOn target multi-step business workflows. Skyvern has the clearest artifact, credential-vault, profile/session, file-block, and human-interaction surface in the captured docs.
- Consumer AI browsers and agents: ChatGPT Agent/Atlas, Perplexity Comet, and Gemini/Mariner are worth monitoring and can be useful personally, but they are weaker Hermes integration targets unless a developer API, MCP endpoint, or local automation bridge exists.
Hermes already has a credible research/browsing stack: search, extraction, JS-rendered browser actions, screenshots/vision, console inspection, file/terminal/wiki workflows, skills, cron, memory, profiles, MCP support, and configurable local/cloud browser backends. The main captured browser-specific gaps are file download/upload support, richer first-party network/CDP tools in the live schema, persistent authenticated browser-profile reuse, and native anti-bot/proxy/captcha infrastructure.
Recommendations for Hermes
Keep Hermes as the default research workbench
Hermes should remain the first tool for source gathering, synthesis, and knowledge-base publication because it can move from web search to rendered browser inspection to file/wiki output without leaving one agent runtime. Dedicated browser products rarely include that curation and workflow layer.
Standardize two free add-ons first
- Playwright MCP should be the default free/open browser-control MCP. It fills deterministic browser automation gaps around file upload, persistent storage state, console/network inspection, tracing, video, PDF, and cross-browser control.
- BrowserBash should be added as an agent-callable verification harness. Markdown tests, NDJSON
--agentoutput, exit-code verdicts, and optional screenshots/video make it well suited to “prove this web flow works” tasks.
Pay only when the task needs paid infrastructure
- Use Browserbase/Stagehand when Hermes needs reliable managed browsers, session replay/debugging, contexts, proxies/stealth/captcha, and MCP/SDK integration.
- Use Skyvern for repeatable business-process browser automation with credentials, profiles, downloaded/uploaded files, workflow blocks, human-interaction steps, and audit artifacts.
- Use Steel when Chad/Hermes wants to build its own browser-agent control loop but outsource cloud browser infrastructure, proxies, captcha solving, and live viewing.
- Use AgentQL when the bottleneck is resilient structured extraction or semantic selectors across changing pages, especially with Playwright.
- Treat Browser Use Cloud as promising but require current license/pricing verification and a small hands-on test before relying on it.
Suggested operating defaults
- Read-only research: start with
web_searchandweb_extract; switch to the Hermes browser when extraction returns a shell, the page is JS-rendered, or exact rendered state matters. - Local web-app QA/debugging: use Hermes browser for quick checks; use Playwright MCP for deterministic flows, uploads, storage, console/network artifacts, traces, video, or PDF; use BrowserBash when a CI-friendly pass/fail artifact is required.
- Authenticated personal accounts: only use real Chrome/Edge profile reuse when the user explicitly authorizes the trust boundary. Claude Code Chrome or a reviewed Browser MCP/local-CDP route are the captured options.
- Anti-bot, proxy, or CAPTCHA-heavy targets: do not pretend open local tools solve this natively. Evaluate Browserbase, Steel, Browser Use Cloud, Skyvern, or AgentQL/Tetra based on whether the need is infrastructure, full workflow automation, or extraction.
- Enterprise repeatable workflows: evaluate Skyvern first, then Browserbase/Stagehand or Steel if the team wants more control over the agent loop.
Capability bucket notes
Hermes versus dedicated browser products
Hermes is strongest when the goal is not just to browse but to produce an auditable artifact: a ResearchHub report, wiki page, code change, scheduled digest, or multi-agent Kanban handoff. Dedicated browser products are stronger at narrow browser mechanics such as persistent sessions, file transfer, anti-bot/proxy/captcha tiers, or enterprise workflow artifacts.
Local browser control options
Playwright MCP is the safest default because it is open, deterministic, and purpose-built for automation. Browser MCP variants that control a real logged-in Chrome profile are powerful but should be treated like giving an extension broad access to the user’s personal browser. BrowserBash is complementary: it turns natural-language web-flow checks into reviewable tests and machine-readable verdicts.
Cloud infrastructure options
Browserbase/Stagehand and Steel are infrastructure layers. They are not the whole agent brain; they provide browsers, sessions, debugging, proxies, captcha, and compatibility with automation frameworks. Skyvern is closer to a workflow/RPA system with business-process primitives and audit artifacts.
Unresolved verification gaps
- OpenAI Codex Chrome-extension details outside the in-app browser docs, and richer current ChatGPT Agent/Atlas FAQ details, remain thin.
- Browser Use’s current license, cloud pricing, and exact file/console/network support need direct verification.
- MultiOn pricing and whether Agent V1 Beta remains current or broadly available need verification.
- Project Mariner’s current availability and capabilities need stronger official source-of-record evidence.
- Browser MCP variants beyond Microsoft Playwright MCP should be installed and tested before relying on README claims, especially for CAPTCHA/human fallback, network tools, and file upload/drop.
- CAPTCHA, proxy, stealth, and anti-bot claims are vendor- and plan-sensitive; recheck before buying or promising them operationally.
Product matrix
Comparison table
| Option | Runtime | Strength | Auth/session | Debug/artifacts | Anti-bot/proxy | Best fit | Caveat |
|---|---|---|---|---|---|---|---|
| Hermes Agent | Local/cloud browser backends plus web_search/web_extract | Broad research orchestration and knowledge workflow integration | Backend-dependent; no first-class persistent user-profile vault in this capture | Screenshots/vision and console inspection; richer CDP exposure depends on installed tool schema | Partial through configured Browserbase, Browser Use, Camofox, or other backends | Default source gathering, dynamic-page fallback, ResearchHub/wiki workflows | No native browser file downloads in captured docs; file upload not exposed in this live schema |
| Codex app browser | OpenAI coding app browser for local/public unauthenticated pages | Coding previews and public/local web-app debugging | Does not support auth flows, cookies, existing tabs, extensions, or regular browser profile | Screenshots and developer-mode CDP reads with approval | No captured claims | Unauthenticated local/public app verification inside Codex | Deliberately scoped away from signed-in browser workflows |
| ChatGPT Agent / Atlas | OpenAI visual/text browser and Atlas product surface | Consumer task execution and research with permissions | Can use logged-in sites with product controls and user takeover | Screenshots/source links; no developer console/network surface captured | No proxy/captcha infrastructure claims captured | Personal browsing tasks, not programmable Hermes infrastructure | SDK/API surface and exact limits are not established in the captured docs |
| Claude Code Chrome | Local Chrome/Edge extension connected to Claude Code | Authenticated app QA/debugging in the user's real browser state | Strong reuse of logged-in Chrome/Edge profile; manual login/CAPTCHA handoff | Console, DOM, network reads, screenshots, GIF recording | Human CAPTCHA/login handoff, not auto-solve/proxy infra | Testing logged-in apps and debugging browser flows | High trust boundary; direct Anthropic plan and browser/version constraints |
| Browserbase + Stagehand | Cloud browsers plus Stagehand SDK/MCP | Managed sessions, structured extraction, recordings, proxies, stealth, captcha tiers | Contexts, keepAlive, contextId, persist, cookies | Recordings, logs, session inspector | Captcha/proxy/identity features are plan-sensitive | Production browser-agent infrastructure and structured extraction | Cloud cost and compliance blocklists; verify paid tier capabilities before buying |
| Browser Use | OSS local/self-hosted or Browser Use Cloud | Fast browser-agent prototyping with cloud profile/proxy/recording options | Cloud profile_id and keep_alive; local support depends implementation | Recording and screenshots likely, exact support needs verification | Cloud claims stealth, CAPTCHA solving, residential proxies | Prototype autonomous browser tasks | Current license, cloud pricing, and exact file/debug support remain verification gaps |
| Skyvern | Cloud Chromium, local embedded/server, self-host options | Workflow/RPA automation with credentials, artifacts, file blocks, human interaction | Sessions up to 24h; persistent profiles; credential vault integrations | Videos, screenshots, HAR, JSON logs, downloaded files | Higher tiers add CAPTCHA, 2FA/TOTP, residential proxy, city targeting | Enterprise repeatable browser workflows | Credential/trust boundary and credit billing need review |
| AgentQL | Structured extraction/query API plus Playwright-style locators | Resilient semantic selectors and schema-shaped extraction | Docs claim public/private/authenticated pages; mechanics need verification | Optional screenshot and remote browser sessions | Stealth browser profile and proxy options; captcha unclear | Changing-site extraction and selectors paired with Playwright | Not a full autonomous browser-agent layer by itself |
| Playwright MCP | Local Playwright browser automation exposed over MCP | Free deterministic browser control with snapshots, storage, network, traces, video, PDF | Persistent login/cookie sessions by default; storage-state tools | Console, network requests/routes, screenshots, tracing/video/PDF | No native anti-bot/captcha beyond Playwright configuration | Default free MCP browser-control layer for Hermes | Local browser infra and token/tool overhead |
| Browser MCP variants | Local Chrome extension/MCP servers controlling a real user browser | Existing logged-in profile, real browser fingerprint, human CAPTCHA handoff | Strong real-profile reuse | Screenshots/console/network/file claims vary by implementation | Human CAPTCHA; no native auto-solve unless variant claims it | Explicitly authorized authenticated-browser workflows | High extension permission/privacy risk; install-level claims need verification |
| BrowserBash | CLI over local Chrome/CDP/Browserbase/browser grids | Plain-English browser smoke tests with NDJSON agent mode and reviewable markdown tests | Secrets/variables and provider/session-dependent persistence | Screenshots/video with --record; grid providers can add logs | Depends on selected provider; no native captcha claim | CI-friendly proof that a web flow works | Young ecosystem; reliability depends model/provider/engine |
| Steel | Self-hosted or Steel Cloud browser sessions | Browser infrastructure with sessions, proxies, captcha, live viewer, Playwright/Puppeteer/Selenium compatibility | Isolated sessions keep cookies/storage; profiles and dedicated IPs | Live viewer, request logging UI, screenshot/PDF APIs | useProxy, managed residential/BYOP, solveCaptcha; tier limitations | Custom browser-agent control loops needing infra | Not an agent brain; captcha limits and session cost need management |
| MultiOn | Cloud or local extension autonomous browsing API | Natural-language browse/retrieve/scrape by API | session_id continuation; 10-minute inactivity sessions | Optional final screenshot; no console/network captured | use_proxy gives residential IP per session | Black-box autonomous web tasks via API | Current availability and pricing unclear |
| Gemini managed agents / Mariner | Google-hosted Linux sandbox / experimental Chrome extension evidence | Managed agents can browse/code/files in sandbox; Mariner is a watchlist browser-agent signal | Sandbox state; Mariner auth details unclear | Multimodal/sandbox details incomplete | No captcha/proxy evidence captured | Watchlist for managed browser/code/file agents | Current Mariner availability and capability evidence is thin |
| Perplexity Comet | Consumer AI browser apps | Personal research and browser assistant workflows | Browser profile/history/memory controls; cookie details not captured | No developer console/network tool | No captured claims | Personal product, not Hermes-integrated infrastructure | No developer API captured; exact limits unclear |
Sources & provenance
Source notes
- Hermes Agent tools reference
Baseline for Hermes tool surface including web, browser, vision, file, terminal, delegation, cron, session search, and profile-aware runtime capabilities.
- Hermes browser automation docs
Source for Hermes browser backends, interaction model, screenshots/vision, session isolation, and no-file-download caveat.
- Hermes web search and extract docs
Source for web_search/web_extract positioning and the browser fallback pattern for dynamic or exact rendered pages.
- OpenAI Codex app browser docs
Source for Codex browser support on local/file/public unauthenticated pages and explicit auth/profile/cookie limitations.
- OpenAI Codex CLI features
Source for Codex first-party web search behavior and live-search controls.
- OpenAI ChatGPT Agent announcement
Source for ChatGPT Agent combining Operator-style website interaction, deep research, visual/text browser, terminal, connectors, permissions, and user takeover.
- Claude Code Chrome docs
Source for Claude Code Chrome/Edge extension capabilities, logged-in browser reuse, console/DOM/network access, screenshots, GIFs, and permission model.
- Claude Code computer-use docs
Source for macOS computer-use preview, app-level approvals, and fallback positioning versus MCP/Bash/Chrome.
- Browserbase sessions and pricing docs
Source for cloud browser sessions, contexts, recordings/logs, identity/proxy/captcha features, and plan-sensitive pricing/capability limits.
- Stagehand MCP tools and setup docs
Source for Stagehand/Browserbase MCP navigate, act, observe, extract, session lifecycle, keepAlive, persist, proxies, and model configuration.
- Browser Use cloud and open-source docs
Source for Browser Use run/browser APIs, cloud profile/proxy/recording options, stealth/CAPTCHA/proxy claims, and OSS/local positioning.
- Skyvern browser automation and core concepts docs
Source for Skyvern cloud Chromium, Playwright-plus-AI methods, agents, sessions/profiles, credential providers, artifacts, file blocks, and billing tiers.
- AgentQL query language and REST API docs
Source for semantic selectors, query_data/query_elements, schema output, remote browser sessions, stealth profile, and proxy parameters.
- Playwright MCP docs and GitHub
Source for accessibility-snapshot browser automation, 40+ tools, persistent login/cookie state, storage, network, console, tracing, video, PDF, and Apache-2.0 license.
- BrowserBash docs and GitHub
Source for plain-English CLI browser automation, NDJSON --agent mode, markdown tests, exit-code verdicts, local/cloud providers, recordings, and Apache-2.0 CLI.
- Steel sessions/proxies docs and steel-browser GitHub
Source for isolated sessions, Playwright/Puppeteer/Selenium compatibility, live viewer, proxy, solveCaptcha, profiles, and Apache-2.0 open-source core.
- MultiOn API docs
Source for /v1/web/browse natural-language autonomous browsing, session continuation, screenshot option, local/cloud mode, and residential proxy flag.
- Gemini managed agents docs
Source for Google managed-agent sandbox browsing/code/files model and security posture; Project Mariner evidence remains thinner.
- Perplexity Comet product and pricing pages
Source for Comet browser/personal assistant positioning and Pro/Max Comet/Computer credit indications.
- Local provenance bundle
ResearchHub publication distilled /home/chad/wiki/queries/agent-tooling-browser-capabilities-2026-07-09.md and raw bundles under /home/chad/knowledge/raw/agent-tooling/browser-capabilities/2026-07-09/.