Scrapeman
Download
Docs: Request Building

URL bar

The URL bar supports {{var}} syntax with live highlighting. Variables resolve from the active environment, collection variables, and built-in dynamics.

An autocomplete popover appears when you type {{ showing all available variables with their current resolved values.

Tabs

  • Params — key-value table with two-way URL sync. Editing a param updates the URL query string and vice versa. Disabled rows survive saves and reloads.
  • Headers — key-value table. Auto-headers (Content-Type, Accept-Encoding, User-Agent) are shown with a toggle to disable or override each one. The pencil toggle in the top-right opens a bulk-edit textarea where each line is Key: Value and a // prefix disables the line. Round-trip is lossless. Hover-only grip handles let you drag rows to reorder them.
  • Body — modes: none, raw (JSON, XML, HTML, text, JavaScript), form-urlencoded, multipart form-data, binary file, GraphQL (planned). The editor is CodeMirror with language-aware syntax highlighting, {{var}} decoration in the accent palette when known and the destructive palette when undefined, and an autocomplete popover that triggers on {{. JSON bodies get a Beautify button (Shift+Cmd+F on macOS, Shift+Ctrl+F on Windows / Linux): strict JSON.parse first, then JSON5 for trailing commas / single quotes / unquoted keys / comments, then a missing-comma repair pass. Inline lint shows a red gutter icon on parse errors.
  • Auth — see Auth Schemes.
  • Settings — per-request proxy, timeout, redirect, HTTP version (allowH2), TLS certificate verification toggle (off behaves like curl -k; the URL bar shows a red Insecure badge), cookie jar opt-out, raw-body toggle (sends {{var}} verbatim instead of resolving), Scrape.do native mode, User-Agent preset picker, rate limit, and rotating proxy. See Proxy & Scrape.do.
  • Scripts — pre-request and post-response JavaScript in a Node vm sandbox. The req proxy mutates the outgoing request, res reads the response (auto-parsed JSON), and bru reads / writes variables across folder, collection, environment, and global scopes. test() / expect() assertions render in the Scripts response tab.
  • Code — see Code Export.
  • WebSocket — bidirectional WebSocket client. Connect to a ws:// or wss:// URL, send messages, watch the timeline with direction arrows, ping latency, and JSON expand. Per-connection proxy, including Scrape.do WS endpoints. Switching tabs leaves the socket open.
  • Load — see Load Runner.

URL bar shortcuts

  • Cmd+Enter — send (or cancel an in-flight send).
  • Cmd+R — parallel send. Each press fires another request without cancelling the in-flight one. A live HUD in the bottom-right tracks every fired request with status, HTTP code, and elapsed duration. Holding the key fires at the OS key-repeat rate, capped at 32 simultaneous parallel sends per tab.
  • Variables that resolve to a full URL (e.g. {{base_url}} → https://api.example.com) are left alone by the URL normalizer; the actual scheme is decided after variable resolution.

Key-value table keyboard shortcuts

In both Headers and Params tables:

  • Shift+Enter — insert a new empty row below the current one; focus moves to the new Key cell.
  • Tab from the last row's Key cell — if the Key cell is non-empty, a new empty row is appended automatically. No need to click "Add row."

Right-click string transforms

The URL bar, header / param cells, and other text inputs expose a right-click menu with these transforms:

  • URL encode / decode — encodeURIComponent / decodeURIComponent.
  • Base64 encode / decode — UTF-8 safe; works with multi-byte characters that pure btoa would reject.
  • Stringify / Destringify — escape and unescape for embedding inside a JSON string literal. Stringifying say "hi" produces say \"hi\".

When a selection is present in the focused input, transforms apply to that selection only. With no selection they apply to the whole field. Malformed inputs leave the field untouched.

Auto-headers

Scrapeman automatically sets three headers based on the request:

  • Content-Type — derived from the body mode (application/json for JSON body, application/x-www-form-urlencoded for form, etc.)
  • Accept-Encoding — gzip, br, deflate so the response is auto-decompressed by undici.
  • User-Agent — Scrapeman/<version>.

Each auto-header can be disabled or overridden per-request from the Headers tab. If you manually set the same header, your value wins.