For Agents
Programmatically general web scraping (post), general web scraping. Covers 7 operations with apiKey authentication.
Use for: I need to general web scraping (post), I want to general web scraping, Search for general web scraping (put), Find all general web scraping (delete)
Not supported: Does not handle payments, communications, or crm - use for cloud infrastructure only.
ScrapingAnt provides a web scraping API that runs a cluster of hundreds of Chrome browsers under the hood. The API handles JavaScript rendering, proxy rotation, CAPTCHA solving, and more. The API exposes 7 endpoints secured with apiKey authentication.
Install Jentic One Beta
Jentic One is a self-hosted execution layer for AI agents. It lets your agent call the ScrapingAnt API, or any other public or private API you need. You set the rules, the agent never sees your credentials, and every call is logged.
Two steps, two machines. Install the instance in a safe environment, then register your agent from wherever it runs.
Step 1: Jentic One Host machine
# On the machine that will host your Jentic One instance:
curl -fsSL "https://jentic.com/install.sh?src=apis&api=%2Fapis%2Fscrapingant.com%2Fscrapingant" | shStep 2: Agent machine
# On the machine where your agent runs (keep this separate from the instance):
curl -fsSL "https://jentic.com/install.sh?src=apis&api=%2Fapis%2Fscrapingant.com%2Fscrapingant" | sh
jentic register # connects your agent to your Jentic One instanceJentic One is in public beta. The setup above keeps your agent separate from the instance, which is what you want before using real credentials: an agent running as the same OS user as Jentic One can read its stored keys directly. Just evaluating? A single local install is fine to start. See the secure deployment guide for the tiers.
What an agent can do with ScrapingAnt API.
General Web Scraping (POST)
Markdown Extraction
AI Data Extraction
Extended JSON Output
Monitor ScrapingAnt API operational status and events
Patterns agents use ScrapingAnt API for, with concrete tasks.
★ Cloud Infrastructure Operations
Use the ScrapingAnt API to perform cloud infrastructure operations programmatically. The API provides 7 endpoints covering core functionality including general web scraping (post), general web scraping, general web scraping (put).
Call POST /general to general web scraping (post)
Automated extended Management
Automate extended operations by combining multiple ScrapingAnt API endpoints. Agents can general web scraping and then general web scraping (put) in a single workflow.
Call GET /general to general web scraping, then verify the result
AI Agent Integration via Jentic
AI agents discover and call ScrapingAnt API endpoints through Jentic without managing credentials directly. An agent searches for the required operation by intent, receives the matching endpoint schema, and executes the call with Jentic-managed authentication. This eliminates the need to read API documentation or handle apiKey tokens manually.
Search Jentic for 'general web scraping (post)', load the operation schema, and execute with Jentic-managed credentials
7 endpoints — scrapingant provides a web scraping api that runs a cluster of hundreds of chrome browsers under the hood.
METHOD
PATH
DESCRIPTION
/general
General Web Scraping (POST)
/general
General Web Scraping
/general
General Web Scraping (PUT)
/general
General Web Scraping (DELETE)
/markdown
Markdown Extraction
/extract
AI Data Extraction
/extended
Extended JSON Output
/general
General Web Scraping (POST)
/general
General Web Scraping
/general
General Web Scraping (PUT)
/general
General Web Scraping (DELETE)
/markdown
Markdown Extraction
/extract
AI Data Extraction
/extended
Extended JSON Output
What agents get from Jentic-routed access to this vendor.
Setup
Wiring the ScrapingAnt API by hand means passing your x-api-key in the query string against api.scrapingant.com and building your own retry handling across its general, markdown, and extract calls. Through Jentic you install once, import ScrapingAnt from the API Directory, store the API key once, and your agent calls it.
Permission scoping
ScrapingAnt takes the target URL in the request rather than the path, so you limit the agent to the operations it needs, such as a general scrape or a markdown extraction. You choose the operations it may call, so the DELETE general operation is not included unless you add it.
Credential isolation
Your ScrapingAnt API key is stored once, encrypted, by your own Jentic One instance and injected at execution time. It never enters the agent's prompt, logs, or context.
Intent-based discovery
Agents search Jentic by intent such as 'scrape a page' or 'get a page as markdown', and Jentic returns the matching ScrapingAnt operation with its input schema so the agent calls the right endpoint without browsing the reference docs.
Alternatives and complements available in the Jentic catalogue.
Specific to using ScrapingAnt API through Jentic.
What authentication does the ScrapingAnt API use?
The ScrapingAnt API uses an API key passed in the `x-api-key` query. Through Jentic, these credentials are stored encrypted in your Jentic One instance and injected at execution time, so raw secrets never enter the agent context.
Can I general web scraping (post) with the ScrapingAnt API?
Yes. Use the POST /general endpoint. The API returns structured JSON responses that agents can parse and act on directly.
What are the rate limits for the ScrapingAnt API?
Rate limits are not specified in the OpenAPI spec. Check the vendor documentation for current limits. Through Jentic, rate limiting is handled automatically with retry logic built into the execution layer.
How do I general web scraping (post) through Jentic?
Install the Jentic SDK with pip install jentic, authenticate through Jentic One, the self-hosted execution layer, then search for 'general web scraping (post)'. Jentic returns the matching ScrapingAnt API operation with its input schema. Load the schema and execute the call - credentials are injected automatically.
How many endpoints does the ScrapingAnt API have?
The ScrapingAnt API exposes 7 endpoints covering extended, extract, general operations.
Can I limit what my agent is allowed to do with the ScrapingAnt API?
Yes. Because you run Jentic One yourself, you decide which ScrapingAnt operations the agent may call, so you can grant only a general scrape (GET or POST /general) or a markdown extraction (GET /markdown) and leave everything else out. Since ScrapingAnt takes the target URL in the request body rather than in the path, the DELETE /general operation is not available to the agent unless you explicitly add it. Your API key is held by your own instance and injected only for the operations you have approved.
GET STARTED