What we do
Any public website, any scale
Give us a target site and requirements. We extract, clean, and deliver structured data on a schedule you define — no infrastructure needed on your side
We handle the hard parts
Anti-bot bypass, CAPTCHA solving, browser fingerprinting, JavaScript rendering, proxy rotation, and schema design — all managed by our team
Delivered to your pipeline
Real-time API, scheduled files, or webhooks. Data lands in S3, GCS, SFTP, or your destination of choice — on the cadence you need
Dedicated account manager
A named person on every project. They handle onboarding, monitor delivery, and respond to issues the same day
How it works
1
Tell us your requirements
Target sites, data fields, delivery format, and refresh frequency. A 20-minute call is usually enough to scope.
2
We build and test
Our team builds the extractors, validates against your schema, and delivers a sample for your approval before going live.
3
Data arrives on schedule
Continuous delivery with monitoring. Your dedicated account manager handles any site changes or issues.
B2B & Sales
AI SDR Platforms
People and company data for automated prospecting, personalisation, and AI-driven outreach sequences
Sales Intelligence
LinkedIn profiles and company data as a full enrichment layer for account intelligence and CRM tools
AI Recruiting Platforms
Candidate profile data for sourcing engines, skills-based matching, and AI-powered recruiting tools
AI & Model Training
Training data, RAG pipelines, and agent enrichment. Schema-consistent records ready for ingestion
Creator & Influencer
Influencer Marketing Platforms
Creator discovery, audience analytics, and campaign management tools built on YouTube, TikTok, and Instagram data
Creator Discovery Tools
Search and filter 200M+ YouTube channels and 100M+ TikTok profiles by niche, follower tier, engagement, and location
Creator Intelligence
Engagement benchmarks, subscriber growth trends, SEO scores, and contact emails across all major platforms
Travel Intelligence
Rate Parity Monitoring
Track hotel and airline pricing across OTA and direct channels. Detect parity breaches in real time
Competitive Rate Intelligence
Monitor competitor pricing across target routes and properties. Feed directly into revenue management systems
OTA Aggregation
Normalised pricing and availability data across 19+ OTAs and brand sites. One schema, all sources
Reviews Intelligence
Competitive Intelligence
Monitor competitor ratings, review trends, and sentiment shifts across G2, Glassdoor, and Capterra
Voice of Customer
Structured review data for NLP, sentiment modelling, and product intelligence at scale
Employer Intelligence
Track employer sentiment, interview experience, and culture signals across Glassdoor and Clutch
WebAutomation
Pricing
Get started free

API Documentation

WebAutomation API Documentation

Refurbished Product Service

 

Model list:

 

GET /api/refurbished/models/

Allow: GET, POST, HEAD, OPTIONS

Content-Type: application/json

Returns list of models with ids:

[

    {

        "id": model_id,

        "user": user_id,

        "name": "a10 (sm-a105) - 32go",

        "brand": "Samsung",

        "storage": storage_id,

        "status": true/false

    },

]

Allows to post new models to system in given json format.

 

 

Store list:

 

GET /api/refurbished/stores/

 

Allow: GET, HEAD, OPTIONS

Content-Type: application/json

Returns list of stores with store ids:

[

    {

        "id": 3,

        "domain": "amazon.co.uk"

    },

    {

        "id": 5,

        "domain": "apple.com"

    },

]

 

Storage List:

 

GET /api/refurbished/storages/

Allow: GET, HEAD, OPTIONS

Content-Type: application/json

Returns list of stores with storage ids:

[

    {

        "id": 4,

        "name": "128GB",

        "alternatives": "128GB||128 GB"

    },

    {

        "id": 1,

        "name": "16GB",

        "alternatives": "16GB||16 GB"

    },

]

Model Prices Ready:

GET /api/refurbished/prices/ready/model_id

Allow: GET, POST

Content-Type: application/json

List all prices of refurbished model.

Model_id = integer - model_id to get.

Returns formatted json which contains model prices:

Data will be same with model prices endpoint.

 

Model Prices:

GET /api/refurbished/prices/model_id?network=unlocked

Allow: GET, POST

Content-Type: application/json

List all refurbished model prices.

Model_id = integer - model_id to get.

network = string - unlocked GET/POST 

 

Returns formatted json which contains model prices:

[

"A3": {

        "colours": {

          "red": {

            "prices": [

              {

                "store": "laptopsdirect.co.uk",

                "link": "https://www.laptopsdirect.co.uk/grade-c-apple-iphone-7-product-red-special-edition-4.7-128gb-4g-unlocked-a3-mprl2b-a-mv/version.asp",

                "price": 179.97

              }

            ],

            "colour": "red"

          },

          "silver": {

            "prices": [

              {

                "store": "laptopsdirect.co.uk",

                "link": "https://www.laptopsdirect.co.uk/grade-c-apple-iphone-7-silver-4.7-128gb-4g-unlocked-sim-free-a3-mn932b-a-mv/version.asp",

                "price": 179.97

              }

            ],

            "colour": "silver"

          },

          "no": {

            "prices": [

              {

                "store": "laptopsdirect.co.uk",

                "link": "https://www.laptopsdirect.co.uk/grade-c-apple-iphone-7-jet-black-4.7-128gb-4g-unlocked-sim-free-a3-mn962b-a-mv/version.asp",

                "price": 149.97

              }

            ],

            "colour": "no"

          },

          "gold": {

            "prices": [

              {

                "store": "laptopsdirect.co.uk",

                "link": "https://www.laptopsdirect.co.uk/grade-c-apple-iphone-7-rose-gold-4.7-128gb-4g-unlocked-sim-free-a3-mn952b-a-mv/version.asp",

                "price": 149.97

              }

            ],

            "colour": "gold"

          }

        },

        "condition": "A3"

      },

      "excellent": {

        "colours": {

          "red": {

            "prices": [

              {

                "store": "smartcellular.co.uk",

                "link": "https://www.smartcellular.co.uk/apple-iphone-7-plus-black-128gb-excellent-condition",

                "price": 279.99

              }

            ],

            "colour": "red"

          },

          "black": {

            "prices": [

              {

                "store": "smartcellular.co.uk",

                "link": "https://www.smartcellular.co.uk/apple-iphone-7-jet-black-128gb-excellent-condition",

                "price": 219.99

              }

            ],

            "colour": "black"

          },

          "silver": {

            "prices": [

              {

                "store": "smartcellular.co.uk",

                "link": "https://www.smartcellular.co.uk/apple-iphone-7-silver-128gb-excellent-condition",

                "price": 219.99

              }

            ],

            "colour": "silver"

          },

          "no": {

            "prices": [

              {

                "store": "envirofone.com",

                "link": "",

                "price": "-"

              },

              {

                "store": "handtec.co.uk",

                "link": "",

                "price": "-"

              },

              {

                "store": "smartcellular.co.uk",

                "link": "https://www.smartcellular.co.uk/catalogsearch/result/?q=apple+iphone+7+black+128gb+excellent+condition",

                "price": 0.0

              }

            ],

            "colour": "no"

          }

        },

        "condition": "excellent"

      },

]

 

Prices:

 

GET /api/refurbished/prices/?networks=unlocked

Allow: GET, POST

Content-Type: application/json

List all prices.

networks = string - separated by comma

colours = string - separated by comma

domains = string - separated by comma

conditions = string - separated by comma

storages = string - separated by comma

sort = string - price asc

sell = string - true/false

q = string

start = integer - 0

rows_per_page = integer - 10

 

Returns default price json grouped by unique itemKey:

{

"start": 0,

"numFound": 62606,

"docs": [

    {

      "brand": ["Apple"],

      "sku": ["-"],

      "updated_on": "2020-06-26T05:15:12Z",

      "id": "e38d9c72-2743-4a54-9630-39161087949d",

      "domain": ["smartcellular.co.uk"],

      "master_product": ["Apple iPhone 6s Plus"],

      "_version_": 1670525969750818816,

      "storage": ["16GB"],

      "network_s": "unlocked",

    "referer":["https://www.smartcellular.co.uk/apple-refurbished-iphone/iphone-6s-plus?p=2"

      ],

      "network": ["unlocked"],

      "status": ["pristine"],

      "url": [       "https://www.smartcellular.co.uk/catalogsearch/result/?q=apple+iphone+6s+plus+gold+16gb+unlocked+pristine"

      ],

      "colour": ["-"],

      "colour_s": "-",

      "itemKey": "4463a7c92bff4ca766956c31ab334eb3",

      "price": 0.0,

      "stock_info": ["instock"],

      "title": ["Search results for: 'apple iphone 6s plus gold 16gb unlocked pristine'"],

      "condition": ["pristine"],

      "image": ["-"],

      "sell": "false"

    },

]}

   

USAGE:

You can reach API endpoints with many methods. Username and password must be passed with request as BasicAuthentication.

curl -H 'Accept: application/json; indent=4' -u username:password https://webautomation.io/api/refurbished/storages/

[

    {

        "id": 4,

        "name": "128GB",

        "alternatives": "128GB||128 GB"

    },

    {

        "id": 1,

        "name": "16GB",

        "alternatives": "16GB||16 GB"

    },

    {

        "id": 7,

        "name": "1TB",

        "alternatives": "1TB||1 TB"

    },

    {

        "id": 5,

        "name": "256GB",

        "alternatives": "256GB||256 GB"

    },

    {

        "id": 2,

        "name": "32GB",

        "alternatives": "32GB||32 GB"

    },

    {

        "id": 6,

        "name": "512GB",

        "alternatives": "512GB||512 GB"

    },

    {

        "id": 3,

        "name": "64GB",

        "alternatives": "64GB||64 GB"

    }

Get Started

Build your first online custom web data extractor.