AutoScout24.com Scraper

{
  "title": "AutoScout24.com Scraper Input",
  "type": "object",
  "schemaVersion": 1,
  "properties": {
    "productUrls": {
      "title": "Product URLs",
      "type": "array",
      "description": "Add one or more product page URLs to scrape. Example product URLs:\n\n- https://www.autoscout24.com/offers/bmw-316-316d-touring-aut-diesel-white-cat_ma13mo1639-08391ca9-d1c4-42b7-ac00-27ba63d2fc78\n- https://www.autoscout24.com/offers/bmw-320-320i-high-executive-hud-sport-stoelen-leer-nette-a-gasoline-brown-cat_ma13mo1641-8d8d44f1-2556-43de-978b-be5c2eedf1b7\n- https://www.autoscout24.com/offers/bmw-318-3-serie-touring-318i-m-performance-eye-catcher-gasoline-blue-cat_ma13mo1640-0bb85b14-ee5e-4c25-8528-651c47b0bba3",
      "prefill": [
        "https://www.autoscout24.com/offers/bmw-316-316d-touring-aut-diesel-white-cat_ma13mo1639-08391ca9-d1c4-42b7-ac00-27ba63d2fc78",
        "https://www.autoscout24.com/offers/bmw-320-320i-high-executive-hud-sport-stoelen-leer-nette-a-gasoline-brown-cat_ma13mo1641-8d8d44f1-2556-43de-978b-be5c2eedf1b7",
        "https://www.autoscout24.com/offers/bmw-318-3-serie-touring-318i-m-performance-eye-catcher-gasoline-blue-cat_ma13mo1640-0bb85b14-ee5e-4c25-8528-651c47b0bba3"
      ],
      "default": [],
      "editor": "stringList"
    },
    "categoryUrls": {
      "title": "List URLs",
      "type": "array",
      "description": "Add one or more List URLs to scrape.\n\nSupported page types with examples:\n\n- Filtered result page: https://www.autoscout24.com/lst/bmw/3-series?atype=C&cy=D&priceto=20000&sort=price&desc=1\n- Brand page: https://www.autoscout24.com/lst/bmw\n- Category page: https://www.autoscout24.com/lst/bmw/3-series\n\nLeave blank if using direct product URLs instead.\n\nThe `scrapeProductDetails` option (labelled Include product details) decides what each List URL produces. When it is enabled, the Actor visits each product page and returns the full detail records; when it is disabled, the Actor returns one list-level record per product card with the fields that are always included.",
      "prefill": [
        "https://www.autoscout24.com/lst/bmw/3-series",
        "https://www.autoscout24.com/lst/bmw",
        "https://www.autoscout24.com/lst/bmw/3-series?atype=C&cy=D&priceto=20000&sort=price&desc=1"
      ],
      "default": [],
      "editor": "stringList"
    },
    "maxResultsPerScrape": {
      "title": "Maximum results",
      "type": "integer",
      "description": "Maximum number of product records to save.",
      "default": 20,
      "minimum": 1,
      "maximum": 100000
    },
    "usePagination": {
      "title": "Use pagination",
      "type": "boolean",
      "description": "If this option is enabled and a List URL has more than one page, the Actor continues through the following pages until it reaches the Maximum results limit. If the option is disabled, the Actor only scrapes the first page of each List URL.",
      "prefill": true,
      "default": true
    },
    "scrapeProductDetails": {
      "title": "Include product details",
      "type": "boolean",
      "default": true,
      "description": "If this option is enabled, the Actor visits each product page and adds the full product details to every record. If it is disabled, the Actor returns one list-level result record per product card.\n\nFields that are always included:\n\n- `url`\n- `product_id`\n- `name`\n- `price`\n- `regular_price`\n- `currency`\n- `sku`\n- `brand`\n- `category`\n- `main_image`\n- `images`\n- `rating_value`\n- `review_count`\n- `seller_name`\n- `seller_type`\n- `seller_url`\n- `location`\n- `mileage_km`\n- `power_hp`\n- `first_registration`\n- `canonical_url`\n- `scraped_at`\n\nFields that are only added when this option is enabled (set to true), and not added when it is disabled:\n\n- `in_stock`\n- `breadcrumbs`\n- `breadcrumb_urls`\n- `description`\n- `description_html`\n- `color`\n- `features`\n- `attributes`\n- `seller_contact_name`\n- `seller_phone`\n- `seller_address`\n- `condition`\n- `created_at`\n- `displacement_cc`"
    }
  }
}

{
  "actorSpecification": 1,
  "fields": {
    "type": "object",
    "additionalProperties": false,
    "properties": {
      "url": {
        "type": [
          "string",
          "null"
        ],
        "format": "uri"
      },
      "product_id": {
        "type": [
          "string",
          "null"
        ],
        "description": "Stable source-side product identifier."
      },
      "name": {
        "type": [
          "string",
          "null"
        ]
      },
      "price": {
        "type": [
          "number",
          "null"
        ]
      },
      "regular_price": {
        "type": [
          "number",
          "null"
        ]
      },
      "currency": {
        "type": [
          "string",
          "null"
        ],
        "description": "ISO 4217 currency code."
      },
      "in_stock": {
        "type": [
          "boolean",
          "null"
        ]
      },
      "sku": {
        "type": [
          "string",
          "null"
        ]
      },
      "brand": {
        "type": [
          "string",
          "null"
        ]
      },
      "category": {
        "type": [
          "string",
          "null"
        ]
      },
      "breadcrumbs": {
        "type": "array",
        "items": {
          "type": "string"
        }
      },
      "breadcrumb_urls": {
        "type": "array",
        "items": {
          "type": "string",
          "format": "uri"
        }
      },
      "main_image": {
        "type": [
          "string",
          "null"
        ],
        "format": "uri"
      },
      "images": {
        "type": "array",
        "items": {
          "type": "string",
          "format": "uri"
        }
      },
      "description": {
        "type": [
          "string",
          "null"
        ]
      },
      "description_html": {
        "type": [
          "string",
          "null"
        ],
        "description": "Sanitized rich-text product description with structural HTML only."
      },
      "color": {
        "type": [
          "string",
          "null"
        ]
      },
      "features": {
        "type": "array",
        "items": {
          "type": "string"
        }
      },
      "attributes": {
        "type": "object",
        "description": "Additional source product attributes."
      },
      "rating_value": {
        "type": [
          "number",
          "null"
        ]
      },
      "review_count": {
        "type": [
          "integer",
          "null"
        ]
      },
      "seller_name": {
        "type": [
          "string",
          "null"
        ]
      },
      "seller_url": {
        "type": [
          "string",
          "null"
        ],
        "format": "uri"
      },
      "seller_contact_name": {
        "type": [
          "string",
          "null"
        ]
      },
      "seller_phone": {
        "type": [
          "string",
          "null"
        ]
      },
      "seller_address": {
        "type": [
          "string",
          "null"
        ]
      },
      "canonical_url": {
        "type": [
          "string",
          "null"
        ],
        "format": "uri"
      },
      "scraped_at": {
        "type": "string",
        "format": "date-time"
      },
      "condition": {
        "type": [
          "string",
          "null"
        ],
        "description": "Displayed new or used vehicle condition."
      },
      "created_at": {
        "type": [
          "string",
          "null"
        ],
        "description": "Source listing creation timestamp when exposed."
      },
      "displacement_cc": {
        "type": [
          "integer",
          "null"
        ],
        "description": "Displayed engine displacement in cubic centimetres."
      },
      "first_registration": {
        "type": [
          "string",
          "null"
        ],
        "description": "Displayed first-registration month and year."
      },
      "location": {
        "type": [
          "string",
          "null"
        ],
        "description": "Displayed seller or vehicle city and country."
      },
      "mileage_km": {
        "type": [
          "integer",
          "null"
        ],
        "description": "Displayed odometer value in kilometres."
      },
      "power_hp": {
        "type": [
          "integer",
          "null"
        ],
        "description": "Displayed engine power in horsepower."
      },
      "seller_type": {
        "type": [
          "string",
          "null"
        ],
        "description": "Displayed dealer or private seller classification."
      }
    },
    "required": [
      "url",
      "name"
    ]
  },
  "views": {
    "overview": {
      "title": "Overview",
      "transformation": {
        "fields": [
          "main_image",
          "url",
          "product_id",
          "name",
          "price",
          "regular_price",
          "currency",
          "in_stock",
          "brand",
          "seller_name",
          "scraped_at"
        ]
      },
      "display": {
        "component": "table",
        "properties": {
          "main_image": {
            "label": "Image",
            "format": "image"
          },
          "url": {
            "label": "Product URL",
            "format": "link"
          },
          "product_id": {
            "label": "Product ID",
            "format": "text"
          },
          "name": {
            "label": "Product name",
            "format": "text"
          },
          "price": {
            "label": "Current price",
            "format": "number"
          },
          "regular_price": {
            "label": "Regular price",
            "format": "number"
          },
          "currency": {
            "label": "Currency",
            "format": "text"
          },
          "in_stock": {
            "label": "In stock",
            "format": "boolean"
          },
          "brand": {
            "label": "Brand",
            "format": "text"
          },
          "seller_name": {
            "label": "Seller",
            "format": "text"
          },
          "scraped_at": {
            "label": "Scraped at",
            "format": "datetime"
          }
        }
      }
    },
    "allFields": {
      "title": "All fields",
      "description": "Every stored field.",
      "transformation": {
        "fields": [
          "url",
          "product_id",
          "name",
          "price",
          "regular_price",
          "currency",
          "in_stock",
          "sku",
          "brand",
          "category",
          "breadcrumbs",
          "breadcrumb_urls",
          "main_image",
          "images",
          "description",
          "description_html",
          "color",
          "features",
          "attributes",
          "rating_value",
          "review_count",
          "seller_name",
          "seller_url",
          "seller_contact_name",
          "seller_phone",
          "seller_address",
          "canonical_url",
          "scraped_at",
          "condition",
          "created_at",
          "displacement_cc",
          "first_registration",
          "location",
          "mileage_km",
          "power_hp",
          "seller_type"
        ]
      },
      "display": {
        "component": "table"
      }
    }
  }
}