Construction Dive Scraper

Lexis Solutions · @lexis-solutions

This actor scrapes articles from Construction Dive's Deep Dive section, extracting details such as title, URL, publication date, and contact information.

About

Construction Dive Scraper

What does the Construction Dive Scraper do?

This actor crawls Construction Dive (constructiondive.com) to collect article and press-release content. It supports both article/search pages (topic pages, press-release index) and article/detail pages (news and press releases). The scraper normalizes and produces structured dataset items for downstream analysis. s

What data can I extract from ConstructionDive.com with this scraper?

With this actor you can extract:

  • Article-level metadata: url, title, publishDate, subHeading, description (cleaned paragraphs and headings)
  • Authors: author, authorTitle
  • Lead image: articleImage, imageCaption, sourceText
  • Inline and gallery images: images array with imageUrl, captionText, sourceText
  • Press release fields (when page is a press release): contactName, contactEmail, contactPhone, aboutSection

How to use this Scraper

This actor is runnable on Apify or locally. Provide startUrls (search/listing pages or direct article pages) and maxItems to limit how many detail pages are enqueued per start URL.

Steps:

  1. Provide start URLs (search/listing or detail pages) in the input or via the startUrls console field.
  2. Set maxItems to limit how many detail pages to collect per start URL.
  3. Run the actor and download the dataset when complete.

Input

The actor accepts the following input parameters:

  • startUrls (array of objects) - Required. URLs to start with. Can be search/listing pages or individual article/press-release pages.
  • maxItems (integer) - The maximum number of detail pages to enqueue per start URL. Example: 5
  • proxyConfiguration (object) - Proxy settings. US residential by default. See Proxy below.
Supported URL Examples

Example input:

{
  "startUrls": [
    { "url": "https://www.constructiondive.com/press-release/" },
    { "url": "https://www.constructiondive.com/topic/commercial-building/" }
  ],
  "maxItems": 5,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"],
    "apifyProxyCountry": "US"
  }
}
Proxy

By default the scraper uses a US residential proxy, which gives the fastest and most reliable runs:

"proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"],
    "apifyProxyCountry": "US"
}

The scraper also handles the site's bot protection without a proxy, so you can turn it off with { "useApifyProxy": false }. To use your own proxies instead, add them in proxyUrls:

"proxyConfiguration": {
    "useApifyProxy": false,
    "proxyUrls": ["http://user:[email protected]:8000"]
}

On platforms without Apify Proxy, the default setting stops the run with an error; turn the proxy off or use proxyUrls there.

Output

The scraped data is saved to the default dataset. Each item represents either a news article or a press release depending on the page type. You can download the dataset in various formats such as JSON, HTML, CSV, or Excel.

Common Fields
  • url, title, publishDate, subHeading, description
  • author, authorTitle (news pages)
  • articleImage, imageCaption, sourceText (lead image)
  • images (array of image objects: imageUrl, captionText, sourceText)
  • contactName, contactEmail, contactPhone, aboutSection (press releases)

All absent values are explicitly set to null.

Example Output - Press Release
{
  "url": "https://www.constructiondive.com/press-release/20260330-southern-impression-homes-jlm-living-advance-the-eleanor-bloomingdale-b/",
  "title": "Southern Impression Homes & JLM Living Advance The Eleanor - Bloomingdale BTR Community | Construction Dive",
  "publishDate": "March 30, 2026",
  "contactName": "Kara Pound",
  "contactEmail": "[email protected]",
  "contactPhone": "386-237-4500",
  "description": "JACKSONVILLE, Fla. — Southern Impression Homes (SIH), a leading full-service property development group specializing in Build-to-Rent (BTR) communities, announces its joint project with JLM Living on The Eleanor - Bloomingdale, a 253-unit single-family rental community currently under construction on Little Neck Road in Bloomingdale, Georgia, just outside Savannah. Vertical construction commenced in October 2025, with the first units expected in April 2026 and full project completion slated for early 2027. \"The Eleanor - Bloomingdale demonstrates our ability to seamlessly integrate design, development, and construction into a single execution platform,\" said Chris Funk, President and CEO of Southern Impression Homes...",
  "aboutSection": "Search Home Topics Commercial Corporate News Economy Infrastructure Labor Safety Tech Sustainability Legal/Regs Deep Dive Opinion Library Events Press Releases Get Construction Dive in your inbox...",
  "subHeading": "253-unit Bloomingdale development highlights strength of vertically-integrated partnership",
  "author": null,
  "authorTitle": null,
  "articleImage": null,
  "imageCaption": null,
  "sourceText": null,
  "images": []
}
Example Output - News Article
{
  "url": "https://www.constructiondive.com/news/data-centers-community-benefits-spec-new-york-build-panel/816335/",
  "title": "Data centers must prove their community worth, panel says",
  "publishDate": "April 2, 2026",
  "author": "Kate Serpico",
  "authorTitle": "Senior Editor",
  "subHeading": "As AI drives demand for data centers, developers face growing pressure to deliver tangible local benefits",
  "description": "NEW YORK — Data center developers rushing to build facilities to support artificial intelligence applications must prove their worth to local communities, industry experts said at a panel discussion here...",
  "articleImage": "https://www.constructiondive.com/imgproxy/...",
  "imageCaption": "Aerial view of data center construction site",
  "sourceText": "Permission granted by Construction Photography",
  "images": [
    {
      "imageUrl": "https://www.constructiondive.com/imgproxy/...",
      "captionText": "Interior view of data center server room",
      "sourceText": "Construction Photography"
    }
  ],
  "contactName": null,
  "contactEmail": null,
  "contactPhone": null,
  "aboutSection": null
}
Notes and Limitations
  • The actor depends on the current Construction Dive HTML structure; update selectors if the site changes.
  • Pages are collected one at a time to avoid being blocked, so large runs take longer.
  • Pagination links that are relative (e.g., ?page=2) are resolved against the current page URL to produce absolute next-page links.

Contact the maintainer or open an issue in the repo for improvements.

Image Credit: https://www.constructiondive.com/

More Actors from the same publisher.

View all from @lexis-solutions