Utility Dive Scraper

What does the Utility Dive Scraper do?

The Utility Dive Scraper collects news articles and press releases from Utility Dive, a leading source of news and analysis for the electric power, energy and utility industry. Use it to monitor energy policy, grid, solar, storage and generation news, track press releases from energy companies, or build datasets for market research and trend analysis.

What data can I extract from UtilityDive.com with this scraper?

News articles

• Title, URL and publication date
• Author name and author title
• Subheading (article summary)
• Main image with caption and image source
• Full article text
• All images inside the article, with captions and sources

Press releases

• Title, URL and publication date
• Subheading
• Full press release text
• Contact name, email and phone
• "About the company" section
• Attached images and videos

How to use the Utility Dive Scraper

1. Add one or more Utility Dive URLs to Start URLs: a topic page, the press release listing, the homepage, or a single article.
2. Set Maximum number of items to choose how many articles to collect per start URL.
3. Run the scraper and download your data as JSON, CSV, Excel or HTML.

Input

• startUrls (array, required): Utility Dive URLs to start from.
• maxItems (integer): Maximum number of articles to collect per start URL. Default: 5.
• proxyConfiguration (object): Proxy settings. US residential by default. See Proxy below.

Supported URLs

Page type	Example
Topic page	https://www.utilitydive.com/topic/solar/
Press release listing	https://www.utilitydive.com/press-release/
Homepage	https://www.utilitydive.com/
Single news article	https://www.utilitydive.com/news/storage-solar-colocation-eia-seia/873882/
Single press release	https://www.utilitydive.com/press-release/20261104-viridi-good-carbon-and-national-grid-named-2026-fortnightly-top-innovator-1/

Available topics include Generation, Solar, Storage, Distributed Energy, Demand Response, Grid Security & Reliability, Transmission & Distribution, Building & Transportation Electrification, Market News and Policy.

Tip: The Utility Dive homepage only lists about 75 of the latest articles. To collect more, use topic pages. They go back many years and contain thousands of articles.

Example input

{
    "startUrls": [
        { "url": "https://www.utilitydive.com/topic/solar/" },
        { "url": "https://www.utilitydive.com/press-release/" }
    ],
    "maxItems": 5,
    "proxyConfiguration": {
        "useApifyProxy": true,
        "apifyProxyGroups": ["RESIDENTIAL"],
        "apifyProxyCountry": "US"
    }
}

Proxy

By default the scraper uses a US residential proxy, which gives the fastest and most reliable runs:

"proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"],
    "apifyProxyCountry": "US"
}

The scraper also handles the site's bot protection without a proxy, so you can turn it off with { "useApifyProxy": false }. To use your own proxies instead, add them in proxyUrls:

"proxyConfiguration": {
    "useApifyProxy": false,
    "proxyUrls": ["http://user:[email protected]:8000"]
}

On platforms without Apify Proxy, the default setting stops the run with an error; turn the proxy off or use proxyUrls there.

Output

Each dataset item is either a news article or a press release. Missing values are returned as null.

Example output: news article

{
    "url": "https://www.utilitydive.com/news/storage-solar-colocation-eia-seia/873882/",
    "title": "Co-located solar, storage jumps to 16% of all installations, up from 2% in 2017: EIA | Utility Dive",
    "publishDate": "2026-11-05T11:37:03",
    "authorInfo": {
        "authorName": "Diana DiGangi",
        "authorTitle": "Reporter"
    },
    "subHeading": "The share of solar projects co-located with storage is projected to pass 30% over the next two years, based on planned additions, according to a report from the U.S. Energy Information Administration.",
    "articleImage": "https://imgproxy.divecdn.com/dnquNi9yM-x9WsJH-oQinQsCgEv0xJ6FaXGzoaut4NA/g:ce/rs:fill:1200:675:1/Z3M6Ly9kaXZlc2l0ZS1zdG9yYWdlL2RpdmVpbWFnZS9Eb21pbmlvbl9WaXJnaW5pYV9iYXR0ZXJ5X3N0b3JhZ2UuanBn.webp",
    "imageCaption": "Dominion Energy Virginia’s Scott Solar and Battery Storage facility in Powhatan County, Va.",
    "sourceText": "Courtesy of Dominion Energy",
    "description": "The share of new solar projects deployed with co-located battery storage this year is 16% — or about 41 GW — as of September, and may reach 19% by year’s end, said an Oct. 30 report from the U.S. Energy Information Admin...",
    "images": [
        {
            "imageUrl": "https://imgproxy.divecdn.com/dnquNi9yM-x9WsJH-oQinQsCgEv0xJ6FaXGzoaut4NA/g:ce/rs:fill:1200:675:1/Z3M6Ly9kaXZlc2l0ZS1zdG9yYWdlL2RpdmVpbWFnZS9Eb21pbmlvbl9WaXJnaW5pYV9iYXR0ZXJ5X3N0b3JhZ2UuanBn.webp",
            "captionText": "Dominion Energy Virginia’s Scott Solar and Battery Storage facility in Powhatan County, Va.",
            "sourceText": "Courtesy of Dominion Energy"
        }
    ]
}

Example output: press release

{
    "url": "https://www.utilitydive.com/press-release/20261104-viridi-good-carbon-and-national-grid-named-2026-fortnightly-top-innovator-1/",
    "title": "Viridi, Good Carbon and National Grid Named 2026 Fortnightly Innovator of the Year for Breakthrough Building-to-Grid Project | Utility Dive",
    "publishDate": "Nov. 5, 2026",
    "contact": {
        "contactName": "Alexandra Pony",
        "contactEmail": "[email protected]",
        "contactPhone": "2508580656"
    },
    "description": "BUFFALO, N.Y. — Viridi, Good Carbon Co. and National Grid have been recognized as 2026 Fortnightly Top Innovator of the Year for their collaboration on a demand flexibility project at Peace Bridge Place, a 105-unit affor...",
    "aboutSection": "Viridi is transforming energy storage with its proprietary fail-safe lithium-ion battery technology. Viridi’s battery energy storage systems (BESS) feature breakthrough anti-propagation technology, preventing propagation...",
    "multimedia": {
        "imageUrls": [
            "https://res.cloudinary.com/dmgi9movl/image/upload/dpr_auto,w_auto/v1/press_release/assets/multimedia_add_ons/SEPA_Awards_oio7jm"
        ],
        "videoUrls": null
    },
    "subHeading": "The recognition highlights how a 3.75 MWh battery storage system at Peace Bridge Place is helping affordable housing support the power grid."
}

Notes and limitations

• maxItems applies to each start URL separately. Two start URLs with maxItems: 5 can return up to 10 items.
• The homepage is limited to about 75 articles. Use topic pages for larger runs.
• Pages are collected at a moderate pace to avoid being blocked, so large runs take longer.

---

Image Credit

Image credit: utilitydive.com