Daily Energy Insider Scraper

What does the Daily Energy Insider Scraper do?

The Daily Energy Insider Scraper collects news articles from Daily Energy Insider, a U.S. news source covering energy policy, utilities, clean energy, oil and gas, nuclear, grid reliability and data centers. Use it to monitor energy policy and utility news, track coverage of specific companies or topics, or build datasets for market research and trend analysis.

What data can I extract from DailyEnergyInsider.com with this scraper?

• Title and URL
• Publication date and last modified date
• Author name and author page
• Category (e.g. Clean Energy, Oil & Gas, Nuclear, Grid & Reliability, Data Centers)
• Reading time
• Summary
• Main image
• Full article text

How to use the Daily Energy Insider Scraper

1. Add one or more Daily Energy Insider URLs to Start URLs: a category page, the news listing, an author or date archive, or a single article.
2. Set Maximum number of items to choose how many articles to collect per start URL.
3. Keep the default proxy (US residential) enabled. It rotates IP addresses so larger runs do not get blocked.
4. Run the scraper and download your data as JSON, CSV, Excel or HTML.

Input

• startUrls (array, required): Daily Energy Insider URLs to start from.
• maxItems (integer): Maximum number of articles to collect per start URL. Default: 5.
• proxyConfiguration (object): Proxy settings. US residential by default (see Notes below).

Supported URLs

Page type	Example
News listing (all articles)	https://dailyenergyinsider.com/news/
Category page	https://dailyenergyinsider.com/clean-energy/
Author archive	https://dailyenergyinsider.com/author/kimriley/
Date archive	https://dailyenergyinsider.com/date/2026/
Single article	https://dailyenergyinsider.com/news/54362-nextera-dominion-strengthen-proposed-merger-with-additional-customer-protections/

Available categories include Clean Energy, Oil & Gas, Nuclear, Grid Reliability, Data Centers, Policy, Innovation, Hearing Summaries and Featured.

Tip: The homepage always shows the same latest articles. If you add the homepage, the scraper uses the News listing instead, which goes back through the full archive.

Example input

{
    "startUrls": [
        { "url": "https://dailyenergyinsider.com/clean-energy/" },
        { "url": "https://dailyenergyinsider.com/news/" }
    ],
    "maxItems": 5,
    "proxyConfiguration": {
        "useApifyProxy": true,
        "apifyProxyGroups": ["RESIDENTIAL"],
        "apifyProxyCountry": "US"
    }
}

Output

Each dataset item is one article. Missing values are returned as null.

Example output

{
    "url": "https://dailyenergyinsider.com/news/54362-nextera-dominion-strengthen-proposed-merger-with-additional-customer-protections/",
    "title": "NextEra, Dominion strengthen proposed merger with additional customer protections",
    "publishedAt": "2026-11-05T14:29:50+00:00",
    "modifiedAt": "2026-11-05T14:52:10+00:00",
    "author": "Kim Riley",
    "authorUrl": "https://dailyenergyinsider.com/author/kimriley/",
    "category": "Featured",
    "readingTime": "3 min read",
    "description": "As they seek regulatory approval for their proposed merger, NextEra Energy Inc. and Dominion Energy Inc. on Nov. 2 filed rebuttal testimony with the Virginia…",
    "imageUrl": "https://dailyenergyinsider.com/wp-content/uploads/2026/11/shutterstock_2593296113.jpg",
    "content": "As they seek regulatory approval for their proposed merger, NextEra Energy Inc. and Dominion Energy Inc. on Nov. 2 filed rebuttal testimony with the Virginia State Corporation Commission (SCC) outlining additional customer protections and financial safeguards.\n\nJohn Ketchum, chairman and CEO of NextEra Energy, said..."
}

Notes and limitations

• maxItems applies to each start URL separately. Two start URLs with maxItems: 5 can return up to 10 items.
• The site blocks repeated requests from a single IP address. The default US residential proxy avoids this.
• Datacenter proxies are not recommended: they get blocked often, so some articles may be missing from the results.
• To use your own proxies instead, set "useApifyProxy": false and list them in proxyUrls:

"proxyConfiguration": {
    "useApifyProxy": false,
    "proxyUrls": ["http://user:[email protected]:8000"]
}

---

Image Credit

Image credit: dailyenergyinsider.com