Question

72

How to cache file with puppeteer

rated 0 times [ 79] [ 7] / answers: 1 / hits: 5644 / 3 Years ago, sun, june 6, 2021, 12:00:00

I want to know how I can cache a file with puppeteer, so I don't have to load it again when the script starts, assuming I have this script:

async function run () {

 const browser = await puppeteer.launch();

 const page = await browser.newPage();

 await page.goto("https://www.amazon.com/");

 browser.close();

}

run();

Well, if I wanted to save the html so it wouldn't be necessary to load it again, how would I do it? I researched and found How can I disable cache in puppeteer? but I didn't find many details neither in the answer, nor in the question, could someone explain to me how to save the html in cache for example?

Answers

Only authorized users can answer the question. Please sign in first, or register a free account.

miranda

Add To Favorites

Follow

Total Points: 655

Total Questions: 110

Total Answers: 121

Location: Netherlands

Member since Thu, Jul 1, 2021

3 Years ago

miranda questions

1 Regex lookbehind alternative for Safari

Tue, Mar 16, 21, 00:00, 3 Years ago

1 Why currentTarget value is null

Sun, Feb 7, 21, 00:00, 3 Years ago

1 Javascript check if object by Id is in array

Mon, Jan 18, 21, 00:00, 3 Years ago

1 How can I prevent Chrome from blocking a XLSX download?

Fri, Jul 17, 20, 00:00, 4 Years ago

1 Uncaught TypeError: Cannot read property 'initialize' of undefined

Mon, Dec 30, 19, 00:00, 5 Years ago

View All

answered 3 Years ago lucianom · Accepted Answer

Puppeteer uses Chrome (or FireFox) browser under the hood, so in case:

This is not the first visit (cache filled)

Resources has proper cache headers and not expired (cache-control, etc.)

You didn't disable cache manually using

await page.setCacheEnabled(false);

await pageSession.send('Network.setCacheDisabled', { cacheDisabled: true });

Resources will be already cached and you don't need to do anything manually.

However, if you want to do testing on cached page, you will need to warm it up simply pre visiting it before tests, like in the example:

async function warmingBrowser(url: URL, pageInstance: Page) {

    await pageInstance.goto(url.href, { waitUntil: 'networkidle0' });

    await pageInstance.close();

}

The code is taken from the perfrunner

In case you want to make it work completely offline - Puppeteer will not help with that, you need to implement your own caching strategy using the ServiceWorker.

But there are some pitfalls on this step (exactly with caching and invalidating the cache) so be aware.