Question

171

How to get the HTML source of a website with PhantomJS

rated 0 times [ 172] [ 1] / answers: 1 / hits: 17712 / 11 Years ago, sun, november 24, 2013, 12:00:00

Below is an example of PhantomJS that gets some element by DOM id from an external webpage:

var page = require('webpage').create();

console.log('The default user agent is ' + page.settings.userAgent);

page.settings.userAgent = 'SpecialAgent';

page.open('http://www.httpuseragent.org', function(status) {

  if (status !== 'success') {

    console.log('Unable to access network');

  } else {

    var ua = page.evaluate(function() {

      return document.getElementById('myagent').textContent;

    });

    console.log(ua);

  }

  phantom.exit();

});

I want to get the entire HTML source of a webpage ... how do I do this?

Answers

Only authorized users can answer the question. Please sign in first, or register a free account.

guadalupec

Add To Favorites

Follow

Total Points: 610

Total Questions: 91

Total Answers: 91

Location: Guernsey

Member since Tue, Jul 6, 2021

3 Years ago

answered 11 Years ago emiliano · Accepted Answer

All you have to do is to use page.content

var page = require('webpage').create();

page.onError = function(msg, trace) {

  //prevent js errors from showing in page.content

  return;

};

page.open('http://www.httpuseragent.org', function () {

    console.log(page.content); //page source

    phantom.exit();

});