Question

23

Programmatic Python Browser with JavaScript

rated 0 times [ 27] [ 4] / answers: 1 / hits: 18474 / 15 Years ago, wed, december 16, 2009, 12:00:00

I want to screen-scrape a web-site that uses JavaScript.

There is mechanize, the programmatic web browser for Python. However, it (understandably) doesn't interpret javascript. Is there any programmatic browser for Python which does? If not, is there any JavaScript implementation in Python that I could use to attempt to create one?

Answers

Only authorized users can answer the question. Please sign in first, or register a free account.

citlalia

Add To Favorites

Follow

Total Points: 138

Total Questions: 104

Total Answers: 87

Location: Iceland

Member since Sat, Sep 17, 2022

2 Years ago

citlalia questions

1 Download PDF from javascript blob, without replacing the open page

Fri, Mar 11, 22, 00:00, 2 Years ago

1 MUI - React does not recognize the `renderInput` prop on a DOM element in Datepicker

Fri, Oct 22, 21, 00:00, 3 Years ago

1 Null value in column of relation violates not-null constraint - NestJS

Thu, Sep 23, 21, 00:00, 3 Years ago

1 Angular: error NG8001: 'component' is not a known element

Tue, Jul 6, 21, 00:00, 3 Years ago

1 Prop is possibly undefined error in Vue 3 setup

Tue, Mar 2, 21, 00:00, 3 Years ago

View All

answered 15 Years ago maxd · Accepted Answer

You might be better off using a tool like Selenium to automate the scraping using a web browser, so the JS executes and the page renders just like it would for a real user.