Web scraping using javascript

Question

I want to make a site (with HTML, CSS and Javascript) which will scrape data from other sites. I want to use javascript in order to accomplish that. Which is the best way to do it? I would like to avoid using Node.js or some other framework.

Konrad · Accepted Answer · 2020-08-24 13:42:29Z

3

If you are getting cors error just use cors anywhere.

For dom parsing use DomParser

Example:

fetch(`https://cors-anywhere.herokuapp.com/${url}`)
.then(response => response.text())
.then(html => {
  const parser = new DOMParser()
  const dom = parser.parseFromString(htmlContent, 'text/html')
  // now you can select elements like for normal node
  dom.querySelector('div')
})

Do you have any other problems?

edited Aug 24, 2020 at 13:42

answered Aug 24, 2020 at 13:16

Konrad

24.9k5 gold badges35 silver badges78 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

gepa Over a year ago

Konrad thanks for the answer. So are you against of Node.js usage for this purpose?

Konrad Over a year ago

I'm not against. But hosting a node.js server isn't as simple as hosting a webpage.

Collectives™ on Stack Overflow

Web scraping using javascript

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related