How would you parse this HTML table using Python?

Question

I'm trying to create a scraping script in Python 2.7.

The request is ok, but I have a hard time trying to parse this table with Beautiful soup. I've tried a lot, and searched a lot on the forum, but nothing works for me, my first time doing this.

Here is the code :

 import requests, os 
 from bs4 import BeautifulSoup  

 url='http://fse.vdkruijssen.eu/ferrylist.php' params={'selectplane':'Cessna 208 Caravan','submit':''}
 response=requests.post(url, data=params) 

 soup = BeautifulSoup(response.text, "html5lib")
 table=soup.find('table')
 print table

But this is not returning any table. I'm trying to retrieve the first and the last column at least.

宏杰李 · Accepted Answer · 2017-02-06 19:19:20Z

1

soup = BeautifulSoup(response.text, "lxml")

change the parser to lxml

Beautiful Soup supports the HTML parser included in Python’s standard library, but it also supports a number of third-party Python parsers. One is the lxml parser. Depending on your setup, you might install lxml with one of these commands:

$ apt-get install python-lxml

$ easy_install lxml

$ pip install lxml

By default, BS4 use lxml parser.

answered Feb 6, 2017 at 19:19

宏杰李

12.2k2 gold badges32 silver badges37 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

MagicP Over a year ago

Thank you for the answer and precisions !

Collectives™ on Stack Overflow

How would you parse this HTML table using Python?

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related