Convert HTML Table to Pandas Data Frame in Python

Question

Here i am trying to extract a table from a website as specified in Python code . i am able to get the HTML Table and further i am unable to convert to data frame using Python . Here is the code

# import libraries
import requests
from bs4 import BeautifulSoup

# specify url
url = 'http://my-trade.in/'

# request html
page = requests.get(url)

# Parse html using BeautifulSoup, you can use a different parser like lxml if present
soup = BeautifulSoup(page.content, 'html.parser')

tbl =soup.find("table",{"id":"MainContent_dataGridView1"})

Prasun Chakraborty · Accepted Answer · 2019-07-10 10:25:51Z

20

You can just Use pandas read_html function for that, and remember to convert the html you get to string else you will get some parsing error.

import requests
from bs4 import BeautifulSoup
import pandas as pd

url = 'http://my-trade.in/'
page = requests.get(url)

soup = BeautifulSoup(page.content, 'html.parser')

tbl = soup.find("table",{"id":"MainContent_dataGridView1"})

data_frame = pd.read_html(str(tbl))[0]

answered Jul 10, 2019 at 10:25

Prasun Chakraborty

5477 silver badges14 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Nabi Shaikh Over a year ago

above code is working fine , i was looking for writing a for loop for every column and then further cbinding it . i usually code in R , Pardon me i am new to python.

Collectives™ on Stack Overflow

Convert HTML Table to Pandas Data Frame in Python

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related