I want to make a really script in Python that gets the contents from the title tags of a specified web page and then puts them into a MySQL database.
I have very (and I mean very) little experience with Python but this needs to be done for my project. How can I do this in the simplest way possible?
I hope you are able to understand what I'm trying to ask.
Here is some example code to get you started:
import urllib2
import BeautifulSoup
import MySQLdb
f = urllib2.urlopen('http://www.python.org/')
soup=BeautifulSoup.BeautifulSoup(f.read())
title=soup.find('title')
print(title.string)
connection=MySQLdb.connect(
host='HOST',user='USER',
passwd='PASS',db='MYDB')
cursor=connection.cursor()
sql='''CREATE TABLE IF NOT EXISTS foo (
fooid int(11) NOT NULL AUTO_INCREMENT,
title varchar(100) NOT NULL,
PRIMARY KEY (fooid)
)'''
cursor.execute(sql)
sql='INSERT INTO foo (title) VALUES (%s)'
args=[title.string]
cursor.execute(sql,args)
cursor.close()
connection.close()
urllib2 is part of Python, but you need to install the other two packages from pypi.python.org/pypiuse urllib2 to open up the web page. Then parse the returned text with regex to retrieve the title.
