I'm trying to build a for-loop based on function varbiables values. I have this code:
import yagooglesearch
query = "future" #something to google-search
client = yagooglesearch.SearchClient(
query,
start=0,
num=100, #number of result that i want for each loop (100 is the max)
max_search_result_urls_to_return=500, #total number of urls that i want inside a list
)
client.assign_random_user_agent() #user agent have to change every loop, so put it
#inside
urls = client.search() #is the list of urls taken (it returns 100 urls in this case)
I need to get a list of 500 urls, so I need a for or while-loop that when it gets first 100 urls (variable 'num') it changes the 'start' variable to 100, and repeat this operation until it reaches 500 (variable 'max_search_result_urls_to_return') and so create a list with all 500 urls. Any ideas of how to do this? it possible?