0

I'm trying to build a for-loop based on function varbiables values. I have this code:

import yagooglesearch

query = "future" #something to google-search

client = yagooglesearch.SearchClient(
query,
start=0,
num=100, #number of result that i want for each loop (100 is the max) 
max_search_result_urls_to_return=500, #total number of urls that i want inside a list
)
client.assign_random_user_agent() #user agent have to change every loop, so put it 
                                  #inside 

urls = client.search() #is the list of urls taken (it returns 100 urls in this case)

I need to get a list of 500 urls, so I need a for or while-loop that when it gets first 100 urls (variable 'num') it changes the 'start' variable to 100, and repeat this operation until it reaches 500 (variable 'max_search_result_urls_to_return') and so create a list with all 500 urls. Any ideas of how to do this? it possible?

1 Answer 1

1

iterate in range(5) the search function and use as variable start variable

import yagooglesearch

def query_function(count):
    query = "future" 
    client = yagooglesearch.SearchClient(
    query,
    start=count,
    num=100, 
    max_search_result_urls_to_return=500)
    client.assign_random_user_agent() 
    urls = client.search()
    return urls

all_urls = []
count = 0
for i in range(5):
    urls = query_function(count)
    all_urls.append(urls)
    count += 100
print(all_urls)
Sign up to request clarification or add additional context in comments.

Comments

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.