Can queries in the bigquery python API use python variables?

Question

I want to run a sql query on multiple tables in a dataset in bigquery. I have the names of these tables in a list in my python script and I want to loop through that list and run the query on every table in the list.

My issue is that I cannot figure out how to structure my query to take python variables as inputs. For example, I have these variables in my script:

# Variables for testing
dataset_id = 'test_dataset'
table_id = 'test_table'

This is how I'm trying to use them in my query object:

query = """
          SELECT *
          FROM """ + dataset_id + '.' + table_id + """
          ORDER BY 1 asc;

    """

This doesn't work and I can't find anything relevant on this online. I'd really appreciate it if you could help me structure this query correctly!

Sabri Karagönen · Accepted Answer · 2020-05-09 18:43:44Z

4

It should be working. Just to be sure it's working, you can add backticks to the beginning and ending of the table name. Also, by using f-strings in python, you can inject variables in the strings in a more readable way.

query = f"""
          SELECT *
          FROM `{dataset_id}.{table_id}`
          ORDER BY 1 asc;

    """

answered May 9, 2020 at 18:43

Sabri Karagönen

2,3651 gold badge18 silver badges29 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Can queries in the bigquery python API use python variables?

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related