Get JSON format for Google BigQuery Data using Pandas/Python

Question

I am trying to query Google BigQuery using the Pandas/Python client interface. I am following the tutorial here: https://cloud.google.com/bigquery/docs/bigquery-storage-python-pandas. I was able to get it to work but I want to query the data as the JSON format that can be downloaded directly from the WebUI (see screenshot). Is there a way to download data as the JSON structure pictured instead of converting it to the data frame object?

I imagine the command would be somewhere around this part of the code from the tutorial:

dataframe = (
    bqclient.query(query_string)
    .result()
    .to_dataframe(bqstorage_client=bqstorageclient)
)

Not exactly what you are asking for, but converting DataFrame to JSON is also trivial pandas.pydata.org/pandas-docs/stable/reference/api/… — Yun Zhang
– Yun Zhang, Commented Sep 26, 2019 at 18:49

user983302 · Accepted Answer · 2019-09-26 18:49:22Z

1

Just add .to_json(orient='records') call after converting to dataframe:

json_data = bqclient.query(query_string).result().to_dataframe(bqstorage_client=bqstorageclient).to_json(orient='records')

pandas docs

answered Sep 26, 2019 at 18:49

user983302

1,4373 gold badges15 silver badges23 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

bradchattergoon Over a year ago

Thanks for pointing me to the "orient" parameter. That solved my problem!

Collectives™ on Stack Overflow

Get JSON format for Google BigQuery Data using Pandas/Python

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related