Error "Login Required" when trying to query Google BigQuery with Python

Question

I'd like to access BigQuery data from my local Linux machine with Python. The code from Google help https://cloud.google.com/bigquery/authorization#service-accounts-server works fine giving me the list of datasets. But the query send via service library

SELECT id, name FROM [test_articles.countries] LIMIT 100

fail with "Login Required" message:

googleapiclient.errors.HttpError: <HttpError 401 when requesting https://www.googleapis.com/bigquery/v2/projects/myproject/queries?alt=json returned "Login Required">

In BigQuery Web UI the query works fine. For auth I use " Google APIs service account" from my Google Development console with permission "Can edit".

Here is the whole code

import httplib2

from apiclient.discovery import build
from oauth2client.client import SignedJwtAssertionCredentials

# REPLACE WITH YOUR Project ID
PROJECT_ID = "xxxxxx"
# REPLACE WITH THE SERVICE ACCOUNT EMAIL FROM GOOGLE DEV CONSOLE
SERVICE_ACCOUNT_EMAIL = '[email protected]'

f = file('xxxxx.p12', 'rb')
key = f.read()
f.close()

credentials = SignedJwtAssertionCredentials(
    SERVICE_ACCOUNT_EMAIL,
    key,
    scope='https://www.googleapis.com/auth/bigquery')

http = httplib2.Http()
http = credentials.authorize(http)

service = build('bigquery', 'v2')
datasets = service.datasets()
response = datasets.list(projectId=PROJECT_ID).execute(http)

print('Dataset list:\n')
for dataset in response['datasets']:
  print("%s\n" % dataset['id'])


# SELECT data

query_data = {'query':'
    SELECT id, name FROM [test_articles.countries] LIMIT 100;
'}
query_request = service.jobs()
query_response = query_request.query(projectId=PROJECT_ID, 
    body=query_data).execute()
pp.pprint(query_response)

Felipe Hoffa · Accepted Answer · 2015-05-19 23:57:19Z

2

Instead of:

service = build('bigquery', 'v2')
datasets = service.datasets()
response = datasets.list(projectId=PROJECT_ID).execute(http)

Try:

service = build('bigquery', 'v2', http=http)
datasets = service.datasets()
response = datasets.list(projectId=PROJECT_ID).execute()

(use the authenticated http connection when building the service)

answered May 19, 2015 at 23:57

Felipe Hoffa

59.8k23 gold badges185 silver badges363 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Embedded_Mugs · Accepted Answer · 2018-02-09 19:14:03Z

2

Make sure to log into your gcloud account through the terminal:

gcloud auth application-default login

answered Feb 9, 2018 at 19:14

Embedded_Mugs

2,4823 gold badges31 silver badges42 bronze badges

Collectives™ on Stack Overflow

Error "Login Required" when trying to query Google BigQuery with Python

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related