Create csv file in Cloud Storage using Cloud Functions

Question

I have been trying to create a csv file from a string in Cloud Functions. It is storing the file temporarily in /tmp folder. Then the file goes to the bucket.

Following is my code -

def upload_blob(bucket_name, source_file_name, destination_blob_name):

    storage_client = storage.Client()
    bucket = storage_client.get_bucket(bucket_name)
    blob = bucket.blob(destination_blob_name)
    blob.upload_from_file(source_file_name)

message = "Data for CSV file"
csv = open('test.csv', "w")    #ERROR HERE
csv.write(message)
with open('/tmp/test.csv', 'r') as file_obj:
    upload_blob('test-bucket', file_obj, 'test.csv')

I am getting the following error -

File "/user_code/main.py", line 30, in hello_main csv = open('test.csv', 
"w") OSError: [Errno 30] Read-only file system: 'test.csv'

How to make this file writable?

You are not closing the handle for test.csv. The file stays locked so you cannot create and write again. In your design, do not use the /tmp directory. Use in-memory buffering. — John Hanley
– John Hanley, Commented May 9, 2019 at 16:59
Why did you tag it with google-cloud-platform? it's a question about simple file operations! — Ashitaka
– Ashitaka, Commented Aug 19, 2019 at 7:35

llompalles · Accepted Answer · 2019-05-13 07:27:42Z

4

As @saccodd said the issue is that you only have write permissions in the /tmp directory. So replacing:

csv = open('test.csv', "w")

with:

csv = open('/tmp/test.csv', "w")

would solve the error but it is recommended to close the file before handling it again. Quoting the Python official documentation:

It is good practice to use the with keyword when dealing with file objects. The advantage is that the file is properly closed after its suite finishes, even if an exception is raised at some point. Using with is also much shorter than writing equivalent try-finally blocks

So better replace

csv = open('test.csv', "w") #ERROR HERE 
csv.write(message)

with:

with open('/tmp/test.csv', "w") as csv: 
    csv.write(message)

answered May 13, 2019 at 7:27

llompalles

3,19614 silver badges22 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

saccodd Over a year ago

I think the use of 'with' is a minor concern for the question asked. Even more, it is just a temporary file in Cloud Function.

saccodd · Accepted Answer · 2019-05-09 13:54:58Z

1

Try replacing:

csv = open('test.csv', "w")

with:

csv = open('/tmp/test.csv', "w")

since you have write permissions only in /tmp

answered May 9, 2019 at 13:54

saccodd

1,07710 silver badges24 bronze badges

Collectives™ on Stack Overflow

Create csv file in Cloud Storage using Cloud Functions

2 Answers 2

1 Comment

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Related