How to import csv file into mongoDB using python

Question

i'm new to Python. I want to insert specific columns of a csv file into a collection in my mongodb, i know how to do it with the shell but i want to do it with python, as i'm learning Python.

This is what i have so far:

import csv
import json
import pandas as pd
import sys, getopt, pprint
from pymongo import MongoClient
#CSV to JSON Conversion
with open('netflix_titles.csv','rt', encoding="utf8") as file:
data = file.read()
mongo_client=MongoClient() 
db=mongo_client.Netflix
db.segment.drop()
header= [ "show_id", "director"]

for each in data:
    row={}
    for field in header:
        row[field]=each[field]  

    db.segment.insert(row)

In only throws me an indented error in this line:

data = file.read()

Buzz Moschetti · Accepted Answer · 2020-05-29 00:21:17Z

1

If you are going to use the csv module then definitely use the reader function of that module. It will deal with quotes, whitespace, etc. etc. Also, not sure if your

for each in data:

Is actually doing the CSV breakup you think it is. This is more tidy (assuming you want to drive the action from a static array of header names):

with open('data.csv', 'r') as csvfile:
    header = [ "show_id", "director"]
    reader = csv.reader(csvfile)

    for row in reader:
        doc={}
        for n in range(0,len(header)):
            doc[header[n]] = row[n]

        db.foo.insert(doc)

answered May 29, 2020 at 0:21

Buzz Moschetti

7,6433 gold badges27 silver badges41 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

lukas.tomoszek · Accepted Answer · 2020-05-28 19:02:24Z

1

You have to put tab before date = file.read() , because with increase indentation level.

answered May 28, 2020 at 19:02

lukas.tomoszek

16411 bronze badges

Collectives™ on Stack Overflow

How to import csv file into mongoDB using python

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related