Inserting specific columns of csv file into mongodb collection using python script

Question

I have a python script to insert a csv file into mongodb collection

import pymongo
import pandas as pd
import json

client = pymongo.MongoClient("mongodb://localhost:27017")

df = pd.read_csv("iris.csv")

data = df.to_dict(oreint = "records")

db = client["Database name"]

db.CollectionName.insert_many(data)

Here all the columns of csv files are getting inserted into mongo collection. How can I achieve a usecase where I want to insert only specific columns of csv file in the mongo collection .

What changes I can make to existing code.

Lets say I also have database already created in my Mongo. Will this command work even if the database is present (db = client["Database name"])

In Pandas, it's easy to create a new dataframe while selecting the columns you want from another dataframe ... or drop columns from a dataframe. Would that satisfy your needs? — rickhg12hs
– rickhg12hs, Commented May 10, 2022 at 6:04
FYI, the rust app xsv is awesome at processing, selecting, formatting, etc., CSV files - and it's fast! — rickhg12hs
– rickhg12hs, Commented May 12, 2022 at 16:11

Rachelle Palmer Frick · Accepted Answer · 2022-05-10 15:35:59Z

1

Have you checked out pymongoarrow? the latest release has write support where you can import a csv file into mongodb. Here are the release notes and documentation. You can also use mongoimport to import a csv file, documentation is here, but I can't see any way to exclude fields like the way you can with pymongoarrow.

answered May 10, 2022 at 15:35

Rachelle Palmer Frick

711 silver badge3 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Inserting specific columns of csv file into mongodb collection using python script

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related