How to Combine JSON Objects From Different Arrays With Python

Question

I am trying to loop through different JSON arrays using Python, in order to combine all the objects into a single data structure. The JSON looks like this:

data = {
  "Wednesday, Apr 3, 2019": [
    {
      "id": "000",
      "keyid": "4273666087",
      "name": "Raptor",
      "symbol": "RPT",
    },
    {
      "id": "111",
      "keyid": "1818114564",
      "name": "Duck",
      "symbol": "DUK",
    }
  ],
  "Tuesday, Apr 2, 2019": [
    {
      "id": "222",
      "keyid": "8032408148",
      "name": "Hawk",
      "symbol": "HWK",
    },
    {
      "id": "333",
      "keyid": "0362766431",
      "name": "Goose",
      "symbol": "GOO",
    }
  ]
}

Since it looks like a dictionary, I tried doing:

for item in data.values():
   print(item)
   print("\n")

which combines each array's objects into a separate lists. But I want all objects to be part of the same data structure, in order for the end result to look something like this:

id  | keyid      | name   | symbol
-----------------------------------
000 | 4273666087 | Raptor | RPT
-----------------------------------
111 | 1818114564 | Duck   | DUK
-----------------------------------
222 | 8032408148 | Hawk   | HWK
-----------------------------------
333 | 0362766431 | Goose  | GOO
-----------------------------------

What's the best way of doing this?

U13-Forward · Accepted Answer · 2019-07-11 04:46:48Z

1

Use pandas:

import pandas as pd
df = pd.DataFrame([x for k,v in data.items() for x in v])
print(df)

Output:

    id       keyid    name symbol
0  000  4273666087  Raptor    RPT
1  111  1818114564    Duck    DUK
2  222  8032408148    Hawk    HWK
3  333  0362766431   Goose    GOO

You can do it in Regular Python but it will be a big hassle, so I support using pandas which can do it in one line.

As you want nested loops:

import pandas as pd
l = []
for k,v in data.items():
    for x in v:
        l.append(x)
df = pd.DataFrame(l)
print(df)

edited Jul 11, 2019 at 4:46

answered Jul 11, 2019 at 2:30

U13-Forward

71.8k15 gold badges100 silver badges125 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

user53526356 Over a year ago

Thanks, I think this will probably work. For my own education, do you mind also sharing what it would look like using nested loops instead of the comprehension? I'm new to Python and still struggle with them so this will help me learn.

U13-Forward Over a year ago

@MSD Done.. :-)

0__ · Accepted Answer · 2019-07-11 02:32:10Z

1

You're very close. You want to go one further, and print the values of each row.

print("id", "keyid\t", "name", "symbol", sep='\t|')

for group in data.values():
    for row in group:
        print("\t|".join([str(i) for i in row.values()]))

To produce:

id      |keyid          |name   |symbol
000     |4273666087     |Raptor |RPT
111     |1818114564     |Duck   |DUK
222     |8032408148     |Hawk   |HWK
333     |0362766431     |Goose  |GOO

answered Jul 11, 2019 at 2:32

0__

1,3261 gold badge9 silver badges22 bronze badges

2 Comments

user53526356 Over a year ago

Thanks, but I should have worded my question more clearly. I was mostly interested in combining the objects into a single data structure (eventually pandas), and not actually printing the sample output. My apologies for the confusion, but I appreciate the response nonetheless.

0__ Over a year ago

No worries @MSD.

Collectives™ on Stack Overflow

How to Combine JSON Objects From Different Arrays With Python

2 Answers 2

2 Comments

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related