Merging list objects in python

Question

I have a pickle file having many objects. I need to have one proper object by combining all the other objects in the file. How can I do that. I tried using many commands, but none seems to work.

objs = []

while True:
    try:
        f = open(picklename,"rb")
        objs.append(pickle.load(f))
        f.close()
    except EOFError:
        break

Like the one above as shown.

OBJECT stored image :

<nltk.classify.naivebayes.NaiveBayesClassifier object at 0x7fb172819198>
<nltk.classify.naivebayes.NaiveBayesClassifier object at 0x7fb1719ce4a8>
<nltk.classify.naivebayes.NaiveBayesClassifier object at 0x7fb1723caeb8>
<nltk.classify.naivebayes.NaiveBayesClassifier object at 0x7fb172113588>

How did you pickle these objects? That will affect how you unpickle them. — user2357112
– user2357112, Commented Apr 27, 2016 at 20:57
@user2357112 I pickled them using pickle.dump(nltk.NaiveBayesClassifier.train(training_set),f). Where I am using the NLTK toolkit. — Arkham
– Arkham, Commented Apr 27, 2016 at 21:03
No, I mean how did you pickle multiple of these objects? If your pickling code made the kind of mistake your unpickling code is making, your file likely only has one classifier pickled in it. — user2357112
– user2357112, Commented Apr 27, 2016 at 21:04
@user2357112 I appended the objects in the same file using open(filename,"ab"). — Arkham
– Arkham, Commented Apr 27, 2016 at 21:09

Ozgur Vatansever · Accepted Answer · 2016-04-27 20:32:12Z

1

You should use .extend() to append all items in the list to objs:

(Assuming pickle.load(f) returns a list of objects)

objs.extend(pickle.load(f))

answered Apr 27, 2016 at 20:32

Ozgur Vatansever

52.5k17 gold badges89 silver badges122 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Arkham Over a year ago

Thank You sir for your answer. Sir I am storing objects in my pickle, which are NaiveBayesClassifier object provided in nltk, so when I run using the above code I get TypeError: 'NaiveBayesClassifier' object is not iterable

Ozgur Vatansever Over a year ago

What does pickle.load(f) return exactly? It returns a single NaiveBayesClassifier object or a list of NaiveBayesClassifier objects?

Arkham Over a year ago

Sir I edited the answer showing the result of printing pickle.load(f)

Collectives™ on Stack Overflow

Merging list objects in python

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest