Python: list index out of range - while/for loop

Question

I have a list

abc = ['date1','sentence1','date2','sentence2'...]

I want to do sentiment analysis on the sentences. After that I want to store the results in a list that looks like:

xyz =[['date1','sentence1','sentiment1'],['date2','sentence2','sentiment2']...]

For this I have tried following code:

def result(doc):
    x = 2
    i = 3
    for lijn in doc:
        sentiment = classifier.classify(word_feats_test(doc[i]))
        xyz.extend(([doc[x],doc[i],sentiment])
        x = x + 2
        i = i + 2

The len(abc) is about 7500. I start out with x as 2 and i as 3, as I don't want to use the first two elements of the list.

I keep on getting the error 'list index out of range', no matter what I try (while, for loops...)

Can anybody help me out? Thank you!

@yole I'm trying to reproduce what I did, but now I'm not getting any output at all. It is as if Python is going through an "infinite loop". — thesisstudent
– thesisstudent, Commented Mar 7, 2015 at 14:33
Looks like you've missed ")" char on the 6th line of your "result" function... — Yam Mesicka
– Yam Mesicka, Commented Mar 7, 2015 at 14:35

brainovergrow · Accepted Answer · 2015-03-07 14:39:50Z

1

As comments mentioned - we won't be able to help You with finding error in Your code without stacktrace. But it is easy to solve Your problem like this:

xyz = []
def result(abc):
    for item in xrange(0, len(abc), 2): # replace xrange with range in python3
        #sentiment = classifier.classify(word_feats_test(abc[item]))
        sentiment = "sentiment" + str(1 + (item + 1) / 2) 
        xyz.append([abc[item], abc[item + 1], sentiment])

You might want to read about built-in functions that makes programmers life easy. (Why worry about incrementing if range has that already?)

#output
[['date1', 'sentence1', 'sentiment1'],
 ['date2', 'sentence2', 'sentiment2'],
 ['date3', 'sentence3', 'sentiment3'],
 ['date4', 'sentence4', 'sentiment4'],
 ['date5', 'sentence5', 'sentiment5']]

answered Mar 7, 2015 at 14:39

brainovergrow

4584 silver badges13 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

ThePavolC · Accepted Answer · 2015-03-07 14:46:52Z

0

Try this

i =0
for i in xrange(0,len(doc) -1)
    date = doc[i]
    sentence = doc[i + 1]
    sentiment = classifier.classify(word_feats_test(sentence))
    xyz.append([date,sentence,classifier])

Only need one index. The important thing is knowing when to stop.

Also, check out the difference between extend and append

Finally I would suggest you store your data as a list of dictionaries rather than a list of lists. That lets you access the items by field name rather than index , which makes for cleaner code.

edited Mar 7, 2015 at 14:46

ThePavolC

1,7381 gold badge17 silver badges28 bronze badges

answered Mar 7, 2015 at 14:39

Nick Bailey

3,1922 gold badges13 silver badges13 bronze badges

1 Comment

Nick Bailey Over a year ago

Could someone be a dear and indent the append. Having trouble getting it to indent on mobile...

Padraic Cunningham · Accepted Answer · 2015-03-07 15:11:26Z

0

If you want two elements from your list at a time, you can use a generator then pass the element/s to your classifier:

abc = ["ignore","ignore",'date1','sentence1','date2','sentence2']

from itertools import islice


def iter_doc(doc, skip=False):
    it = iter(doc)
    if skip: # if  skip is set, start from index doc[skip:]
         it = iter(islice(it, skip, None))
    date, sent = next(it), next(it)
    while date and sent:
        yield date, sent
        date, sent = next(it, ""), next(it, "")


for d, sen in result(abc, 2): # skip set to to so we ignore first two elements
    print(d, sen)

date1 sentence1
date2 sentence2

So to create you list of lists xyz you can use a list comprehension:

xyz = [ [d,sen,classifier.classify(word_feats_test(sen))] for d, sen in iter_doc(abc, 2)]

edited Mar 7, 2015 at 15:11

answered Mar 7, 2015 at 14:56

Padraic Cunningham

181k30 gold badges264 silver badges327 bronze badges

Comments

Sakib Ahammed · Accepted Answer · 2015-03-07 16:47:02Z

0

It's simple. you can try it:

>>> abc = ['date1','sentence1','date2','sentence2'...]    
>>> xyz = [[ abc[i], abc[i+1], "sentiment"+ str(i/2 + 1)] for i in range(0, len(abc), 2) ]
>>> xyz
output : [['date1', 'sentence1', 'sentiment1'], ['date2', 'sentence2', 'sentiment2'], .....]

answered Mar 7, 2015 at 16:47

Sakib Ahammed

2,4802 gold badges26 silver badges29 bronze badges

Collectives™ on Stack Overflow

Python: list index out of range - while/for loop

4 Answers 4

Comments

1 Comment

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

Comments

1 Comment

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related