For loop in script with arrays and script/terminal inconsistency

Question

I want to loop through a list of directories (a subset of the directories in a folder) and do operations with them. However, for some reason it is not working. Here is the code where I am just echoing all of them:

#!/bin/bash                                                                                                                                                                   
                                                                                                                                                                              
cd images                                                                                                                                                                     
array=$(ls -d *)                                                                                                                                                              
selection=(${array[@]:1:12})                                                                                                                                                  
cd ..                                                                                                                                                                         
                                                                                                                                                                              
for sub in ${selection[@]}                                                                                                                                                    
do                                                                                                                                                                            
    echo $sub                                                                                                                                                                 
    mkdir $HOME/Projects/PhD/0_project/fMRI/scans/temp/temp_$sub                                                                                                              
done

The ouptut I get for the echo command is:

And the folders: temp_3, temp_04, temp_306, temp_307

HOWEVER, if I run each single line in bash in the termiinal (interactive mode, no script) I do get the correct output for the echo command:

And for the mkdir command: temp_306, temp_307... temp_324

Any idea about this strange and inconsistent behaviour? What am I missing?

Thanks for your help.

array=( */ ) is a much less buggy way to put folder names into an array. array=( "${array[@]%/}" ) to postprocess if you don't want the trailing slashes. Parsing ls is bad juju, and doing it badly defeats the whole point of using arrays in the first place (their ability to accurately store arbitrary strings). Though your current code isn't actually using arrays at all. — Charles Duffy
– Charles Duffy, Commented Jul 21, 2022 at 15:53
It's a good idea to run any shell script through shellcheck.net. In this case, I think it would've found the issue for you. — kojiro
– kojiro, Commented Jul 21, 2022 at 15:53
BTW, it's a good idea to make sure people know enough to understand how your code is supposed to work as part of the question (we can tell what working code does by reading it, but we can't tell what broken code was intended by its author to do without trying to read its author's mind; don't make us do that). What should the path entries in images look like? — Charles Duffy
– Charles Duffy, Commented Jul 21, 2022 at 15:59
Thanks. They are folders named with three digits ("304", "424", "306", etc.) — Modellics
– Modellics, Commented Jul 21, 2022 at 17:59

Charles Duffy · Accepted Answer · 2022-07-21 16:51:22Z

1

result of $(ls -d *) is a string.
you are slicing a string not an array.

remove :1:12.

#!/bin/bash

cd images || exit
array=(*/) # result is array of subdirectories with / on end of each
selection=("${array[@]%/}") # remove trailing slashes from that array.
selection_sliced=("${selection[@]:1:12}") # if you want to slice.
cd .. || exit

for sub in "${selection_sliced[@]}"
do
    echo "$sub"
    mkdir "$HOME/Projects/PhD/0_project/fMRI/scans/temp/temp_$sub"
done

edited Jul 21, 2022 at 16:51

Charles Duffy

299k43 gold badges441 silver badges496 bronze badges

answered Jul 21, 2022 at 14:56

fver1004

3111 gold badge3 silver badges10 bronze badges

Sign up to request clarification or add additional context in comments.

7 Comments

Modellics Over a year ago

But what if I want to select only a subset of the elements of that array to feed into the for loop?

fver1004 Over a year ago

@Carlos_567 just slice the variable selection. selection is an array. i edited post.

Charles Duffy Over a year ago

selection=( ${array[@]} ) is buggy; see BashPitfalls #50. And for sub in ${array[@]} acts exactly like for sub in ${array[*]}; do get proper array behavior it needs to be for sub in "${array[@]}" with the quotes.

Charles Duffy Over a year ago

Similarly this answer has a whole lot of quoting bugs; consider running it through shellcheck.net -- and see ParsingLs.

Charles Duffy Over a year ago

Much better as amended. I'm not sure if it's what the OP needs, but that's because their question is vague, not because of anything wrong with this answer. I did add a few minor cleanups -- cd should always handle errors so you don't run your mkdirs in the wrong directory should they fail -- and correct some comments.

|

Collectives™ on Stack Overflow

For loop in script with arrays and script/terminal inconsistency

1 Answer 1

7 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

7 Comments

Your Answer

Sign up or log in

Post as a guest

Related