foreach in Scala parallel collections

Question

I have this code evaluated with Ammonite:

$ amm
Welcome to the Ammonite Repl 2.5.1 (Scala 2.13.8 Java 17.0.1)
@ import $ivy.`org.scala-lang.modules::scala-parallel-collections:1.0.4`
@ import scala.collection.parallel.CollectionConverters._
@ Seq(1,2).foreach { x => Thread sleep x*1000; println(s"Fin $x") };println("Fin") 
Fin 1
Fin 2
Fin

It completes ok. If I add the par to parallelize, then it never finishes:

@ Seq(1,2).par.foreach { x => Thread sleep x*1000; println(s"Fin $x") };println("Fin")

Is this a bug? With Scala 2.12 I get the same behaviour.

Parallel collections and REPLs never play well together. You may try just wiring a normal program or looking for the options to tune so it works in REPLs. — Luis Miguel Mejía Suárez
– Luis Miguel Mejía Suárez, Commented Feb 24, 2022 at 13:20
I'm used to employ successfully parallelism in Ammonite scritps. — david.perez
– david.perez, Commented Feb 25, 2022 at 8:33

AlexV · Accepted Answer · 2022-03-01 06:45:38Z

1

+50

You're having this problem due this bug with Scala's lambda encoding that will also happen in the Scala REPL.

The bug on the Scala side: https://github.com/scala/scala-parallel-collections/issues/34

The corresponding ammonite bug report is here: https://github.com/com-lihaoyi/Ammonite/issues/556

You can work around this in two ways that I'm aware of. The first is to put your parallel work inside of an object e.g.

  object work {
    def execute() = Seq(1, 2).foreach { x =>
      Thread.sleep(x * 1000); println(s"Fin $x")
    }; println("Fin")
  }
  work.execute

I believe running Ammonite with amm --class-based should also do the trick, but I'm not able to test this right now.

answered Mar 1, 2022 at 6:45

AlexV

4493 silver badges6 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

foreach in Scala parallel collections

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related