running a python file from the ipython notebook using command line in loop

Question

I have built a model that trains using training.py. I want to tune the hyperparameters and run the following script from the notebook in loop by varying the arguments passed.

python training.py --cuda --emsize 1500 --nhid 1500 --dropout 0.65 --epochs 10

For eg: If the hyperparameter is dropout, I want to be able to run the script in loop by varying dropout values and plot the graph.

This is probably what you need to do stackoverflow.com/questions/14500183/… — p13rr0m
– p13rr0m, Commented Apr 6, 2018 at 8:40

layog · Accepted Answer · 2018-04-06 06:31:59Z

0

You can run a shell command using ! in an ipython environment as

!ls -l

If you want to use it with variables,then you can use {}.

# Supposing you have epochs in e and dropout size in d
!python training.py --cuda --emsize 1500 --nhid 1500 --dropout {d} --epochs {e}

You can also capture the output of shell runs in ipython using !! instead of !. The !! magic command returns the output of the command as a list of strings. So, you can do something like

files = !! ls - l

answered Apr 6, 2018 at 6:31

layog

4,8111 gold badge31 silver badges32 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

running a python file from the ipython notebook using command line in loop

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related