Replicate shell environment in python for executing bash commands

Question

I'm trying to execute a bash script from inside python using the subprocess module. The problem is that this bash script relies on many environment variables that are set in my .bashrc file. What I want is for python subprocess to exactly replicate the environment that is setup when I launch a terminal window. So far I tried:

p = subprocess.Popen(args=['my-script.sh', '--additional_args'], stdout=subprocess.PIPE, env=os.environ.copy(), shell=True)
output_buffer, return_code = p.communicate()

But then read somewhere that even after doing shell=True, the .bashrc file is still not loaded, and that i should try something like this:

p = subprocess.Popen(args=['/bin/bash', '-i', '-c', 'my_script.sh', '--additional_args'], stdout=subprocess.PIPE)
output_buffer, return_code = p.communicate()

But with this function call, I get this error:

tput: No value for $TERM and no -T specified
bash: cannot set terminal process group (2071): Inappropriate ioctl for device
bash: no job control in this shell

Might be useful stackoverflow.com/questions/9673730/…

taras
– taras

2017-06-07 17:45:40 +00:00
Commented Jun 7, 2017 at 17:45 — taras
– taras, Commented Jun 7, 2017 at 17:45

Miguel Ortiz · Accepted Answer · 2017-06-19 14:08:55Z

3

This worked for me:

Bashrc

$ cat ~/.bashrc  |grep LOLO
export LOLO="/foo/bar"

Bash

#!/usr/bin/bash

echo $LOLO

Python

#!/usr/bin/python

import subprocess, os
my_env = os.environ.copy()
my_env["PATH"] = "/usr/sbin:/sbin:" + my_env["PATH"]
subprocess.Popen('/home/m.ortiz.montealegre/lolo/script.sh', env=my_env)

Output:

$ python script.py
/foo/bar

The thing is, if you add new values (aliases / variables) to your bashrc you'll need to restart your terminal in order to bashrc gets executed and make those changes availables in the environment.

I've found the references to do this here and here

Note: From a subshell process you can't set environment variables to the parent shell.

edited Jun 19, 2017 at 14:08

answered Jun 7, 2017 at 19:12

Miguel Ortiz

1,49210 silver badges25 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Alok · Accepted Answer · 2024-03-11 09:23:56Z

0

xonsh shell should be useful for such mixing of bash and python

xonsh is a Python-powered shell that combines the flexibility of Python with > the convenience of a shell environment. It supports interactive use, > scripting, and seamless integration with existing Python libraries and tools.

answered Mar 11, 2024 at 9:23

Alok

10.9k11 gold badges75 silver badges133 bronze badges

Collectives™ on Stack Overflow

Replicate shell environment in python for executing bash commands

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related