Pipe infinite output from shell command to a python script

Question

I would like to forward the output from one script to the another.

I try to do it like that:

./producer.py > ./consumer.py

Where procuder:

#!/usr/bin/env python3

import sys
import time

i=0
while True:
    print(i)
    i+=1
    time.sleep(1)

And consumer:

#!/usr/bin/env python3

import sys

f= open("test.txt","w+")

while True:
    line = sys.stdin.read()
    print(line)
    f.write(line)

I expect that producer will generate: 1 2 3 4 5 and this pipe will be saved in file test.txt by another script. Thank you for help.

Koen G. · Accepted Answer · 2019-05-08 09:40:41Z

1

Use a pipe | instead of > to forward output (stdout) from one process to another (as stdin). Also, beware that the data over the pipe is buffered, which may seem like nothing is happening when there is not a lot of data and the stream is never closed.

answered May 8, 2019 at 9:40

Koen G.

7885 silver badges10 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Dia · Accepted Answer · 2019-05-08 10:09:41Z

0

Consider using a queue with two threads instead. Here is a good basic guide. Here is another guide.

edited May 8, 2019 at 10:09

answered May 8, 2019 at 10:02

Dia

415 bronze badges

Comments

satyam soni · Accepted Answer · 2019-05-08 10:52:41Z

0

Try using subprocess and then save the data from output pipe to file. You do not need to execute the command outside.

from subprocess import PIPE,Popen

process = Popen(['python','test.py'],stderr=PIPE,stdout=PIPE)

output = process.stdout.readlines()

answered May 8, 2019 at 10:52

satyam soni

2691 silver badge9 bronze badges

Collectives™ on Stack Overflow

Pipe infinite output from shell command to a python script

3 Answers 3

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related