How to clone repo using ssh on Airflow? [duplicate]

Question

I'm trying to clone my bitbucket repo using ssh (which works perfectly fine on my local machine) on Airflow to continue executing several scripts. Since the keys are present locally I always get the following error while running my DAG on docker, and I believe the same will happen when running this on the server.

raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['git', 'clone', 'ssh://[email protected]:7999/app.git', 'app']' returned non-zero exit status 128.

How can I mount (or maybe pass) the key onto my docker container as well as the airflow server in order to achieve this cloning step?

Debug stdout and stderr in order to have a look at the error message — Maurice Meyer
– Maurice Meyer, Commented Jan 3 at 14:32
stackoverflow.com/a/66301568/7976758 Found in stackoverflow.com/search?q=%5Bdocker%5D+ssh+keys — phd
– phd, Commented Jan 4 at 9:46

Dave982 · Accepted Answer · 2025-01-04 03:50:06Z

0

Why not just copy over the ssh keys into the docker container?

RUN mkdir -p /root/.ssh

COPY id_rsa /root/.ssh/id_rsa
COPY id_rsa.pub /root/.ssh/id_rsa.pub

RUN chmod 600 /root/.ssh/id_rsa && chmod 644 /root/.ssh/id_rsa.pub

RUN ssh-keyscan -H myrepo.com >> /root/.ssh/known_hosts

answered Jan 4 at 3:50

Dave982

216 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to clone repo using ssh on Airflow? [duplicate]

1 Answer 1

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Linked

Related