increase proxy_send_timeout and proxy_read_timeout ingress nginx

Question

Im running deployments on GKE,

using quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.12.0 image as nginx-ingress-controller

Im trying to increase proxy_send_timeout and proxy_read_timeout following to this link

here is my ingress config:

apiVersion: extensions/v1beta1
kind: Ingress
metadata:
  name: nginx-ingress
  namespace: production
  annotations:
    kubernetes.io/ingress.class: "nginx"
    nginx.ingress.kubernetes.io/proxy-connect-timeout: "360s"
    nginx.ingress.kubernetes.io/proxy-send-timeout: "360s"
    nginx.ingress.kubernetes.io/proxy-read-timeout: "360s"
    nginx.ingress.kubernetes.io/proxy-body-size: 100m
    nginx.ingress.kubernetes.io/client-body-buffer-size: 100m
spec:
  rules:
  - host: app.my.com
    http:
      paths:
      - backend:
          serviceName: front-app
          servicePort: 80
  - host: api.my.com
    http:
      paths:
      - backend:
          serviceName: backend-app
          servicePort: 80
  - host: api.old.com
    http:
      paths:
      - backend:
          serviceName: backend-app
          servicePort: 80
  tls:
  - hosts:
    - app.my.com
    - api.my.com
    secretName: tls-secret-my-com
  - hosts:
    - api.old.com
    secretName: tls-secret-old-com

still this does not change the proxy_send_timeout and proxy_read_timeout

requests which take longer than 60s (default nginx timeout) are closed

I see this log:

[error] 20967#20967: * upstream prematurely closed connection while reading response header from upstream, client: 123.456.789.12, server: api.my.com, request: "GET /v1/example HTTP/2.0", upstream: "http://11.22.3.44:4000/v3/example", host: "api.my.com", referrer: "https://app.my.com/"

when I go into the nginx pod:

> kubectl exec -it nginx-ingress-controller-xxxx-yyyy -n ingress-nginx -- bash
> cat /etc/nginx/nginx.conf

output:

server {
    server_name _ ;

    listen 80 default_server  backlog=511;
    location / {
        # Custom headers to proxied server

        proxy_connect_timeout                   5s;
        proxy_send_timeout                      60s;
        proxy_read_timeout                      60s;

proxy_send_timeout and proxy_read_timeout are set to 60s and not 360s as I configured on the ingress

so I tried changing manually the timeout on nginx conf, and then I did not get the timeout on the client, but every time the nginx is restarted the values are returned to the default 60s

how can I configure currectly the timeouts on the ingress?

Bob · Accepted Answer · 2024-10-18 20:00:04Z

46

Based on : https://github.com/kubernetes/ingress-nginx/issues/2007#issuecomment-374856607

I had the same problem and discovered that the following do not work:

nginx.ingress.kubernetes.io/proxy-read-timeout: 1800
nginx.ingress.kubernetes.io/proxy-read-timeout: 1800s
nginx.ingress.kubernetes.io/proxy-read-timeout: "1800s"

What does work is:

nginx.ingress.kubernetes.io/proxy-read-timeout: "1800"

Try to change the value in the annotation to '360'. The value needs to be a number.

edited Oct 18, 2024 at 20:00

Bob

1,8413 gold badges23 silver badges35 bronze badges

answered Dec 3, 2018 at 12:25

Axel

5065 silver badges5 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Luke Briner Over a year ago

To be clear, it has to be a quoted number! "360" would be good but NOT 360, 360s or "360s"

Community · Accepted Answer · 2021-04-10 13:50:09Z

19

As per Kubernetes documentation you should use numerical values treated as a string.

Example:

apiVersion: extensions/v1beta1
kind: Ingress
metadata:
  name: webapp-domain-local
  annotations:
    nginx.ingress.kubernetes.io/proxy-connect-timeout: "10"
    nginx.ingress.kubernetes.io/proxy-read-timeout: "1"
spec:
  rules:
  - host: webapp.domain.local
    http:
      paths:
      - backend:
          serviceName: webapplication
          servicePort: 8080

edited Apr 10, 2021 at 13:50

CommunityBot

11 silver badge

answered Aug 19, 2019 at 10:09

theelog

1911 silver badge3 bronze badges

1 Comment

Muzi Jack Over a year ago

how can i change this to connection to close instead of keep-alive

P Ekambaram · Accepted Answer · 2021-01-05 06:12:40Z

6

Use the annotation as shown below

     kubernetes.io/ingress.class: nginx
     kubernetes.io/ingress.allow-http: "false"
     nginx.ingress.kubernetes.io/proxy-read-timeout: "3600"
     nginx.ingress.kubernetes.io/proxy-send-timeout: "3600"

It should reflect in the nginx conf file as below


                        proxy_send_timeout                      3600s;
                        proxy_read_timeout                      3600s;

answered Jan 5, 2021 at 6:12

P Ekambaram

17.9k9 gold badges46 silver badges69 bronze badges

Comments

Nikolay Baranenko · Accepted Answer · 2024-08-15 16:22:12Z

try to use this helm chart for set timeout on 10 sec

apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
  name: {{ .Values.app.name }}
  labels:
    ingress: {{ .Values.app.name }}
  annotations:
    ingress.kubernetes.io/preserve-host: "false"
    ingress.kubernetes.io/secure-backends: "true"
    nginx.ingress.kubernetes.io/upstream-vhost: "{{ .Values.DNS_DMZ }}"
    nginx.ingress.kubernetes.io/backend-protocol: "HTTPS"
    nginx.ingress.kubernetes.io/proxy-body-size: "300m"
    nginx.ingress.kubernetes.io/proxy-connect-timeout: "10"
    nginx.ingress.kubernetes.io/proxy-send-timeout: "10"
    nginx.ingress.kubernetes.io/proxy-read-timeout: "10"
    nginx.ingress.kubernetes.io/client-body-timeout: "10"
    nginx.ingress.kubernetes.io/client-header-timeout: "10"
    nginx.ingress.kubernetes.io/upstream-keepalive-timeout: "10"
    nginx.ingress.kubernetes.io/keep-alive: "10"
    nginx.ingress.kubernetes.io/server-snippet: |
      proxy_ssl_name {{ .Values.DNS_DMZ }};
      proxy_ssl_server_name on;
spec:
  tls:
    - hosts:
        - {{ .Values.DNS }}
      secretName: {{ .Values.DNS }}
  rules:
    - host: "{{ .Values.DNS }}"
      http:
        paths:
          - pathType: Prefix
            path: "/"
            backend:
              service:
                name: {{ .Values.app.name }}
                port:
                  number: {{ .Values.PORT }}

Collectives™ on Stack Overflow

increase proxy_send_timeout and proxy_read_timeout ingress nginx

4 Answers 4

1 Comment

1 Comment

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

1 Comment

1 Comment

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related