The OpenSDN tf-config pods fail to process API calls

The OpenSDN tf-config pods may fail to process API calls when the uWSGI listen queue is full. As a result, pods report Unhealthy and OpenSDN deployments can fail. In the pod logs, repeated messages appear such as:

*** uWSGI listen queue of socket "10.10.0.155:8082" (fd: 3) full !!!
(101/100) ***

To resolve the issue:

Delete all tf-config pods one by one so they are recreated.

  1. List the tf-config pods:

    kubectl get pods -l tungstenfabric=config -n tf
    
  2. Delete one tf-config pod:

    kubectl delete pod <POD_NAME> -n tf
    

    Wait for the new pod to be created.

  3. Verify that the new pod has status Running and the restart count does not increase:

    kubectl get pods -l tungstenfabric=config -n tf
    

    Example of a positive system response:

    tf-config-jcfrr     4/4     Running     0     2m
    
  4. Repeat steps 2-3 for the remaining tf-config pods one by one.