Run an operator as a deployment

Thank you so much for your quick response! 🙂

(I should have asked more specifically. Sorry for the long description below.)

My operator receives an container’s addr, calls HTTP GET to get “Hello. Docker”, and displays that msg sent by one container. This container is deployed with a StatefulSet + headless service so that ClusterIP is NOT assigned to that container. AFAIK, …svc.cluster.local is assigned to a container if it is deployed with a headless service.

The service name is “http-service” and the container’s name is “http-server-0”. And the operator’s name is “operator”.

bash-4.4$ kubectl get svc -o wide
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE SELECTOR
http-service ClusterIP None 80/TCP 65m app=http-server

bash-4.4$ kubectl get pods -o wide
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED
NODE READINESS GATES
http-server-0 1/1 Running 0 28m 172.17.0.9 minikube

bash-4.4$ kubectl get pod -n operator-system
NAME READY STATUS RESTARTS AGE
operator-controller-manager-6cdf9b5448-nv54q 2/2 Running 0 32s

/* Code snippet of Reconcile method */
import (
. . . . . . . . .
“sigs.k8s.io/controller-runtime/pkg/log”
)
func (r *OperatorReconciler) Reconcile(ctx context.Context, req ctrl.Request) (ctrl.Result, error) {
log := log.FromContext(ctx).WithValues(“Operator”, req.NamespacedName)
. . . . . . . . . . . .
spec := &instance.Spec
log.Info(“Request received”, “podURL”, spec.PodURL)
// Update spec
err = r.Update(context.TODO(), instance)
if err != nil {
log.Error(err, “Faile to update”)
return ctrl.Result{}, nil
}
// HTTP GET
log.Info(“http GET”, “podURL”, spec.PodURL)
resp, err := http.Get(spec.PodURL)
if err != nil {
log.Error(err, “http GET failed”)
resp.Body.Close()
return ctrl.Result{}, nil
} else {
log.Info(“http GET”, “Response status:”, resp.Status)
}
// Display msg received.
scanner := bufio.NewScanner(resp.Body)
for i := 0; scanner.Scan() && i < 5; i++ {
log.Info("http GET", "Received", scanner.Text())
}
if err := scanner.Err(); err != nil {
log.Error(err, "Scanner Failed")
}
resp.Body.Close()
return ctrl.Result{}, nil
}

So the custom resource 'Operator' manifest goes here:

/* myoperator.yaml */
apiVersion: example.com/v1alpha1
kind: Operator
metadata:
name: operator-sample
spec:
podURL: "http://http-server-0.http-service.default.svc.cluster.local:8080&quot;

I observe that Reconcile method is receiving 'podURL'. However, http-server-0 does NOT respond. The http-server-0 creates a file named 'RHA' and writes "Hello. Docker" to that file and returns that msg to the client as well. Pls see below.

bash-4.4$ kubectl exec -it http-server-0 bash
root@http-server-0:/# curl http://localhost:8080
Hello, Docker!
root@http-server-0:/# cd /var/data
root@http-server-0:/var/data# ls
RHA

After running "kubectl apply -f myoperator.yaml", I checked whether that file has ben created. But the file is NOT created. This means the operator is unable to send HTTP GET with http-server-0,http-service.default.svc.cluster.local:8080

root@http-server-0:/var/data# rm -rf RHA
/*** After removing RHA, I ran "kubectl apply -f myoperator.yaml" ***/
root@http-server-0:/var/data# ls
root@http-server-0:/var/data#

So I wanted to get the debug logs that I added to the Reconcile method. But unlike deploying it locally, I couldn't get the logs. When I run it locally, the logs are displayed as below.

1.6512988519094684e+09 INFO controller.operator Request received {"reconciler group": "example.com", "reconciler kind": "Operator", "name": "operator-sample", "namespace": "default", "Operator": "default/operator-sample", "podURL": "http://http-server-0.http-service.default.svc.cluster.local:8080&quot;}
1.6512988519170702e+09 INFO controller.operator http GET {"reconciler group": "example.com", "reconciler kind": "Operator", "name": "operator-sample", "namespace": "default", "Operator": "default/operator-sample", "podURL": "http://http-server-0.http-service.default.svc.cluster.local:8080&quot;}
1.6512988519185042e+09 INFO controller.operator http GET {"reconciler group": "example.com", "reconciler kind": "Operator", "name": "operator-sample", "namespace": "default", "Operator": "default/operator-sample", "Response status:": "404 Not Found"}

Guess that since this is run locally, not in k8s network, the HTTP GET fails. So I deployed it onto k8s cluster by running "make deploy". However, I couldnt see the custom logs. So don't know why it fails to call HTTP GET.

I looked into your custom log function 'CustomLogs()'. Guess that this is similar to mine in Reconcile since mine is also calling log.Info() with the context.Context.

I tried to run the following cmd to get the debug logs, but as seen below, looks like these are controller or k8s system logs. The debug msgs are NOT displayed.

bash-4.4$ kubectl -n operator-system logs operator-controller-manager-6cdf9b5448-nv54q
1.6512992746191816e+09 INFO controller-runtime.metrics Metrics server is starting to listen {"addr": "127.0.0.1:8080"}

LikeLike