Can I containerize UI and apiserver and manage the deployment myself

Yes, it is possible.
This is the full k8s guide written by a community member: Self-hosting RedwoodJS on Kubernetes

Although some steps are a bit out of date because they’re easier now since redwoodjs introduced a docker setup: Docker | RedwoodJS Docs

Redwoodjs is pretty flexible and only needs a little work when it comes to root paths and web env vars.