GPU Instances on Kubernetes
I noticed GPU instances aren't supported for cluster nodes on LKE. Has anyone tried manually running a GPU instance as a node on LKE?
Also, has anyone heard if there are plans to add support for this? I read this article which makes it sound like not much further work is planned with GPUs.
6 Replies
bd5k
Linode Staff
Hi there,
You are correct - currently you are not able to deploy GPU Linodes as part of your LKE cluster's node pools. It's worth mentioning that I'm not an expert in all the intricacies of Kubernetes, but from reviewing the LKE guide, it doesn't appear that you would be able to manually add a GPU instance as a node within the LKE cluster itself.
I believe you could instead deploy a GPU Linode external to the cluster and then utilize a network service inside the cluster to give access for your containers to interact with the external GPU Linode. With that said, I haven't messed around with this personally, so your mileage may vary.
An alternative option might be to standup your own unmanaged Kubernetes cluster, this should give you the ability to have a GPU Linode as a worker node within a Kubernetes cluster. While researching this topic, I came across a resource from the Kubernetes documentation that describes how you can schedule GPU nodes. In case this may be of interest to you I'll link it below:
With regards to future plans for GPU Linodes and LKE, I'm not sure. In my opinion it would be really cool and I definitely see the value for other users as well. I'll pass your interest in this functionality along to our teams responsible for making those sorts of decisions.
-- BD.
This would be a very useful feature and make LKE even closer in terms of feature parity with the larger cloud providers (i.e. AWS, GCP, Azure). In fact it may be the one feature that's preventing us from using Linode for our production workloads.
rdaniels
Linode Staff
@RosebudAI-Alex Thanks for sharing your thoughts about this. While I don't have an ETA on this feature yet, I have created an escalation about allowing GPUs to be used for LKE nodes. Please, let us know if you have any additional feature request.
Hello, for us this is a very nice feature to have. We need to process a high work load for deep learning tasks. So we want to orchestrate the GPU instances from K8S. Using an external node will add complexity and it's not fully scalable.
I hope Linode add this feature soon.
Is there any ETA for running GPU instances inside LKE? Or at least an updated CCM and CSI, supporting K8S >1.23, so we can create unmanaged clusters with GPU easily?
I also want to know that. Although I enjoy playing online casino games, some of them spam and occasionally give us money when we play for the first time before taking it all away when we play for the big prize. I now feel really let down by it. The website click to read, where I learned about Canadian players' online real money slot sites, is thanks to my friend, who informed me about it. I often enjoy playing Canadian slots because I'm from there.