Installing KubeFlow on your Local Machine

--

KubeFlow is an open-source ML toolkit for Kubernetes. It is a convenient tool for making Machine Learning Workflows Simple, Portable and Scalable. As, it runs on top of Kubernetes it can run on-prem Servers, GKE (Google Kubernetes Engine) and Amazon Elastic Kubernetes Service (EKS) or any other Kubernetes Service.

There are many ways of Installing Kubernetes Locally in your System:

When we check for Local KuberFlow options we are having MiniKF, in the official documentation of KubeFlow, they are using Vagrant and VirtualBox to install MiniKf. I avoided this installation as i wanted to avoid VirtualBox.

Big Data Jobs

Another option is first Installing MiniKube and then Installing Kubeflow on that. I encountered some bugs where it did not install few of the services.

The Easiest Option which I found was using MicroK8s. Following are the commands which I used to install this.

  1. First Step is to install microk8s.

sudo snap install microk8s -classic

2. Verify the status of microk8s

microk8s.status --wait-ready

Trending AI Articles:

1. Top 5 Open-Source Machine Learning Recommender System Projects With Resources

2. Deep Learning in Self-Driving Cars

3. Generalization Technique for ML models

4. Why You Should Ditch Your In-House Training Data Tools (And Avoid Building Your Own)

3. We have to enable Services which have will be used by KubeFlow.

microk8s.enable dns dashboard storage

4. For Deploying KubeFlow

microk8s.enable kubeflow

After Deploying Kubeflow we will access the KubeFlow Dashboard. We will the dashboard IP in the command line. We will also get Username and Password which we will require to access the KubeFlow Dashboard. After entering the credentials we will access the Dashboard which will look like this.

KubeFlow Dashboard

5. Stopping After Deployment

microk8s.disable kubeflow

Congrats! Hope You are Enjoying KubeFlow in your Local!

If if you encountering any Problem then,

  1. Install Multipass

snap install multipass

2. Launch multipass

multipass launch --name kubeflow-vm --mem 16G --disk 50G

multipass shell kubeflow-vm

3. Install microk8s in Multipass VM

sudo snap install microk8s --classic

sudo iptables -P FORWARD ACCEPT

sudo usermod -aG microk8s $USER

newgrp microk8s (exit Shell and Enter Shell Again)

Now Follow the steps Mentioned Above.

Congrats! Finally I really Hope You are Enjoying KubeFlow in your Local!

References:

  1. https://github.com/kubeflow/kubeflow/issues/4931
  2. https://ubuntu.com/kubeflow/install

Now, as you have installed it you can go through this article to learn more about KubeFlow and How it Works

https://neptune.ai/blog/deep-dive-into-ml-models-in-production-using-tfx-and-kubeflow

Don’t forget to give us your 👏 !

--

--