⚜How to Contribute Limited Amount of Storage as a Slave to the Cluster ❓❓

Harshal Thakare
4 min readOct 23, 2020

--

Hey Friends ❗❗❗🙋‍♂️🙋‍♂️

Today ,we are going to find out “In Hadoop Cluster How to Contribute Limited Amount of Storage as a Slave to the Cluster ❓❓”

What you think is it possible ❓❓🤔🤔

Let’s begin…🤩🤩

It Seems Interesting… 😃 I’m too excited to see is it really possible or not Are you ❔❔

🔰This is one of our data node & This is 50 GB in size & its contributes it entire 50 GB storage(space) to the respective name node .

🔰This is our name node Here we can able to see that the data node has contribute his entire 50GB storage(space) to the name node .

🔰Now Friends , Let’s find the way how to contribute limited/specific amount of storage as slave to the cluster ❔❔🤔

🔰Following Steps are required to find the way how to contribute limited/specific amount of storage as slave to the cluster ?

Step 1 : Shut down the data node

Step 2 : Go to settings

Step 3 : In Setting , go to storage section

🔰Now , After doing these choose the default options as below ….

Here , We provided 10 GB Hard Disk

🔰Now , we have succesfully created the new hard disk of 10GB.We need to attach it …..

Select the newly created Hard Disk that we created recently of 10GB
Here we can see that our new Hard Disk is attached

🔰Now , Start our Virtual Machine

🔰In our VM we are able to see the attached Hard Disk by using the command :

# fdisk -l

🔰Now for using the created Hard Disk we need to follow the below Steps :

Step 1 : Check & Fix how much space you need & then create the Physical Partition

Step 2 : After creating physical partition Format it …..

Step 3 : After Format we have to mount it with the folder which we want to share to the name node …..

🔰 Now , We can Start our Services of Name node & Data Node & Let’s see what happens….😃😃🤩

🔰And Here , We can see that We created a New Hard Disk of size 10 GB But It’s shares only 5.85 GB i.e. 6 GB to Name Node ….

🔰It proves that In Hadoop Cluster we can able to contribute limited /specific amount of storage as slave to the master 🤩🤩🤩

⚜And Here , We completed the task succesfully……✌✌✨

🔰We can perform this task on AWS instance also by adding EBS volume of particular size & doing the same steps for partition …..

Thanks for reading !!!😃✌

🔰Keep Learning ❗❗🔰Keep Sharing ❗❗

--

--