Installing Hadoop for Single Node Cluster

In this video we are discussing installing Hadoop for single node cluster and

you shall explain these steps one by one into further detailing and also you

can do the same on your system. So let us start with this installation of Hadoop for

single node cluster. So before studying at first we are going to discuss three

terminologies. We are going to discuss them one by one. Now at first we are going

for the installation of SSH and R sync but before going for that we'll be discussing three terminologies. The first one is the

secure shell that is SSH what is that. Then we shall go for R sync, that is a remote sync and

the last one is the pass phrase. So, let us go for the respective definitions. So is this

SSH is a protocol for cryptographic network for operating network services securely over an

unsecured network. So, that is a protocol for cryptographic network for operating network. that is the definition of SSH

That means it is a protocol for cryptographic network for operating network services securely on an unsecured network

Next one is the remote sync, that is the R sync. So is a remote and local file synchronization tool

So sometimes it may happen that the two files, which is at the local and at the remote

the file content may have got changed. Then it is not transferring the full file

but it is transferring that portion of the file where the updates were done

So depending upon that the remote sync will work and obviously that will have the less amount of data transfer So it uses an algorithm that minimizes the amount of data copied by moving the portions of

the files that have got some changes. Next one is a pass phrase

So a pass phrase is a sequence of words or other texts used to control the access of one

computer system. And this particular computer system or program are also on data

A passphrase is similar to a password in usage but it generally required for the added security of our data

So these are the three terminologies are there. Now let us go step by step one by one for the installation of Hadoop for single node cluster

So here we're having two operations are to be done. So first one is the install SSH and R sync and then you shall go for SSH without passphrase

setup. So, to do this one, we require to issue these two commands, that is pseudo-ap-t-hyphen

get install SSH, then pseudo-a-T-h-h-hfin-get install R-Sync. So, these two commands are

to be executed to install SSH and R-Sync on our system. These two commands were executing

from the dollar prompt. So, SSH without parse, phrase, setup. So the command will be

s s h hyphen key jane minus t r s a after that we are supposed to press enter for three times

without entering anything so three times enter is to be pressed then we shall go for cat then s s dot ss h slash id underscore rsa dot pub So this particular file is there under the home path this particular file we are doing the CAT means where it is printing

the content of the file, but not, we are not printing the content of the file on the console

We are redirecting it to this respective file in this particular folder existing

So, this command has to be executed. Then SSH, local host. So, these two commands are to be executed after pressing enter three times issuing this command

Now, open the browser. So in the Linux we'll be having one browser, open the browser and go to this particular link

So this link has been created, has been given here, so just copy this particular link and type

this particular link at the URL of that browser and then click on the highlighted link

So here you can find if you put this particular link. link on the browser URL, this web page will get opened and this particular web page is

having this particular file that is the Hadoop-2.4.1.tard.g. So this is a file which has

to be highlighted here and it has to be clicked there. Now open up the terminal. To open up

the terminal we are supposed to go for Control Alter T and then create a directory called the

Hadoop at the home directory. So, how to create this directory? Just issue the command MKDIR Hadoop

So, just issue this command, MKDIR Hadoop. Then one directory will get opened

Now edit the slash ETC slash profile file and add the following lines So profile file is existing under the folder that is slash ETC slash

So under this folder there is one file, that is a profile file where these lines are to be written

You can open this file in G-Edit and then we can type these lines and then save and exit from

the G-Edit. And then to make it effective onto the system, whatever you have typed extra, just execute

this file dot slash ETC slash profile. So in this way you can execute the file. So, whatever the

changes you did in the profile file, the corresponding changes will be obtained onto the system

Now, copy the downloaded Hadoop, that is a Hadoop, hyda-2.4.1.org.org. So, the file which

we downloaded from the respective URL, which I showed you earlier, into the Hadoop directory

and then go to this directory and using terminal and then enter the downloaded tar

So, just go to the download folder where you downloaded there and then copy those files

and then now put those files under the Hadoop folder and follow the lines to go to the Hadoop directory

So just go to the Hadoop folder and the files which were copied from the downloaded folder

to the Hadoop folder now execute TAR XZF for the Hadoop folder. Now execute tar x zf for the untoward operation

So, tar xzf and then Hadoop start. So the file which was copied from the downloaded folder to the Hadoop folder, those

turd.gd files will be untoward here and this much you are going to do for this single

node cluster installation on Hadoop. Thanks for watching this video