Up next in 10
Installing Hadoop for Single Node Cluster
Nov 28, 2024
Installing Hadoop for Single Node Cluster
View Video Transcript
0:00
in this video we are going to discuss
0:02
installing Hadoop for single node
0:05
cluster and we shall follow the steps
0:07
one by one for your easy understanding
0:10
so that also you can do the same at your
0:12
end so let us start the discussion on
0:14
this installation now at first we are
0:17
going for the installation of SSH and
0:20
our sync but before going for that we'll
0:22
be discussing three terminologies the
0:24
first one is the secure shell that is
0:27
SSH what is that then we shall go for
0:30
our sync that is a remote sync and the
0:33
last one is the passphrase so let us go
0:35
for the respective definitions so is
0:39
this SSH is a protocol for cryptographic
0:42
Network for operating network services
0:46
securely over an unsecured Network so
0:50
that is the definition of SSH that means
0:52
it is a protocol for cryptographic
0:55
Network for operating network services
0:58
securely on an unsecured Network next
1:03
one is a remote sync that is a heart
1:05
sync so is a remote and local file
1:08
synchronization tool so sometimes it may
1:11
happen that the two files which is at
1:13
the local and at the remote the file
1:15
content may have got changed then it is
1:18
not transferring the full file but it is
1:20
transferring that portion of the file
1:21
where the updates were done so depending
1:24
upon that the remote sync will work and
1:26
obviously that will have the less amount
1:29
of data transferred so it uses an
1:32
algorithm that minimizes the amount of
1:34
data copied by moving the portions of
1:37
the files that have got some changes
1:40
next one is a passphrase so a passphrase
1:44
is a sequence of words or other text
1:47
used to control the access of one
1:50
computer system and this particular
1:52
computer system or program are also on
1:55
data a passphrase is similar to a
1:58
password in usage but it generally
2:00
required for the added security of our
2:04
data so these are the three
2:06
terminologies are there now let us go
2:08
step by step one by one for the
2:10
installation of Hadoop for single
2:13
node cluster so here we are having two
2:17
operations have to be done so first one
2:19
is the install SSH and our sink and then
2:22
you shall go for SSH without passphrase
2:25
setup so to do this one we required to
2:28
issue these two commands that is sudo
2:30
apt - get install SSH
2:34
then sudo apt - get install our sink so
2:39
these two commands are to be executed to
2:41
install SSH and our sink on our system
2:44
these two commands were executing from
2:46
that dollar prompt so ssh without parse
2:50
phrase setup so the comment will be ssh
2:54
- qijin - t RSA after that we are
2:59
supposed to press ENTER for three times
3:01
without entering anything so three times
3:03
entered is to be pressed then we shall
3:06
go for cat then SS dot SSH / ID
3:11
underscore RSA dot pops so this
3:14
particular file is there hundred the
3:16
under the home path this particular file
3:18
we are doing the cat means where it is
3:20
printing the content of the file but not
3:23
we are not printing the content of the
3:25
file on the console we are redirecting
3:28
it to this respective file in this
3:30
particular folder existing so this
3:32
command has to be executed then SSH
3:34
localhost
3:36
so these two commands are to be executed
3:37
after pressing enter three times issuing
3:40
this command now open the browser so in
3:47
the Linux will be having one browser
3:48
open the browser and go to this
3:50
particular link so this link has been
3:52
created has been given here so just copy
3:56
this particular link and type this
3:58
particular link at the URL of that
3:59
browser and then click on the
4:02
highlighted link so here you can find if
4:04
you put this particular link on the
4:06
browser URL this web page will get
4:09
opened and this particular web page is
4:11
having this particular file that is a
4:13
hadoop - two point four point one dot
4:16
dot dot g jet so this is a file which
4:19
has to be highly huge has been
4:21
highlighted here and it has to be
4:22
click there now open up the terminal to
4:28
open up the terminal we are supposed to
4:30
go for control all dirty and then create
4:34
a directory called the Hadoop at the
4:36
home directory so how to create this
4:38
directory just issue the command mkdir
4:40
hadoop so just issue this command mkdir
4:43
hadoop then one directory will get
4:46
opened now edit the slash etc' slash
4:50
profile file and add the following lines
4:52
so profile file is existing under the
4:55
folder that is slash it is a slash
4:58
so under this folder there is one file
5:00
that is a profile file where these lines
5:02
are to be written you can open this file
5:05
in G edit and then we can type this
5:07
lines and then save and exit from the
5:09
g-eight it and then to make it effective
5:12
on to the system whatever you have typed
5:15
extra just execute this file dot slash
5:18
etc' slash profile so in this way you
5:20
can execute the file so whatever the
5:22
changes you did in the profile file the
5:24
corresponding changes will be obtained
5:26
onto the system now copy the downloaded
5:32
hadoop that is a hadoop - two point four
5:35
point one dot dot dot g jet so that file
5:38
which we downloaded from the respective
5:40
URL which i shown you earlier into the
5:43
hadoop directory and then go to this
5:45
directory and using terminal and then
5:48
enter the downloaded dot dot g jet file
5:51
so just go to the download folder where
5:54
you download it there and then copy
5:56
those files and then now put those files
5:59
under the hadoop folder and follow the
6:02
lines to go to the hadoop directory so
6:04
just go to the hadoop folder and the
6:06
files which were copied from the
6:08
downloaded folder to the Hadoop folder
6:10
now execute our X Z F for the under
6:14
operation so Todd X Z F and then hadoop
6:17
start so the file which was copied from
6:20
the downloaded folder to the Hadoop
6:21
folder those dot dot G jet files will be
6:25
entered here and this much we were going
6:27
to do for this single node clustered
6:30
installation on Hadoop thanks for
6:32
watching this video
#Network Monitoring & Management
#Programming