Results 1 to 2 of 2

Thread: Data storage on rack in HDFS?

  1. #1
    Senior Member
    Join Date
    Jun 2013
    Posts
    8,902

    Data storage on rack in HDFS?

    Please explain on what criteria the data will be stored on a rack in HDFS?

  2. #2
    Senior Member
    Join Date
    Jul 2013
    Posts
    65,077
    Quote Originally Posted by rohan View Post
    Please explain on what criteria the data will be stored on a rack in HDFS?
    When the client is ready to load a file into the cluster, the content of the file will be divided into blocks. Now the client consults the Namenode and gets 3 datanodes for every block of the file which indicates where the block should be stored. While placing the datanodes, the key rule followed is “for every block of data, two copies will exist in one rack, third copy in a different rack“. This rule is known as “Replica Placement Policy“.

    Please add more on it if anyone has other opinion on it!

Similar Threads

  1. What is rack in HDFS?
    By rohan in forum Hadoop
    Replies: 1
    Last Post: 08-13-2013, 09:53 AM
  2. Replies: 1
    Last Post: 08-05-2013, 07:45 AM
  3. Replies: 0
    Last Post: 05-09-2013, 05:10 PM
  4. Replies: 0
    Last Post: 05-08-2013, 07:30 AM
  5. Replies: 0
    Last Post: 12-22-2012, 03:54 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •