DataXceiver error processing WRITE_BLOCK operation src: /x.x.x.x:50373 dest: /x.x.x.x:50010

Error:

DataXceiver error processing WRITE_BLOCK operation src: /x.x.x.x:50373 dest: /x.x.x.x:50010

Solution:

1.修改进程最大文件打开数

/etc/security/limits.conf
# End of file
*               -      nofile          1000000
*               -      nproc           1000000

2.修改数据传输线程个数

hdfs-site.xml

in hadoop-1.x

<property>
    <name>dfs.datanode.max.xcievers</name>
    <value>8192</value>
    <description>
        Specifies the maximum number of threads to use for transferring data
        in and out of the DN.
    </description>
</property>

in hadoop-2.x

<property> 
    <name>dfs.datanode.max.transfer.threads</name> 
    <value>8192</value> 
    <description> 
        Specifies the maximum number of threads to use for transferring data
        in and out of the DN. 
    </description>
</property>