下面给你一个Linux 下 HDFS 配置并启动的简明流程(以 Hadoop 3.x 为例,伪分布式模式,最常见)。
java -version
tar -zxvf hadoop-3.x.x.tar.gz -C /opt/
vi ~/.bashrc
添加:
export HADOOP_HOME=/opt/hadoop-3.x.x
export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
生效:
source ~/.bashrc
hadoop-env.shvi $HADOOP_HOME/etc/hadoop/hadoop-env.sh
设置 JAVA_HOME:
export JAVA_HOME=/usr/java/jdk1.8.0_xxx
core-site.xmlvi $HADOOP_HOME/etc/hadoop/core-site.xml
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>
hdfs-site.xmlvi $HADOOP_HOME/etc/hadoop/hdfs-site.xml
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>/opt/hadoop-3.x.x/data/namenode</value>
</property>
<property>
<name>dfs.datanode.data.dir</name>
<value>/opt/hadoop-3.x.x/data/datanode</value>
</property>
</configuration>
ssh-keygen -t rsa
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
chmod 600 ~/.ssh/authorized_keys
测试:
ssh localhost
hdfs namenode -format
start-dfs.sh
验证进程:
jps
应看到:
http://localhost:9870
hdfs dfs -mkdir /test
hdfs dfs -put file.txt /test
hdfs dfs -ls /
stop-dfs.sh
如果你是要:
告诉我你的环境,我可以给你对应配置。