更多代码请见:https://github.com/xubo245/SparkLearning
ADAM学习之4集群安装(未成功)
1.基本:
$ git clone https://github.com/bigdatagenomics/adam.git
$ cd adam
$ export MAVEN_OPTS="-Xmx512m -XX:MaxPermSize=256m"
2.安装maven
3.配置pom.xml
可能要启动
4.$ mvn clean package -DskipTests
需要多次重试,老是卡在adam-core
alias adam-submit="/home/hadoop/cloud/adam/bin/adam-submit"
alias adam-shell="/home/hadoop/cloud/adam/bin/adam-shell"
hadoop fs -put ../adam-core/src/test/resources/small.vcf
hadoop fs -put ../adam-core/src/test/resources/* /adam/adam-core
去除安全模式:bin/hadoop dfsadmin -safemode leave
http://blog.csdn.net/xw13106209/article/details/6866072
20160305:
测试:
adam-submit transform /xubo/adam/dataAdam/small.sam /xubo/adam/output/smallMcnode2.adam
其他:
sudo rm -r adam
export ADAM_HOME=$CLOUD_PREFIX/adam
export CLASSPATH=$CLASSPATH:$JAVA_HOME/lib:$JAVA_HOME/jre/lib:$SPARK_HOME/assembly/target/scala-2.10:$ADAM_HOME/lib
export PATH=$HOME/bin:$JAVA_HOME/bin:$JAVA_HOME/jre/bin:$ADAM_HOME/bin:$PATH
source /etc/profile
备份:
export CLASSPATH=$CLASSPATH:$JAVA_HOME/lib:$JAVA_HOME/jre/lib:$SPARK_HOME/assembly/target/scala-2.10:$ADAM_HOME/lib:$ADAM_HOME/adam-core/target/scala-2.10.4/classes:$ADAM_HOME/lib/adam-apis_2.10-0.18.3-SNAPSHOT.jar:$ADAM_HOME/lib/adam-cli_2.10-0.18.3-SNAPSHOT.jar:$ADAM_HOME/lib/adam-core_2.10-0.18.3-SNAPSHOT.jar
笔记:
1.从Master用dispath.sh将adam分发到其他节点
2.修改每个节点的/etc/profile,并且source
3.为什么还是找不到ADAMcontext??