在windows 7上安装Apache Spark 32位

问题描述：

我刚刚开始学习apache spark。我做的第一件事是我试图在我的机器上安装spark。我用hadoop 2.6下载了预建的spark 1.5.2。当我跑spark shell我得到了以下错误回报在windows 7上安装Apache Spark 32位

java.lang.RuntimeException: java.lang.NullPointerException 
     at  org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522) 
     at org.apache.spark.sql.hive.client.ClientWrapper.<init> (ClientWrapper.scala:171) 
    at  org.apache.spark.sql.hive.HiveContext.executionHive$lzycompute(HiveContext.scala :163) 
     at  org.apache.spark.sql.hive.HiveContext.executionHive(HiveContext.scala:161) 
     at org.apache.spark.sql.hive.HiveContext.<init>(HiveContext.scala:168) 
     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) 
     at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) 
     at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) 
    at java.lang.reflect.Constructor.newInstance(Unknown Source) 
    at org.apache.spark.repl.SparkILoop.createSQLContext(SparkILoop.scala:1028) 
    at $iwC$$iwC.<init>(<console>:9) 
    at $iwC.<init>(<console>:18) 
    at <init>(<console>:20) 
    at .<init>(<console>:24) 
    at .<clinit>(<console>) 
    at .<init>(<console>:7) 
    at .<clinit>(<console>) 
    at $print(<console>) 
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
    at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) 
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) 
    at java.lang.reflect.Method.invoke(Unknown Source) 
    at org.apache.spark.repl.SparkIMain$ReadEvalPrint.call(SparkIMain.scala:1065) 
    at org.apache.spark.repl.SparkIMain$Request.loadAndRun(SparkIMain.scala:1340) 
    at org.apache.spark.repl.SparkIMain.loadAndRunReq$1(SparkIMain.scala:840) 
    at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:871) 
    at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:819) 
    at org.apache.spark.repl.SparkILoop.reallyInterpret$1(SparkILoop.scala:857) 
    at org.apache.spark.repl.SparkILoop.interpretStartingWith(SparkILoop.scala:902) 
    at org.apache.spark.repl.SparkILoop.command(SparkILoop.scala:814) 
    at org.apache.spark.repl.SparkILoopInit$$anonfun$initializeSpark$1.apply(SparkILoopInit.scala:132) 
    at org.apache.spark.repl.SparkILoopInit$$anonfun$initializeSpark$1.apply(SparkILoopInit.scala:124) 
    at org.apache.spark.repl.SparkIMain.beQuietDuring(SparkIMain.scala:324) 
    at org.apache.spark.repl.SparkILoopInit$class.initializeSpark(SparkILoopInit.scala:124) 
    at org.apache.spark.repl.SparkILoop.initializeSpark(SparkILoop.scala:64) 
    at org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1$$anonfun$apply$mcZ$sp$5.apply$mcV$sp(SparkILoop.scala:974)

我搜索了这个错误，并得到了我要下载winutils.exe，我做到了，我设置的路径HADOOP_HOME = "c:\Hadoop"，然后运行该命令

C:\Hadoop\bin\winutils.exe chmod 777 /tmp/hive

但我得到了以下错误

This version of C:\Hadoop\bin\winutils.exe is not compatible with the version of 
Windows you're running. Check your computer's system information to see whether 
you need a x86 (32-bit) or x64 (64-bit) version of the program, and then contac 
t the software publisher.

我试图寻找winutils.exe的32位版本，但我不能得到它。请帮我这个安装。预先感谢您

答

以下的链接可能会有帮助。

https://issues.apache.org/jira/browse/HADOOP-9922

https://issues.apache.org/jira/browse/HADOOP-11784

Not able to find winutils.exe for hadoop 2.6.0 for 32 bit windows

[https://issues.apache.org/jira/browse/HADOOP-9922这具有贴片，使之成为32位的工作。 – DineshM

在windows 7上安装Apache Spark 32位

相关推荐