将Cassandra sstableloader从一个AWS实例使用到另一个AWS实例失败

问题描述:

一个AWS实例已安装并运行Cassandra(2.1.16)。另一个AWS实例没有安装Cassandra,但正在使用apache-cassandra-2.1.16二进制文件中的sstableloader程序。在sstableloader服务器上使用的cassandra.yaml具有以下设置:将Cassandra sstableloader从一个AWS实例使用到另一个AWS实例失败

群集名: '测试集群' listen_address: storage_port:7000 rpc_address:0.0.0.0 rpc_port:9160

两个服务器都使用它具有开放组以下端口相同AWS安全组:

7000,9160

当我执行ssltableloader这样的:

./sstableloader -d <CassandraNode> -f ../../cassandra/cassandra.yaml -v ../../cassandra/<Keyspace>/<CFName>/ 

我得到这个错误:

Established connection to initial hosts 
Opening sstables and calculating sections to stream 
Streaming relevant part of ../../cassandra/<Keyspace>/<CFName>/<Keyspace-CFName>-ka-6952-Data.db ../../cassandra/<Keyspace>/<CFName>/<Keyspace-CFName>-ka-6951-Data.db to [/public ip of Cassandra node] 
ERROR 20:06:33 [Stream #c7915b50-f7a7-11e6-bd84-8dd23712cb6e] Streaming error occurred 
java.net.ConnectException: Connection timed out 
at sun.nio.ch.Net.connect0(Native Method) ~[na:1.8.0_111] 
at sun.nio.ch.Net.connect(Net.java:454) ~[na:1.8.0_111] 
at sun.nio.ch.Net.connect(Net.java:446) ~[na:1.8.0_111] 
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:648) ~[na:1.8.0_111] 
at java.nio.channels.SocketChannel.open(SocketChannel.java:189) ~[na:1.8.0_111] 
at org.apache.cassandra.tools.BulkLoadConnectionFactory.createConnection(BulkLoadConnectionFactory.java:62) ~[apache-cassandra-2.1.16.jar:2.1.16] 
at org.apache.cassandra.streaming.StreamSession.createConnection(StreamSession.java:240) ~[apache-cassandra-2.1.16.jar:2.1.16] 
at org.apache.cassandra.streaming.ConnectionHandler.initiate(ConnectionHandler.java:80) ~[apache-cassandra-2.1.16.jar:2.1.16] 
at org.apache.cassandra.streaming.StreamSession.start(StreamSession.java:227) ~[apache-cassandra-2.1.16.jar:2.1.16] 
at org.apache.cassandra.streaming.StreamCoordinator$StreamSessionConnector.run(StreamCoordinator.java:208) [apache-cassandra-2.1.16.jar:2.1.16] 
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_111] 
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_111] 
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_111] 
progress: total: 100% 0 MB/s(avg: 0 MB/s)WARN 20:06:33 [Stream #c7915b50-f7a7-11e6-bd84-8dd23712cb6e] Stream failed 
Streaming to the following hosts failed: 
[/<public ip of Cassandra node>] 
java.util.concurrent.ExecutionException: org.apache.cassandra.streaming.StreamException: Stream failed 
at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299) 
at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286) 
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116) 
at org.apache.cassandra.tools.BulkLoader.main(BulkLoader.java:125) 
Caused by: org.apache.cassandra.streaming.StreamException: Stream failed 
at org.apache.cassandra.streaming.management.StreamEventJMXNotifier.onFailure(StreamEventJMXNotifier.java:85) 
at com.google.common.util.concurrent.Futures$4.run(Futures.java:1172) 
at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) 
at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156) 
at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145) 
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:202) 
at org.apache.cassandra.streaming.StreamResultFuture.maybeComplete(StreamResultFuture.java:209) 
at org.apache.cassandra.streaming.StreamResultFuture.handleSessionComplete(StreamResultFuture.java:185) 
at org.apache.cassandra.streaming.StreamSession.closeSession(StreamSession.java:413) 
at org.apache.cassandra.streaming.StreamSession.onError(StreamSession.java:518) 
at org.apache.cassandra.streaming.StreamSession.start(StreamSession.java:233) 
at org.apache.cassandra.streaming.StreamCoordinator$StreamSessionConnector.run(StreamCoordinator.java:208) 
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
at java.lang.Thread.run(Thread.java:745) 

我已经成功地使用从sstableloader本地PC将数据加载到AWS上的卡桑德拉节点。我失败的地方是当我尝试从一个ASW实例到另一个ASW实例的sstableloader时。

为了充分披露,我也尝试过在2个实例之间打开所有端口,并导致相同的故障。

是否有配置步骤,我失踪的实例试图做sstableloading?

Cassandra节点使用其公有IP作为其broadcast_address。当我从我的盒子使用sstableloader时,这工作。尝试从另一个AWS实例使用sstableloader时失败,因为该服务器无法通过其公共IP查找Cassandra节点。我能够通过使用Cassandra节点的专用IP作为broadcast_address使其工作。