卡夫卡认证生产者无法连接生产者

问题描述:

我试图复制在所描述的SASL_PLAIN或SASL_SSL认证:http://docs.confluent.io/3.0.0/kafka/sasl.html#sasl-configuration-for-kafka-brokers卡夫卡认证生产者无法连接生产者

在配置/ server.properties,添加以下4行:

listeners=SASL_SSL://localhost:9092 
security.inter.broker.protocol=SASL_SSL 
sasl.mechanism.inter.broker.protocol=PLAIN 
sasl.enabled.mechanisms=PLAIN 

在配置/ producer.properties,添加以下两行:

security.protocol=SASL_SSL 
sasl.mechanism=PLAIN 

然后我设置服务器终端以下环境变量:

KAFKA_OPTS=/home/kafka/kafka_server_jaas.conf 

这个文件有以下内容:

KafkaServer { 
    org.apache.kafka.common.security.plain.PlainLoginModule required 
    username="admin" 
    password="admin-secret" 
    user_admin="admin-secret" 
    user_alice="alice-secret"; 
}; 

而在生产者端I定义下面的环境变量:

KAFKA_OPTS=/home/kafka/kafka_client_jaas.conf 

而这个文件有以下内容:

KafkaClient { 
    org.apache.kafka.common.security.plain.PlainLoginModule required 
    username="alice" 
    password="alice-dsecret"; 
}; 

I用下面的命令启动服务器:

./bin/kafka-server-start.sh config/server.properties 

并与下面的命令生产商:

bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test 

开始都没有问题。但是,只要我的制片人控制台上输入的时候,我得到了以下信息,不断滚动:

WARN Bootstrap broker localhost:9092 disconnected (org.apache.kafka.clients.NetworkClient) 
Bootstrap broker localhost:9092 disconnected (org.apache.kafka.clients.NetworkClient) 
WARN Bootstrap broker localhost:9092 disconnected (org.apache.kafka.clients.NetworkClient) 
WARN Bootstrap broker localhost:9092 disconnected (org.apache.kafka.clients.NetworkClient) 
WARN Bootstrap broker localhost:9092 disconnected (org.apache.kafka.clients.NetworkClient) 
WARN Bootstrap broker localhost:9092 disconnected (org.apache.kafka.clients.NetworkClient) 
WARN Bootstrap broker localhost:9092 disconnected (org.apache.kafka.clients.NetworkClient) 
WARN Bootstrap broker localhost:9092 disconnected (org.apache.kafka.clients.NetworkClient) 

如果我从服务器和生产配置中删除安全配置,按预期工作的一切。我正在使用Kafka 0.10.0.1。

更新: 我做了一些更多的调查,把日志级别调试运行在服务器揭示了一些奇怪的。只要我在server.properties中指定侦听器字段,服务器就会处于奇怪的状态。它建立了它自己无法验证的连接。这种情况下的协议是SASL_PLAINTEXT。

日志如下:

2016-09-15 21:43:02 DEBUG SaslClientAuthenticator:204 - Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE 
2016-09-15 21:43:02 DEBUG NetworkClient:476 - Completed connection to node 0 
2016-09-15 21:43:02 DEBUG Acceptor:52 - Accepted connection from /127.0.0.1 on /127.0.0.1:9092. sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [102400|102400] 
2016-09-15 21:43:02 DEBUG Processor:52 - Processor 2 listening to new connection from /127.0.0.1:42815 
2016-09-15 21:43:02 DEBUG SaslServerAuthenticator:269 - Set SASL server state to HANDSHAKE_REQUEST 
2016-09-15 21:43:02 DEBUG SaslServerAuthenticator:310 - Handle Kafka request SASL_HANDSHAKE 
2016-09-15 21:43:02 DEBUG SaslServerAuthenticator:354 - Using SASL mechanism 'PLAIN' provided by client 
2016-09-15 21:43:02 DEBUG SaslServerAuthenticator:269 - Set SASL server state to AUTHENTICATE 
2016-09-15 21:43:02 DEBUG SaslClientAuthenticator:204 - Set SASL client state to INITIAL 
2016-09-15 21:43:02 DEBUG SaslClientAuthenticator:204 - Set SASL client state to INTERMEDIATE 
2016-09-15 21:43:02 DEBUG SaslServerAuthenticator:269 - Set SASL server state to FAILED 
2016-09-15 21:43:02 DEBUG Selector:345 - Connection with /127.0.0.1 disconnected 
java.io.IOException: javax.security.sasl.SaslException: Authentication failed: Invalid JAAS configuration [Caused by  javax.security.sasl.SaslException: Authentication failed: Invalid username or password] 
at org.apache.kafka.common.security.authenticator.SaslServerAuthenticator.authenticate(SaslServerAuthenticator.java:243) 
at org.apache.kafka.common.network.KafkaChannel.prepare(KafkaChannel.java:64) 
at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:318) 
at org.apache.kafka.common.network.Selector.poll(Selector.java:283) 
at kafka.network.Processor.poll(SocketServer.scala:472) 

是绝对没有其他客户端或服务器上运行。这是一个服务器自言自语。

有什么想法?

帮助来自卡夫卡论坛。请参阅http://mail-archives.apache.org/mod_mbox/kafka-users/201609.mbox/%3CCAHX2Snk11vg7DXNVUr9oE97ikFSQUoT3kBLAxYymEDj7E14XrQ%40mail.gmail.com%3E

我有错误的凭据。他们是:

KafkaServer { 
    org.apache.kafka.common.security.plain.PlainLoginModule required 
    username="admin" 
    password="admin-secret" 
    user_admin="alice-secret" 
    user_alice="alice-secret"; 
}; 

相反的:

KafkaServer { 
    org.apache.kafka.common.security.plain.PlainLoginModule required 
    username="admin" 
    password="admin-secret" 
    user_admin="admin-secret" 
    user_alice="alice-secret"; 
}; 

此外,在控制台消费者需要在一定的调用。首先应该提供国旗 - 新消费者。其次,应该指定引导服务器。导致:

bin/kafka-console-consumer.sh --new-consumer --zookeeper localhost:2181 --topic test --from-beginning --consumer.config=config/consumer.properties --bootstrap-server=localhost:9092