更改实木复合地板日志级别

问题描述：

我在将json文件转换为实木复合格式的java程序中使用了org.apache.parquet。然而，无论我尝试什么，我都无法禁用parquet自己的日志记录到stdout。有没有办法改变木地板的日志级别，或完全关闭它？更改实木复合地板日志级别

在标准输出日志消息的示例...我怎么称呼拼花

12-Feb-2017 18:12:21 INFO: org.apache.parquet.hadoop.ColumnChunkPageWriteStore: written 427B for [verb] BINARY: 2,890 values, 385B raw, 390B comp, 1 pages, encodings: [BIT_PACKED, PLAIN_DICTIONARY], dic { 2 entries, 17B raw, 2B comp} 
12-Feb-2017 18:12:21 INFO: org.apache.parquet.hadoop.ColumnChunkPageWriteStore: written 3,256B for [postedTime] BINARY: 2,890 values, 3,585B raw, 3,180B comp, 1 pages, encodings: [BIT_PACKED, PLAIN_DICTIONARY], dic { 593 entries, 16,604B raw, 593B comp} 
12-Feb-2017 18:12:21 INFO: org.apache.parquet.hadoop.ColumnChunkPageWriteStore: written 4,611B for [message] BINARY: 2,890 values, 4,351B raw, 4,356B comp, 1 pages, encodings: [BIT_PACKED, PLAIN_DICTIONARY], dic { 2,088 entries, 263,329B raw, 2,088B comp}

例...

public void writeToParquet(List<GenericData.Record> recordsToWrite, Path fileToWrite) throws IOException { 
    try (ParquetWriter<GenericData.Record> writer = AvroParquetWriter 
      .<GenericData.Record>builder(fileToWrite) 
      .withSchema(SCHEMA) 
      .withConf(new Configuration()) 
      .withCompressionCodec(CompressionCodecName.SNAPPY) 
      .build()) { 

     for (GenericData.Record record : recordsToWrite) { 
      writer.write(record); 
     } 
    } 
}

答

我知道这是一个老问题，但我只是遇到过在CDH 5.x中使用Parquet与Hive时发生此问题并找到解决方法。看到这里：https://stackoverflow.com/a/45572400/14186

也许别人会觉得它有用。

更改实木复合地板日志级别

相关推荐