您的位置: 首页  >  文章  >  高版本springcloud sleuth+zipkin+rabbitmq+ES 微服务链路追踪，还是有几个坑哎

高版本springcloud sleuth+zipkin+rabbitmq+ES 微服务链路追踪，还是有几个坑哎

分类: 文章 • 2024-10-27 13:08:52

一、用来干嘛的

微服务运用较多，相互调用可能错综复杂，springcloud sleuth+zipkin+rabbitmq+ES可以帮助定位问题，分析各个服务性能瓶颈，快速了解整个服务调用过程

二、了解原理，虚线外部分一般springcloud sleuth实现，zipkin将链路数据通过http或mq发送到ES或MySQL

高版本springcloud sleuth+zipkin+rabbitmq+ES 微服务链路追踪，还是有几个坑哎

一个链路一个traceId多个跨度spanId（第一个spanId=traceId）,可以自定义跨度，前一个spanId是后一个的parent，维系调用顺序。如图上一行的server received（SR）事件对应下一行的则是server sent (SS)事件（或相反），client sent （CS）对应client recieved（CR）事件（或相反），且上下行spanId对应，整个过程traveId不变。spanId=A的server receive时间与spanId=A的server sent时间差为调用耗时。springcloud-sleuth大致原理是这样的：也是扫描spring.factories里一些配置类实例化一些特殊bean实现链路追踪，有十余个配置类，这里简单看几个

TraceAutoConfiguration->主要配置了一个Tracing对象到spring
TraceWebServletAutoConfiguration->设置自定义请求头traceID,spanID，这是为什么traceID,spanID能跨服务器传递的原因，而同一进程内能够自由获取到traceID,spanID就是threadlocal的作用了
TraceSchedulingAutoConfiguration ->通过aop切入@Scheduled注解的方法来记录spanid等，
TraceFeignClientAutoConfiguration同上
TraceZuulAutoConfiguration以拦截器方式获取请求中获取请求头中的span等

 

高版本springcloud sleuth+zipkin+rabbitmq+ES 微服务链路追踪，还是有几个坑哎

 

三、集成步骤

先整合log4j2，@link https://mp.****.net/postedit/88916349log4j2    异步日志总结

，关键是日志pattern配置pattern="%d{yyyy-MM-dd HH:mm:ss.SSS} [%t] %-5level [%logger{50}:%L] [%X{X-B3-TraceId},%X{X-B3-SpanId}] - %msg%n" ，然后每个服务添加依赖，重启即可看到traceID与spanID.，需要配置类zipkin URL等相关配置

        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-sleuth</artifactId>
        </dependency>
        <dependency>
             <groupId>org.springframework.cloud</groupId>
             <artifactId>spring-cloud-starter-zipkin</artifactId>
         </dependency>
每个服务的主配置都要配置，通过http上传链路数据
spring.zipkin.base-url=http://localhost:9411
spring.zipkin.enabled=true
spring.sleuth.sampler.probability=1

四、zipkin-server

网上找了一些资料想直接搭一个zipkin-server,网上找了一些资料都是整合的低版本springboot。这里有最新版本=>最新zipkin-server，需要其它版本可修改URL中的版本参数。直接启动jar包，默认端口9411。浏览器访问：http://localhost:9411/zipkin/

五、使用rabbitmq/kafak收集数据，ES储存数据

1、自己搭建zipkin-server，实现从rabbitMQ收集数据，ES储存数据

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>
    <parent>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-parent</artifactId>
        <version>2.1.1.RELEASE</version>
        <relativePath/>
    </parent>
    <groupId>com.jwolf</groupId>
    <artifactId>zipkin-server</artifactId>
    <version>0.0.1-SNAPSHOT</version>
    <name>zipkin-server</name>
    <description>zipkin-server</description>

    <properties>
        <project-name>zipkin-server-stream</project-name>
        <spring-cloud.version>Finchley.SR2</spring-cloud.version>
        <zipkin.version>2.11.9</zipkin.version>
    </properties>

    <dependencies>
        <dependency>
            <groupId>io.zipkin.java</groupId>
            <artifactId>zipkin-server</artifactId>
            <version>${zipkin.version}</version>
        </dependency>

        <!-- 使用消息的方式收集数据（使用rabbitmq） -->
        <dependency>
            <groupId>io.zipkin.java</groupId>
            <artifactId>zipkin-autoconfigure-collector-rabbitmq</artifactId>
            <version>${zipkin.version}</version>
        </dependency>

        <!-- 支持Elasticsearch 2.x - 6.x -->
        <dependency>
            <groupId>io.zipkin.java</groupId>
            <artifactId>zipkin-autoconfigure-storage-elasticsearch-http</artifactId>
            <version>2.8.4</version>
        </dependency>

        <dependency>
            <groupId>io.zipkin.java</groupId>
            <artifactId>zipkin-autoconfigure-ui</artifactId>
            <version>2.11.12</version>
        </dependency>
        
    </dependencies>
    <dependencyManagement>
        <dependencies>
            <dependency>
                <groupId>org.springframework.cloud</groupId>
                <artifactId>spring-cloud-dependencies</artifactId>
                <version>${spring-cloud.version}</version>
                <type>pom</type>
                <scope>import</scope>
            </dependency>
        </dependencies>
    </dependencyManagement>
    <build>
        <plugins>
            <plugin>
                <groupId>org.springframework.boot</groupId>
                <artifactId>spring-boot-maven-plugin</artifactId>
            </plugin>
        </plugins>
    </build>

</project>

2.配置文件，入口类开启@EnableZipkinServer

server.port=9411
spring.application.name=zipkin
management.metrics.web.server.auto-time-requests=false
#rabbitmq采集数据
zipkin.collector.rabbitmq.addresses=127.0.0.1:5672
zipkin.collector.rabbitmq.password=guest
zipkin.collector.rabbitmq.username=guest
zipkin.collector.rabbitmq.queue=zipkin  #不可自定义

#ES存储数据
zipkin.storage.type=elasticsearch
zipkin.storage.elasticsearch.cluster=elasticsearch
zipkin.storage.elasticsearch.hosts=192.168.199.128:9200
zipkin.storage.elasticsearch.index=zipkin #可自定义
zipkin.storage.elasticsearch.index-shards=3
zipkin.storage.elasticsearch.index-replicas=0

3.各个被监控微服务client端基本依赖

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>
    <parent>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-parent</artifactId>
        <version>2.1.1.RELEASE</version>
        <relativePath/> <!-- lookup parent from repository -->
    </parent>
    <groupId>com.jwolf</groupId>
    <artifactId>jwolf-ordercenter</artifactId>
    <version>0.0.1-SNAPSHOT</version>
    <name>jwolf-ordercenter</name>
    <description>order center</description>

    <properties>
        <java.version>1.8</java.version>
        <spring-cloud.version>Greenwich.RC2</spring-cloud.version>
    </properties>

    <dependencies>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-web</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-netflix-eureka-client</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-netflix-ribbon</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-openfeign</artifactId>
        </dependency>

        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-netflix-hystrix</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-actuator</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-netflix-hystrix-dashboard</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-test</artifactId>
            <scope>test</scope>
        </dependency>
        <dependency>
            <groupId>com.jwolf</groupId>
            <artifactId>jwolf-usercenter</artifactId>
            <version>0.0.1-SNAPSHOT</version>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-sleuth</artifactId>
        </dependency>
        <dependency>
             <groupId>org.springframework.cloud</groupId>
             <artifactId>spring-cloud-starter-zipkin</artifactId>
         </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-stream-binder-rabbit</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter</artifactId>
            <exclusions>
                <!-- 排除自带的logback依赖 -->
                <exclusion>
                    <groupId>org.springframework.boot</groupId>
                    <artifactId>spring-boot-starter-logging</artifactId>
                </exclusion>
            </exclusions>
        </dependency>

        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter</artifactId>
            <exclusions>
                <exclusion>   <!-- 排除自带的logback依赖 -->
                    <groupId>org.springframework.boot</groupId>
                    <artifactId>spring-boot-starter-logging</artifactId>
                </exclusion>
            </exclusions>
        </dependency>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-log4j2</artifactId>
        </dependency>
        <dependency><!--log4j2异步支持-->
            <groupId>com.lmax</groupId>
            <artifactId>disruptor</artifactId>
            <version>3.3.6</version>
        </dependency>
        
    </dependencies>

    <dependencyManagement>
        <dependencies>
            <dependency>
                <groupId>org.springframework.cloud</groupId>
                <artifactId>spring-cloud-dependencies</artifactId>
                <version>${spring-cloud.version}</version>
                <type>pom</type>
                <scope>import</scope>
            </dependency>
        </dependencies>
    </dependencyManagement>

    <build>
        <plugins>
            <plugin>
                <groupId>org.springframework.boot</groupId>
                <artifactId>spring-boot-maven-plugin</artifactId>
            </plugin>
        </plugins>
    </build>

    <repositories>
        <repository>
            <id>spring-milestones</id>
            <name>Spring Milestones</name>
            <url>https://repo.spring.io/milestone</url>
        </repository>
    </repositories>

</project>

4.client端配置

spring.sleuth.sampler.probability=1
spring.sleuth.web.client.enabled=true
spring.zipkin.enabled=true
#spring.zipkin.base-url=http://localhost:9411   默认web http方式上传，改用mq异步方式
spring.zipkin.sender.type=rabbit
spring.rabbitmq.addresses=localhost:5672
spring.rabbitmq.password=guest
spring.rabbitmq.username=guest
spring.rabbitmq.port=5672
spring.zipkin.service.name=${spring.application.name}

5.ES效果预览，睡觉！

高版本springcloud sleuth+zipkin+rabbitmq+ES 微服务链路追踪，还是有几个坑哎

五、点到即止：也可以不自己单独搭一个rabbitmq上报链路信息，es存储信息的zipkin-server.

可以直接log4j2直接上报到logstash或日志落地后上传到logstash,或rabbitmq到logstash或filebeat读取日志文件到es（或logstash）

相关推荐