장애분석(tcpdump, strace, was thread dump)
작성자 관리자 작성시간 2018-04-23 10:44:14
 

* thread dump -> strace -> lsof 순으로

1. jeus thread dump => nid 값  (native id)

"alinkjmapp_ai-clh0(localhost:8002)-w028 [container1-196]" prio=10 tid=0x00007f60bd591800 nid=0x19871 runnable [0x00007f6068987000]
  java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:152)
        at java.net.SocketInputStream.read(SocketInputStream.java:122)
        at com.exem.jspd.XmRTWrapper$IWrap.read(XmRTWrapper.java:108)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:254)
        - locked <0x00000000ebec4fd8> (a java.io.BufferedInputStream)
        at

2. nid=0x19871 10진수로 변환 => 104561

3. strace 덤프 분석 (FD값 = nid값)

# strace -fF -t -p PID -o stra22.txt

104583 21:51:06 recvfrom(314,  <unfinished ...>
104579 21:51:06 recvfrom(310,  <unfinished ...>
104576 21:51:06 recvfrom(307,  <unfinished ...>
104575 21:51:06 recvfrom(306,  <unfinished ...>
104574 21:51:06 recvfrom(305,  <unfinished ...>
104571 21:51:06 recvfrom(302,  <unfinished ...>
104570 21:51:06 recvfrom(301,  <unfinished ...>
104568 21:51:06 recvfrom(299,  <unfinished ...>
104567 21:51:06 recvfrom(298,  <unfinished ...>
104561 21:51:06 recvfrom(292,  <unfinished ...>

* unfinished : 응답이 오지 않을 때(ack 네트웍 문제 또는 상대 서버에서 ack 주기 전에 종료된 경우 발생)

3-1. lsof -p PID

4. linux서버 tcpdump 분석

tcpdump -xX -i eno16780032 host 172.16.65.10 and port 7060 -w /kbklog/fepap01_7th_p7060.pcap


5. 와이어샤크로 tcpdump 분석
tcp.port == 49393


목록 | 입력 | 수정 | 답변 | 삭제