C6509 ºÎÆÃÁß ¿¡·¯.. ¤Ð¤Ð

   Á¶È¸ 13509   Ãßõ 3    

C6509 장비 두대를 VSS 로 묶어서 사용중이었습니다..

네트워크에 원인 미상의 장애가 발생하여.. 상단으로 연결된 L4 스위치들과의
LB 문제 유발로 상호 점검을 했으나.. 특이점이 없어서..

각 장비들 전부 재부팅을 했고..
마지막으로 재부팅을 한게 VSS 백본이었습니다..


1,2 번 장비를 모두 끄고...
1번을 부팅 -> 정상 부팅

1번이 액티브 되고.. 2번을 켜셔 장비끼리 통신을 하고 부팅을 시키려 하는데..
에러가 뜨면서 계속 재부팅이 되네요..

00:00:24: %PFREDUN-6-ACTIVE: Initializing as ACTIVE processor for this switch

Active crashed three times, disabling auto-boot and dropping to rommon


Crashdump : 14:15:23.776  Tue May 20 2014 : ios-base : (PID=12311, TID=4) : -Traceback=(s72033-advipservicesk9_wan-2-dso-b.so+0x51BAEC) ([37:0]+0x51DBE0) ([37:0]+0x521420) ([27:-9]3+0x2CCC78) ([37:0]+0x2D94A0) ([27:-9]6+0x138B1C) ([37:0]+0x138AF4)

crashdump called (with pause = 0 sec)


%ALIGN-1-FATAL: Illegal access to a low address 14:15:23 UTC Tue May 20 2014

 addr=0x0, pc=0x72AB55EC, ra=0x72AB551C, sp=0x323EB88

SLOT0:00:00:24: %DUMPER-3-PROCINFO: pid = 12311: (sbin/ios-base), terminated due to signal SIGSEGV, Segmentation violation (Address not mapped)

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:             zero     at       v0       v1

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:   R0   00000000  7A221568  00000014  00FBCFC0

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:             a0       a1       a2       a3

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:   R4   00000000  00FBCEC0  00000000  00000000

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:             t0       t1       t2       t3

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:   R8   00000000  00000000  00000053  00000025

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:             t4       t5       t6       t7

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:   R12  00000000  72A30B00  FFFFFFFF  728F8000

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:             s0       s1       s2       s3

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:   R16  0323EE48  0323EE78  00000000  00000000

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:             s4       s5       s6       s7

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:   R20  00000000  00000000  00000000  00000000

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:             t8       t9       k0       k1

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:   R24  0323EA88  70CD5040  00000000  00000000

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:             gp       sp       s8       ra

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:   R28  7A05E710  0323EB88  00000000  72AB551C

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:             sr       lo       hi       bad

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:   R32  1000FC63  00000000  00000001  00000000

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:             cause    pc       epc

SLOT0:00:00:24: %DUMPER-3-REGISTERS_INFO: 12311:   R36  00000000  72AB55EC  00000000

SLOT0:00:00:24: %DUMPER-3-TRACE_BACK_INFO: 12311: (s72033-advipservicesk9_wan-6-dso-b.so+0x1BD5EC) (s72033-advipservicesk9_wan-2-dso-b.so+0x51BAEC) (s72033-advipservicesk9_wan-2-dso-b.so+0x51DBE0) (s72033-advipservicesk9_wan-2-dso-b.so+0x521420) (s72033-advipservicesk9_wan-3-dso-b.so+0x2CCC78) (s72033-advipservicesk9_wan-3-dso-b.so+0x2D94A0) (s72033-advipservicesk9_wan-6-dso-b.so+0x138B1C) (s72033-advipservicesk9_wan-6-dso-b.so+0x138AF4)

SLOT0:00:00:25: %DUMPER-6-BAD_PATH: 12311: Choice 1 either not configured or bad path. Trying next choice.

SLOT0:00:00:25: %DUMPER-6-BAD_PATH: 12311: Choice 2 either not configured or bad path. Trying next choice.

SLOT0:00:00:25: %DUMPER-6-BAD_PATH: 12311: Choice 3 either not configured or bad path. Trying next choice.

SLOT0:00:00:25: %DUMPER-3-DUMP_FAILURE: 12311: Core dump failed: Could not create core

SLOT0:00:00:26: %DUMPER-3-CRASHINFO_FILE_NAME: 12311: Crashinfo for process sbin/ios-base at bootflash:/crashinfo_ios-base-20140520-141523

SLOT0:00:00:26: %SYSMGR-3-ABNORMTERM: ios-base:1 (jid 74) abnormally terminated, restart disabled

SLOT0:00:00:26: %SYSMGR-6-ERROR_EOK: ios-base:1 (jid 74) mandatory process exited, rebooting


하... 뭔가 심각하다는게 본능적으로 느껴지는데 

시스코 엔지니어분들 계시면 조언 부탁드리겠습니다..

¾Ç¶¥ 2014-05
Ȥ½Ã 2¹ø 6509¸¦ ¸ÕÀú ºÎÆýÃÄÑ º¸¼Ì³ª¿ä?
1¹øÀ» ²¨µÐ»óÅ¿¡¼­ 2¹øÀ» ºÎÆýÃÄѼ­ 2¹øÀÌ Á¤»ó ºÎÆÃÀÌ µÇ¾î active°¡ µÇ¾î Á¤»óÀÛµ¿ÇÑ´Ù¸é 2¹ø½ºÀ§Ä¡ÀÇ ½É°¢ÇÑ ¹®Á¦´Â ¾Æ´Ï°í 1,2¹ø ½ºÀ§Ä¡³¢¸®ÀÇ ½ÌÅ©³ª ±âŸ(L4³ª ¹¹ µîµî..ÀÚ¼¼ÇÑ ÄÁÇÈÀ» ¸ð¸£´Ï...) ¿¬µ¿ÀÌ ¾ÈµÇ´Â »óȲÀÌ°Ú±¸¿ä..
2¹ø ´Üµ¶À¸·Îµµ Àú·± »óÅ°¡ °è¼ÓµÈ´Ù¸é vsse¸ðµâÀÌ ÀÌ»óÀÌ »ý±äµí ÇÕ´Ï´Ù.
6509 Á¤µµ¸é.... À¯Áöº¸¼ö¾÷ü ÀÖÀ¸½ÇÅ´Ï.. ¾ó¸¥ ¿À¶ó°í Çϼ¼¿ä...
     
°­¸íÈ£ 2014-05
¸ÕÀú´Â ¾Æ´Ï°í µû·Î ºÎÆÃÀº ÇغýÀ´Ï´Ù¸¸ ¿©ÀüÈ÷ ¾ÈµÇ´õ±º¿ä.
´Ù¸¥ »þ½Ã¿¡¼­ Å×½ºÆ®¸¦ Çϱâ À§ÇØ ½´ÆÛ¹ÙÀÌÀú ¸ðµâ¸¦ »©¼­ º¸³Â³×¿ä..
¹ö¸®½ÉÀÌ.... ÈåÈåÈå
psj1050 2014-06
Log file À» ´ëÃæ º¸¾ÆÇÏ´Ï ... Crashdump °¡ ¹ß»ý µÈµí Çϳ׿ä .. Cisco ·Î Á¤½Ä Case-open À» ÇÏ¿©¾ß ¿øÀÎÀ» ÇØ°á ÇØ¾ß ÇÒµí ½Í½À´Ï´Ù.
 
Crashdump ´Â º¸Åë NVRAM À̳ª SUP FLASH disk ¿¡ ÀÖÀ¸´Ï Crashdump ¸¦ TFTP ¸¦ ÅëÇÏ¿© äÃë ÇÏ½ÅµÚ CISCO ¿¡ ¹®ÀÇ Çغ¸´Â °ÍÀÌ Çö¸í ÇÒµí ÇÕ´Ï´Ù.

À§ÀÇ »çÇ×Àº ¾îµð±îÁö³ª .. À¯Áöº¸¼ö ¾÷ü ¾÷¹« AREA ÀÌ¿À´Ï Áï, À¯Áöº¸¼ö ¾÷ü¸¦ ÀßÀÌ¿ëÇÏ½Ã±æ ¹Ù¶ø´Ï´Ù.
     
psj1050 2014-06
Âü°í·Î Crashdump´Â Àåºñ»óÀÇ Hardware ¶Ç´Â software ÀÇ °áÇÔÀÌ ¹ß»ýµÇ¾î ¿Àµ¿ÀÛÀÌ ¹ß»ý µÇ¾úÀ»¶§, Àåºñ ½º½º·Î Àåºñ »óŸ¦ TXT ÆÄÀÏÀ» »ý¼ºÇÏ¿© º¸´Ù ºü¸¥ Àå¾Ö¿øÀÎÀ» ÇØ°áÇϱâ À§ÇÑ process ÀÔ´Ï´Ù.


Á¦¸ñPage 3/105
2014-05   9652   ±èÀå¿ì
2014-05   13047   s±èÁ¾È­z
2014-05   10978   ±èÀºÈ£
2014-05   12326   ´«ºû¸¶À½
2014-05   11966   ±Ç¿µÇöz
2014-05   28074   ´«ºû¸¶À½
2014-05   13510   °­¸íÈ£
2014-05   8357   ÀÌÅ¿í
2014-05   11042   ¼­¿ï»ç¶÷
2014-06   6805   ¹ÎÈ£¾ç
2014-06   7512   s±èÁ¾È­z
2014-06   7837   MikroTikÀÌÁø
2014-06   10409   Á¦Ol
2014-06   7518   Á¦Ol
2014-06   7598   Á¦Ol
2014-06   9161   ÀÌÅ¿í
2014-06   9409   Á¦Ol
2014-06   9197   Á¦Ol
2014-06   11806   Á¦Ol
2014-07   13418   MikroTikÀÌÁø