Quantcast
Channel: VMware Communities: Message List
Viewing all articles
Browse latest Browse all 219257

@BlueScreen: PANIC bora/vmkernel/main/dlmalloc.c - Corruption in dlmalloc

$
0
0

ESXi 5.5.0 frequent PANIC recently on server HP ProLiant DL388 Gen9, almost once per week, and upgraded the server firmware to no avail.

 

~ # vmware -l -v
VMware ESXi 5.5.0 build-2403361
VMware ESXi 5.5.0 Update 2

 

2016-01-23T14:41:45.575Z cpu2:33469)World: 8777: PRDA 0x418040800000 ss 0x0 ds 0x4018 es 0x4018 fs 0x4018 gs 0x4018
2016-01-23T14:41:45.575Z cpu2:33469)World: 8779: TR 0x4020 GDT 0x41238af61000 (0x402f) IDT 0x4180040f4000 (0xfff)
2016-01-23T14:41:45.575Z cpu2:33469)World: 8780: CR0 0x8001003d CR3 0x7b7ff000 CR4 0x216c
2016-01-23T14:41:45.652Z cpu2:33469)Backtrace for current CPU #2, worldID=33469, ebp=0x41238af5d860
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5d860:[0x41800408d1c9]PanicvPanicInt@vmkernel#nover+0x575 stack: 0x412300000008, 0x41238af
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5d8c0:[0x41800408d40d]Panic_NoSave@vmkernel#nover+0x49 stack: 0x410a3997d000, 0x410a3998a4
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5d8e0:[0x418004042400]DLM_free@vmkernel#nover+0x6cc stack: 0x0, 0x410a3997d000, 0x41238af5
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5d930:[0x418004058563]Heap_Free@vmkernel#nover+0x107 stack: 0x410a3998afe0, 0x410a3998a690
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5d950:[0x4180046c82ec]LinuxCharFreeDevData@com.vmware.driverAPI#9.2+0x20 stack: 0x4109d1cd
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5d990:[0x41800469eb7a]VmkplxrCharUnregCleanup@com.vmware.vmkplexer#3.0+0x42 stack: 0x41230
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5d9d0:[0x4180040b38f3]VMKAPICharDevTearDown@vmkernel#nover+0x27 stack: 0x41238af5d9f0, 0x2
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5da20:[0x4180046c8193]unregister_chrdev@com.vmware.driverAPI#9.2+0x23 stack: 0x287, 0xd1d1
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5dae0:[0x4180048486fa]usbfs_notify@com.vmware.usb#9.2.2.0+0xfe stack: 0x41238af5db20, 0x41
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5db50:[0x4180046f5075]notifier_call_chain@com.vmware.driverAPI#9.2+0x4d stack: 0x41238af5d
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5db80:[0x4180046f50c5]blocking_notifier_call_chain@com.vmware.driverAPI#9.2+0x31 stack: 0x
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5dba0:[0x4180048573fd]usb_notify_remove_device@com.vmware.usb#9.2.2.0+0x3d stack: 0x417fc9
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5dbc0:[0x41800484a9a5]generic_disconnect@com.vmware.usb#9.2.2.0+0x11 stack: 0x410a00001023
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5dc10:[0x418004849d00]usb_unbind_device@com.vmware.usb#9.2.2.0+0x44 stack: 0x410a00001023,
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5dc60:[0x4180046b1224]__device_release_driver@com.vmware.driverAPI#9.2+0xec stack: 0x410a3
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5dc80:[0x4180046b13cc]device_release_driver@com.vmware.driverAPI#9.2+0x40 stack: 0x410a399
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5dca0:[0x4180046b0ded]bus_remove_device@com.vmware.driverAPI#9.2+0x29 stack: 0x410a3998bc0
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5dcc0:[0x4180046b031a]device_del@com.vmware.driverAPI#9.2+0x9a stack: 0x41238af5dce0, 0x41
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5dd10:[0x418004851e42]usb_disconnect@com.vmware.usb#9.2.2.0+0xe6 stack: 0x41000674e0f0, 0x
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5de90:[0x41800485318f]hub_thread@com.vmware.usb#9.2.2.0+0x5fb stack: 0x0, 0x0, 0x0, 0x0, 0
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5df30:[0x4180046f56ed]kthread@com.vmware.driverAPI#9.2+0x185 stack: 0x0, 0x41238af67000, 0
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5df80:[0x4180046f2deb]LinuxStartFunc@com.vmware.driverAPI#9.2+0x97 stack: 0x100e, 0x418004
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5dfd0:[0x4180040bb45f]vmkWorldFunc@vmkernel#nover+0x83 stack: 0x0, 0x0, 0x0, 0x0, 0x0
2016-01-23T14:41:45.652Z cpu2:33469)0x41238af5dff0:[0x418004256872]CpuSched_StartWorld@vmkernel#nover+0xfa stack: 0x0, 0x0, 0x0, 0x0, 0
2016-01-23T14:41:45.686Z cpu2:33469)ESC[45mESC[33;1mVMware ESXi 5.5.0 [Releasebuild-2403361 x86_64]ESC[0m
PANIC bora/vmkernel/main/dlmalloc.c:4876 - Corruption in dlmalloc
2016-01-23T14:41:45.686Z cpu2:33469)cr0=0x8001003d cr2=0x55a0f80 cr3=0x7b7ff000 cr4=0x216c
2016-01-23T14:41:45.686Z cpu2:33469)pcpu:0 world:34214 name:"rhttpproxy-work" (U)
2016-01-23T14:41:45.686Z cpu2:33469)pcpu:1 world:33415 name:"tq:vmklinux" (S)
2016-01-23T14:41:45.686Z cpu2:33469)pcpu:2 world:33469 name:"vmklinux_9:hub_thread" (S)
2016-01-23T14:41:45.686Z cpu2:33469)pcpu:3 world:39096 name:"vmm1:mantis-4-34" (V)
2016-01-23T14:41:45.686Z cpu2:33469)pcpu:4 world:32894 name:"numasched" (S)
2016-01-23T14:41:45.686Z cpu2:33469)pcpu:5 world:37329 name:"vmm0:Printer" (V)
2016-01-23T14:41:45.686Z cpu2:33469)pcpu:6 world:36610 name:"vmm3:DC" (V)
2016-01-23T14:41:45.686Z cpu2:33469)pcpu:7 world:32795 name:"tlbflushcounttryflush" (S)
2016-01-23T14:41:45.686Z cpu2:33469)pcpu:8 world:33462 name:"vmklinux_9:ipmi_thread" (S)
2016-01-23T14:41:45.686Z cpu2:33469)pcpu:9 world:36603 name:"vmx" (U)
2016-01-23T14:41:45.686Z cpu2:33469)pcpu:10 world:32888 name:"memsched-periodic" (S)
2016-01-23T14:41:45.687Z cpu2:33469)pcpu:11 world:33489 name:"Tcpip4 wtask" (S)
2016-01-23T14:41:45.687Z cpu2:33469)pcpu:12 world:35727 name:"vmm1:Avaya" (V)
2016-01-23T14:41:45.687Z cpu2:33469)pcpu:13 world:39442 name:"vmm0:HHT-172" (V)
2016-01-23T14:41:45.687Z cpu2:33469)pcpu:14 world:32799 name:"coalesceWorld-0" (S)
2016-01-23T14:41:45.687Z cpu2:33469)pcpu:15 world:48319 name:"vmm0:centos6_4-32" (V)
2016-01-23T14:41:45.687Z cpu2:33469)pcpu:16 world:33325 name:"vmsyslogd" (U)
2016-01-23T14:41:45.687Z cpu2:33469)pcpu:17 world:1140524 name:"sleep" (U)
2016-01-23T14:41:45.687Z cpu2:33469)pcpu:18 world:35703 name:"vmm0:Avaya" (V)
2016-01-23T14:41:45.687Z cpu2:33469)pcpu:19 world:36976 name:"vmx" (U)
2016-01-23T14:41:45.687Z cpu2:33469)pcpu:20 world:38751 name:"vmm0:HHT-173" (V)
2016-01-23T14:41:45.687Z cpu2:33469)pcpu:21 world:37678 name:"vmx-mks:4-31.it-pub" (U)
2016-01-23T14:41:45.687Z cpu2:33469)pcpu:22 world:36977 name:"vmm0:FS" (V)
2016-01-23T14:41:45.687Z cpu2:33469)pcpu:23 world:33053 name:"memMapKernel-23" (S)
2016-01-23T14:41:45.687Z cpu2:33469)@BlueScreen: PANIC bora/vmkernel/main/dlmalloc.c:4876 - Corruption in dlmalloc
2016-01-23T14:41:45.687Z cpu2:33469)Code start: 0x418004000000 VMK uptime: 4:09:32:39.396
2016-01-23T14:41:45.687Z cpu2:33469)0x41238af5d860:[0x41800408d1c9]PanicvPanicInt@vmkernel#nover+0x575 stack: 0x412300000008
2016-01-23T14:41:45.688Z cpu2:33469)0x41238af5d8c0:[0x41800408d40d]Panic_NoSave@vmkernel#nover+0x49 stack: 0x410a3997d000
2016-01-23T14:41:45.688Z cpu2:33469)0x41238af5d8e0:[0x418004042400]DLM_free@vmkernel#nover+0x6cc stack: 0x0
2016-01-23T14:41:45.688Z cpu2:33469)0x41238af5d930:[0x418004058563]Heap_Free@vmkernel#nover+0x107 stack: 0x410a3998afe0
2016-01-23T14:41:45.689Z cpu2:33469)0x41238af5d950:[0x4180046c82ec]LinuxCharFreeDevData@com.vmware.driverAPI#9.2+0x20 stack: 0x4109d1cd
2016-01-23T14:41:45.689Z cpu2:33469)0x41238af5d990:[0x41800469eb7a]VmkplxrCharUnregCleanup@com.vmware.vmkplexer#3.0+0x42 stack: 0x41230
2016-01-23T14:41:45.690Z cpu2:33469)0x41238af5d9d0:[0x4180040b38f3]VMKAPICharDevTearDown@vmkernel#nover+0x27 stack: 0x41238af5d9f0
2016-01-23T14:41:45.690Z cpu2:33469)0x41238af5da20:[0x4180046c8193]unregister_chrdev@com.vmware.driverAPI#9.2+0x23 stack: 0x287
2016-01-23T14:41:45.690Z cpu2:33469)0x41238af5dae0:[0x4180048486fa]usbfs_notify@com.vmware.usb#9.2.2.0+0xfe stack: 0x41238af5db20
2016-01-23T14:41:45.691Z cpu2:33469)0x41238af5db50:[0x4180046f5075]notifier_call_chain@com.vmware.driverAPI#9.2+0x4d stack: 0x41238af5d
2016-01-23T14:41:45.691Z cpu2:33469)0x41238af5db80:[0x4180046f50c5]blocking_notifier_call_chain@com.vmware.driverAPI#9.2+0x31 stack: 0x
2016-01-23T14:41:45.692Z cpu2:33469)0x41238af5dba0:[0x4180048573fd]usb_notify_remove_device@com.vmware.usb#9.2.2.0+0x3d stack: 0x417fc9
2016-01-23T14:41:45.692Z cpu2:33469)0x41238af5dbc0:[0x41800484a9a5]generic_disconnect@com.vmware.usb#9.2.2.0+0x11 stack: 0x410a00001023
2016-01-23T14:41:45.693Z cpu2:33469)0x41238af5dc10:[0x418004849d00]usb_unbind_device@com.vmware.usb#9.2.2.0+0x44 stack: 0x410a00001023
2016-01-23T14:41:45.693Z cpu2:33469)0x41238af5dc60:[0x4180046b1224]__device_release_driver@com.vmware.driverAPI#9.2+0xec stack: 0x410a3
2016-01-23T14:41:45.694Z cpu2:33469)0x41238af5dc80:[0x4180046b13cc]device_release_driver@com.vmware.driverAPI#9.2+0x40 stack: 0x410a399
2016-01-23T14:41:45.694Z cpu2:33469)0x41238af5dca0:[0x4180046b0ded]bus_remove_device@com.vmware.driverAPI#9.2+0x29 stack: 0x410a3998bc0
2016-01-23T14:41:45.694Z cpu2:33469)0x41238af5dcc0:[0x4180046b031a]device_del@com.vmware.driverAPI#9.2+0x9a stack: 0x41238af5dce0
2016-01-23T14:41:45.695Z cpu2:33469)0x41238af5dd10:[0x418004851e42]usb_disconnect@com.vmware.usb#9.2.2.0+0xe6 stack: 0x41000674e0f0
2016-01-23T14:41:45.695Z cpu2:33469)0x41238af5de90:[0x41800485318f]hub_thread@com.vmware.usb#9.2.2.0+0x5fb stack: 0x0
2016-01-23T14:41:45.696Z cpu2:33469)0x41238af5df30:[0x4180046f56ed]kthread@com.vmware.driverAPI#9.2+0x185 stack: 0x0
2016-01-23T14:41:45.696Z cpu2:33469)0x41238af5df80:[0x4180046f2deb]LinuxStartFunc@com.vmware.driverAPI#9.2+0x97 stack: 0x100e
2016-01-23T14:41:45.696Z cpu2:33469)0x41238af5dfd0:[0x4180040bb45f]vmkWorldFunc@vmkernel#nover+0x83 stack: 0x0
2016-01-23T14:41:45.697Z cpu2:33469)0x41238af5dff0:[0x418004256872]CpuSched_StartWorld@vmkernel#nover+0xfa stack: 0x0
2016-01-23T14:41:45.702Z cpu2:33469)base fs=0x0 gs=0x418040800000 Kgs=0x0
2016-01-23T14:41:45.702Z cpu2:33469)vmkernel             0x0 .data 0x0 .bss 0x0
2016-01-23T14:41:45.702Z cpu2:33469)chardevs             0x418004576000 .data 0x417fc0000000 .bss 0x417fc0000400
2016-01-23T14:41:45.702Z cpu2:33469)user                 0x41800457d000 .data 0x417fc0400000 .bss 0x417fc040e200
2016-01-23T14:41:45.702Z cpu2:33469)vmkapi_mgmt          0x418004631000 .data 0x417fc0800000 .bss 0x417fc0800140
2016-01-23T14:41:45.702Z cpu2:33469)vmkapi_socket        0x418004637000 .data 0x417fc0c00000 .bss 0x417fc0c005c0
2016-01-23T14:41:45.702Z cpu2:33469)vmkapi_v2_0_0_0_vmkernel_shim 0x41800463c000 .data 0x417fc1000000 .bss 0x417fc10080c0
2016-01-23T14:41:45.702Z cpu2:33469)vmkapi_v2_1_0_0_vmkernel_shim 0x418004641000 .data 0x417fc1400000 .bss 0x417fc1408840
2016-01-23T14:41:45.702Z cpu2:33469)vprobe               0x418004646000 .data 0x417fc1800000 .bss 0x417fc180b7c0
2016-01-23T14:41:45.702Z cpu2:33469)procfs               0x418004684000 .data 0x417fc1c00000 .bss 0x417fc1c00240
2016-01-23T14:41:45.702Z cpu2:33469)procMisc             0x418004687000 .data 0x417fc2000000 .bss 0x417fc2000000
2016-01-23T14:41:45.702Z cpu2:33469)vmkapei              0x418004688000 .data 0x417fc2400000 .bss 0x417fc2400ae0
2016-01-23T14:41:45.702Z cpu2:33469)vfat                 0x418004690000 .data 0x417fc2800000 .bss 0x417fc2802600
2016-01-23T14:41:45.702Z cpu2:33469)iodm                 0x41800469a000 .data 0x417fc2c00000 .bss 0x417fc2c00138
2016-01-23T14:41:45.702Z cpu2:33469)vmkplexer            0x41800469e000 .data 0x417fc3000000 .bss 0x417fc3000260
2016-01-23T14:41:45.702Z cpu2:33469)vmklinux_9           0x4180046a2000 .data 0x417fc3400000 .bss 0x417fc3408e80
2016-01-23T14:41:45.702Z cpu2:33469)vmklinux_9_2_0_0     0x418004729000 .data 0x417fc3800000 .bss 0x417fc3807e84
2016-01-23T14:41:45.702Z cpu2:33469)vmklinux_9_2_1_0     0x41800472c000 .data 0x417fc3c00000 .bss 0x417fc3c07f98
2016-01-23T14:41:45.702Z cpu2:33469)vmklinux_9_2_2_0     0x41800472f000 .data 0x417fc4e00000 .bss 0x417fc4e08838
2016-01-23T14:41:45.702Z cpu2:33469)iscsi_trans          0x418004732000 .data 0x417fc5600000 .bss 0x417fc5601800
2016-01-23T14:41:45.702Z cpu2:33469)iscsi_trans_compat_shim 0x41800473d000 .data 0x417fc5a00000 .bss 0x417fc5a0096c
2016-01-23T14:41:45.702Z cpu2:33469)iscsi_trans_incompat_shim 0x41800473e000 .data 0x417fc5e00000 .bss 0x417fc5e007e4
2016-01-23T14:41:45.702Z cpu2:33469)etherswitch          0x41800473f000 .data 0x417fc6200000 .bss 0x417fc6213a40
2016-01-23T14:41:45.702Z cpu2:33469)netsched             0x418004774000 .data 0x417fc6600000 .bss 0x417fc6604800
2016-01-23T14:41:45.702Z cpu2:33469)cnic_register        0x418004786000 .data 0x417fc6a00000 .bss 0x417fc6a00200
2016-01-23T14:41:45.702Z cpu2:33469)tg3                  0x418004788000 .data 0x417fc6e00000 .bss 0x417fc6e01480
2016-01-23T14:41:45.702Z cpu2:33469)mlx4_core            0x4180047b5000 .data 0x417fc7200000 .bss 0x417fc72012a0
2016-01-23T14:41:45.702Z cpu2:33469)mlx4_en              0x4180047e3000 .data 0x417fc7600000 .bss 0x417fc76002c0
2016-01-23T14:41:45.702Z cpu2:33469)vmkapi_v2_0_0_0_iscsi_shim 0x418004801000 .data 0x417fc7a00000 .bss 0x417fc7a00970
2016-01-23T14:41:45.702Z cpu2:33469)vmkapi_v2_1_0_0_iscsi_shim 0x418004802000 .data 0x417fc7e00000 .bss 0x417fc7e00970
2016-01-23T14:41:45.702Z cpu2:33469)ipmi_msghandler      0x418004803000 .data 0x417fc8200000 .bss 0x417fc8200600
2016-01-23T14:41:45.702Z cpu2:33469)ipmi_si_drv          0x41800480c000 .data 0x417fc8600000 .bss 0x417fc8600680
2016-01-23T14:41:45.702Z cpu2:33469)ipmi_devintf         0x418004817000 .data 0x417fc8a00000 .bss 0x417fc8a00180
2016-01-23T14:41:45.702Z cpu2:33469)vmci                 0x41800481a000 .data 0x417fc8e00000 .bss 0x417fc8e057c0
2016-01-23T14:41:45.702Z cpu2:33469)random               0x41800483d000 .data 0x417fc9200000 .bss 0x417fc9200600
2016-01-23T14:41:45.702Z cpu2:33469)usb                  0x418004841000 .data 0x417fc9600000 .bss 0x417fc9601660
2016-01-23T14:41:45.702Z cpu2:33469)ehci-hcd             0x418004863000 .data 0x417fc9a00000 .bss 0x417fc9a002a0
2016-01-23T14:41:45.703Z cpu2:33469)usb-uhci             0x41800486e000 .data 0x417fc9e00000 .bss 0x417fc9e00220
2016-01-23T14:41:45.703Z cpu2:33469)hid                  0x418004875000 .data 0x417fca200000 .bss 0x417fca2004e0
2016-01-23T14:41:45.703Z cpu2:33469)healthchk            0x41800487a000 .data 0x417fca600000 .bss 0x417fca611e40
2016-01-23T14:41:45.703Z cpu2:33469)teamcheck            0x418004891000 .data 0x417fcaa00000 .bss 0x417fcaa122c0
2016-01-23T14:41:45.703Z cpu2:33469)vlanmtucheck         0x4180048a4000 .data 0x417fcae00000 .bss 0x417fcae12040
2016-01-23T14:41:45.703Z cpu2:33469)heartbeat            0x4180048b9000 .data 0x417fcb200000 .bss 0x417fcb211f40
2016-01-23T14:41:45.703Z cpu2:33469)shaper               0x4180048ca000 .data 0x417fcb600000 .bss 0x417fcb613ec0
2016-01-23T14:41:45.703Z cpu2:33469)lldp                 0x4180048dd000 .data 0x417fcba00000 .bss 0x417fcba00040
2016-01-23T14:41:45.703Z cpu2:33469)cdp                  0x4180048e2000 .data 0x417fcbe00000 .bss 0x417fcbe13480
2016-01-23T14:41:45.703Z cpu2:33469)ipfix                0x4180048fe000 .data 0x417fcc200000 .bss 0x417fcc2125c0
2016-01-23T14:41:45.703Z cpu2:33469)tcpip4               0x418004912000 .data 0x417fcc600000 .bss 0x417fcc6181c0
2016-01-23T14:41:45.703Z cpu2:33469)dvsdev               0x418004a18000 .data 0x417fcca00000 .bss 0x417fcca00030
2016-01-23T14:41:45.703Z cpu2:33469)dvfilter             0x418004a1b000 .data 0x417fcce00000 .bss 0x417fcce00b00
2016-01-23T14:41:45.703Z cpu2:33469)lacp                 0x418004a3d000 .data 0x417fcd200000 .bss 0x417fcd200160
2016-01-23T14:41:45.703Z cpu2:33469)svmmirror            0x418004a47000 .data 0x417fcd600000 .bss 0x417fcd6000c0
2016-01-23T14:41:45.703Z cpu2:33469)cbt                  0x418004a54000 .data 0x417fcda00000 .bss 0x417fcda00080
2016-01-23T14:41:45.703Z cpu2:33469)migrate              0x418004a58000 .data 0x417fcde00000 .bss 0x417fcde04d40
2016-01-23T14:41:45.703Z cpu2:33469)hbr_filter           0x418004ab7000 .data 0x417fce200000 .bss 0x417fce200300
2016-01-23T14:41:45.703Z cpu2:33469)esxfw                0x418004ae3000 .data 0x417fce600000 .bss 0x417fce612d40
2016-01-23T14:41:45.703Z cpu2:33469)vmkapi_v2_0_0_0_dvfilter_shim 0x418004af8000 .data 0x417fcea00000 .bss 0x417fcea00930
2016-01-23T14:41:45.703Z cpu2:33469)vmkapi_v2_1_0_0_dvfilter_shim 0x418004af9000 .data 0x417fcee00000 .bss 0x417fcee009b0
2016-01-23T14:41:45.703Z cpu2:33469)dvfilter-generic-fastpath 0x418004afa000 .data 0x417fcf200000 .bss 0x417fcf212380
2016-01-23T14:41:45.703Z cpu2:33469)vmkstatelogger       0x418004b14000 .data 0x417fcf600000 .bss 0x417fcf603a00
2016-01-23T14:41:45.703Z cpu2:33469)dm                   0x418004b38000 .data 0x417fcfa00000 .bss 0x417fcfa00000
2016-01-23T14:41:45.703Z cpu2:33469)nmp                  0x418004b3a000 .data 0x417fcfe00000 .bss 0x417fcfe03e50
2016-01-23T14:41:45.703Z cpu2:33469)vmw_satp_local       0x418004b5d000 .data 0x417fd0200000 .bss 0x417fd0200028
2016-01-23T14:41:45.703Z cpu2:33469)vmw_satp_default_aa  0x418004b5f000 .data 0x417fd0600000 .bss 0x417fd0600000
2016-01-23T14:41:45.703Z cpu2:33469)vmw_psp_lib          0x418004b60000 .data 0x417fd0a00000 .bss 0x417fd0a00290
2016-01-23T14:41:45.703Z cpu2:33469)vmw_psp_fixed        0x418004b62000 .data 0x417fd0e00000 .bss 0x417fd0e00000
2016-01-23T14:41:45.703Z cpu2:33469)vmw_psp_rr           0x418004b64000 .data 0x417fd1200000 .bss 0x417fd1200068
2016-01-23T14:41:45.703Z cpu2:33469)vmw_psp_mru          0x418004b67000 .data 0x417fd1600000 .bss 0x417fd1600000
2016-01-23T14:41:45.703Z cpu2:33469)libata_92            0x418004b69000 .data 0x417fd1a00000 .bss 0x417fd1a02660
2016-01-23T14:41:45.703Z cpu2:33469)libata_9_2_0_0       0x418004b8b000 .data 0x417fd1e00000 .bss 0x417fd1e01750
2016-01-23T14:41:45.703Z cpu2:33469)libata_9_2_1_0       0x418004b8c000 .data 0x417fd2200000 .bss 0x417fd2201750
2016-01-23T14:41:45.703Z cpu2:33469)usb-storage          0x418004b8d000 .data 0x417fd2600000 .bss 0x417fd2604780
2016-01-23T14:41:45.703Z cpu2:33469)vmkapi_v2_0_0_0_nmp_shim 0x418004b99000 .data 0x417fd2a00000 .bss 0x417fd2a00ca8
2016-01-23T14:41:45.703Z cpu2:33469)vmkapi_v2_1_0_0_nmp_shim 0x418004b9a000 .data 0x417fd2e00000 .bss 0x417fd2e00ca8
2016-01-23T14:41:45.703Z cpu2:33469)libfc_92             0x418004b9b000 .data 0x417fd3200000 .bss 0x417fd3200b80
2016-01-23T14:41:45.703Z cpu2:33469)libfcoe_92           0x418004bb4000 .data 0x417fd3600000 .bss 0x417fd36001c0
2016-01-23T14:41:45.703Z cpu2:33469)libfc_9_2_0_0        0x418004bba000 .data 0x417fd3a00000 .bss 0x417fd3a00868
2016-01-23T14:41:45.703Z cpu2:33469)libfcoe_9_2_0_0      0x418004bbb000 .data 0x417fd3e00000 .bss 0x417fd3e001f4
2016-01-23T14:41:45.703Z cpu2:33469)libfc_9_2_1_0        0x418004bbc000 .data 0x417fd4200000 .bss 0x417fd4200868
2016-01-23T14:41:45.703Z cpu2:33469)libfcoe_9_2_1_0      0x418004bbd000 .data 0x417fd4600000 .bss 0x417fd46001f4
2016-01-23T14:41:45.703Z cpu2:33469)hpsa                 0x418004bbe000 .data 0x417fd4a00000 .bss 0x417fd4a00800
2016-01-23T14:41:45.703Z cpu2:33469)ahci                 0x418004bd8000 .data 0x417fd4e00000 .bss 0x417fd4e00420
2016-01-23T14:41:45.703Z cpu2:33469)sunrpc               0x418004bdf000 .data 0x417fd5200000 .bss 0x417fd5202b80
2016-01-23T14:41:45.703Z cpu2:33469)nfsclient            0x418004bee000 .data 0x417fd5600000 .bss 0x417fd56039c0
2016-01-23T14:41:45.703Z cpu2:33469)vmkibft              0x418004c07000 .data 0x417fd5a00000 .bss 0x417fd5a037c0
2016-01-23T14:41:45.703Z cpu2:33469)lvmdriver            0x418004c0a000 .data 0x417fd5e00000 .bss 0x417fd5e03380
2016-01-23T14:41:45.703Z cpu2:33469)deltadisk            0x418004c1e000 .data 0x417fd6200000 .bss 0x417fd6205c00
2016-01-23T14:41:45.703Z cpu2:33469)tracing              0x418004c49000 .data 0x417fd6600000 .bss 0x417fd6605b40
2016-01-23T14:41:45.703Z cpu2:33469)rdt                  0x418004c50000 .data 0x417fd6a00000 .bss 0x417fd6a04e00
2016-01-23T14:41:45.703Z cpu2:33469)vsanutil             0x418004c76000 .data 0x417fd6e00000 .bss 0x417fd6e069c0
2016-01-23T14:41:45.703Z cpu2:33469)lsomcommon           0x418004c95000 .data 0x417fd7200000 .bss 0x417fd7201680
2016-01-23T14:41:45.703Z cpu2:33469)plog                 0x418004cc9000 .data 0x417fd7600000 .bss 0x417fd7605680
2016-01-23T14:41:45.703Z cpu2:33469)vmfs3                0x418004d0c000 .data 0x417fd7a00000 .bss 0x417fd7a03840
2016-01-23T14:41:45.703Z cpu2:33469)dvfg-igmp            0x418004d78000 .data 0x417fd7e00000 .bss 0x417fd7e00208
2016-01-23T14:41:45.703Z cpu2:33469)cmmds_net            0x418004d7e000 .data 0x417fd8200000 .bss 0x417fd8202f40
2016-01-23T14:41:45.703Z cpu2:33469)cmmds                0x418004d8b000 .data 0x417fd8600000 .bss 0x417fd8604d80
2016-01-23T14:41:45.703Z cpu2:33469)cmmds_resolver       0x418004dc0000 .data 0x417fd8a00000 .bss 0x417fd8a00140
2016-01-23T14:41:45.703Z cpu2:33469)vsan                 0x418004dcc000 .data 0x417fd8e00000 .bss 0x417fd8e1c680
2016-01-23T14:41:45.703Z cpu2:33469)vmklink_mpi          0x418004ee9000 .data 0x417fd9200000 .bss 0x417fd9202400
2016-01-23T14:41:45.703Z cpu2:33469)swapobj              0x418004eee000 .data 0x417fd9600000 .bss 0x417fd9603010
2016-01-23T14:41:45.703Z cpu2:33469)vflash               0x418004ef6000 .data 0x417fd9a00000 .bss 0x417fd9a03540
2016-01-23T14:41:45.703Z cpu2:33469)vfc                  0x418004f01000 .data 0x417fd9e00000 .bss 0x417fd9e02ac0
2016-01-23T14:41:45.703Z cpu2:33469)hpilo                0x418004f20000 .data 0x417fda200000 .bss 0x417fda200260
2016-01-23T14:41:45.703Z cpu2:33469)hpcru                0x418004f23000 .data 0x417fda600000 .bss 0x417fda600180
Coredump to disk.
2016-01-23T14:41:45.753Z cpu2:33469)Slot 1 of 1.
2016-01-23T14:41:45.753Z cpu2:33469)Dump: 2215: Using dump slot size 2684354560.

 

vmkernel-log.2

# grep -i -na 'Corruption' vmkernel-log.2
42198:PANIC bora/vmkernel/main/dlmalloc.c:4836 - Corruption in dlmalloc
42224:2016-01-14T22:37:44.616Z cpu0:33416)@BlueScreen: PANIC bora/vmkernel/main/dlmalloc.c:4836 - Corruption in dlmalloc

 

vmkernel-log.3:

# grep -i -na 'Corruption' vmkernel-log.3
41966:PANIC bora/vmkernel/main/dlmalloc.c:4836 - Corruption in dlmalloc
41992:2016-01-16T06:29:20.919Z cpu3:33422)@BlueScreen: PANIC bora/vmkernel/main/dlmalloc.c:4836 - Corruption in dlmalloc

 

 

For more details, please see attachment.

 

Any help would be appreciated.


Viewing all articles
Browse latest Browse all 219257

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>