Hi,
Good News
This is my current status :
Done: load all required modules for iser transport
Done: Creating storages type : LVM over iSCSI , but with transport iser , in XenCenter
Only the transport was changed from tcp to iser .
All XenServer features like:
-
Live Storage Migration
-
XenMotion ® live migration
-
VM Copy / Move
are still available
A test with a VM :
win2008r2 - 1024MB Ram , 1CPU , Disk C, E , F ( XENSRC PVDisk SCSI Disk Device)
Atto Disk Benchmark v2.47 default prefs , but Queue Depth : 10
max iops read> 45000
max iops write > 45000
RMB / s> 1300
WMB / s> 1300
This is f : in Dom0
[root @ xenserver ~ ] # iostat -x - m 1 sdc | grep sdc
sdc0.00 0.00 0.00 45123.00 0.00 22.07 1.00 1.63 0.04 0.01 64.00
sdc 0.00 0.00 45918.00 0.00 22.42 0.00 1.00 1.61 0.04 0.01 65.00
see attached files
# # #Bad news :
The server is not stable. At high I / O load , the server crashed .
Here is the error message:
<3 > [ 434.554641 ] iser : iser_start_rdma_unaligned_sg : Failed to allocate mem size 66 266240 for copying SGList
<3 > [ 434.592026 ] iser : iser_prepare_write_cmd : Failed to register write cmd RDMA mem
<3 > [ 434.629054 ] iser : iser_send_command : conn e8c3b0c8 failed task- > itt 83 err -12
<3 > [ 434.648441 ] PCI - DMA: Out of SW- IOMMU space for 266240 bytes at device 0000:03:00.0
<0 > [ 434.686043 ] ------------ [ cut here] ------------
<2 > [ 434.704686 ] kernel BUG at / tmp/mlnx_iso.24095/OFED_topdir/BUILD/ofa_kernel-1.5.3/drivers/infiniband/ulp/iser/iser_memory.c : 98 !
<0 > [ 434.743223 ] invalid opcode : 0000 [# 1 ] SMP<0 > [ 434.743224 ] load sysfs file: / sys/class/iscsi_session/session2/targetname
Maybe someone an idea how I can solve the problem?
more info in the file error.txt
error.txt.zip (1.66 KB)
lvm-lun-256.txt.zip (3.43 KB)