How to install kernel modules after a successful compiling

[FuLong Wang]

Hello Experts,


I'm trying to enable some infiniband related kernel modules (ib_ipoib, 
iser, isert, etc) on my RHEL 7.6 instance running on IBM linuxONE 
machine. (I have found the code in the kernel source tree.)

After installing the kernel source rpm in a normal user and make module 
selection using the "make menuconfig" command, i can successfully 
re-built all the selected modules (include the new selection) with the 
"make modules" command.

I copied the desired module files to the 
"/lib/modules/3.10.0-957.el7.s390x/kernel/drivers/infiniband/ulp" dir 
and the depmod -a command also was executed with no errors.

[root at bz094f ulp]# pwd
/lib/modules/3.10.0-957.el7.s390x/kernel/drivers/infiniband/ulp
[root at bz094f ulp]#
[root at bz094f ulp]# ls -l ipoib
total 5704
-rw-r--r--. 1 root root 5837016 Dec  9 15:50 ib_ipoib.ko
[root at bz094f ulp]# ls -l iser
total 2880
-rw-r--r--. 1 root root 2946496 Dec  9 15:50 ib_iser.ko
[root at bz094f ulp]# ls  -l isert
total 1384
-rw-r--r--. 1 root root 1414304 Dec  9 15:50 ib_isert.ko
[root at bz094f ulp]#


But after reboot the OS, i found the new copied modules can't be loaded 
by the kernel.

errors reported in the /var/log/message:

Dec  9 15:49:05 bz094f systemd-modules-load: Failed to insert 
'ib_ipoib': Exec format error
Dec  9 15:49:05 bz094f systemd-modules-load: Failed to find module 'ib_umad'
Dec  9 15:49:05 bz094f systemd: rdma-load-modules at infiniband.service: 
main process exited, code=exited, status=1/FAILURE
Dec  9 15:49:05 bz094f systemd: Failed to start Load RDMA modules from 
/etc/rdma/modules/infiniband.conf.
Dec  9 15:49:05 bz094f systemd: Unit 
rdma-load-modules at infiniband.service entered failed state.
Dec  9 15:49:05 bz094f systemd: rdma-load-modules at infiniband.service failed.
Dec  9 15:49:05 bz094f kernel: ib_ipoib: no symbol version for module_layout
Dec  9 15:49:05 bz094f systemd-modules-load: Failed to insert 'ib_iser': 
Exec format error
Dec  9 15:49:05 bz094f kernel: ib_iser: no symbol version for module_layout




when load the module manually, it will produce the same error:


[root at bz094f ~]# modprobe ib_ipoib
modprobe: ERROR: could not insert 'ib_ipoib': Exec format error

error reported in the dmesg:

[    9.589647] ib_ipoib: no symbol version for module_layout
[    9.597600] ib_srp: no symbol version for module_layout


[root at bz094f ~]# modinfo ib_ipoib
filename: 
/lib/modules/3.10.0-957.el7.s390x/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko
license:        Dual BSD/GPL
description:    IP-over-InfiniBand net driver
author:         Roland Dreier
alias:          rtnl-link-ipoib
rhelversion:    7.6
srcversion:     917AA4365B3509F0B347217
depends:        ib_core,ib_cm
intree:         Y
vermagic:       3.10.0 SMP mod_unload modversions
parm:           max_nonsrq_conn_qp:Max number of connected-mode QPs per 
interface (applied only if shared receive queue is not available) (int)
parm:           cm_data_debug_level:Enable data path debug tracing for 
connected mode if > 0 (int)
parm:           mcast_debug_level:Enable multicast debug tracing if > 0 
(int)
parm:           data_debug_level:Enable data path debug tracing if > 0 (int)
parm:           send_queue_size:Number of descriptors in send queue (int)
parm:           recv_queue_size:Number of descriptors in receive queue (int)
parm:           ipoib_enhanced:Enable IPoIB enhanced for capable devices 
(default = 1) (0-1) (int)
parm:           debug_level:Enable debug tracing if > 0 (int)
[root at bz094f ~]#


I had also tried the "make modules_install" command, but get the error 
below.

[root at bz094f ~]# su - zbrand
Last login: Wed Dec  9 16:38:08 CST 2020 on pts/1
[zbrand at bz094f ~]$ cd 
/home/zbrand/rpmbuild/BUILD/kernel-3.10.0-957.el7/linux-3.10.0-957.el7.s390x
[zbrand at bz094f linux-3.10.0-957.el7.s390x]$
[zbrand at bz094f linux-3.10.0-957.el7.s390x]$ sudo make modules_install
   INSTALL arch/s390/appldata/appldata_mem.ko
Can't read private key
make[1]: *** [arch/s390/appldata/appldata_mem.ko] Error 2
make: *** [_modinst_] Error 2
[zbrand at bz094f linux-3.10.0-957.el7.s390x]$


So, did anybody have idea on this?


Many Thanks!

-- 
Regards
FuLong Wang
_______________________________________________