[15486] in athena10
Re: Debathena Fails to load AFS kernel modules
daemon@ATHENA.MIT.EDU (Anne Collin)
Wed Feb 28 14:37:43 2018
From: Anne Collin <acollin@mit.edu>
To: Benjamin J Kaduk <kaduk@mit.edu>
CC: debathena <debathena@mit.edu>
Date: Wed, 28 Feb 2018 19:37:30 +0000
Message-ID: <5311823E-F045-477D-B3DF-21DD0A5C8C44@mit.edu>
In-Reply-To: <29DD5F90-79AA-461E-8D56-8597F83DF4A5@mit.edu>
Content-Language: en-US
Content-Type: multipart/signed;
boundary="Apple-Mail=_D16D1EB0-8CB2-46A3-B366-A0DF3AA4DEAF";
protocol="application/pkcs7-signature"; micalg=sha1
MIME-Version: 1.0
--Apple-Mail=_D16D1EB0-8CB2-46A3-B366-A0DF3AA4DEAF
Content-Type: multipart/alternative;
boundary="Apple-Mail=_E7BCBBF7-4FAB-40BB-ACC7-105622D83383"
--Apple-Mail=_E7BCBBF7-4FAB-40BB-ACC7-105622D83383
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=windows-1252
Hi again Ben,
I have a somewhat related question; is there a way to prevent the login =
of a user to time-out on our machine? What happens is that I check in =
the morning results that have been running during the night, but I=92m =
being told that my authentification expired, and then when I try to do =
something the screen freezes. The only solution I have is to do a manual =
reboot, which I=92m sure is not great for the system. I didn=92t manage =
to find anything online in the Debathena docs about this.
Best,
Anne
> On 28 Feb 2018, at 10:15, Anne Collin <acollin@mit.edu> wrote:
>=20
> Hi Ben,
>=20
> Thanks a lot for tracking this down! I ended up reinstalling Ubuntu =
and Debathena from scratch and openAFS now works, but I wasn=92t sure if =
I could upgrade to 16.04 as it didn=92t seem to be supported by =
Debathena. So your answer is useful in that 1) now I know that I can and =
2) I was afraid it would happen again.=20
>=20
> It=92s true that it started getting messed up after upgrades that were =
suggested around the time of the =AB spectre =BB publicity.
>=20
> Best,
> Anne
>=20
>> Am 27.02.2018 um 21:16 schrieb Benjamin Kaduk <kaduk@mit.edu>:
>>=20
>> [re-adding debathena@mit.edu to the cc list]
>>=20
>> Hi Anne,
>>=20
>> Thanks for the data. It looks like you're running the Ubuntu
>> "hardware enablement" kernel with the 14.04.5 release, as opposed to
>> the older linux kernel series that shipped with the original 14.04
>> release. With some help from another developer, we spotted a
>> potential issue with this setup, in that the kernel you're running
>> is compiled using a compiler feature called "retpoline", that was
>> introduced as a partial mitgiation for the "spectre" vulnerabilities
>> that have been in the news recently. This changes the contract for
>> interactions between kernel modules such as the one from OpenAFS,
>> and the main kernel, so that the kernel module in question would
>> need to use the same compiler as the main kernel. Unfortunately,
>> the updated compiler does not appear to be readily available on your
>> system, and so (if our hypothesis is right), the mismatch would
>> prevent openafs from working.
>>=20
>> We could get one more data point to try to confirm if this is the
>> case, via:
>>=20
>> sudo dmesg | grep openafs
>>=20
>> In terms of possible workarounds, if you do not actually need the
>> "nardware enablement" kernel for the particular hardware in
>> question, you could try to downgrade to an older kernel; otherwise,
>> the simplest solution might be to upgrade the machine to a newer
>> Ubuntu release (e.g., 16.04 "Xenial", the source of the "hardware
>> enablement" kernel; the requisite compiler looks to be present on
>> Xenial systems).
>>=20
>> This is all pretty complicated and confusing, so please ask for
>> clarification as needed.
>>=20
>> -Ben
>>=20
>>> On Mon, Feb 26, 2018 at 04:07:46PM -0500, Anne Collin wrote:
>>> Sorry, the actual response to =93lsb_release -a=94 is
>>>=20
>>> =93No LSB modules are available.
>>> Distributor ID: Ubuntu
>>> Description: Ubuntu 14.04.5 LTS
>>> Release: 14.04
>>> Codename: trusty=94
>>>=20
>>> Anne
>>>=20
>>>> On 26 Feb 2018, at 14:31, Anne Collin <acollin@mit.edu> wrote:
>>>>=20
>>>> Hi Ben,
>>>>=20
>>>> Thanks for the quick response, I'm attaching the screenshot of the =
terminal.
>>>>=20
>>>>=20
>>>> ________________________________________
>>>> De : Benjamin Kaduk [kaduk@mit.edu]
>>>> Envoy=E9 : lundi 26 f=E9vrier 2018 13:53
>>>> =C0 : Anne Collin
>>>> Cc : debathena
>>>> Objet : Re: Debathena Fails to load AFS kernel modules
>>>>=20
>>>> Hi Anne,
>>>>=20
>>>>> On Mon, Feb 26, 2018 at 01:50:03PM -0500, Anne Collin wrote:
>>>>> Hi,
>>>>>=20
>>>>> For some reason I am not able to access AFS MIT user accounts (not =
just mine, several MIT students=92) on our lab Debathena machine (used =
to work fine until last week). I logged with the local admin account, =
and tried to troubleshoot with these instructions =
http://kb.mit.edu/confluence/display/istcontrib/Troubleshooting+Debathena+=
installation =
<https://master.mailbutler.io/redirect/90F34E00-60F7-403B-BBCB-CAD61795EB1=
3>, but when I try to restart openafs-client, I get the error
>>>>> =93Starting AFS services:modprobe: ERROR: could not insert =
=91opens=92: Exec format error
>>>>>=20
>>>>> Failed to load AFS kernel module, not starting AFS=94
>>>>>=20
>>>>> Do you have any advice on what I should do? I=92m even ready to =
reinstall Debathena, but I didn=92t find any documentation online on how =
to do that.
>>>>=20
>>>> The OpenAFS packages used by Debathena are maintained as part of
>>>> Debian and Ubuntu, so in general issues seen with them may also be
>>>> present on non-Debathena machines. To help us understand what's
>>>> going on, could you provide the output of the following commands?
>>>>=20
>>>> uname -a
>>>>=20
>>>> lsb_release -a
>>>>=20
>>>> dpkg-query -W openafs-client
>>>>=20
>>>> Thanks,
>>>>=20
>>>> Ben
>>>> <Screenshot from 2018-02-26 14:30:25.png>
>>>=20
>>=20
>>=20
>>=20
--Apple-Mail=_E7BCBBF7-4FAB-40BB-ACC7-105622D83383
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
charset=windows-1252
<html><body style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; =
-webkit-line-break: after-white-space;" class=3D"">Hi again Ben,<div =
class=3D""><br class=3D""></div><div class=3D"">I have a somewhat =
related question; is there a way to prevent the login of a user to =
time-out on our machine? What happens is that I check in the morning =
results that have been running during the night, but I=92m being told =
that my authentification expired, and then when I try to do something =
the screen freezes. The only solution I have is to do a manual reboot, =
which I=92m sure is not great for the system. I didn=92t manage to find =
anything online in the Debathena docs about this.</div><div class=3D""><br=
class=3D""></div><div class=3D"">Best,</div><div =
class=3D"">Anne</div><div class=3D""><br class=3D""><blockquote =
type=3D"cite" class=3D"">On 28 Feb 2018, at 10:15, Anne Collin <<a =
href=3D"mailto:acollin@mit.edu" class=3D"">acollin@mit.edu</a>> =
wrote:<br class=3D""><br class=3D"">Hi Ben,<br class=3D""><br =
class=3D"">Thanks a lot for tracking this down! I ended up reinstalling =
Ubuntu and Debathena from scratch and openAFS now works, but I wasn=92t =
sure if I could upgrade to 16.04 as it didn=92t seem to =
be supported by Debathena. So your answer is useful in that 1) now =
I know that I can and 2) I was afraid it would happen again. <br =
class=3D""><br class=3D"">It=92s true that it started getting messed up =
after upgrades that were suggested around the time of the =AB spectre =BB =
publicity.<br class=3D""><br class=3D"">Best,<br class=3D"">Anne<br =
class=3D""><br class=3D""><blockquote type=3D"cite" class=3D"">Am =
27.02.2018 um 21:16 schrieb Benjamin Kaduk <<a =
href=3D"mailto:kaduk@mit.edu" class=3D"">kaduk@mit.edu</a>>:<br =
class=3D""><br class=3D"">[re-adding <a href=3D"mailto:debathena@mit.edu" =
class=3D"">debathena@mit.edu</a> to the cc list]<br class=3D""><br =
class=3D"">Hi Anne,<br class=3D""><br class=3D"">Thanks for the data. =
It looks like you're running the Ubuntu<br class=3D"">"hardware =
enablement" kernel with the 14.04.5 release, as opposed to<br =
class=3D"">the older linux kernel series that shipped with the original =
14.04<br class=3D"">release. With some help from another =
developer, we spotted a<br class=3D"">potential issue with this setup, =
in that the kernel you're running<br class=3D"">is compiled using a =
compiler feature called "retpoline", that was<br class=3D"">introduced =
as a partial mitgiation for the "spectre" vulnerabilities<br =
class=3D"">that have been in the news recently. This changes the =
contract for<br class=3D"">interactions between kernel modules such as =
the one from OpenAFS,<br class=3D"">and the main kernel, so that the =
kernel module in question would<br class=3D"">need to use the same =
compiler as the main kernel. Unfortunately,<br class=3D"">the =
updated compiler does not appear to be readily available on your<br =
class=3D"">system, and so (if our hypothesis is right), the mismatch =
would<br class=3D"">prevent openafs from working.<br class=3D""><br =
class=3D"">We could get one more data point to try to confirm if this is =
the<br class=3D"">case, via:<br class=3D""><br class=3D""> sudo =
dmesg | grep openafs<br class=3D""><br class=3D"">In terms of possible =
workarounds, if you do not actually need the<br class=3D"">"nardware =
enablement" kernel for the particular hardware in<br class=3D"">question, =
you could try to downgrade to an older kernel; otherwise,<br =
class=3D"">the simplest solution might be to upgrade the machine to a =
newer<br class=3D"">Ubuntu release (e.g., 16.04 "Xenial", the source of =
the "hardware<br class=3D"">enablement" kernel; the requisite compiler =
looks to be present on<br class=3D"">Xenial systems).<br class=3D""><br =
class=3D"">This is all pretty complicated and confusing, so please ask =
for<br class=3D"">clarification as needed.<br class=3D""><br =
class=3D"">-Ben<br class=3D""><br class=3D""><blockquote type=3D"cite" =
class=3D"">On Mon, Feb 26, 2018 at 04:07:46PM -0500, Anne Collin =
wrote:<br class=3D"">Sorry, the actual response to =93lsb_release -a=94 =
is<br class=3D""><br class=3D"">=93No LSB modules are available.<br =
class=3D"">Distributor ID: Ubuntu<br class=3D"">Description: Ubuntu =
14.04.5 LTS<br class=3D"">Release: 14.04<br class=3D"">Codename: =
trusty=94<br class=3D""><br class=3D"">Anne<br class=3D""><br =
class=3D""><blockquote type=3D"cite" class=3D"">On 26 Feb 2018, at =
14:31, Anne Collin <<a href=3D"mailto:acollin@mit.edu" =
class=3D"">acollin@mit.edu</a>> wrote:<br class=3D""><br class=3D"">Hi =
Ben,<br class=3D""><br class=3D"">Thanks for the quick response, I'm =
attaching the screenshot of the terminal.<br class=3D""><br class=3D""><br=
class=3D"">________________________________________<br class=3D"">De : =
Benjamin Kaduk [<a href=3D"mailto:kaduk@mit.edu" =
class=3D"">kaduk@mit.edu</a>]<br class=3D"">Envoy=E9 : lundi 26 f=E9vrier =
2018 13:53<br class=3D"">=C0 : Anne Collin<br class=3D"">Cc : =
debathena<br class=3D"">Objet : Re: Debathena Fails to load AFS kernel =
modules<br class=3D""><br class=3D"">Hi Anne,<br class=3D""><br =
class=3D""><blockquote type=3D"cite" class=3D"">On Mon, Feb 26, 2018 at =
01:50:03PM -0500, Anne Collin wrote:<br class=3D"">Hi,<br class=3D""><br =
class=3D"">For some reason I am not able to access AFS MIT user accounts =
(not just mine, several MIT students=92) on our lab Debathena machine =
(used to work fine until last week). I logged with the local admin =
account, and tried to troubleshoot with these instructions <a =
href=3D"http://kb.mit.edu/confluence/display/istcontrib/Troubleshooting+De=
bathena+installation" =
class=3D"">http://kb.mit.edu/confluence/display/istcontrib/Troubleshooting=
+Debathena+installation</a> <<a =
href=3D"https://master.mailbutler.io/redirect/90F34E00-60F7-403B-BBCB-CAD6=
1795EB13" =
class=3D"">https://master.mailbutler.io/redirect/90F34E00-60F7-403B-BBCB-C=
AD61795EB13</a>>, but when I try to restart openafs-client, I get the =
error<br class=3D"">=93Starting AFS services:modprobe: ERROR: could not =
insert =91opens=92: Exec format error<br class=3D""><br class=3D"">Failed =
to load AFS kernel module, not starting AFS=94<br class=3D""><br =
class=3D"">Do you have any advice on what I should do? I=92m even ready =
to reinstall Debathena, but I didn=92t find any documentation online on =
how to do that.<br class=3D""></blockquote><br class=3D"">The OpenAFS =
packages used by Debathena are maintained as part of<br class=3D"">Debian =
and Ubuntu, so in general issues seen with them may also be<br =
class=3D"">present on non-Debathena machines. To help us =
understand what's<br class=3D"">going on, could you provide the output =
of the following commands?<br class=3D""><br class=3D"">uname -a<br =
class=3D""><br class=3D"">lsb_release -a<br class=3D""><br =
class=3D"">dpkg-query -W openafs-client<br class=3D""><br =
class=3D"">Thanks,<br class=3D""><br class=3D"">Ben<br =
class=3D""><Screenshot from 2018-02-26 14:30:25.png><br =
class=3D""></blockquote><br class=3D""></blockquote><br class=3D""><br =
class=3D""><br class=3D""></blockquote></blockquote><br =
class=3D""></div><img =
src=3D"https://master.mailbutler.io/tracking/80208B94-9CB6-4D5F-B9F2-50B24=
E2638F7" align=3D"left" width=3D"0" height=3D"0" =
style=3D"width:0;height:0;border:0;" title=3D"" alt=3D"" =
id=3D"MailButlerTrackingPixel" class=3D""></body></html>=
--Apple-Mail=_E7BCBBF7-4FAB-40BB-ACC7-105622D83383--
--Apple-Mail=_D16D1EB0-8CB2-46A3-B366-A0DF3AA4DEAF
Content-Disposition: attachment; filename="smime.p7s"
Content-Type: application/pkcs7-signature; name="smime.p7s"
Content-Transfer-Encoding: base64
MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIDvjCCA7ow
ggMjoAMCAQICEAGOWh7BATYeWz55d1+SwwUwDQYJKoZIhvcNAQELBQAwbDELMAkGA1UEBhMCVVMx
FjAUBgNVBAgTDU1hc3NhY2h1c2V0dHMxLjAsBgNVBAoTJU1hc3NhY2h1c2V0dHMgSW5zdGl0dXRl
IG9mIFRlY2hub2xvZ3kxFTATBgNVBAsTDENsaWVudCBDQSB2MTAeFw0xNzA2MjkyMzQ1MzFaFw0x
ODA3MzAyMzQ1MzFaMIGiMQswCQYDVQQGEwJVUzEWMBQGA1UECBMNTWFzc2FjaHVzZXR0czEuMCwG
A1UEChMlTWFzc2FjaHVzZXR0cyBJbnN0aXR1dGUgb2YgVGVjaG5vbG9neTEVMBMGA1UECxMMQ2xp
ZW50IENBIHYxMRQwEgYDVQQDEwtBbm5lIENvbGxpbjEeMBwGCSqGSIb3DQEJARYPYWNvbGxpbkBN
SVQuRURVMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEApCcZ1vD1uP47XYvgdNGgXkfQ
6qLQizrScQrORKNbuTSGE5d23OUH0u0bSh+MwDieUGutWyxcz9KugzGfHl934vOdVD4c8YxEFPib
66y5jzHETP8+XShiBOZt9D8Zf2nACLn4TioERoIZiE6cfa1A0jp6LMc+gZA7lQSx6ixs0tkcqGwW
YefygYmCQL4tMCrSoR6HUJXC3YeNPFudXi3YalaKFWDzoQfWzheLwQ79XdyOTSVqP8VaYtPZ95WM
zHGfQLqnA3nmIcsIRaTSCLM27kAffLWoOsd2puFf3k/DSUKoxCdzfQYIdTpHOOT7b3RJYnIAtd4t
ADGdsp+6rjj+TwIDAQABo4GhMIGeMAkGA1UdEwQCMAAwEQYJYIZIAYb4QgEBBAQDAgWgMB0GA1Ud
JQQWMBQGCCsGAQUFBwMEBggrBgEFBQcDAjALBgNVHQ8EBAMCBeAwHQYDVR0OBBYEFOlQeCUznFVd
Cr2yOp/GMvIU3VJzMDMGA1UdHwQsMCowKKAmoCSGImh0dHA6Ly9jYS5taXQuZWR1L2NhL21pdGNs
aWVudC5jcmwwDQYJKoZIhvcNAQELBQADgYEAmPgTbR3nh7bLSGn/hvNDBEOA4q738yUSm/Re7ZkG
pVAQf3RJkU3rHqj4J1UfZefp6nhafVJDyc5lzrSDPxV9w5IbvjgJ4xs1qQGBxWsajS1o0jLHUZ9+
ZDEo0Nn/0rIgMD9QB8718a/wJrJKNvzaDkjPuaLiWUIekkaFq27FoGwxggMzMIIDLwIBATCBgDBs
MQswCQYDVQQGEwJVUzEWMBQGA1UECBMNTWFzc2FjaHVzZXR0czEuMCwGA1UEChMlTWFzc2FjaHVz
ZXR0cyBJbnN0aXR1dGUgb2YgVGVjaG5vbG9neTEVMBMGA1UECxMMQ2xpZW50IENBIHYxAhABjloe
wQE2Hls+eXdfksMFMAkGBSsOAwIaBQCgggGHMBgGCSqGSIb3DQEJAzELBgkqhkiG9w0BBwEwHAYJ
KoZIhvcNAQkFMQ8XDTE4MDIyODE5MzcyOFowIwYJKoZIhvcNAQkEMRYEFPR8yLFt9cceQUdIDNxp
/7RCvSJJMIGRBgkrBgEEAYI3EAQxgYMwgYAwbDELMAkGA1UEBhMCVVMxFjAUBgNVBAgTDU1hc3Nh
Y2h1c2V0dHMxLjAsBgNVBAoTJU1hc3NhY2h1c2V0dHMgSW5zdGl0dXRlIG9mIFRlY2hub2xvZ3kx
FTATBgNVBAsTDENsaWVudCBDQSB2MQIQAY5aHsEBNh5bPnl3X5LDBTCBkwYLKoZIhvcNAQkQAgsx
gYOggYAwbDELMAkGA1UEBhMCVVMxFjAUBgNVBAgTDU1hc3NhY2h1c2V0dHMxLjAsBgNVBAoTJU1h
c3NhY2h1c2V0dHMgSW5zdGl0dXRlIG9mIFRlY2hub2xvZ3kxFTATBgNVBAsTDENsaWVudCBDQSB2
MQIQAY5aHsEBNh5bPnl3X5LDBTANBgkqhkiG9w0BAQEFAASCAQBco5fMM6EQmEI/YGCVILl1GIAx
9BFnlJnfiG2Zl2tt5h2DfwcGZrMAhaPcZqNulKGjvtUH8nPRg81q5J/9zCsNChepQQ2a4AgC8NHI
wzkmvZee3mggSuVT9jtkkhY0akWjKejk858s/9rjgM0W2V2HgPI28zKEOiB1JXyCISPyuJLsyE9V
P6OJgIEM7DkthfZ5hS8BF14Mz+4HDYWR2C3z9iCmI3kNdcXNMJ0OtSsTcX0AeoO6qbK8YglufL9/
jbQjIAYFV9s0Hknpp3oJo23x9ysEVL7cYETRJInpopdAGp8QtIxyU62Mz6XhrJmjBan2HBe+7L8C
bcPQ6hMz8Nl/AAAAAAAA
--Apple-Mail=_D16D1EB0-8CB2-46A3-B366-A0DF3AA4DEAF--
