[98313] in tlhIngan-Hol
Re: [Tlhingan-hol] Certification Test Woes
daemon@ATHENA.MIT.EDU (d'Armond Speers, Ph.D.)
Mon Mar 31 22:40:52 2014
In-Reply-To: <8D11B509A6CEAC0-1B74-10222@webmail-vm031.sysops.aol.com>
Date: Mon, 31 Mar 2014 20:39:49 -0600
From: "d'Armond Speers, Ph.D." <speersd@georgetown.edu>
To: tlhIngan-Hol List <tlhingan-hol@kli.org>
Errors-To: tlhingan-hol-bounces@kli.org
--===============4913617564670776077==
Content-Type: multipart/alternative; boundary=001a113ab330f4df9004f5f214d6
--001a113ab330f4df9004f5f214d6
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
On Mon, Mar 31, 2014 at 5:32 PM, Brad Wilson <bmacliam@aol.com> wrote:
> Assigning questions randomly from a large test bank may ensure that over=
many tests, there is a balance of high & low-value questions, but it doesn=
't prevent any one test from being overly skewed, which isn't really fair t=
o that particular student. Can the questions be "weighted" so that in choos=
ing them, the test still retains a difficulty consistent with the objective=
?
>
>
That's similar to what I was saying before about measuring the content of
an expected answer and ensuring consistency. Sounds easy in theory, but
not so much in practice. (In theory, theory and practice are the same; in
practice, they're different.) I also wonder if balancing the questions on
any given test by weight/content wouldn't interfere with the randomization,
making certain questions more or less likely to appear on a test. I'm open
to suggestions on whether this is an issue that needs to be addressed, and
if so, what the right way to adjust things might be. (I mean, for example,
if you would like to see questions weighted by content, then propose a
means for measuring the content of a question.)
> gheyIl
>
> --Holtej
--001a113ab330f4df9004f5f214d6
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
<div dir=3D"ltr"><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">=
On Mon, Mar 31, 2014 at 5:32 PM, Brad Wilson <span dir=3D"ltr"><<a href=
=3D"mailto:bmacliam@aol.com" target=3D"_blank">bmacliam@aol.com</a>></sp=
an> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><font color=3D"black" face=3D"arial">
<div style=3D"font-size:10pt">
<div style=3D"font-size:12px;margin:0px"><pre style=3D"font-size:9pt"><span=
style=3D"font-family:Tahoma,Verdana,Arial,sans-serif;font-size:9pt">Assign=
ing questions randomly from a large test bank may ensure that over many tes=
ts, there is a balance of high & low-value questions, but it doesn'=
t prevent any one test from being overly skewed, which isn't really fai=
r to that particular student. Can the questions be "weighted" so =
that in choosing them, the test still retains a difficulty consistent with =
the objective?</span></pre>
</div></div></font></blockquote><div><br></div><div>That's similar to w=
hat I was saying before about measuring the content of an expected answer a=
nd ensuring consistency. =A0Sounds easy in theory, but not so much in pract=
ice. =A0(In theory, theory and practice are the same; in practice, they'=
;re different.) =A0I also wonder if balancing the questions on any given te=
st by weight/content wouldn't interfere with the randomization, making =
certain questions more or less likely to appear on a test. =A0I'm open =
to suggestions on whether this is an issue that needs to be addressed, and =
if so, what the right way to adjust things might be. =A0(I mean, for exampl=
e, if you would like to see questions weighted by content, then propose a m=
eans for measuring the content of a question.)</div>
<div>=A0</div><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;=
border-left:1px #ccc solid;padding-left:1ex"><font color=3D"black" face=3D"=
arial"><div style=3D"font-size:10pt"><div style=3D"font-size:12px;margin:0p=
x"><pre style=3D"font-size:9pt">
<span style=3D"font-family:Tahoma,Verdana,Arial,sans-serif;font-size:9pt">g=
heyIl</span><br></pre>
</div>
=20
</div>
</font></blockquote></div>--Holtej</div></div>
--001a113ab330f4df9004f5f214d6--
--===============4913617564670776077==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
_______________________________________________
Tlhingan-hol mailing list
Tlhingan-hol@kli.org
http://mail.kli.org/mailman/listinfo/tlhingan-hol
--===============4913617564670776077==--
