More on peer-to-peer reviews

The Dean shared this with me this morning. SWoRD is the program his colleague at Pitt Law helped develop.
http://chronicle.com/blogs/future/2014/02/12/why-it-makes-sense-for-stud...

Cyndi Johnson
Director/Assistant Dean for Information Technology
UNM School of Law
(505) 277-0695

_______________________________________________
You are currently subscribed to teknoids as: tekpal@teknoids.net.
To unsubscribe send a blank email to teknoids-leave@ruckus.law.cornell.edu
--
See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.

More on peer-to-peer reviews

Now this is interesting.
I can tell you that over the years we've heard from a number of law
professors who were interested in peer-review-ish things that allowed
law students to review and grade/rate one anothers' work. The
Chronicle article points to 2 systems that do this sort of thing, both
developed with, among other things, NSF money. SWoRD is a commercial
product now, exclusively licensed by UPitt to Panther Learning. The
other, Expertiza, is an open source project out of NC State,
https://github.com/expertiza/expertiza.

Are any Teknoids aware of any faculty at their schools using either of
these? Have you heard from any faculty who might be interested in
doing this sort of thing? Have any of you had any experiences with
these systems or something like them?

Happy Friday,
Elmer.

On Fri, Feb 14, 2014 at 10:17 AM, Johnson, Cyndi <johnson@law.unm.edu> wrote:
> The Dean shared this with me this morning. SWoRD is the program his colleague at Pitt Law helped develop.
> http://chronicle.com/blogs/future/2014/02/12/why-it-makes-sense-for-stud...
>
>
> Cyndi Johnson
> Director/Assistant Dean for Information Technology
> UNM School of Law
> (505) 277-0695
>
> _______________________________________________
> You are currently subscribed to teknoids as: emasters@cali.org.
> To unsubscribe send a blank email to teknoids-leave@ruckus.law.cornell.edu
> --
> See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.

RE: More on peer-to-peer reviews

Elmer

Apprennet/LawMeets' interactive exercises include a process where students review and critique other students' videos on a skills based exercise/problem. One of our faculty uses it for his classes and Apprennet is giving a demo as a whole to our faculty in the beginning of March.

Gary

Gary Moore
Assistant Dean for Academic Technology

Phone - 803-777-8296
E-mail - Gmoore@law.sc.edu
Web - http://law.sc.edu

-----Original Message-----
From: teknoids-bounces@ruckus.law.cornell.edu [mailto:teknoids-bounces@ruckus.law.cornell.edu] On Behalf Of Elmer Masters
Sent: Friday, February 14, 2014 11:53 AM
To: Teknoids
Subject: Re: [teknoids] More on peer-to-peer reviews

Now this is interesting.
I can tell you that over the years we've heard from a number of law professors who were interested in peer-review-ish things that allowed law students to review and grade/rate one anothers' work. The Chronicle article points to 2 systems that do this sort of thing, both developed with, among other things, NSF money. SWoRD is a commercial product now, exclusively licensed by UPitt to Panther Learning. The other, Expertiza, is an open source project out of NC State, https://github.com/expertiza/expertiza.

Are any Teknoids aware of any faculty at their schools using either of these? Have you heard from any faculty who might be interested in doing this sort of thing? Have any of you had any experiences with these systems or something like them?

Happy Friday,
Elmer.

On Fri, Feb 14, 2014 at 10:17 AM, Johnson, Cyndi <johnson@law.unm.edu> wrote:
> The Dean shared this with me this morning. SWoRD is the program his colleague at Pitt Law helped develop.
> http://chronicle.com/blogs/future/2014/02/12/why-it-makes-sense-for-st
> udents-to-grade-one-anothers-papers/
>
>
> Cyndi Johnson
> Director/Assistant Dean for Information Technology UNM School of Law
> (505) 277-0695
>
> _______________________________________________
> You are currently subscribed to teknoids as: emasters@cali.org.
> To unsubscribe send a blank email to
> teknoids-leave@ruckus.law.cornell.edu
> --
> See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.

--
Elmer R. Masters
Center for Computer-Assisted Legal Instruction
emasters@cali.org 773-332-7508
_______________________________________________
You are currently subscribed to teknoids as: gmoore@law.sc.edu.
To unsubscribe send a blank email to teknoids-leave@ruckus.law.cornell.edu
--
See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.
_______________________________________________
You are currently subscribed to teknoids as: tekpal@teknoids.net.
To unsubscribe send a blank email to teknoids-leave@ruckus.law.cornell.edu
--
See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.

More on peer-to-peer reviews

From a pedagogical perspective, having students critically evaluate each others work (for evaluation purposes or not) is an excellent way to help students engage the course content with higher order thinking skills and engage in deeper learning. Before implementing, I’d do a survey of the literature for best practices irrespective if whether I was planning to use a software tool or a more manual process.

Having taken a graduate level course this past summer (not in law) that involved elements of peer assessment, I found it very useful in helping me to engage the materials in a different way. Writing about something and then critically analyzing it were very different process for my brain, and helped me to master the concepts and make linkages to other ideas in a much more enjoyable and organic way than rote memorization. In my class most of the peer assessments were for participation marks, not for grading the material being assessed, however we did a more detailed and structured peer evaluation a the group project we worked on (it was worth 40% of the final grade in the course).

---
Rich McCue, BComm
University of Victoria Libraries
http://library.uvic.ca
http://richmccue.com

My PGP Public Key: http://msys.ca/PGPKeyRichMcCueUvicPublic.asc

On Feb 14, 2014, at 10:04 AM, MOORE, GARY <GMOORE@law.sc.edu> wrote:

> Elmer
>
> Apprennet/LawMeets' interactive exercises include a process where students review and critique other students' videos on a skills based exercise/problem. One of our faculty uses it for his classes and Apprennet is giving a demo as a whole to our faculty in the beginning of March.
>
> Gary
>
> Gary Moore
> Assistant Dean for Academic Technology
>
> Phone - 803-777-8296
> E-mail - Gmoore@law.sc.edu
> Web - http://law.sc.edu
>
> -----Original Message-----
> From: teknoids-bounces@ruckus.law.cornell.edu [mailto:teknoids-bounces@ruckus.law.cornell.edu] On Behalf Of Elmer Masters
> Sent: Friday, February 14, 2014 11:53 AM
> To: Teknoids
> Subject: Re: [teknoids] More on peer-to-peer reviews
>
> Now this is interesting.
> I can tell you that over the years we've heard from a number of law professors who were interested in peer-review-ish things that allowed law students to review and grade/rate one anothers' work. The Chronicle article points to 2 systems that do this sort of thing, both developed with, among other things, NSF money. SWoRD is a commercial product now, exclusively licensed by UPitt to Panther Learning. The other, Expertiza, is an open source project out of NC State, https://github.com/expertiza/expertiza.
>
> Are any Teknoids aware of any faculty at their schools using either of these? Have you heard from any faculty who might be interested in doing this sort of thing? Have any of you had any experiences with these systems or something like them?
>
>
> Happy Friday,
> Elmer.
>
> On Fri, Feb 14, 2014 at 10:17 AM, Johnson, Cyndi <johnson@law.unm.edu> wrote:
>> The Dean shared this with me this morning. SWoRD is the program his colleague at Pitt Law helped develop.
>> http://chronicle.com/blogs/future/2014/02/12/why-it-makes-sense-for-st
>> udents-to-grade-one-anothers-papers/
>>
>>
>> Cyndi Johnson
>> Director/Assistant Dean for Information Technology UNM School of Law
>> (505) 277-0695
>>
>> _______________________________________________
>> You are currently subscribed to teknoids as: emasters@cali.org.
>> To unsubscribe send a blank email to
>> teknoids-leave@ruckus.law.cornell.edu
>> --
>> See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.
>
>
>
> --
> Elmer R. Masters
> Center for Computer-Assisted Legal Instruction
> emasters@cali.org 773-332-7508
> _______________________________________________
> You are currently subscribed to teknoids as: gmoore@law.sc.edu.
> To unsubscribe send a blank email to teknoids-leave@ruckus.law.cornell.edu
> --
> See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.
> _______________________________________________
> You are currently subscribed to teknoids as: rmccue@uvic.ca.
> To unsubscribe send a blank email to teknoids-leave@ruckus.law.cornell.edu
> --
> See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.

RE: More on peer-to-peer reviews

Our new Dean came from Pitt Law. He's the one who sparked my interest in this (OK, mostly because it's a performance goal for next year...I had no prior knowledge of this topic) as his colleague, Kevin Ashley, co-developed SWoRD. He has some publications with case studies.
http://www.law.pitt.edu/people/full-time-faculty/kevin-d-ashley

I don't know if our faculty are interested in doing peer-to-peer reviews but since the Dean is, methinks they will be, too.

Cyndi Johnson
Director/Assistant Dean for Information Technology
UNM School of Law
(505) 277-0695

-----Original Message-----
From: teknoids-bounces@ruckus.law.cornell.edu [mailto:teknoids-bounces@ruckus.law.cornell.edu] On Behalf Of Elmer Masters
Sent: Friday, February 14, 2014 9:53 AM
To: Teknoids
Subject: Re: [teknoids] More on peer-to-peer reviews

Now this is interesting.
I can tell you that over the years we've heard from a number of law professors who were interested in peer-review-ish things that allowed law students to review and grade/rate one anothers' work. The Chronicle article points to 2 systems that do this sort of thing, both developed with, among other things, NSF money. SWoRD is a commercial product now, exclusively licensed by UPitt to Panther Learning. The other, Expertiza, is an open source project out of NC State, https://github.com/expertiza/expertiza.

Are any Teknoids aware of any faculty at their schools using either of these? Have you heard from any faculty who might be interested in doing this sort of thing? Have any of you had any experiences with these systems or something like them?

Happy Friday,
Elmer.

On Fri, Feb 14, 2014 at 10:17 AM, Johnson, Cyndi <johnson@law.unm.edu> wrote:
> The Dean shared this with me this morning. SWoRD is the program his colleague at Pitt Law helped develop.
> http://chronicle.com/blogs/future/2014/02/12/why-it-makes-sense-for-st
> udents-to-grade-one-anothers-papers/
>
>
> Cyndi Johnson
> Director/Assistant Dean for Information Technology UNM School of Law
> (505) 277-0695
>
> _______________________________________________
> You are currently subscribed to teknoids as: emasters@cali.org.
> To unsubscribe send a blank email to
> teknoids-leave@ruckus.law.cornell.edu
> --
> See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.

--
Elmer R. Masters
Center for Computer-Assisted Legal Instruction
emasters@cali.org 773-332-7508
_______________________________________________
You are currently subscribed to teknoids as: johnson@law.unm.edu.
To unsubscribe send a blank email to teknoids-leave@ruckus.law.cornell.edu
--
See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.
_______________________________________________
You are currently subscribed to teknoids as: tekpal@teknoids.net.
To unsubscribe send a blank email to teknoids-leave@ruckus.law.cornell.edu
--
See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.

More on peer-to-peer reviews

This would make a great conference session if someone wants to do some
research, talk about the products and lead a disucssion.

Just sayin'

We are excepting proposals for talks right now.
http://conference.cali.org/2014/content/calicon14-call-speakers

John

On Fri, Feb 14, 2014 at 10:59 AM, Johnson, Cyndi <johnson@law.unm.edu>wrote:

> Our new Dean came from Pitt Law. He's the one who sparked my interest in
> this (OK, mostly because it's a performance goal for next year...I had no
> prior knowledge of this topic) as his colleague, Kevin Ashley, co-developed
> SWoRD. He has some publications with case studies.
> http://www.law.pitt.edu/people/full-time-faculty/kevin-d-ashley
>
> I don't know if our faculty are interested in doing peer-to-peer reviews
> but since the Dean is, methinks they will be, too.
>
> Cyndi Johnson
> Director/Assistant Dean for Information Technology
> UNM School of Law
> (505) 277-0695
>
>
> -----Original Message-----
> From: teknoids-bounces@ruckus.law.cornell.edu [mailto:
> teknoids-bounces@ruckus.law.cornell.edu] On Behalf Of Elmer Masters
> Sent: Friday, February 14, 2014 9:53 AM
> To: Teknoids
> Subject: Re: [teknoids] More on peer-to-peer reviews
>
> Now this is interesting.
> I can tell you that over the years we've heard from a number of law
> professors who were interested in peer-review-ish things that allowed law
> students to review and grade/rate one anothers' work. The Chronicle article
> points to 2 systems that do this sort of thing, both developed with, among
> other things, NSF money. SWoRD is a commercial product now, exclusively
> licensed by UPitt to Panther Learning. The other, Expertiza, is an open
> source project out of NC State, https://github.com/expertiza/expertiza.
>
> Are any Teknoids aware of any faculty at their schools using either of
> these? Have you heard from any faculty who might be interested in doing
> this sort of thing? Have any of you had any experiences with these systems
> or something like them?
>
>
> Happy Friday,
> Elmer.
>
> On Fri, Feb 14, 2014 at 10:17 AM, Johnson, Cyndi <johnson@law.unm.edu>
> wrote:
> > The Dean shared this with me this morning. SWoRD is the program his
> colleague at Pitt Law helped develop.
> > http://chronicle.com/blogs/future/2014/02/12/why-it-makes-sense-for-st
> > udents-to-grade-one-anothers-papers/
> >
> >
> > Cyndi Johnson
> > Director/Assistant Dean for Information Technology UNM School of Law
> > (505) 277-0695
> >
> > _______________________________________________
> > You are currently subscribed to teknoids as: emasters@cali.org.
> > To unsubscribe send a blank email to
> > teknoids-leave@ruckus.law.cornell.edu
> > --
> > See the web interface at
> http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list
> password, unsubscribe, and view your list settings.
>
>
>
> --
> Elmer R. Masters
> Center for Computer-Assisted Legal Instruction
> emasters@cali.org 773-332-7508
> _______________________________________________
> You are currently subscribed to teknoids as: johnson@law.unm.edu.
> To unsubscribe send a blank email to teknoids-leave@ruckus.law.cornell.edu
> --
> See the web interface at
> http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list
> password, unsubscribe, and view your list settings.
> _______________________________________________
> You are currently subscribed to teknoids as: jmayer@cali.org.
> To unsubscribe send a blank email to teknoids-leave@ruckus.law.cornell.edu
> --
> See the web interface at
> http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list
> password, unsubscribe, and view your list settings.
>

RE: More on peer-to-peer reviews

Since I started this discussion, it goes without saying that I'd love to see a session on the topic. I won't be attending CALI this year (but two other people from UNM IT are going) but would watch remotely...

Cyndi Johnson
Director/Assistant Dean for Information Technology
UNM School of Law
(505) 277-0695

From: teknoids-bounces@ruckus.law.cornell.edu [mailto:teknoids-bounces@ruckus.law.cornell.edu] On Behalf Of John Mayer
Sent: Friday, February 14, 2014 10:55 AM
To: Teknoids
Subject: Re: [teknoids] More on peer-to-peer reviews

This would make a great conference session if someone wants to do some research, talk about the products and lead a disucssion.

Just sayin'

We are excepting proposals for talks right now.
http://conference.cali.org/2014/content/calicon14-call-speakers

John

On Fri, Feb 14, 2014 at 10:59 AM, Johnson, Cyndi <johnson@law.unm.edu> wrote:
Our new Dean came from Pitt Law. He's the one who sparked my interest in this (OK, mostly because it's a performance goal for next year...I had no prior knowledge of this topic) as his colleague, Kevin Ashley, co-developed SWoRD. He has some publications with case studies.
http://www.law.pitt.edu/people/full-time-faculty/kevin-d-ashley

I don't know if our faculty are interested in doing peer-to-peer reviews but since the Dean is, methinks they will be, too.

Cyndi Johnson
Director/Assistant Dean for Information Technology
UNM School of Law
(505) 277-0695

-----Original Message-----
From: teknoids-bounces@ruckus.law.cornell.edu [mailto:teknoids-bounces@ruckus.law.cornell.edu] On Behalf Of Elmer Masters
Sent: Friday, February 14, 2014 9:53 AM
To: Teknoids
Subject: Re: [teknoids] More on peer-to-peer reviews

Now this is interesting.
I can tell you that over the years we've heard from a number of law professors who were interested in peer-review-ish things that allowed law students to review and grade/rate one anothers' work. The Chronicle article points to 2 systems that do this sort of thing, both developed with, among other things, NSF money. SWoRD is a commercial product now, exclusively licensed by UPitt to Panther Learning. The other, Expertiza, is an open source project out of NC State, https://github.com/expertiza/expertiza.

Are any Teknoids aware of any faculty at their schools using either of these? Have you heard from any faculty who might be interested in doing this sort of thing? Have any of you had any experiences with these systems or something like them?

Happy Friday,
Elmer.

On Fri, Feb 14, 2014 at 10:17 AM, Johnson, Cyndi <johnson@law.unm.edu> wrote:
> The Dean shared this with me this morning. SWoRD is the program his colleague at Pitt Law helped develop.
> http://chronicle.com/blogs/future/2014/02/12/why-it-makes-sense-for-st
> udents-to-grade-one-anothers-papers/
>
>
> Cyndi Johnson
> Director/Assistant Dean for Information Technology UNM School of Law
> (505) 277-0695
>
> _______________________________________________
> You are currently subscribed to teknoids as: emasters@cali.org.
> To unsubscribe send a blank email to
> teknoids-leave@ruckus.law.cornell.edu
> --
> See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.

--
Elmer R. Masters
Center for Computer-Assisted Legal Instruction
emasters@cali.org 773-332-7508
_______________________________________________
You are currently subscribed to teknoids as: johnson@law.unm.edu.
To unsubscribe send a blank email to teknoids-leave@ruckus.law.cornell.edu
--
See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.
_______________________________________________
You are currently subscribed to teknoids as: jmayer@cali.org.
To unsubscribe send a blank email to teknoids-leave@ruckus.law.cornell.edu
--
See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.

--
----------
John Mayer
Executive Director
Center for Computer-Assisted Legal Instruction/CALI
565 West Adams
Chicago, IL 60661
312-906-5307
312-906-5280 - fax
jmayer@cali.org
http://www.cali.org
twitter.com/johnpmayer
----------

RE: More on peer-to-peer reviews

I don't know that this is an issue, but does FERPA have an impact here?
Ken

Kenneth J. Hirsh
Director of the Law Library and I.T.
Professor of Practice
University of Cincinnati College of Law
ken.hirsh@uc.edu
(513) 556-0159

-----Original Message-----
From: teknoids-bounces@ruckus.law.cornell.edu [mailto:teknoids-bounces@ruckus.law.cornell.edu] On Behalf Of Johnson, Cyndi
Sent: Friday, February 14, 2014 10:17 AM
To: 'Teknoids'
Subject: [teknoids] More on peer-to-peer reviews

The Dean shared this with me this morning. SWoRD is the program his colleague at Pitt Law helped develop.
http://chronicle.com/blogs/future/2014/02/12/why-it-makes-sense-for-stud...

Cyndi Johnson
Director/Assistant Dean for Information Technology UNM School of Law
(505) 277-0695

_______________________________________________
You are currently subscribed to teknoids as: hirshkh@ucmail.uc.edu.
To unsubscribe send a blank email to teknoids-leave@ruckus.law.cornell.edu
--
See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.
_______________________________________________
You are currently subscribed to teknoids as: tekpal@teknoids.net.
To unsubscribe send a blank email to teknoids-leave@ruckus.law.cornell.edu
--
See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.

RE: More on peer-to-peer reviews

Ken,

I believe that peer-edited assignments are not considered educational records under FERPA until the grade has been recorded. It also appears that the systems referenced in the article allow students to use pseudonyms and feedback is only reviewable by the author or the professor.

None of this is legal advice, of course.

Kris

-----Original Message-----
From: teknoids-bounces@ruckus.law.cornell.edu [mailto:teknoids-bounces@ruckus.law.cornell.edu] On Behalf Of Hirsh, Kenneth (hirshkh)
Sent: Friday, February 14, 2014 10:27 AM
To: Teknoids
Subject: [teknoids] RE: More on peer-to-peer reviews

I don't know that this is an issue, but does FERPA have an impact here?
Ken

Kenneth J. Hirsh
Director of the Law Library and I.T.
Professor of Practice
University of Cincinnati College of Law
ken.hirsh@uc.edu
(513) 556-0159

-----Original Message-----
From: teknoids-bounces@ruckus.law.cornell.edu [mailto:teknoids-bounces@ruckus.law.cornell.edu] On Behalf Of Johnson, Cyndi
Sent: Friday, February 14, 2014 10:17 AM
To: 'Teknoids'
Subject: [teknoids] More on peer-to-peer reviews

The Dean shared this with me this morning. SWoRD is the program his colleague at Pitt Law helped develop.
http://chronicle.com/blogs/future/2014/02/12/why-it-makes-sense-for-stud...

Cyndi Johnson
Director/Assistant Dean for Information Technology UNM School of Law
(505) 277-0695

_______________________________________________
You are currently subscribed to teknoids as: hirshkh@ucmail.uc.edu.
To unsubscribe send a blank email to teknoids-leave@ruckus.law.cornell.edu
--
See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.
_______________________________________________
You are currently subscribed to teknoids as: krisn@gsu.edu.
To unsubscribe send a blank email to teknoids-leave@ruckus.law.cornell.edu
--
See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.
_______________________________________________
You are currently subscribed to teknoids as: tekpal@teknoids.net.
To unsubscribe send a blank email to teknoids-leave@ruckus.law.cornell.edu
--
See the web interface at http://ruckus.law.cornell.edu/mailman/listinfo/teknoids to get your list password, unsubscribe, and view your list settings.