Archive for August, 2009

A Conference on Assessment

Tuesday, August 18th, 2009

On September 11-13, 2009, the University of Denver will host a conference, Legal Education at the Crossroads, v. 3 – A Conference on Assessment:

This conference responds to the calls for better methods of student, teaching, and institutional assessment made in the Carnegie Report, Sullivan, et al., Educating Lawyers: Preparation for the Profession of Law(2007) and in Stuckey et al., Best Practices for Legal Education (2007). The conference will be particularly useful for law teachers and deans interested or engaged in developing and implementing outcomes measures.

Gary Rosin

Peer Assessments and the Great Divide

Tuesday, August 18th, 2009

Earlier this year, Paul Caron listed the peer assessment scores from the 2010 US News law school rankings. The rating scale runs from 1 (highest) to 5 (lowest). Here’s how the numbers fell out:

Average: 2.55

Percentiles
     25th between 1.9 (22nd) and 2.0 (30th)
     50th between 2.3 (47th) & 2.4 (55th)
     75th about 2.9

The distribution (with a normal reference curve) looks like this:

Distribution of 2010 US News Peer Asessments

Looking at the actual scores, the distribution is decidedly non-normal.  Of particular interest are the “fat tails”–the distributions of the top and bottom 25 percent, which are much larger than would be expected with a normal distribution.  The top 75% of law schools have peer assessments have a range of 1.5 points (1.4 to 1.9), while the for bottom 25%, peer assessments have a slightly larger range, 1.7 points (from 3.1 to 4.8).

Assessing Student Learning: A Report from the Eastern Front

Tuesday, August 18th, 2009

Educating Lawyers:  Preparation for the Profession of Law (2007) started it (again).  Then the ABA adopted minimum Bar passage standards for law schools (Interpretation 301-6 of the Standards for Law School Approval).  Then the ABA’s Standards Review Commmittee appointed a Special Committee on Outcome Measures (Report and Comments).  The upshot is that law schools are going to be paying much more attention to assessing student learning.  Law schools are latecomers at this.  You might even say we’re a back-water.  The rest of the American academy started a while ago, not to mention grades K-12 and No Child Left Behind.

On the Brainstorm blog on the Chronicle of Higher Education website, Sara Goldrick-Rab asks “Is Our Student’s Learning?”  She discusses a recent presentation, at the meeting of the American Sociological Association, on the CLA Longitudinal Study.  According to Goldrick-Rab, one of the findings is that

[S]tudents who start behind tend to stay behind; put another way those inequalities at the starting gate are consistent.

Certainly, that’s what my analysis of law-school first-time Bar-passage rates shows:  Law schools whose students have lower LSAT scores have lower Bar passage rates.  See Unpacking the Bar:  Of Cut Scores and Competence, 32 J. Legal Prof. 67 (2008) (submission draft).

For law schools with a greater number of at-risk students, the question is whether better instructional practices and assessment, as well as academic support, can improve student learning.

Gary Rosin

Rankings: Peer Assessments and Test Scores

Monday, August 17th, 2009

Inside Higher Ed has an interesting piece, More Questions on Rankings, on an article by Kyle Sweitzer (Michigan State) & J. Fredericks Volkwein (Penn State), Prestige Among Graduate and Professional Schools: Comparing the U.S. News’ Graduate School Reputation Ratings Between Disciplines (forthcoming in Research in Higher Education).  The Inside Higher Ed notes that the article concludes that

Peer reviewers also seem to place a high emphasis on standardized test scores, with the average score significant for all of the graduate categories except education. Test scores also appear to have the greatest influence on the reputation (as measured by the survey) in law and medical schools.

Update:  Over on TaxProf, Paul Caron discusses the article in Peer Reputation:  Size Matters, 

Gary Rosin