You couldn’t expect a guy with a doctorate in the politics of education to let the education portion of Wednesday night’s presidential debate go unchecked, could you?

Apparently, both candidates support charter schools.  No surprise from McCain; the Republican party tends to support most forms of school choice (that’s a gross generalization, but I’ll live with that for now). That Obama supports charter schools signals an interesting policy shift, assuming that Obama’s stance is representative of the Democraticy party as a whole (which it may very well not be).  I’m personally pretty mixed on charter schools.  On one hand, I think any policy or set of policies based in free market principles where perfect information on the part of consumers is assumed is highly problematic in the field of education.  On the other hand, these days I’m for anything that attempts to disrupt the status quo in public education.

And, speaking of “perfect information,” both candidates at least implied that charter schools “work” or that they are “effective” in some way (as opposed to voucher programs, where there seemed to be some disagreement).  Well, that’s less than perfect information.  Consider this study conducted as part of NAEP’s pilot study of charter school performance in 2003.  According to the executive summary for the report, “After adjusting for student characteristics, charter school mean scores in reading and mathematics were lower, on average, than those for public noncharter schools.”

I also bring your attention to more recent research conducted by colleagues and “social associates” (I’m not sure I can call them “friends,” but I have been out socially with them on multiple occasions) Sarah and Chris Lubienski.  Based on their analyses of NAEP data, Sarah and Chris concluded that “charter schools, privately operated and publicly financed, did significantly worse than public schools in the fourth grade, once student populations were taken into account.”

(BTW, teachable moment…the next sentence in the NYT article is as follows: “In the eighth grade, it found, students in charters did slightly better than those in public schools, though the sample size was small and the difference was not statistically significant.”  That’s a nonsensical statement.  If the differences were not statistically significant, then nobody did better than anybody else; not even slightly better.  So, the first part of the sentence cannot logically precede the second part.  This bugs me!)

The body of research on charter schools and school choice policies more generally has become overly politicized.  There are too many researchers with agendas dabbling in that field, and too many policy advocates who cherrypick a single study to support their argument.  However, in my reasonably well-informed opinion, the two studies above are as “independent” as they come.

So, Senators Obama and McCain, I’m in favor of exploring any and all educational policy options, including choice-based alternatives.  But, let’s please not mislead the American public.

Tags: charter schools, choice, education, election, NAEP, policy

Continuing my sniffing through the NAEP Data Explorer, today I “explored” differences in digitally-infused pedagogy by race.  One of the items on the background questionnaire of the 8th grade NAEP in 2007 was as follows: “When you are doing math for school or homework, how often do you use these different types of computer programs?”  One of the listed programs was “A program to practice or drill on math facts (addition, subtraction, multiplication, division).”   Looking at the results for that item disaggregated by race, we get the following (click on image to enlarge):

Overall, African-American students are much more likely to use computers to practice or drill on math facts than White students.  Given the significant achievement gap that exists, these differences partly explain why, overall, the there is a negative correlation between using computers to practice or drill on math facts and math achievement.  I can’t be entirely sure about the degree to which race confounds that overall relationship without access to the raw (restricted-use) NAEP data.

But, more importantly, is the figure above problematic?

Tags: computers, drill, math, NAEP

One of my posts from almost four months ago has been resurrected by comments from Tina K. and Amir.  In that post, I suggested I’d do some more digging.  So, I dug.

Some background…these are NAEP data with tables and statistics generated by the NAEP Data Explorer.  The NDE is an awesome (free!) tool for analyzing NAEP data.  It’s kinda amazing to me that more folks, including the media, haven’t picked up on this tool to do some really quick and easy data analysis.  Anyway, to satisfy the inquiries of Amir and particularly Tina, I analyzed 8th grade data from the 2007 NAEP administration.  The 8th grade assessment includes the best “type of computer” use data; i.e. we can break down computer use by some specific applications.  That’s what I did.  The math achievement results disaggregated by response category follow:

[NOTE: click on images to enlarge them]

So, quite clearly, the same results appear as with the 4th grade data in my earlier post.  The group of students who never or hardly ever use computers score significantly higher than the other groups, across all applications.  Again, I don’t know anything about those students demographically.  But, still…

Going one step further, I ran a regression analysis with four of the independent variables (i.e. the “types” of uses).  The NDE would only allow me to use four; it’s a statistical/psychometric thing…don’t ask.  So, I took out word processing and drawing as those seemed likely the most remotely associated with math achievement.  The results are as follows (again, click on the image to enlarge):

Make sense? Yeah, I know, unlikely. Unless you are well versed and regularly practiced in regression analysis, there’s no reason that would make any sense to you. So, let me try to summarize some key results:

• Of all the variance in math achievement, differences in these four types of computer use for math account for 16%. That’s not that high; not terrible, but it’s safe to say that, overall, computer use for math does not explain much of why kids differ on their math scores.

The independent variables are “contrast coded” which is the right way to do this analysis. But, it limits what we can say. That being said,…

• The average score for a student who never or hardly ever uses computers in any of those ways is 291.
• Students who use the Internet for math once every few weeks score a bit higher than the previously mentioned student (i.e. never or ever uses in any of the ways).  That is, by simply adding Internet use for math once every few weeks adds a little bit to the average score of the non-computer using student.
• Same story for using graphing programs for charts.
• Adding Internet use once every few weeks AND graphing programs once ever few weeks has a cumulative positive effect on the non-computer using student (again, though, VERY small positive effect).
• The more frequently kids use math programs to drill on math facts, the lower they score.

So, there you have it.  I’ll likely play around a bit more with the NDE to see what else I find with respect to other subjects and other uses of computers.  Fun times!

Tags: achievement, math, NAEP, technology