And now back to our regularly scheduled program…

blogging, higher ed. August 21st, 2008

Haven’t been writing/posting here much.  Had to prioritize putting together my tenure portfolio.  Having rid my shoulders of that weight (literally and figuratively), I look forward to writing more here.  For now, I thought I’d let you know what I wrote about my blog in my tenure narrative.  First, I began my section on “scholarship” with the following quote from Dewey’s Logic: The Theory of Inquiry:

In scientific inquiry, every conclusion reached, whether of fact or conception, is held subject to determination by its fate in further inquires…The conditional status of scientific conclusions (conditional in the sense of subjection to revision in further inquiry) is sometimes used by critics to disparage scientific “truths” in comparison with those which are alleged to be eternal and immutable. In fact, it is a necessary condition of continuous advance in apprehension and in understanding.

Then, in making the claim that a blog can be a form of scholarship, I wrote:

Since January 2008, I have explored a new mode of publishing. As a blogger at Educational Insanity (http://edinsanity.com), I have come to firmly believe that I am engaging in a relevant and important form of scholarship. Consistent with Dewey’s theory of inquiry and my beliefs about scholarship, I use my blog as a space to make knowledge claims; assertions that are conditional on their fate by further inquiries. Those inquiries come from peers, most of whom are educators in one form or another. In other words, blogging affords a pure form of peer review. The “blogosphere,” and especially the “edublogosphere,” is wonderfully rigorous and relentless in its review process; knowledge claims without sufficient warrants are regularly challenged. Blogging, for me, is very much a scholarly endeavor and satisfies me as a public intellectual.

Tags: , , ,

On being an informed consumer of educational research in the digital age

Ed. Leadership, Ed. Research, blogging, higher ed. August 5th, 2008

Been blogging less frequently lately, mostly because the tenure application deadline looms LARGE.  But, I got a bit riled up after reading an article that Kevin Jarrett pointed out via Twitter.

Blogging under the auspices of The Wall Street Journal (a highly respectable publication), John J. Edwards III wrote about a forthcoming book by two sociologists at the University of Texas-Arlington.  He surely learned of this book through a press release issued by the Office of Media Relations at UT-A.  I think it’s great that the folks in that office are promoting this book.  In fact, the public relations guru that works in my unit at VCU will be publishing an article about me and my blogging/professional networking in the next issue of our alumni magazine.

I do, however, have a couple of problems with this press release and the associated blog post by Mr. Edwards.  First, Edwards notes only that the book is “forthcoming.”  The press release says that “[t]he book is being published…with the release date to be announced.”  So, not only is the book not available to the public yet, but there isn’t even a date for release yet.  I don’t have a ton of experience with book publishers, but I have plenty of data from experiences with colleagues.  And I’m guessing that without even a date for release, we won’t see this book for a while.

That’s highly problematic.  When I read articles about educational research in the popular media, I’m instantly skeptical.  Not skeptical as in doubtful; but skeptical as in “I’m going to have to see the actual text of the report/article/book myself” so that I can make my own meaning of it.  Here, all I’ve got to go on is one blogger’s account of the book.  Furthermore, there’s no indication that Edwards read the book himself.  He quotes directly from the press release.  YET, amazingly (maybe not considering the usual credibility of the WSJ), there are dozens and dozens (I couldn’t count) of comments to the post.  I understand that Edwards used the press release to ask a couple of otherwise banal questions to his readers, but wouldn’t we all be better served if we had access to the book itself?  Wouldn’t the discussion within the comments be a more interesting and more informed discussion?

My department is launching a new Ed.D. program in educational leadership this coming fall semester.  In planning the program, we’ve had some really good and really important discussions about the sorts of skills and dispositions school leaders need to have.  I’ve been most interested in our conversations around “inquiry.”  There, we’ve concluded that school leaders need to be informed and critical consumers of research.  In fact, we’re working on a case/module where the doc. students will be asked to consider, for example, new math software.  There will be various activities built into that case/module, and among them will be an exploration of the research base on math software.  In an era where schools are mandated to implement only research-based programs, it’s crucial for educational leaders and policymakers to not just accept what others say about the research base for a given program.  They need to know how to find and critique the research base themselves.  This becomes particularly important in the digital age, where access to information is not bounded by space or time and where anyone with an Internet connection can provide information.

I recognize that the media relations folks at UT-A were doing their jobs by creating advance buzz for a book to be published by two of their faculty members.  And, I realize that there’s nothing inherently wrong with using a press release as a departure point for a blog post.  But, I just think a disservice has been done to the educational community here.

My second problem has to do with the book itself and the way it’s portrayed in the news release and the blog post.  The language used suggests that these researchers have devised some kind of novel argument.  Consider: “The authors explore topics like time-use in schools; the confinement and physical disciplining of young bodies as they carry backpacks and sit at cramped desks; the stress on fine motor skills; the performance principle and grading; the performance principle and testing; the disunity of mind and body; vocationalism; a fetish of facts and factoids; rote learning and regurgitation; worksheet-driven learning; classroom authoritarianism and competitive school sports.”  Isn’t the verb “to explore” usually associated with charting new terrain?  Perhaps this stuff is new to the researchers, but haven’t they ever read anything by the likes of Alfie Kohn?  Even Gary Stager?  According to the UT-A website, Dr. Agger is a professor of sociology and the humanities housed in the Department of Sociology.  Same with his co-worker and wife, Dr. Shelton.  They are sociologists and apparently not especially sociologists of education.  So, maybe they are not as versed in the literature on progressive education.  Maybe they do reference that literature.

And, is their argument/contention based on new data they’ve collected and analyzed?  Or, are they synthesizing others’ research?  Or, are they simply theorizing?

But, see I can’t know any of this for sure.  And, apparently I won’t know for sure for a while because it’s not clear when the book will be available.  That’s what’s so infuriating here.  Rather than creating advanced buzz, the fine folks at the Office of Media Relations have just thoroughly annoyed me.  They’ve treated you and me as uncritical consumers of information.

Tags: , , ,

Pedagogical Improvement

assessment, higher ed., teaching July 21st, 2008

If you’ve ever taken a college or graduate level course, surely you’ve completed some kind of summative evaluation form at the end of the semester.  At Hofstra University, where I worked for 5 years before this past academic year, we called them CTRs (Course and Teacher Ratings).  They consisted of a bunch of Likert scale items (strongly disagree to strongly agree) and a few open-ended questions.  For the most part, students hated doing them and faculty members hated having to use them.  I didn’t love the wording of many of the items, but I always asked my students to please take them seriously as an opportunity to let me know how I was doing.  I told them that I would receive an analysis of the data and their actual responses to the open-ended items.

As part of applying for tenure at VCU, I have to demonstrate growth as an instructor.  So, I plugged the CTR data from my 5 years at Hofstra into EXCEL and discovered some very interesting things.  The graph below represents the data from a scale (composed of 5 items) that purports to be an overall measure of the course and the instructor.  The x-axis represents the time points from Fall 2002 to Spring 2007.  The y-axis represents the range of scores (which can range from 1 to 5).  For this particular scale, the lower the number the better.  But, I flipped the y-axis so that it looks like “better is higher;” a more standard look for such a line graph.  The blue line represents my ratings; the red line represents the average score of the other faculty members (including adjuncts) within the program area.

[NOTE: click on image for larger view]

I entered the professoriate with NO teaching experience.  I guest lectured once while I was getting a masters degree, but that was it.  Hofstra took a bit of chance on me in that respect and I am eternally grateful to them for that.  But, the graph clearly shows that my ratings were not as good early in my teaching career as they were last year.

I should also add that in my first couple of years as a professor, i was asked to teach a few sections of an undergraduate foundations of education course.  I thought I would really enjoy working with undergraduates considering a future as an educator.  But, after teaching a few semesters, I began to really dislike it.  I had a hard time dealing with the students’ limited understanding of and experiences with education.  Seemingly simple concepts such as “charter schools” were completely foreign to them.  My ratings were not terrible for those course sections, but my department chair and my colleagues and I decided that my time and energy was better spent working with graduate students.

Overall though, I think the graph tells an accurate and interesting story.  Quite simply, I’ve improved significantly as an instructor.  The more comfortable I’ve become in my own skin and the more I’ve been able to find my own voice, the more I’ve been able to engage my students.  That’s my interpretation of the data.

Academics bemoan the use of “quantitative” ratings of their work as instructors.  But, I think it’s critically important that we ask our students to reflect on their experiences in our classes and to provide us with data about our work.  I wonder how many of my P-12 colleagues/readers have similar systems in place to collect and analyze summative or formative data about their performance directly from their students.  Do you?

Tags: , ,