tag:blogger.com,1999:blog-13713642.post112722401039561492..comments2024-03-28T11:03:41.050-05:00Comments on Unlocked Wordhoard: "Worst Practices" in Studying Colleges/UniversitiesDr. Richard Scott Nokeshttp://www.blogger.com/profile/01348275071082514870noreply@blogger.comBlogger3125tag:blogger.com,1999:blog-13713642.post-1127399179936631352005-09-22T09:26:00.000-05:002005-09-22T09:26:00.000-05:00Finally, while academics may grind their teeth abo...<EM>Finally, while academics may grind their teeth about the U.S. News rankings, they are nevertheless accepted by the consumers of the service (parents and students) as a useful benchmark.</EM><BR/><BR/>Are they really? Has anyone done a study to see what parents and students think about the U.S. News rankings?<BR/><BR/>And really, whether they are "accepted" as a useful benchmark is irrelevant to the "truth" of their "benchmarkness."<BR/><BR/>To use another silly example: The Associated Press puts out a preseason football ranking of teams that haven't played yet. And people accept this as a useful benchmark. Yet as we saw in the first three weeks of the season, a lot of those rankings were pure crap.<BR/><BR/>Such may not be *totally* the case with the U.S. News rankings, but enough so that they are worth questioning.<BR/><BR/>And besides, why not a random sample? Even using carnegie rankings to gather a list?<BR/><BR/>But more to the point of the actual study, the conclusion states (paraphrased) that "universities should use best practices," but doesn't tell us <EM>why?</EM> What *effects* were seen by universities that used best practices? Did their constituencies even *notice* the efforts? Did the constituencies see these added efforts as valuable to their experience? These are not questions that can be answered by a quick survey of web sites, but through more substantive methodologies like survey research or focus groups.<BR/><BR/>And really, connecting those two dots is where the study fails.<BR/><BR/>Bryan S.<BR/>Arguing with signpostsAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-13713642.post-1127323258422197892005-09-21T12:20:00.000-05:002005-09-21T12:20:00.000-05:00Thanks for your comments. I'm still not clear, tho...Thanks for your comments. I'm still not clear, though, on why you felt that the actions of the disinterested are more interesting. I'm wondering (and maybe it is not polite to ask) if the implication you are getting at when you write: "First, these institutions are touted as being the best – having the best students, faculty, and infrastructure. If anyone has the processes and resources to respond in the best way, it should be these institutions" -- if the implication there is that these schools aren't what they are cracked up to be? Or perhaps you are implying that aggressive action by high-profile schools unaffected is a cheap PR tactic?<BR/><BR/>I guess the reason I find it so confusing is that, on the one hand, the viewpoint of the practices in your study was "Katrina didn't affect us," but your explanation is that you only wanted to study schools for which that viewpoint was true. Why would you criticize schools for having an accurate view? Is this ultimately considering Katrina a dry run for when crises happen in their own back yards?<BR/><BR/>So, to sum up my confusing and confused questions, if this methodology shows you exactly what you wanted to know ... was this ultimately a question about web design, and not about the institutions themselves?Dr. Richard Scott Nokeshttps://www.blogger.com/profile/01348275071082514870noreply@blogger.comtag:blogger.com,1999:blog-13713642.post-1127315333707331082005-09-21T10:08:00.000-05:002005-09-21T10:08:00.000-05:00As the author of the report, let me clarify some p...As the author of the report, let me clarify some points. In your post you note that you felt the report didn't study the relevant schools -- in your view, it should have been about the schools in the Gulf Coast region. For the purpose of my report -- which was to study Best Practices in Web site design and structure -- it is precisely those schools I had to avoid.<BR/><BR/>The report focused on the top 30 U.S. colleges/universities as defined by U.S. News (none of which are in the region, as you note) for three reasons. First, these institutions are touted as being the best – having the best students, faculty, and infrastructure. If anyone has the processes and resources to respond in the best way, it should be these institutions. Second, they weren’t impacted by Hurricane Katrina – so they had no logistical hurdles to overcome. Their servers weren’t down, their people were available, etc. Third, because their responses were more muted, how they behaved was more interesting. For example, Tulane knew it had to respond – the university was in crisis mode. The affected colleges were expected to respond in Best Practice mode; and if they didn’t, it wouldn’t be easy to figure out if they didn’t due to logistical problems.<BR/><BR/>Therefore, how did these more disinterested institutions redesign their Web sites to talk about a crisis to their constituents, given that they had everything going for them? While a Gulf Coast universities story might be more interesting from a human interest point-of-view, these institutions were not the best laboratory for talking about differing responses to Web site design issues in a controlled environment.<BR/><BR/>While your argument that alumni wouldn't think of checking their college's Web site for news seems to make sense in the abstract, it wasn't borne out by my experience. I attended Williams College, and a lot of Williams alumni did go to the college Web site looking for information about their friends and former classmates.<BR/><BR/> Finally, while academics may grind their teeth about the U.S. News rankings, they are nevertheless accepted by the consumers of the service (parents and students) as a useful benchmark. It's my experience that there is little difference between schools 1 and 2, but certainly some difference between a school ranked 1 and another ranked 50. I chose to use the U.S. News rankings because they are well-known and served as a useful proxy for schools that have large endowments, solid infrastructure, and have relatively sophisticated Web sites.Anonymousnoreply@blogger.com