Archive for the 'Information Literacy' Category

Change We Can Afford

Wednesday, August 15th, 2012

Now that Mitt Romney has chosen his running mate, I’d like to return to a comment he made earlier in the campaign.

“I think this is a land of opportunity for every single person, every single citizen of this great nation. And I want to make sure that we keep America a place of opportunity, where everyone has a fair shot. They get as much education as they can afford and with their time they’re able to get and if they have a willingness to work hard and the right values, they ought to be able to provide for their family and have a shot of realizing their dreams.”

The key phrase is “as much education as they can afford.” Right now, our taxes provide a K-12 education to all children in this country free of charge. This drives conservatives crazy. Their fantasy is a free-market education system where schools have to compete for learner dollars. If a school isn’t making the grade, well, parents just won’t send their kids there and, bang, the education crisis is over.

And I have to admit that the position is consistent with their other ideals. Liberals believe that the government can be a force for good in people’s lives. Conservatives believe that it cannot be, that government interference is always unwelcome. So getting rid of government services like education and Social Security and Medicaid makes perfect sense to them.

Even their lopsided tax values make sense, in an odd sort of way. For you see, Romney tells us in the quote above that the ingredients of success are hard work and the right values. If you don’t have a job, that’s your fault. (Unless the president is a Democrat, in which case it’s his fault.) So the wealthy are a special class of people who deserve special consideration. They should get as much influence in government as they can afford.

It’s not surprising that Romney believes that his immense wealth is a direct function of his hard work and correct values. And it explains his cringe-worthy comments about the economic disparities between nations being due to culture. This is his worldview. The free market is a just God, and doles out rewards and punishments appropriately.

For obvious reasons, he doesn’t like to talk about this worldview very much. We only get the occasional glimpse of it through these “education” and “culture” slips when Romney commits the ultimate gaffe of speaking from the heart.

But with the selection of Paul Ryan as his running mate, he is signaling that this is not an accident, not a coincidence, not an occasional gaffe. Paul Ryan is the human embodiment of this philosophy. And it’s not just his adoration of Ayn Rand; his actions speak much louder than her words.

Paul Ryan’s plan phases out Medicare. It phases out Medicare. You hear that, PolitiFact? It phases out Medicare. Over the past few days, Republicans have been quick to point out that, under their plan, current seniors would not have their benefits affected. But after that, they phase out Medicare. Really. Under their plan, Medicare would be replaced by a voucher system which – just like their voucher proposal for education – would be underfunded and ultimately targeted for elimination.

And then seniors will get all of the health care they can afford.

Another Story

Tuesday, November 22nd, 2011

The Klaxon invaders lit up the starship corridor with weapons fire, as Alliance scientists and technicians dove for cover on the other end. Klaxons had a reputation for ruthless violence, but nothing could prepare you for your first encounter with them. It was likely to be your last.

This starship seemed an unlikely target. The captain recalled how a mundane scientific mission had turned noteworthy by the addition of the President of the Intergalactic Council, who decided to join the expedition as an observer. The scientists had been excited by the leader’s visit, and were eager to show him the important work they had been doing. But now, a Klaxon boarding party was attacking, and his life, all of their lives, were very much in danger.

A Klaxon pulse blast damaged a power generator, creating massive interference waves in the electromagnetic field within the ship, which rendered pulse weapons on both sides absolutely useless. What now? Hand-to-hand fighting? Klaxons weren’t known to be skillful in direct combat, but they could likely hold their own against a team of scientists with no battle experience.

Suddenly, the side hatch flew open, and there stood Will Daring, one of the two humans who had recently been taken from Earth, the planet they were currently orbiting. Telescopes had not yet been invented on their world, so it seemed safe to do the experiments close by. The captain had no idea how the male human had broken loose from his containment section, but he had bigger problems.

Will Daring walked halfway down the corridor. Was he fearless, or did he just not understand the threat the Klaxons posed? He bent to the floor to pick up one of the sharp wooden pikes that had been dislodged from its decorative place on the wall by the Klaxon weapons, and waved it menacingly in front of the invaders. The Klaxons took one look at the handsome eighteen-year-old human gesturing wildly with his makeshift lance, and decided it wasn’t worth the risk. They made a hasty retreat to their battleship, frightened off by no more than a boy holding a stick.

When he returned back to his hosts, the captain greeted him warmly. “You have saved the lives of this entire team, not to mention the President of the Intergalactic Council. We are all in your debt, Will Shake-Spear.” It was customary for Alliance captains to grant titles based on achievements in battle, and Will liked the way the moniker rang in his ear. “I have something for you,” the captain added slyly, beckoning Will to follow him into a side chamber.

Once the two men were alone, the captain handed Will a thick packet of paper, bound in a leather portfolio. Will looked through the pages and was surprised to find a collection of 55 plays: Hamlet, Macbeth, Love’s Labours Lost, Love’s Labour’s Won, the titles went on and on. “This is our gift to you, Will Shake-Spear,” the captain beamed, “a collection of plays for you to stage with your theatre company. We have analyzed your simple language, and have created combinations of words to appeal to the primate brains of your species. The stories have been taken from among the most popular in your culture, but the language patterns we’ve created are more complex than anything your world has ever seen.”

“What am I supposed to tell people,” Will responded, “that space aliens gave me these plays?”

“No, you must say that you yourself wrote them.”

“What sane person could possibly believe that?”

“Nevertheless, you must claim these plays as your own, or risk being condemned as a lunatic.”

Just then, the ship was rocked by an explosion. The Klaxons had fired on the science vessel and the ship’s systems were failing fast. The captain rushed to the bridge, while Will Daring ran back to the containment section where he and his companion had been kept. There he found the raven-haired beauty Anne Hathaway. Her bodice had been ripped, exposing the tops of her voluptuous breasts. For a moment, Will found himself captivated by her stunning allure before snapping back to the matter at hand. “We’ve got to get out of here!”

The two humans ran to the emergency hatch, but there were no escape chambers. By now, the damaged ship had broken orbit and had descended into the atmosphere of the planet below. Will Daring recalled a drawing he had seen by Leonardo Da Vinci, created over a century earlier. “I have an idea!” he bellowed over the sound of explosions erupting across the ship. Grabbing some nearby cloth, he created a makeshift parachute, grabbed Anne Hathaway, and jumped out of the hatch.

As the two floated gently to their home planet below, Anne Hathaway looked at Will Daring like he was the only man in the world. He had always felt she was unapproachable to him, nine years older and so impossibly lovely. But now they were closer than they had ever been. The landing was rough, but the two were unhurt. Nothing could hurt them now.

The explosion of the starship turned the sky a bright orange, creating a majestic backdrop for the most passionate kiss either of them had ever known. “Oh darling!” moaned Anne Hathaway breathlessly. “It’s pronounced Daring,” Will responded calmly, looking down at the bulky leather portfolio still in his hands, “but from now on, baby, you can call me Shakespeare!”

Film: Anonymous

Sunday, November 13th, 2011

I went to see Anonymous, the new Roland Emmerich film questioning the authorship of Shakespeare’s plays, with cautious anticipation. What I was not expecting was to be thoroughly entertained by a period-piece thriller fantasy, but I was! I loved this movie, and can’t wait to go see it again. Seriously.

Let’s set aside the question of whether or not the film is accurate. The film is wildly inaccurate. The notion that Shakespeare didn’t write the plays is not even the most egregious speculation offered by John Orloff’s cheeky screenplay. If anyone wants to stand outside the theatre and argue that, yes, this is all true, they should be treated about as seriously as someone making that claim about Star Wars or Waiting for Superman. But inside the theatre, we have license to suspend our disbelief. Call it historical fiction, alternate timeline, sci-fi fantasy, or whatever helps the medicine go down, but don’t miss Anonymous for political reasons.

The film is based on the premise that the plays we know as William Shakespeare’s were actually written by Edward De Vere, 17th Earl of Oxford. Unable to claim the plays as his own in a treacherous climate, he asks established playwright Ben Jonson to put his name on them. Jonson wants to keep his voice distinct from the nobleman’s, so an illiterate actor, one William Shakespeare, steps forward and claims the glory. Political maneuverings surrounding the question of who will succeed the aging Queen Elizabeth I create tension for Oxford, who finds that he can speak directly to the people through the voice of his celebrated front man. You see? It all makes perfect sense.

The visual depiction of Elizabethan London is stunning and believable. Rhys Ifans and Sebastian Armesto give outstanding performances as Oxford and Jonson. Vanessa Redgrave and Joely Richardson (her daughter) together create a powerful mutli-dimensional Elizabeth. If you can stomach the depiction of our beloved William Shakespeare as an opportunistic buffoon, he is played to comic perfection by Rafe Spall. But if it does bother you, please remember that Shakespeare himself is largely responsible for our present day image of King Richard III as a deformed child-murderer. Payback’s a bitch, Billy-Boy.

But his own depiction aside, I think Shakespeare is honored by this film. A running theme throughout the movie is that these simple words have the power to delight and to inspire, to incite riots and to seduce monarchs. Will some people come away with the idea that Shakespeare was a fraud? Maybe. But for every audience member who gets that impression, there will be another ten who are moved to find out more about these plays and poems. We get to hear quite a bit of the original language spoken by the magnificent Mark Rylance as Richard Burbage, and the see the power it wields. That’s the transcendent truth that rises above all of the fabrications. And that, ultimately, is what we take away from Anonymous.

May the Fourth…

Wednesday, May 4th, 2011

…be with you.

Today is Star Wars Day, and Shakespeare Geek and Bardfilm made sure that Shakespeare got in on the action. For my contribution… No, I’m not going to compare Luke Skywalker to Hamlet, at least not today. But I would like to share how the Star Wars franchise has made teaching Shakespeare just a little bit easier.

A series of three related dramatic works is called a trilogy. Four works make a tetralogy. Early in Shakespeare’s career, he wrote a tetralogy of plays about the English kings: Henry VI, Part One; Henry VI, Part Two; Henry VI, Part Three; and Richard III. The plays cover the span of events from 1422 to 1485, and are referred to collectively as the first tetralogy.

A bit later (though still early in his career), Shakespeare wrote another tetralogy of plays about the English kings: Richard II; Henry IV, Part One; Henry IV, Part Two; and Henry V. These plays were set earlier; they depict events that occurred from 1399 to 1415. This was the second tetralogy.

This seems pretty straightforward, but it could often cause confusion, even for graduate students. The second tetralogy takes place before the first tetralogy? How can that be? Why did he do it that way? Wait, which was the first tetralogy?

Everything changed with the release of Episode One: The Phantom Menace. Now, when I explain that Shakespeare wrote the first tetralogy before the second, but the second takes place before the first, I can enjoy their momentarily confused looks. I know I can just add “You know, like Star Wars…” and instantly see the clouds lift and light shine into the room. Since the second Star Wars trilogy, everyone understands the idea of a prequel series.

So thank you to Star Wars for making a hard thing easy. May Henry IV be with you!

The Hartfordian Theory

Wednesday, April 27th, 2011

The release of the birth certificate certainly proves that someone named Barack Obama was born in Hawaii in 1961. But Hartfordians don’t deny that Barack Obama exists; we just don’t believe that he is the current president. The Hartfordian theory is that the current President of the United States is actually former senator Christopher Dodd.

All of the questions surrounding Obama’s past are easy to reconcile, once you realize that his many accomplishments are actually those of Dodd. Much has been made of Obama’s 2004 keynote speech at the Democratic National Convention, a call for unity that thrust him into the national spotlight. But records from the time show that the real Barack Obama was only a state senator. The DNC would never have given him that kind of platform. Christopher Dodd was a United States senator, and potential presidential candidate. Clearly, it was Dodd who gave that speech.

In the Senate, the man from Hawaii stood in as a front for legislation that Dodd would have considered too controversial to put his own name on. For example, the Mercury Export Ban Act of 2008 was supposedly sponsored by “Senator Barack Obama.” But the true author of the bill left behind plenty of coded messages in the text, so posterity would have no doubt who really sponsored it. (Click below for a larger image.)

Anti-Hartfordian critics have pointed out that it is impossible for Dodd to have sponsored both Obama’s legislation and his own at the same time. But Dodd is one of the great legislative geniuses of all time, and was able to manage it without raising suspicion. In 2010, “President Barack Obama” signed into law the Dodd-Frank Wall Street Reform and Consumer Protection Act. The former president, George W. Bush, had been opposed to financial regulation. But the man from Hawaii takes office, and all of a sudden financial reform is on the table? Obviously, Dodd signed his own bill into law.

The idea that the President of the United States is Barack Obama is one of the greatest frauds ever perpetrated on the American people, despite overwhelming evidence that it is actually Chris Dodd. I guess people just see what they want to see.

A Choice to Make

Wednesday, April 13th, 2011

There is so much wrong with this article by Eric Hanushek that I fear that anything less than a line-for-line rebuttal will be woefully inadequate as a response. Out of consideration for my readers, I will refrain from providing one, and will rather try to focus on the most important points. Hanushek, of course, is the Stanford economist whose lurch into the field of education has driven much of the recent misguided effort towards “Reform” in today’s educational system. His article does a good job of summarizing his most crucial arguments, so it’s worth some time examining.

The title of the piece is “Valuing Teachers” and a brilliantly disingenuous title it is. Rather than using the word as we might use it (placing a high value on teachers), he is using it as an economist might (assessing the value of teachers). He is measuring how much teachers are worth. According to Hanushek, better teachers result in higher incomes for their students later in life. To make his case, he uses a series of unscientific leaps of logic that will yield easily to a few moments of rationality.

He notes that “a student with achievement (as measured by test performance in high school) that is one standard deviation above average can later in life expect to take in 10 to 15 percent higher earnings per year.” I have no reason to doubt his numbers.

But Hanushek is making the classic blunder of confusing correlation with causation. Do higher test scores in school directly cause higher incomes? Or is it possible that they may have common contributing factors? What about factors that the student brings in, such as intelligence, stamina, and motivation? Is it possible that parental income can be a factor in both standardized testing scores and future income? Hanushek’s famous value-added study attempted to isolate these factors, but he seems content to ignore them when citing this achievement/income connection.

And, as Diana Senechal points out, “there is no evidence (as far as I know) that students in the highest percentiles in high school are those who made the greatest gains on their standardized tests over the years. In fact, I suspect that most of them did pretty well on those tests all along.”

Using future income as a measure of teacher quality is even more outrageous than using test scores. How much does a Stanford professor make compared to a Wall Street hedge fund manager? Is that a function of the quality of education they received? In the interest of full disclosure, I should mention that I make significantly less than LeBron James. Did he have better teachers?

Hanushek’s solution is to “contemplate asking 5 to 10 percent of teachers to find a job at which they are more effective so they can be replaced by teachers of average productivity.” (Note to my boss: if it should ever become necessary to fire me, I would request that you instead contemplate asking me to find a job at which I am more effective.)

Hanushek’s solution – fire the bad teachers – is very simple, but it requires several assumptions that I don’t think we should be so quick to grant.

Assumptions

  1. Standardized tests accurately measure student achievement.
  2. The teachers whose students don’t make progress on the tests are the bad teachers.
  3. There is a line of average teachers at the door waiting to be hired.
  4. No factors other than teacher quality are significant.

Peruse this list, and note that Hanushek’s plan falls apart if even one of these assumptions is false. In fact, they all are.

Assumption: Standardized tests accurately measure student achievement.

False. The tests that students are given are deeply flawed indeed. Many of the questions do not test what they purport to test, and test-taking itself has become it’s own skill set that schools ignore at their own peril. If we’re careful, we can use some the results to identify areas in need of improvement. But the tests on the whole are way too idiosyncratic to use the overall scores as a basis for high-stakes decision making.

Assumption: The teachers whose students don’t make progress on the tests are the bad teachers.

False. In an August 2010 paper for the Economic Policy Institute, a team of highly distinguished education researchers laid out the case against the use of student test scores to evaluate teachers. Bottom line: It doesn’t work. Test scores are simply an ineffective statistical measure for identifying bad teachers. If you don’t find twenty pages of research from a panel of experts compelling, then you can read about this well-respected hard-working teacher who got slammed by a statistical formula.

Assumption: There is a line of average teachers at the door waiting to be hired.

False. In fact, teacher recruitment and retention is becoming a serious problem. A McKinsey study, Closing the Talent Gap, describes the decline in the teaching profession’s ability to compete in the labor market.

However, I suspect there is a bit of condescension towards the profession of teaching when we assume we can just go out and hire average teachers. The implication is that the average person would make an average teacher, rather than acknowledging that teaching requires a particular set of qualities (e.g., diligence, patience, intelligence, and a calling to want to do it) for someone to even be an average teacher. To glibly say that we can just fire the bad teachers and hire average ones is unintentionally insulting.

Assumption: No factors other than teacher quality are significant.

False. Hanushek anticipates this rebuttal, and is kind enough to provide examples of other factors that are not significant:

The initiatives we have emphasized in policy discussions—class-size reduction, curriculum revamping, reorganization of school schedule, investment in technology—all fall far short of the impact that good teachers can have in the classroom. Moreover, many of these interventions can be very costly.

Costly? I thought we were discussing what is most effective. Aren’t we having a national education crisis? Hanushek has moved past his role as researcher and now is making policy judgements. Danny Westneat argues effectively against the idea that class size is irrelevant, so I don’t have to. Teachers already know the importance of class size, and I suspect that the Reformers do as well. Similarly, other initiatives we take to improve education, costly or no, are based on research and accumulation of best practices. Even if we let Hanushek fire all of the bad teachers, we would still want to implement successful education initiatives. Sorry.

Neither side is happy with our current educational system. But Reformers seem to offer nothing but slapdash solutions that keep expenses low but ignore the facts on the ground. It seems, then, we have a choice to make. Do we want to have a public education system in this country? Many do not, and would rather see the free market take over education. Charter schools seem to be a first step in that direction, and I think the Reformers who tout them have become, wittingly or unwittingly, somewhat of a stalking horse for the movement against public education. Diane Ravitch, in her eloquent response to Waiting for Superman, discusses why charter schools aren’t the panacea they’re often held up as. She also discusses the impact of poverty on student achievement, and the dangers of ignoring it in the national discussion. Paying teachers more? Keeping class size down? Addressing the needs of high-poverty schools? It all seems so… costly.

That’s what it’s going to take, though. If we want a high-quality public education system, we’re going to have to pay for it. These may be troubled economic times, but really it’s just a question of priorities. If we’re going to have public education at all, we need to increase, not decrease, funding for it. We need to increase it by a lot. Reformer “solutions” only distract from the real issue. They want us to look at charter schools, but if we look closely enough, we’ll see that the most successful charter schools are able to spend much more per student than the public schools who are expected to emulate them.

And so, we must choose between abolishing public education and funding it adequately. Abolishing it is not really a choice at all, and would lead to an even worse crisis than we have now. But, if we can adjust our priorities and give our students the schools they deserve, then, as Dan Quayle said, “We are going to have the best educated American people in the world.” (Should we be blaming his teachers?)

It’s Funny Because It’s Not Funny

Sunday, March 6th, 2011

I recently saw a particularly poignant piece of graffito etched on a friend’s Facebook wall:

A public union employee, a tea party activist and a CEO are sitting at a table with a plate of a dozen cookies in the middle of it. The CEO takes 11 of the cookies, turns to the tea partier and says, “Watch out for that union guy. He wants a piece of your cookie.”

And while this might easily refer to any number of anti-labor sentiments, it seems most appropriate as a reaction to the current – inexplicable – War on Teachers that has been raging in the media lately.

If you haven’t seen last Thursday’s Daily Show, you really need to go watch it. In a brilliant piece at the top of the show, Jon Stewart demonstrates the hypocrisy of the right-wing talking heads when talking about teachers. Later, he interviews education truth-teller Diane Ravitch, who lays out the rest of the argument.

If you want to understand the conversations surrounding education reform, then – as Tom Tomorrow says in this week’s strip – that’s all you need to know.

It’s a Poor Workman Who Blames Yogi Berra: Artificial Intelligence and Jeopardy!

Wednesday, February 23rd, 2011

Last week, an IBM computer named Watson beat Ken Jennings and Brad Rutter, the two greatest Jeopardy! players of all time, in a nationally televised event. The Man vs. Machine construct is a powerful one (I’ve even used it myself), as these contests have always captured progressive imaginations. Are humans powerful enough to build a rock so heavy, not even we can lift it?

Watson was named for Thomas J. Watson, IBM’s first president. But he could just as easily have been named after John B. Watson, the American psychologist who is considered to be the father of behaviorism. Behaviorism is a view of psychology that disregards the inner workings of the mind and focuses only on stimuli and responses. This input leads to that output. Watson was heavily influenced by the salivating dog experiments of Ivan Pavlov, and was himself influential in the operant conditioning experiments of B.F. Skinner. Though there are few strict behaviorists today, the movement was quite dominant in the early 20th century.

The behaviorists would have loved the idea of a computer playing Jeopardy! as well as a human. They would have considered it a validation of their theory that the mind could be viewed as merely generating a series of predictable outputs when given a specific set of inputs. Playing Jeopardy! is qualitatively different from playing chess. The rules of chess are discrete and unambiguous, and the possibilities are ultimately finite. As Noam Chomsky argues, language possibilities are infinite. Chess may one day be solved, but Jeopardy! never will be. So Watson’s victory here is a significant milestone.

Much has been made of whether or not the contest was “fair.” Well, of course it wasn’t fair. How could that word possibly have any meaning in this context. There are things computers naturally do much better than humans, and vice versa. The question instead should have been in which direction would the unfairness be decisive. Some complained that the computer’s superior buzzer speed gave it the advantage, but buzzer speed is the whole point.

Watson has to do three things before buzzing in: 1) understand what question the clue is asking, 2) retrieve that information from its database, and 3) develop a sufficient confidence level for its top answer. In order to achieve a win, IBM had to build a machine that could do those things fast enough to beat the humans to the buzzer. Quick reflexes are an important part of the game to be sure, but if that were the whole story, computers would have dominated quiz shows decades ago.

To my way of thinking, it’s actually the comprehensive database of information that gives Watson the real edge. We may think of Ken and Brad as walking encyclopedias, but that status was hard earned. Think of the hours upon hours they must have spent studying classical composers, vice-presidential nicknames, and foods that start with the letter Q. Even a prepared human might temporarily forget the Best Picture Oscar winner for 1959 when the moment comes, but Watson never will. (It was Ben-Hur.)

In fact, given what I could see, Watson’s biggest challenge seemed to be understanding what the clue was asking. To avoid the complications introduced by Searle’s Chinese Room thought experiement, we’ll adopt a behaviorist, pragmatic definition of “understanding” and take it to mean that Watson is able to give the correct response to a clue, or at least a reasonable guess. (After all, you can understand a question and still get it wrong.) Watching the show on television, we are able to see Watson’s top three responses, and his confidence level for each. This gives us remarkable insight into the machine’s process, allowing us a deeper level of analysis.

A lot of my own work lately has been in training school-based data inquiry teams how to examine testing data to learn where students need extra help, and that work involves examining individual testing items. So naturally, when I see three responses to a prompt, I want to figure out what they mean. In this case, Watson was generating the choices rather than simply choosing among them, but that actually makes them more helpful in sifting through his method.

One problem I see a lot in schools is that students are often unable to correctly identify what kind of answer the question is asking for. In as much as Watson has what we would call a student learning problem, this is it. When a human is asked to come up with three responses to a clue, all of the responses would presumably be of the correct answer type. See if you can come up with three possible responses to this clue:

Category: Hedgehog-Pogde
Clue: Hedgehogs are covered with quills or spines, which are hollow hairs made stiff by this protein

Watson correctly answered Keratin with a confidence rating of 99%, but his other two answers were Porcupine (36%) and Fur (8%). I would have expected all three candidate answers to be proteins, especially since the words “this protein” ended the clue. In many cases, the three potential responses seemed to reflect three possible questions being asked rather than three possible answers to a correct question, for example:

Category: One Buck or Less
Clue: In 2002, Eminem signed this rapper to a 7-figure deal, obviously worth a lot more than his name implies

Ken was first to the buzzer on this one and Alex confirmed the correct response, both men pronouncing 50 Cent as “Fiddy Cent” to the delight of humans everywhere. Watson’s top three responses were 50 Cent (39%), Marshall Mathers (20%), and Dr. Dre (14%). This time, the words “this rapper” prompted Watson to consider three rappers, but not three potential rappers that could have been signed by Eminem in 2002. It was Dr. Dre who signed Eminem, and Marshall Mathers is Eminem’s real name. So again, Watson wasn’t considering three possible answers to a question; he was considering three possible questions. And alas, we will never know if Watson would have said “Fiddy.”

It seemed as though the more confident Watson was in his first guess, the more likely the second and third guesses would be way off base:

Category: Familiar Sayings
Clue: It’s a poor workman who blames these

Watson’s first answer Tools (84%) was correct, but his other answer candidates were Yogi Berra (10%) and Explorer (3%). However Watson is processing these clues, it isn’t the way humans do it. The confidence levels seemed to be a pretty good predictor of whether or not a response was correct, which is why we can forgive Watson his occassional lapses into the bizarre. Yeah, he put down Toronto when the category was US Cities, but it was a Final Jeopardy, where answers are forced, and his multiple question marks were an indicator that his confidence was low. Similarly cornered in a Daily Double, he prefaced his answer with “I’ll take a guess.” That time, he got it right. I’m just looking into how the program works, not making excuses for Watson. After all, it’s a poor workman who blames Yogi Berra.

But the fact that Watson interpreted so many clues accurately was impressive, especially since Jeopardy! clues sometimes contain so much wordplay that even the sharpest of humans need an extra moment to unpack what’s being asked, and understanding language is our thing. Watson can’t hear the the other players, which means he can’t eliminate their incorrect responses when he buzzes in second. It also means that he doesn’t learn the correct answer unless he gives it, which makes it difficult for him to catch on to category themes. He managed it pretty well, though. After stumbling blindly through the category “Also on Your Computer Keys,” Watson finally caught on for the last clue:

Category: Also on Your Computer Keys
Clue: Proverbially, it’s “where the heart is”

Watson’s answers were Home is where the heart is (20%), Delete Key (11%), and Elvis Presley quickly changed to Encryption (8%). The fact that Watson was considering “Delete Key” as an option means that he was starting to understand that all of the correct responses in the category were also names of keys on the keyboard.

Watson also is not emotionally affected by game play. After giving the embarrassingly wrong answer “Dorothy Parker” when the Daily Double clue was clearly asking for the title of a book, Watson just jumped right back in like nothing had happened. A human would likely have been thrown by that. And while Alex and the audience may have laughed at Watson’s precise wagers, that was a cultural expectation on their part. There’s no reason a wager needs to be rounded off to the nearest hundred, other than the limitations of human mental calculation under pressure. This wasn’t a Turing test. Watson was trying to beat the humans, not emulate them. And he did.

So where does that leave us? Computers that can understand natural language requests and retrieve information accurately could make for a very interesting decade to come. As speech recognition improves, we might start to see computers who can hold up their end of a conversation. Watson wasn’t hooked up to the Internet, but developing technologies could be. The day may come when I have a bluetooth headset hooked up to my smart phone and I can just ask it questions like the computer on Star Trek. As programs get smarter about interpreting language, it may be easier to make connections across ideas, creating a new kind of Web. One day, we may even say “Thank you, Autocorrect.”

It’s important to keep in mind, though, that these will be human achievements. Humans are amazing. Humans can organize into complex societies. Humans can form research teams and develop awesome technologies. Humans can program computers to understand natural language clues and access a comprehensive database of knowledge. Who won here? Humanity did.

Ken Jennings can do things beyond any computer’s ability. He can tie his shoes, ride a bicycle, develop a witty blog post comparing Proust translations, appreciate a sunset, write a trivia book, raise two children, and so on. At the end of the tournament, he walked behind Watson and waved his arms around to make it look like they were Watson’s arms. That still takes a human.

UPDATE: I’m told (by no less of an authority than Millionaire winner Ed Toutant) that Watson was given the correct answer at the end of every clue, after it was out of play. I had been going crazy wondering where “Delete Key” came from, and now it makes a lot more sense. Thanks, Ed!

Can You Explain What Internet Is?

Wednesday, February 2nd, 2011

Here’s a video that can be enjoyed both by younger viewers and older viewers, but in very different ways.

This clip of The Today Show is apparently from January 1994. The hosts ponder over a new entity that seems to be cropping up all over the place, the strange and magical new Internet. If it’s not obvious, the person on the left is Katie Couric, the current anchor of The CBS Evening News.

The point of this is not to make fun of the hosts who, 17 years ago, could hardly have been expected to understand how ubiquitous the Internet would become in our lives. But the clip is intriguing as a frozen moment in time, recalling the days when you had to check the newspaper for movie listings and you had to buy stamps to mail a letter. Back then, the thought of someone like me writing something like this and having someone like you come here and read it would have been unthinkable.

Now if you’ll excuse me, I’m going outside to do a video chat on my mobile phone.

Accountability

Tuesday, February 1st, 2011

I was talking to my graduate students about the literacy standards last night, and predictably got pulled off on a tangent about accountability. I found myself making a point that I’ve alluded to before, but it’s worth making explicit now.

Robert Benchley famously said “There are two kinds of people in the world: those who divide the world into two kinds of people, and those who don’t.” I will put myself in the former category when I say that, generally, there are two kinds of people who talk about standards and accountability.

The first believes that anything worth doing is worth doing well. In order to make sure we’re doing the best job we can, it’s important to measure our results, so we can identify areas for potential improvement and apply strategies for intervention where they will do the most good.

The second believes that taxpayer-funded education is one of the evils of socialism and must be eradicated. In order to make the necessary changes, evidence must be gathered that the public education system is a failure, so that arguments to turn education over to the free market will be more persuasive.

And my point was that, when you hear someone talking about standards and accountability, it’s important to know which of these two groups that person is in.