MOOCs, Meet Turing or Is It Socrates?

It dawns on me that Turing tests may have a role for the future of education and MOOCs. In short, can one create a Socratic style system that automates probing what a student knows? A combination of gamification (not a great word) and machine learning might allow a system to press a student to express more than “I memorized X” and move to explaining why in a discussion. If I understand the simple idea of Turing tests, one should not know that the other side is a machine in a conversation. It should be a discussion. That is what a professor does in Socratic method. There would likely be a wall of sorts where the student has no more questions or perhaps the machine determines that some level of mastery is in place. To me, a key reason to press questions is to see whether the student can answer why their claim or understanding is correct. When they can do that they may at last “own” the idea and then do something with it. Insofar as the key is to keep questioning, this approach will hit a different wall where a person may need to engage with the student. In addition, when a student asks something the teacher has not considered, a “does not compute” response will likely be a let down. Assuming one solves that personal dimension, that moment would be a signal to shift to other resources including instructors to go deeper into the issue. Otherwise we are left with test passing equals knowledge. As Erika Christakis put it, we have:

a broken system built on the dangerous misconception that testing is a proxy for actual teaching and learning. Somehow, along the path of good intentions, testing stopped being seen as a diagnostic tool to guide good instruction and became, instead, the instruction itself. It’s as if a patient were given a biopsy, learned she had cancer and was then told that no further medical treatment was necessary. If that didn’t sound quite right, we could just fire the doctor who ordered the test or scratch out the patient’s results and mark “cured” in the file.

Although I am leery of easy solutions, I think that a system that may prod a student to see what they know and then come to a teacher to gain further insight and evaluate what they grasp would be great. It might be a step away from a system that asks students to jump through a hoop and receive a star or treat for performing a trick without knowing why the words or ideas coming from them matter or how to apply the words and ideas to new contexts, which I think would be knowledge rather than inert data.

MOOCs, costs, and Dan Ariely

MOOCs will solve our education problems. No one wants to pay for education. Everyone wants education to be free. MOOCs will at least bring down the costs and bring the best lecturers to all the world. I own some land in Florida, the Glengary project. Perhaps you’d like to buy a tract? I am fascinated by MOOCs but reject the claims being made about them as demonstrating some sort of magical new education system.

Yet, when I think about taking a great class with a master teacher, I get excited. Heck, I already listen to lectures from iTunes U and MIT’s Open Course Ware when I work out. MOOCs seem like a step up. And the reality of the cost problem means that they will likely play a role. Then I saw that Dan Ariely is offering a MOOC. And he wrote about the experience. His thoughts track much of what I think. On costs he says, “I have learned that some students feel that it is their basic human right to get free education (they call it free but of course free in this case is a shorthand for “someone else should pay for it,”) while the majority feels privileged to live in a time when such adventures are possible.” But more important are his ideas about where MOOCs may fit and why live learning has a place. I think he is correct, but he may miss a deeper problem.

On MOOCs’ place in the future, Ariely offers:

I don’t think that the future of the university is doomed for a few reasons. First, having a scheduled class with obligations, deadlines, exams, real consequences and real rewards is incredibly important for human motivation and getting people to spend the necessary time and effort to really understand the material. The second reason is that the model of many universities, in which students study and live together, is a particularly helpful model for creating the environment that people need to take their education seriously. It is not just about the particular classes, but about being immersed in an academic environment for a substantial period of time.

The latent problems of MOOCs flow from the benefits of physical place-based teaching; they are expensive and will be for the few; not the many. Assume Ariely is correct. The advantages of the scheduled classes etc. matters. That can be mimicked online. That kills the claim that schedules will require the university. Studying and living together is important. Think of The Social Life of Information by John Seely Brown and Paul Duguid. Drawing on Xerox PARC, (and the California “Virtual University”) they show that social context is vital for technology and information to help society going forward. But again that physical structure costs money. My concern then is how do we leverage MOOCs and other technology to improve the way education is delivered while not offering only the virtual world, one that may lack social context, to the poorer parts of society.

If we run to replace classrooms at state schools, only the rich will have the benefits I had. That is a mistake. I was lucky. I went to private schools, UC Berkeley, and Yale Law. I have gained social capital. I know some of the language, manners, styles, and more that are part of getting into the game and playing it. That aspect of life is possibly undercut unless everyone in the future works only on social networks and online culture. To date, it still matters to be in Silicon Valley, Wall Street, Hollywood, etc. so that one can have the day-to-day chance to leverage connections and be part of the so-called conversation. Put differently, back room deals are about who you know. Interviews, for now, may be on videochat, but they still reveal diction, ideas, and manners that influence hiring. Plus, I prefer to read, explore, and solve things on my own. Those who may not be so motivated are precisely those for whom a more disconnected teaching system will not work. So far the drop-out rate for online courses is high. Now, I think there are ways to address these issues. I have believed and continue to believe that technology coupled with social reality can be powerful and beneficial. I stand by that belief.

The danger is to think that because certain facets of universities cannot be duplicated, universities will survive and all is well. Only certain versions of the university will survive. Duke and other elite schools will survive. At those schools students will be part of all the benefits, on and offline, education can offer. For others, access to the benefits Ariely sets out will be even less than today.

Education is a public good with many dimensions beyond the obvious mastery of a subject. It is better thought of as liberal, as in freeing, one to address the myriad problems and changes one encounters in work and life. MOOCs and other advances in technology can and should help that process. Relying on them alone may increase the problems of an education system that delivers a meal, proves that person ate the meal, but the customer has no idea how to fish for herself when on her own.

STEM education and some more on 3D printing as general purpose tech

3D printing and its related technology is general purpose technology that can train kids for the future. I saw an example of that yesterday when I was able to visit La Jolla Country Day School where sixth to eighth grade kids on spring break were learning basic 3D Modeling and Design. Last week they worked on How to Make Musical Electronics. In the 3D modeling program, Ann Worth, an MIT School of Architecture graduate, guided the youngsters as they manipulated files of their heads so that at the end of the program they could print them. I also watched a video of two girls who had been shown how to make an amplifier and oscillator for their iPhones. Brendan Bernhardt Gaffney, UCSD was their instructor. The kids talked about trial and error, vectors and faces, and circuit boards with energy and joy. How often does that happen? If Katie Rast and her co-visionaries at FabLab San Diego have their way, much more often.

Despite some nerds are cool ideas, we still hear that kids are turned off by math and science and that there is a lack of good Science Technology Engineering Math (STEM) education. New programs may change all that. By taking an old idea like shop and updating it, a FabLab (short for Fabrication Lab) offers the chance to make learning about programing, engineering, geometry, and the jot of creation. Kids are willing to engage with formulas; start, fail, and restart projects; and work rather hard at their projects, because there is fun and an outcome for them. The spring break program I visited is called Science Technology Engineering Arts and Math, or STEAM. The University of California, San Diego and FabLab SD worked together to offer the classes (which to me is a tech transfer moment that is quite important).

In the 3D modeling program, the kids started with a series of photos, which were uploaded to 123D (a suite of 3D modeling apps by Autodesk). That service knits the images together into a file that the kids then download. In many cases there are holes in the images. As they made models of their heads, they laughed at the holes in their heads. They then used a program called Blender to learn about filling the gaps. That meant some kids were telling me about vectors, others about textures, and all showed off as they pulled, stretched, and edited files to create the proper rendering of their heads. After that, they grabbed files for the bodies. A range of animal bodies will be virtually sliced up to make the new creature upon which the heads will attach. When asked what they might do next, these folks talked about how metals, glass, and other materials would be awesome so they could make really functional items. Some talked about being able to have a home printer that could make solar cells to power other printers. When told that these ideas were already being pursued, eyes popped out of their heads, and then grins covered their faces at thoughts of what’s next (and I think a little pride at predicting where the technology could go).

The skills learned in these programs will persist even as the machines and software are superseded. Who knows? If I had access to this sort of tech training combined with math and science education, I might have stuck with that path. Even if I didn’t, I’d have a greater ability to play with and understand the technology that surrounds us. In short, congratulations to La Jolla Country Day School, UCSD, FabLab SD, Ann Worth, Brendan Bernhardt Gaffney, and Katie Rast for pursuing ways to make STEM fun and for kids. The ideas here remind me of Julie Cohen’s work about play and its importance in her book, Configuring the Networked Self: Law, Code, and the Play of Everyday Practice. As Rast said on a panel at SxSW, computer labs were often seen as saviors for education especially in low income areas, but they often gathered dust. The key is to have maker spaces that work for the group’s context. A lab need not have the latest technology. If the technology is connected to people in meaningful ways, then the magic can happen. I agree. The magic of playing with technology, understanding what you can do with it, and seeing new possibilities will fire the desire to learn and create. As Neil Gershenfeld (a leader in the Maker and Fab movement) put it, this is a liberal, as in liberating, art. But don’t take my word for it. As one kid told me at lunch, adults’ brains are not as good at learning as kids’ brains, and kids like showing what they can do. Now that is education.

Can a Website Operator Disclose Identifying Information About Blog Commenters?

groundhog-smOver on The Faculty Lounge and Prawfsblawg there is an emerging kerfuffle over whether it breaks any laws, or leads to any liability, for a blog operator to disclose the email addresses or IP address of people that post comments there. The whole debate is somewhat ridiculously wrapped up in a brouhaha that it’s not worth going into, and involves Paul Campos, Brian Leiter, Leiter’s co-blogger Dan Filler, The Faculty Lounge (where Filler also posts), the whole Law-School-Is-a-Scam movement, anonymous trolls, and who knows what else. Suffice it to say it is reaching kerfuffled heights of kerfuffledness. I’m just interested in the legal question as an Internet Law issue. If you really must know more, you can follow the links in wrap-up posts on Volokh Conspiracy and Above the Law.

(Aside: The whole thing reminds me of a lawsuit between neighbors. Some dispute arises between the two — maybe one doesn’t keep his or her grass cut short enough. Pretty soon the neighbors come to hate each other, and seek to express that hate in legal claims over every perceived infraction dating years back, no matter how tenuous the relation of those claims is to any facts. Before you know it, they’ve got dueling civil RICO lawsuits against each other, and they are telling their lawyers, “it’s the principle of the matter!” I tell my students they should see dollar signs when they hear that phrase, at least if they are billing by the hour, but other attorneys have told me what they hear is, “Run away!“)

Let’s start with a hypothetical, in order to avoid the need for any hyper-ventilated speculation. A runs a blog on which B comments, providing an email address that is not displayed with the comment, which A then provides to third party C. Is A liable for anything?

One point worth noting right away is that, unless you add more facts to the hypo, there’s nothing in it that would hinge liability on whether the disclosure is to one person or 1,000 people. So what people are suggesting is some legal provision that would prohibit a blog operator from posting on the site, “Dear ObstreperousMan, using email address joe@yahoo.com and posting from IP address 168.192.100.100, I’m sick of your rude and abusive comments, and you are not welcome here any more.” Is there something in the law that would prohibit such behavior or subject the blog operator to liability?

The short answer is no, I can’t think of any basis on which the blog operator would be liable for such conduct. It seems clear that the actual law is only a small and perhaps relatively insignificant part of the furor, but I still found it to be an interesting intellectual exercise, so let me walk through what people have suggested. Continue reading

Two Worlds of Software Patents

I recently participated in Santa Clara Law School’s great conference on “Solutions to the Software Patent Problem.” The presentations were interesting and thoughtful, and…short! A total of 34 presentations in one day, including some Q&A from the audience. Op-Eds from the conference are continuing to appear at Wired Magazine’s blog, and Groklaw has a fairly thorough article summarizing the presentations.

I want to focus this post on an epiphany I had at the conference, one that is alluded to at the end of the Groklaw article. In short, there appear to be at least two world views of software patenting (there is probably a third view, relating to natural rights and property, but I’m going to put that one to the side). More after the jump.

On the one hand, you have the utilitarians, who believe that the costs of patenting might be worth the benefits of patenting. Or maybe they aren’t, but that’s the important question to them: to what extent does allowing software patent drive innovation? The Groklaw article implies that this group is primarily large corporate interests, but I think that’s too restrictive. For example, I’m unabashadly a member of this world view, and my affinity is toward start-ups.

On the other hand, you have what I’ll call the friends of free software (more fully called FOSS – Free and Open-source Software). These individuals believe that software is thought, and math, and that no one can own it. I’ve found that some take this view to the extreme – they have no problem with a circuit that performs the same thing as software, so long as it is performed in hardware. Members of this group believe that software patents should be unpatentable as a matter of principle, and that by allowing any kind of software patenting bad things will happen to individual programmers, to free software, and in the world generally. As further evidence that the divide is not just about large corporate interests, there are plenty of people who subscribe to this world view that started large successful companies.

Now, here is the epiphany – I belive that bridging these two worlds is  possible if one believes that any software patent should issue. (If you agree that software patents can never satisfy utilitarian ends, then you can bridge the worlds. Benson Revisited  by Pamela Samuelson is a great example of such a bridge.)

Believe me, I tried to make the leap. I wrote a lengthy post at Groklaw that garnered more than 1300 comments where I tried to better understand the free software view and they tried to understand mine.

Surely, I thought, they might see that there are some lines that can be drawn that would allow for inventive software innovations. Surely, I thought, we can discuss some tweaks that would help alleviate the deleterious effects of low quality patents but save the system for one good software patent.

Surely, they thought, I would see how software patents are a bane to society, and must just go. Surely, they thought, I would see that there is no such thing as a good software patent.

The problem is that the goals of each world view are just too different. The following exchange from the Santa Clara conference between John Duffy and Richard Stallman drives the point home. I’m paraphrasing the statements, of course:

[Stallman's keynote]: Companies don’t need software patents to innovate – just look at the rise of Google. [later] My proposal is that we can enforce software patents in standalone devices but not in general purpose computers.

[Duffy's talk]: I’m glad Stallman points out that software companies don’t need patents – I think we agree on a solution. My proposal is that if an inventor is not induced to invent because of the prospect of a patent, then the invention is obvious and no patent should issue.[later]Stallman’s proposal, though, is a kludge – a patch on the system rather than an elegant solution like redefining obviousness.

[Stallman in response to Duffy]:It doesn’t matter if the patent induced the invention, it is still a bad patent. It may actually be worse, because now it can’t be invalidated. My solution is not a kludge, because it handles the very real problem of software patents and eliminates it.

[Duffy]: But you have to look at the ex ante incentive to invent. If we don’t allow patent enforcement, inventions might not happen that would have happened with the patent system.

[Stallman]: It’s OK if we don’t get those inventions. Maybe
they will be developed, maybe they won’t, maybe they will take longer, but the harm to any future software programmer/company is never justified by encouraging that investment with a patent.

And there you have the core of the problem. Utilitarians like Duffy (and me) believe that it is worth driving the ex ante incentive to innovate, but trying to hone the system to minimize collateral damage. Free software folks like Stallman (and probably 99% of Groklaw readers) believe that the collateral damage never justifies the ex ante incentive in a practical way.

You can see the core of these arguments in the debate about whose invention is elegant and whose is a kludge. Duffy believes that tweaking inducement to invent is elegant because that’s what utilitarianism is all about. Just barring patents on general purpose computers is a patch, because there might be valuable innovations in the use of general purpose computers that are worth encouraging. Investment in standalone software might decline if there is not general purpose application at the end of the rainbow, especially in the age of smartphones.

On the other hand, Stallman believes that barring enforcement on general purpose computers is elegant, because it eliminates the most harmful effects to programmers. He believes that changing obviousness is a kludge, because it refuses to acknowledge that even the patents that come from the new rules will be bad for society. As Stallman commented to me after the conference: “There may be weak patents, and there may be strong patents, but they are all bad patents.”

So, where does that leave us? I don’t know, but I have to think it is helpful to understand why we can’t seem to understand each other. I’m not sure where it leaves the utilitarians. They seem to be winning in policy circles, as this recent speech by PTO director David Kappos shows, but utilitarians can’t even seem to agree among themselves the best course of action with software patents. Perhaps this recognition will aid those with the free software view to hone their arguments in a way that will get more policy traction – by making their same important points, but somehow framing them in a langauge utilitarians will hear. Samuelson’s Benson Revisited article is a good example.