Monday 28 January 2013

Teaching Programming To A Highly Motivated Beginner: The Difference between Anecdote and Data

Phillip Guo has a piece in Blog@CACM on how he tutored a single adult to learn to program. He contrasts it with the MOOC approach of teaching thousands. There’s another important contrast–between anecdote and data.Phillip’s story is interesting and compelling. He raises some key insights, like the value of motivation to drive someone to come to a new understanding. But some of his claims are just too broad, like the one he boldfaced below in his original, “I don’t think there is any better way to internalize knowledge than first spending hours upon hours growing emotionally distraught over such struggles and only then being helped by a mentor.”Phillip could be right. (I don’t think that he is.) But to suggest that there isn’t a better way based on the study of one learner is over-generalizing. There is a research methods for produce case studies, which is the closest research method to what Phillip did. There’s only so much you can claim from a single case study, though.

Brian usually did 10-15 hours of programming on his own before each 1-2 hour Skype call with me, so he always had plenty of urgent questions and newly-written code that he wanted me to help him debug or improve. If I had just given him lectures without any context, he would not have internalized the lessons as thoroughly. He would have probably nodded his head and been like, “uh huh, ok that makes sense … cool. what’s next?” Instead, because he was usually struggling with concrete, code-related problems before our tutoring sessions — often to the point of frustration and discouragement — he would respond more like, “OHHH, WOW! Now I totally get it!”, whenever I guided him over some problem that seemed insurmountable to him at the time. His joy and relief were always unmistakable. I don’t think there is any better way to internalize knowledge than first spending hours upon hours growing emotionally distraught over such struggles and only then being helped by a mentor.

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

First, Do No Harm: Inequality in American Education Will Not Be Solved Online

Ian raises a really important issue that I don’t think is being discussed enough. I predict that computer science MOOC completers are even more white and male than in existing computing education. Replacing more face-to-face CS courses with MOOCs may be reversing the hard-fought gains we've made through NCWIT and NSF BPC efforts. I've asked both Udacity and Coursers about the demographics of their completers. Coursera said that they don’t know yet because they simply haven’t looked. Udacity said that it’s “about the same” as in existing face-to-face CS classes.To address issues of inequality, we will have to do something different than what we are doing now, but we want to do something different that has better results. We need to be careful that we don’t make choices that lead us to a worse place than we are now.

Here’s a concrete proposal: Any institution that belongs to NCWIT (or more significantly, the NCWIT Pacesetters program) that runs a MOOC for computer science and does not check demographics should have its member ship revoked. (See Note.) We should not be promoting computer science education that is even more exclusive. We need new forms of computer science education that broaden participation. At the very least, we ought to be checking — are we doing no harm? Are we advancing our agenda of broadening participation, or making it more exclusionary? I wonder if the responsibility to check is even greater for public institutions. Public institutions have a responsibility to the citizens of their state to be inclusive. Readers of this blog have argued that Title IX does not apply to academic programs, suggesting that there is no legal requirement for CS departments to try to draw in more women and minorities. We in public universities still have a moral responsibility to make our courses and programs accessible. If we choose to offer instruction via MOOCs, particularly as a replacement for face-to-face courses, don’t we have a responsibility to make sure that we are not driving away women and minorities?

The SJSU test will be run on “remedial” courses at one of the country’s most ethnically diverse universities, of which only 25 percent of the student population is white, and which is primarily comprised of minorities, first-generation college students, and commuting students. This is a population that has more likely been subject to underfunded primary and secondary schools and, generally speaking, a whole regime of distress, neglect, and bias compared to California residents who would attend Berkeley or UCLA. Put differently, the conditions that produced the situation that the Udacity deal is meant to solve, at least in part, was first caused by a lack of sufficient investment in and attention to early- and mid-childhood education.In response, California could reinvest in public schools and the profession of secondary teaching. But instead, the state has decided to go the private paved surface and illumination services route — siphoning California taxpayer receipts and student tuition directly into a for-profit start up created, like all start ups, with the purpose of producing rapid financial value for its investors. Just how much of those proceeds Udacity will hold onto is unclear. While the company has reportedly paid instructors in the past, it’s unclear if its new institutional relationships will support paid teaching or not. Coursers  Udacity’s primary competitor in the private MOOC marketplace, has managed to get faculty from prestigious institutions to provide courses for free, in exchange for the glory of a large audience and the marketing benefit of the host institution.

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

The future of the university with MOOCs: It’s all about the individual

Interesting piece in Inside Higher Ed which argues that the real impact of MOOCs on the University is to get the University out of the business of engaging students and working to improve completion, retention, and graduation rates. Nobody gets into the University until proven by MOOC. And since so few people complete the MOOCs, the percentage of the population with degrees may plummet.

Constructing this future will take some time, but not much time. It only requires the adaptation of various existing mechanisms for providing proctored exams worldwide and a revenue and expense model that allows all the providers (university and faculty content providers, MOOC middle ware providers, and quality control providers) to establish profitable fee structures. In this model, the risk and cost of student engagement is borne by the students alone. The university assumes no responsibility for student success other than identifying quality courses. The MOOC middle ware companies create and offer the content through sophisticated Internet platforms available to everyone but make no representations about the likelihood of student achievement. Indeed, many student participants may seek only participation not completion. The quality control enterprise operates on a fee-for-service basis that operates without much concern for the number of students that pass or fail the various proctored tests of content acquisition, and many participants in MOOC activities may not want to engage the quality control system.

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

Kids should learn programming as well as reading and writing – Mitch Resnick

A recommended video from Mitch Re snick  who leads the Lifelong Kindergarten group at the MIT Media Lab, the home of Scratch.Most people view computer coding as a narrow technical skill. Not Mitch Re snick  He argues that the ability to code, like the ability to read and write, is becoming essential for full participation in today’s society. And he demonstrates how Scratch programming software from the MIT Media Lab makes coding accessible and appealing to everyone — from elementary-school children to his 83-year-old mom.

As director of the Lifelong Kindergarten group at the MIT Media Lab, Mitch Re snick designs new technologies that, in the spirit of the blocks and finger paint of kindergarten, engage people of all ages in creative learning experiences.

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

Wednesday 16 January 2013

A STEM Modeling Contest (not programming, not games)

I got this from Bill Jordan of the Florida Virtual High School and was intrigued. It’s a programming contest to make models — and not about speed of programming, not quality of games. As I've mentioned before, we've had some good luck with competitions in terms of teacher professional development. Getting teachers to learn about modeling is even more exciting STEM Modeling Challenge (Register by Jan. 31)
Are you interested in Science, Technology, Engineering, Art, or Math? How often have you asked yourself, “When will I ever use this?” Find the answers by participating in the STEM Modeling Challenge©. FREE registration is now open but the deadline is January 31, 2013. Don’t miss this opportunity to use your problem-solving skills to win cash prizes! For details and contest rules, visit http://smc2013.weebly.com/.
Florida Virtual School (www.flvs.net) is sponsoring the STEM Modeling Challenge (SMC), an academic competition in which high school students explore a STEM related problem with the opportunity to win cash prizes.

The SMC will consist of five rounds lasting approximately 20-25 days each in which students complete a specific task in science, technology, engineering, mathematics, and art to come up with a solution to the STEM related problem. During the final round, students will apply their accumulated knowledge from the previous tasks and write a computer program to develop a simple predictive model. This should be of particular interest to students taking introductory and advanced computer science courses.
One of the goals of the STEM Modeling Challenge is to promote awareness and interest in computer science in support of the Common Core Standards and the College Board’s efforts to promote STEM education.Please help us spread the word about the SMC and share this information.



Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

What is the current state of high school computer science professional development? The results of the UChicago Landscape Study

I am at the meeting in Portland of all the wardresses from the NSF programs in Broadening Participation in Computing (BPC-A, like ECEP), Computing Education in the 21st Century (CE21, like our CS Learning 4U project), and all the funded projects related to CS10K, sponsored by NCWIT. You may recall that I invited people to participate in the Landscape Study on the capacity of our computing community’s professional development efforts. The results of that survey are being presented here at this meeting, and a summary is available at the URL below.

I find the results a little depressing. The folks at U Chicago who do the study compare us to professional development in Science or Mathematics, and we don’t much look like that. We have such a long way to go.
What is the current state of high school computer science professional development? THIS STRAND OF WORK FOCUSED ON DESCRIBING THE CURRENT PROFESSIONAL DEVELOPMENT OPPORTUNITIES that are available for high school computer science (CS) teachers. The primary data collection for this strand took place through a survey administered to providers of high school computer science teacher professional development (PD).

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

UCSD’s overwhelming argument for Peer Instruction in CS Classes

For teachers in those old, stodgy, non-MOOC, face-to-face classes (“Does anybody even *do* that anymore?!?”), I strongly recommend using “Clickers” and Peer Instruction, especially based on these latest findings from Beth Simon and colleagues at the University of California at San Diego. They have three papers to appear at SIGCSE 2013 about their multi-year experiment using Peer Instruction:
  • They found that use of Peer Instruction, beyond the first course (into theory and architecture), halved their failure rates:http://db.grinnell.edu/sigcse/sigcse2013/Program/view Accepted Proposal . pd f?sessionType=paper&sessionNumber=176
  • They found that the use of Peer Instruction, with Media Computation and pair-programming, in their first course (on the quarter system, so it’s only 10 weeks of influence) increased the percentage of students in their major (tracking into the second year and beyond) up to 30%:http://db.grinnell.edu/sigcse/sigcse2013/Program/view Accepted Proposal.pdf?sessionType=paper&sessionNumber=96
  • They also did a lecture vs. Peer Instruction head-to-head comparison which showed significant impact of the instructional method:http://db.grinnell.edu/sigcse/sigcse2013/Program/viewAcceptedProposal.pdf?sessionType=paper&sessionNumber=223
If we have such strong evidence that changing our pedagogy does work, are we doing our students a disservice if we do not use it?

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

NPR piece on Scratch

Thanks to Guy Haas for the link to this While the programming languages are simpler than the ones used by professionals, they’re still teaching kids the foundations of computer science, according to Karen Brennan of Harvard Graduate School of Education, who helped develop the Scratch program at MIT’s Media Lab.

“They were learning how to test and debug, they were learning how to break down problems,” Brennan told Here & Now. “They started seeing the world in a new way, that computers weren’t something that other people did or other people think about, but computation becomes something that they can use to express themselves, that they can solve problems.”

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

Computer code frees us to think in new ways: BBC News – Viewpoint

A nice piece describing reasons to learn code. What makes this one particularly noteworthy is how it talks about art, architecture, and aesthetic — learning to code as a way of connecting to our world. Both aesthetic and rooted in physics, sturdy yet beautiful, containing both purpose and artistic intent. Code is now a core part of the architecture of the world we live in.

It both powers and shapes finance, business, and entertainment; it is embedded in our homes and in our pockets. And so “architecture” feels like the appropriate metaphor for the skills needed to master it: for architecture both shapes its inhabitants and is shaped by them.Computer programs can make people more efficient in day to day life It can’t really exist without people inside it. And we can’t separate code from people; from the people who write it; from the people who are shaped by it.

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

Friday 11 January 2013

Kiki Prottsman: Why American Students Are Trailing in Computer Science

It’s an interesting argument in favor of computational literacy, computing education for everyone. It’s a pretty accurate description of what happens at the first undergraduate classes.Imagine, if you will, a world where Americans don’t teach their children math in elementary school. Imagine that children no longer learn addition in first grade, subtraction in second or multiplication and division in third and fourth. Imagine instead that children make it all the way through high school without having any formal presentation of mathematical concepts. Now imagine that a student is observant enough to realize that adults who have a firm grasp on mathematics have much better problem-solving life skills and financial opportunities than adults who don’t. If that student is curious enough to enroll in an undergraduate math class, imagine how frustrating it would be to have the whole of arithmetic, algebra and statistics thrown at you in your very first term. Wouldn't it feel overwhelming? Wouldn't you be discouraged… especially if you noticed that several people in the class already seemed to understand the stuff fluently? Wouldn't it be difficult to perceive the subject as one where you have talent?

This hypothetical may seem ridiculous, but the truth is that a similar situation is being played out in America today with the subject of computer science. For many, computer science isn't introduced at a k-12 level, so their first exposure comes in an undergraduate classroom, where they’re forced to absorb all of the basic building blocks of computational thinking at lightning speed before they can begin to fathom the concept of programming, design or engineering. To add further blows, a handful of students (often boys) will actually have skills in these areas, making the newcomers feel deficient, awkward and behind.


Deepa Singh
Business Developer
Web Site:-http://www.gyapti.com
Blog:- http://gyapti.blogspot.com
Email Id:-deepa.singh@soarlogic.com

It’s not about the teachers, it’s about the students: In MOOCs or Classroom

I agree with the post below which suggests that MOOCs misunderstand what a good teacher does–that’s what my post earlier was about. I’m not convinced that I agree with the author’s definition of what a teacher does. Yes, a good teacher does all those things described in the second paragraph below, but a key part of what a teacher does is to motivate the student to learn. Learning results from what the student does and thinks. It’s the teacher’s job to cajole, motivate, engage, and even infuriate the student so that he or she thinks about things in a new way and learns. In the end, it’s always about the student, and the most important thing a teacher does is to get the student to do something.

But even if Tabarrok’s model makes good economic sense, it makes bad education sense and misrepresents what genuine teaching is and what the “best” teachers actually do. For starters, unlike TED speakers, they don’t simply deliver lectures and profess. They also work with students to help them become better thinkers, readers, and writers. How? Through personal attention (such as tutorials) and classroom interaction (such as discussions and the guided close reading of texts). By constantly testing their students’ minds against theirs, forcing them to ask the hard questions and to explain them with significant answers. And by giving them appropriate personalized feedback.

via A Cautious Word about MOOCs. Seb Schmoller had a nice response to my Friday post, where he asked what it will take for MOOCs to engage the student and lead to the learning that a good teacher can achieve. He included a wonderful quote from Herb Simon which really captures the key idea.“Learning results from what the student does and thinks, and only from what the student does and thinks. The teacher can advance learning only by influencing what the student does to learn.” – Herb Simon.

Deepa Singh
Business Developer
Web Site:-http://www.gyapti.com
Blog:- http://gyapti.blogspot.com
Email Id:-deepa.singh@soarlogic.com

Definitions of “Code” and “Programmer”: Response to “Please Don’t Learn to Code”

Audrey Watters’ excellent post on Learning to Code in 2012 pointed me to Jeff Atwood’s piece (linked at the bottom). I want everyone to learn code, so I am in direct contradiction to his position, “Please don’t learn to Code.” Jeff and I disagree primarily on two points, both of which are issues of definition:
  • Most people who write code are not trying to create code solutions. Most people who write code are trying to find solutions or create non-code solutions. By “most people,” I do mean quantitatively and I do mean all people, not just professional programmers. We know that there are many more people who write code to accomplish some task, as compared to professional programmers. When I visited the NASA Goddard Visualization Lab last month, I met the director Horace Mitchell, who told me that everyone there writes code, whether they are computer scientists or not. They write code in order to explore their data and create effects that they couldn’t given existing visualization systems. They are trying to create great visualizations, not great code. They simply throw the code away afterward. This is a critical difference between what Jeff is describing and what I hope to see. We agree that the goal is a solution. I want everyone to have the possibility of using code to create their solution, not to create code as the solution.
  • Most people who program are not and don’t want to be software developers. Most of the people that I teach (non-CS majors, high school teachers) have zero interest in becoming programmers. They don’t want to be “addicted to code.” They don’t want a career that requires them to code. They want to use coding for their own ends. Brian Dorn’s graphic designers are a great case in point. Over 80% of those who answered his surveys said “No, I am not a programmer,” but everyone who answered his surveys wrote programs of 100 lines or more. Not everyone who “programs” wants to be known as a “programmer.”
The problem is that we in computer science often have blinders on when it comes to computing — we only see people who relate to code and programming as we do, as people in our peer group and community do. There are many people who code because of what it lets them do, not because they want the resulting code.“You should be learning to write as little code as possible. Ideally none.” And people who want to do interesting, novel things with computers should just wait until a software developer gets around to understanding what they want and coding it for them? I could not disagree more. That’s like saying that the problem with translating the Bible is that it made all that knowledge accessible to lay people, when they should have just waited for the Church to explain it to them. ”Please don’t learn to code” can be interpreted as “Please leave the power of computing to us, and we’ll let you know when we’ll make some available to you.”

It assumes that more code in the world is an inherently desirable thing. In my thirty year career as a programmer, I have found this … not to be the case. Should you learn to write code? No, I can’t get behind that. You should be learning to write as little code as possible. Ideally none.It assumes that coding is the goal. Software developers tend to be software addicts who think their job is to write code. But it’s not. Their job is to solve problems. Don’t celebrate the creation of code, celebrate the creation of solutions. We have way too many coders addicted to doing just one more line of code already.

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

The Bigger Issues in Learning to Code: Culture and Pedagogy

I mentioned in a previous blog post the nice summary article that Audrey Watters wrote (linked below) about Learning to Code trends in educational technology in 2012, when I critiqued Jeff Atwood’s position on not learning to code. Audrey does an excellent job of describing the big trends in learning to code this last year, from Code Academy to Bret Victor and Khan Academy and MOOCs. But the part that I liked the best was where she identified the problem that cool technology and badges won’t solve: culture and pedagogy. This is a problem. A big problem. A problem that an interactive JavaScript lesson with badges won’t solve.Two organizations — Black Girls Code and Code Now — did hold successful Kick starter campaigns this year to help “change the ratio” and give young kids of color and young girls opportunities to learn programming. And the Irish non-profit Coder Dojo also ventured state-side in 2012, helping expand after school opportunities for kids interested in hacking. The Maker Movement another key ed-tech trend this year is also opening doors for folks to play and experiment with technologies. And yet, despite all the hype and hullabaloo from online learning start ups and their marketing campaigns that now “everyone can learn to code,” its clear there are still plenty of problems with the culture and the pedagogy surrounding computer science education.

via Top Ed-Tech Trends of 2012: Learning to Code | Inside Higher Ed. We still do need new programming languages whose design is informed by how humans work and learn. We still do need new learning technologies that can help us provide the right learning opportunities for individual student’s needs and can provide access to those who might not otherwise get the opportunity. But those needs are swamped by culture and pedagogy.What do I mean by culture and pedagogy?Culture: Betsy diSalvo’s work on Glitch is a great example of considering culture in computing education. I’ve written about her work before — that she engaged a couple dozen African-American teen men in computing, by hiring them to be video game testers, and the majority of those students went on to post-secondary education in computing. I’ve talked with Betsy several times about how and why that worked. The number one reason why it worked: Betsy spent the time to understand the African-American teen men’s values, their culture, what they thought was important. She engaged in an iterative design process with groups of teen men to figure out what would most appeal to them, how she could re frame computing into something that they would engage with. Betsy taught coding — but in a different way, in a different context, with different values, where the way, context, and values were specifically tuned to her audience. Is it worth that effort? Yeah, because it’s about making a computing that appeals to these other audiences.

Pedagogy: A lot of my work these days is about pedagogy. I use peer instruction in my classrooms, and try out worked examples in various ways. In our research, we use sub goal labels to improve our instructional materials. These things really work.Let me give you an example with graphs that weren't in Lauren Margelieux’s paper, but are in the talk slides that she made for me. As you may recall, we had two sets of instructional materials: A set of nice videos and text descriptions that Barbara Ericsson built, and a similar set with sub goal labels inserted. We found that the sub goal labelled instruction led to better performance (faster and more correct) immediately after instruction, more retention (better performance a week later), and better performance on a transfer task (got more done on a new app that the students had never seen before). But I hadn't shown you before just how enormous was the gap between the sub goal labelled group and the conventional group on the transfer task.

Part of the transfer task involved defining a variable in App Inventor — don’t just grab a component, but define a variable to represent that component. The subgoal label group did that more often. ALOT more often.


Lauren also noticed that the conventional group tended to “thrash,” to pull out more blocks in App Inventor than they actually needed. The correlation between number of blocks drawn out and correctness was r = -.349 — you are less likely to be correct (by a large amount) if you pull out extra blocks. Here’s the graph of number of blocks pulled out by each group.


These aren’t small differences! These are huge differences from a surprisingly small difference between the instructional materials. Improving our pedagogy could have a huge impact. I agree with Audrey: Culture and pedagogy are two of the bigger issues in learning to code.

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

Research questions on MOOCs: Who’s talking, who’s completing, and where’s the teaching?

In the last three weeks, I was asked several times at MIT and Stanford about what questions I would like answered about MOOCs. I didn't get any answers, but folks at Georgia Tech were asking me about the questions, so I thought I’d share some of them here. This is the evidence I’m looking for.

What’s the value of the discussion forum in a MOOC? What percentage of students participate in the discussion forum? What’s the correlation between participation in the forum and completing? I've heard people say that that’s where the “teaching” and learning takes place, but I would like evidence of that. I've mentioned here that I used to work in computer-supported collaborative learning in the early 2000′s, and some of our work showed that students posted about 1 note every two weeks most on-line forums (even when students were measurably learning). That’s not really enough posting for a dialog and colla borative learning. Is it the same for MOOCs? We also found that students were LESS likely to participate in on-line collaborative learning forums when the subject was Engineering or CS. Is that true for MOOCs as well?

What are the demographics of completer in a MOOC? We already have a problem of CS being mostly White/Asian and Male. (Lots of reasons why that is a problem: From equity and fairness, to tapping into the fastest growing demographics vs the fastest shrinking demographics, to involving more diversity in design decisions.) I suspect that MOOCs are even more Male than face-to-face classes (based on the factors that we know lead to broadening participation in computing). If I’m right, then investing more in MOOCs is counter to our community’s goals to broaden and diversify computing.

Is there any teaching going on? Overall, I’d really like to know more about the characteristics of people who complete MOOCs, e.g., how many are working full-time when taking the MOOC, how many hours a week are spent on homework in order to complete, what is the background of completer in terms of other degrees? Right now, MOOCs are just for autodidacts. Do we want Computer Science to only be for autodidacts? Don’t we believe that teaching allows people to succeed who might not succeed on their own? (Isn't that the definition of scaffolding?) Are MOOCs really teaching, or are they filtering out the people who couldn't learn on their own? If we want MOOCs to be for more than just those who don’t really need the teacher anyway, then we need to measure who is going in, what they know already, and what they learn at the end (and if they “come out,” i.e., complete).

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

Is learning a programming language like becoming bilingual?

Fascinating question! Bilingual people have some additional executive control. Does learning a programming language give a similar benefit in executive control? The study described below is suggestive but not conclusive. If we could find evidence for it, it would be another benefit of learning to program.

If computer programming languages are languages, then people who spoke one language and could programmer to a high standard should be bilingual. Research has suggested that bilingual people perform faster than monolingual people at tasks requiring executive control – that is, tasks involving the ability to pay attention to important information and ignore irrelevant information (for a review of the “robust” evidence for this, see Hilchey & Klein, 2011). So, I set out to find out whether computer programmers were better at these tasks too. It is thought that the bilingual advantage is the result of the effort involved in keeping two languages separate in the brain and deciding which one to use. I noticed that novice computer programmers have difficulty in controlling “transfer” from English to programming languages (e.g. expecting the command “while” to imply continuous checking; see Solo way and Spohrer, 1989), so it seemed plausible that something similar might occur through the learning of programming languages.

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

Computing Industry: Put 2 and 2 together! Recruit more women!

ACM Technews this week included this article about “Software Companies begging for Qualified Job Candidates“The big challenge facing the U.S. software industry might not be the economy, looming fiscal cliff or growing competition. First things first — the companies are begging for qualified job candidates. Software firms say the U.S. isn’t producing enough qualified engineers and tech salespeople.

“I’d say that has been the industry’s biggest problem in the past year,” said Jeff Winter, chief executive of GravityPeople, a tech recruiting firm. “You have a harder time finding and hiring people for open positions.”And then includes the article below about how very few women there are in the computing industry. Uh, folks? You’re not engaging 50% of the population — fixing that might help with the labor problem? Women, however, account for just 6 per cent of the chief executives of the top 100 technology companies in the US, and just 22 per cent of the IT workforce overall, according to the National Center for Women & Information Technology. In the UK, women make up just 17 per cent of technology professionals, according to e-Skills, an organisation that promotes technology learning.

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

Thursday 10 January 2013

Applying New Research to Improve Science Education by Carl Wieman: Value of Competitions?

(Thanks to Beth Simon for pointing this out to me!) A new paper from Carl Wieman reviewing the literature on science education is always worth reading, but the one linked below is particularly useful to us in computer science. One of the issues that Carl addresses in this paper is whether competitions and other informal science learning efforts really do help with student learning. We do have a lot of different kind of competitions in computing education, from the First Robotics league to theUSA Computing Olympiad. His finding (quoted below): “there is little evidence that such programs ultimately succeed, and some limited evidence to the contrary.”

We use competitions in “Georgia Computes!” but for a very different purpose, not considered in Carl’s analysis below. As he points out later in the article, most efforts at improving teacher quality through in-service workshops fail because the teachers don’t have enough STEM knowledge to begin with, and content knowledge precedes pedagogical content knowledge. What Barbara Ericson has found is that competitions inspire the teachers to learn more. Competitions inspire students, but even more, teachers are inspired to learn in order to support their students. When we have Alice or Scratch competitions, teachers start showing up for our Alice and Scratch professional development, because they want to learn in order to help their students. While the impact of the competitions on the students might be short-lived, I would love to see some measure of the longer-term impact on the teachers.

Competitions and other informal science programs Attempting to separate the inspiration from the learning. Motivation in its entirety, including the elements of inspiration, is such fundamental requirement for learning that any approach that separates it from any aspect the learning process is doomed to be ineffective. Unfortunately, a large number of government and private programs that support the many science and engineering competitions and out-of-school programs assume that they are separable. The assumption of such programs is that by inspiring children through competitions or other enrichment experiences, they will then thrive in formal school experiences that provide little motivation or inspiration and still go on to achieve STEM success. Given the questionable assumptions about the learning process that underlie these programs, we should not be surprised that there is little evidence that such programs ultimately succeed, and some limited evidence to the contrary. The past 20 years have seen an explosion in the number of participants in engineering-oriented competitions such as First Robotics and others, while the fraction of the population getting college degrees in engineering has remained constant. A study by Rena Subotnik and colleagues that tracked high-school Westinghouse (now Intel) talent search winners, an extraordinarily elite group already deeply immersed in science, found that a substantial fraction, including nearly half of the women, had switched out of science within a few years, largely because of their experiences in the formal education system. It is not that such enrichment experiences are bad, just that they are inherently limited in their effectiveness. Programs that introduce these motivational elements as an integral part of every aspect of the STEM learning process, particularly in formal schooling, would probably be more effective.

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

Summer Camps in Georgia: Roll-up Report and Invitation to Play with Data

Our external evaluators (The Findings Group) has just produced the roll-up analysis for all the GaComputes related summer camps from Summer 2012. These include camps offered at Georgia Tech, and those offere elsewhere in the state, started by GaComputes seed grants (as described in the 2011 SIGCSE paper that I blogged about). The results are strong:
  • Over 1,000 K-12 students participated statewide.
  • The camps were even more effective with women than men.
  • There was a statistically significant improvement in content knowledge for Scratch, Alice, and App Inventor, across genders, ethnic groups, and grade levels.
  • “The computing camps were particularly effective at increasing students’ intent to pursue additional computing, self‐efficacy in doing computing, and sense of belonging in computing.”
  • “Minority students reported significantly more growth in their intent to persist in computing than majority students.”
The Findings Group had a particularly interesting proposal for the Computing Education Research community. They are making all the survey data from all the camps freely available, in an anonymous form. They have a sense that there is more to learn from these data. It’s a lot of students, and there’s a lot to explore there in terms of motivation, engagement, and learning.

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

How many programmers are there? From The Computer Boys Take Over

I just learned about book The Computer Boys Take Over (and immediately ordered a copy for my Kindle), and have been digging through the associated blog. (Thanks, Lauren Klein!) It’s a look at the politics of computing (including gender issues), from a historical perspective. I thought that this graph and blog post were particularly interesting. It’s markedly different from the Scaffidi, Shaw, and Myers prediction about 2012 that they made in 2005, but in part, that’s because Scaffidi et al. actually looked at what people did, where the BLS has been messing with the categories, as described below.



The chart above shows the Bureau of Labor statistics on programmer employment. I am not convinced that these numbers are at all accurate. Getting reliable data on programmer employment is surprisingly difficult.To begin with, programmer is a vague category, and it is by no means clear that everyone who worked on “programming” defined themselves primarily as a “programmer.” Secondly, the Bureau of Labor Statistics did not beginning tracking programmers until 1972, and in 1983 and again in 2000 they adjusted their categories and methodologies. For the first ten years, three broad categories (“computer specialists”, “computer programmer”, and “computer analysts”) encompassed everyone working in computing.

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

What happens when professionals take on-line CS classes: When Life and Learning Do Not Fit

The journal article on the research that Klara Benda, Amy Brock man, and I didfinally came out last month the ACM Transactions on Computing Education. The abstract is below. Klara has a background in sociology, and she’s done a great job of blending research from sociology with more traditional education and learning sciences perspectives to explain what happens when working professionals take on-line CS classes. This work has informed our CS Learning 4U project significantly, and informs my perspective on MOOCs.

We present the results of an interview study investigating student experiences in two online introductory computer science courses. Our theoretical approach is situated at the intersection of two research traditions: distance and adult education research, which tends to be sociologically oriented, and computer science education research, which has strong connections with pedagogy and psychology. The article reviews contributions from both traditions on student failure in the context of higher education, distance and online education as well as introductory computer science. Our research relies on a combination of the two perspectives, which provides useful results for the field of computer science education in general, as well as its online or distance versions. The interviewed students exhibited great diversity in both socio-demographic and educational background. We identified no profiles that predicted student success or failure. At the same time, we found that expectations about programming resulted in challenges of time-management and communication. The time requirements of programming assignments were unpredictable, often disproportionate to expectations, and clashed with the external commitments of adult professionals. Too little communication was available to access adequate instructor help. On the basis of these findings, we suggest instructional design solutions for adult professionals studying introductory computer science education.

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

Wednesday 9 January 2013

MOOCs are a fundamental misperception of how teaching works

During break (e.g., multi-hour long car rides), I gave a lot of thought to MOOCs and the changes that are coming to higher education. I realized that people can only believe that MOOCs can replace existing higher-education classes if they misunderstand what a teacher does.MOOCs (for the most part, as they are defined in Udacity, Coursera, and edX, and as defined at Wikipedia) provide lecture-like material (typically through videos). These are broken into small pieces, and are presented with interspersed mini-quizzes. There is additional homework. Feedback is provided, either canned (the system knows what’s right and wrong) or through peer-evaluation. There is typically some kind of forum for questions and answers, and is a key part of the connectivist MOOC for “nurturing and maintaining connections.”

So why isn’t this the same as a face-to-face higher education class?
The main activity of a higher-education teacher is not to lecture. The main activity of a teacher is to orchestrate learning opportunities, to get students to do and think. A teacher does this most effectively by responding to the individuals in the class. I just got my student feedback on the prototyping course I taught in the Fall. What the students liked best was that I led discussions based on their questions and comments on the readings, and that I had stories and anecdotes in response to their queries. A teacher responds to the students, provides scaffolding, and helps the students increase their knowledge.

  • A teacher is an expert at teaching the topic, and the teaching is dependent on the domain. Teaching is not a generalized skill. The most effective teachers have a lot of pedagogical content knowledge — they know how to teach the domain. The same general course structure is not as effective as a course structure aimed at the domain.
  • The job of the teacher is to educate, not filter, and that includes motivating students. What’s the difference between a book and a University? You can learn from a book. Most students can’t learn as effectively on-their-own with a book as they can with a good teacher. Many self-taught learners who have only studied books lack a general overview of the field, and haven’t read the books that challenge and contradict the books that they have read and loved. A good teacher motivates students to keep going, explains why the topics are important, challenges students, points out where their understanding is lacking, and makes sure that they see more than one perspective on a topic.

If the only educated people in our society were the ones who wanted to learn (at the start, from the beginning of a class), our society would collapse. We would have too few educated workers to create innovations and maintain the technology we have.Our society depends on teachers who motivate students to persevere and learn. There is evidence that MOOCs do not teach. We know that MOOCs have a low completion rate. What most people don’t realize is that the majority of those who complete already knew the content. MOOCs offer a one-size-fits-few model, unchanging between content domains, that does not change for individual students (I know that they hope that it will one day, but it doesn’t now), that filters and certifies those who can learn on their own. The role of education in society is to teach everyone, not just those auto-didacts who can learn in a MOOC.

Absolutely, it’s worth exploring how to make educational technology (including MOOCs) that provides learning opportunities where no teacher is available. Alan Kay encouraged us to think that way here in this blog. However, replacing good teachers with MOOCs reflects a deep misunderstanding of what a teacher does. Please note that I am not arguing that MOOCs are bad technologies, or that they can’t be used to create wonderful learning environments. I am explicitly critiquing the use of MOOCs as a replacement for existing courses (with a good teacher), not MOOCs as a textbook or augmentation of existing courses. How did we get to this point, that people are seriously talking about shutting down schools in favor of MOOCs? Maybe it’s because we in Universities haven’t done enough to recognize, value, and publicize good teaching. We haven’t done enough to tell people what we do well. MOOCs do what the external world thinks that University teachers do.

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

The End of the University as We Know It — One of Two Visions of a MOOC-filled World

When I talk to people about MOOCs, I realize that people are hearing two radically different stories.
The first group hears that MOOCs can replace lectures, as MOOCs as a kind of textbook. They dream of higher-quality education with blended/flipped classrooms with more interactive exchange during classtime. This group wants to keep Colleges and Universities, and make them better (here’s an example of that vision). The second group hears the story linked below: that MOOCs will replace classes, then schools. They expect (and maybe even want) the MOOCopalypse.

What’s fascinating to me is that each group generally dismisses the other’s story. 
  • The flipped/blended classroom group expresses shock when I tell them the second story. ”Who would want to do that? That would ruin universities! Quality would decrease.” 

  • The MOOCopalypse group doesn’t understand why you would want to do flipped/blended classrooms. ”But that doesn’t reduce costs!”

I like the first story, and the second one scares me. Consider the implications of the vision described below (which is a clear second-group story). With less in-class interaction, graduation rates will plummet — online classes have dramatically lower completion rates without face-to-face contact. With far fewer schools, there is a much smaller demand for PhD’s, so fewer people will pursue higher degrees. Our technological innovation and competitiveness will whither. Think hard about what Universities provide for you before you write them off.

In fifty years, if not much sooner, half of the roughly 4,500 colleges and universities now operating in the United States will have ceased to exist. The technology driving this change is already at work, and nothing can stop it. The future looks like this: Access to college-level education will be free for everyone; the residential college campus will become largely obsolete; tens of thousands of professors will lose their jobs; the bachelor’s degree will become increasingly irrelevant; and ten years from now Harvard will enroll ten million students.

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com

Hard to tell if Universities teach: The challenge of low-stakes testing

What a great idea! Everybody who goes to University takes a test like the ACT or SAT. Simply give it to them again as they’re graduating! Now you have a measure of impact — the change between the entrance test and exit test is the value added by a University. Seems simple, but it doesn't work. Students have a huge incentive to do well on the entrance exam, but zero incentive to do well on the exit exam. A new study published in Education Researcher shows that the motivation really matters, and it calls into question the value of the Academically Adrift study that claimed that Colleges aren't teaching much. How do you know, if students don’t really have any incentive to do well on the post-intervention exams?

To test the impact of motivation, the researchers randomly assigned students to groups that received different consent forms. One group of students received a consent form that indicated that their scores could be linked to them and (in theory) help them. “[Y]our test scores may be released to faculty in your college or to potential employers to evaluate your academic ability.” The researchers referred to those in this group as having received the “personal condition.” After the students took the test, and a survey, they were debriefed and told the truth, which was that their scores would be shared only with the research team.

The study found that those with a personal motivation did “significantly and consistently” better than other students — and reported in surveys a much higher level of motivation to take the test seriously. Likewise, these student groups with a personal stake in the tests showed higher gains in the test — such that if their collective scores were being used to evaluate learning at their college, the institution would have looked like it was teaching more effectively.

Deepa Singh
Business Developer
Email Id:-deepa.singh@soarlogic.com