April 17, 2004
Electronic Portfolio Problems
Yesterday, each of our graduating English majors presented their "showcase" portfolios to a pair of English faculty, giving a ten minute speech followed by a question & answer period. Instead of an exit exam, we ask students to reflect on how they have met the objectives of the English major in a 6-10 page paper and to talk about where they're going and where they've been, using the portfolio to illustrate and support their claims about their own learning.
We've only been doing this for two or three years now, but I've found it a rewarding process for both student and teacher. Some students get stressed about having to "defend" their work, but the students with the best attitudes approach it as a sort of celebration of their learning. It's thrilling for me to see how far the students have come over four years -- I'm always awe-struck on some level by how quickly they mature and it's renewing to see that I've made a positive impact -- no matter how small -- on the student's thinking. In fact, I think of these moments as not only a way for the student to reflect positively on their development, but also as a means by which we can gauge the effectiveness of our English program.
I've always been a proponent of the "electronic portfolio" option, which allows students to assemble their work online in the form of a webpage, rather than a binder brimming with papers. Only a few students have taken us up on this option. Donna Hibbs was the first, and her's was a great model for others to follow. This year we had only three e-portfolios and the remainder of our graduating English majors chose to submit their portfolio on paper. I only worked with Julie Young's portfolio, which I thought was outstanding -- she did a great job and I admire her skill in web design and data organization, on top of all her talents as an English major.
Nevertheless, I was thinking about some of the cons of electronic portfolios as assessment tools or educational technologies, even as I was grading them side-by-side with paper portfolios. I thought I'd write about these problems here.
Revision
Young entitled her portfolio "Revision" -- and I know from working with her just how much energy she pours into rewriting. And though I didn't mention this to her (and didn't hold it against her), I found her title very ironic, because it called my attention to the fact that e-portfolios give no sense of the process of revision. They rarely contain work that includes commentary from teachers or peer reviewers; there's no sense of process attached to the writing; in fact, there's no way, really, to tell if the papers in an online portfolio are the same ones that produced the grade in the course or whether or not the student revised the paper before putting it online. Does it matter? Maybe not. But I think the feedback that writers get from others (students, teachers, editors) can and should be part of the reflective process as the student uses the portfolio to assess their own growth. Often it's the commentary that "teaches" and so if a student reflects on their learning, they would want to reflect on that material.
I think students harbor the belief that 'clean' copy is good copy, so uploading the MS Word file that they printed their paper from only serves to erase the comments that otherwise were intended to help the student revise or re-see their work from another perspective. Thus, the e-portfolio serves -- in an odd way -- to privilege product over process. Granted, a 'showcase' portfolio at the end of a student's career at a college inherently does this. But the idea of the portfolio -- and of most writing courses -- is to help students see writing (and learning) as a process...and a portfolio, ultimately, should be that: a work-in-process rather than a closed book. Even our Q&A sessions often felt more like advising sessions than exercises in probing into what a student did or did not learn.
One solution for this might be to ask students to include links to earlier drafts or scans of commented papers in .pdf format or some sort of reflection essay on their revision process.
Document Issues
E-portfolios are somewhat clumsy when students upload (at best) .rtf files or Word documents or huge scans of images or .pdf files. Even when they put their work into hypertext, often there's so much of it that students don't recode everything but simply "save as" .html in their word processor, causing innumerable changes in format. If I were working on an e-portfolio, I'd probably 'save as" html and then re-edit -- by hand -- every paper, to make it look something like the work I've done on the sample essays from Paradoxa. It takes a lot of time and a little know-how that not every student has. And unless they're blogging everything or writing every paper in html from scratch, the juggling of different document formats is a lot of trouble for the student and his or her audience online.
Perhaps this issue could be solved by distributing standardizing guidelines for format, but then this risks streamlining out the creativity and personality that an e-portfolio could harbor.
Permanence
If a school provides web space for e-portfolios, then they're doing themselves a favor because the option most students would take otherwise would be to upload their files to some "free" website service which not only forces pop-up and banner advertising, but also might have some questionable terms of service that would -- in effect -- hand all publishing rights over to the web provider. But by the same token, how long is a school required to host a student's portfolio online? Should the student be allowed to showcase their work to future employers...and will they have rights to edit those files long after graduation? I'd think they should, since I see these portfolios as works-in-progress that don't magically "end" just because a student has received a diploma. But there are economic and spatial issues that might prevent this from occurring in an ideal fashion. Just as students who use their school e-mail accounts encounter issues with staying in contact once they graduate, there are similar problems that could occur post-graduation.
There are potential problems, moreover, for both the institution and the student, because of the very nature of publication. What if a paper in the portfolio is plagiarized by a student (after all, uploaded files in .rtf format make this a snap!)? While a great portfolio makes our institution look good, what does a poor portfolio do? What if the student adds a very personal paper written in freshman composition that embarrasses the student five years later? Because essays that are written for teachers often are written in a sort of "safe harbor" (which publication on the web is not), then what happens when a student uploads documents they wrote under the assumption that they were private? Virtually all the potential problems that are associated with student writing online threaten the portfolio process.
Perhaps CDs are a better way to go.
Shifting the Burden of Office Supplies
Okay, so this is a minor point, but over the past five years I have seen a dramatic increase in the number of pages I've had to print on behalf of my students. With an electronic portfolio, it increases tenfold. I have to ask myself: do I want to strain my eyes for another few hours reading on screen, or do I want to print these pages out to refer to later or even bring with me to the portfolio defence. Naturally, I'll read on screen. But you can bet that I'm going to skim more quickly and "surf" rather than "read" in some cases. I'm not convinced yet that that's the best way to assess a student's career.
Students could be asked to provide hard copy of any new paper (like the introductory essay we ask them to write).
Complicating the Presentation
Although students can utilize our smart classrooms at Seton Hill and project their e-portfolio onto a wall, few actually click through different pages, showing and telling. Instead, they present a talk. And frankly, I think I prefer it that way. If a student went page by page through their bound portfolio, I'd be tempted not to pass them because they would seem under-prepared or disorganized. Similarly, a student could hide behind their e-portfolio as a sort of shield from public speaking, the way some people poorly use PowerPoint. The portfolio is something the group can turn to during the presentation/defense, but doesn't necessarily need to.
Well, I'm sure there are more problems -- and MANY more benefits that I've bracketed off for now for the sake of focusing on this issue. Hopefully, I'll take these ideas back to my colleagues and talk about ways that we can improve the system. Naturally, if a student wants to work in the electronic media, such as students in our New Media Journalism program, then an e-portfolio makes a lot of sense. But for now, the students who do use electronic portfolios are paving the way to standards and realizing the pros and cons of this method through the risks they take. So far, I've been very pleased with the work they've done.
Trackback Pings
You can ping this entry by using .
Comments
I've blogged a bit more on this...
http://jerz.setonhill.edu/weblog/permalink.jsp?id=2389
Another issue with electronic portfolios: the cost of having a website without advertising. I recently was faced with the decision to pay a year's worth of hosting and domain name registration fees, and have decided not to renew. Since I am currently employed, I'm not really using it anymore as a resume booster, and the money is better spent on paying back the hefty student loans :-) But as a student, it's the easiest way (in my opinion) to showcase all of your work. And I bet you were happy to not have to carry around another binder, Dr. A.
It's bad news to save as HTML from Word; you generate too much crazy coding. I'd hope that anyone that knows enough about the web to be creating an online portfolio would realize that, but maybe not. When I did mine, I copied it all into notepad and then into Frontpage, making all the papers look the same and fixing obvious mistakes (and probably making more) here and there.
However, my copies were obviously clean which is what Seton Hill suggests for the showcase portfolio. Senior seminars even deduct points for professors comments on the final evaluation. However, I also have my developmental portfolio in paper form, complete with comments that will last forever. Although I'm sure it would be handy for professors to see comments, I'm not quite sure why. In my limited student viewpoint, they shouldn't be reading my paper and then checking out what so-and-so thought. That's not important anymore; it's not being graded, it's being viewed as a piece of a whole. In a developmental portfolio that would be important, but in a showcase, it's time for the final, polished product. Think of it this way: it's my senior recital, and even though I practiced for it, you don't see the metronome at the performance.
I also think that electronic portfolios aren't for everyone. I'm in a strange position of having some uniquely online work. I have a hypertext story and internships where my job was to work on a website. It ruins the site's beauty to print them out, and frankly, I have a 3 inch binder that is simply every page I ever did, printed out, because the web isn't permanent.
I obviously like revision, as ironic as it is. My Webster's says that it's the act or the result, so I think that it should only be half-ironic. ;)
Great responses everyone. Donna: I hope yoru portfolio stays online -- it's a great resource! And thanks, Julie, for arguing the pragmatics. And if you didn't hear me shout it loud enough in my original post, let me climb on the rooftop this time and shout it out: your portfolio was superlative -- a great role model for others to follow (and I really hope anyone reading this clicks through the link to check it out). I was very impressed. My point here was simply academic -- that "showcasing" might be the very crux of the problem. It erases and elides so much developmental work (critique, collaboration, revision, etc.) that it doesn't really 'showcase' the learning but the end-product. That's how it works when things are published, of course, and teachers and other people on the job market might want portfolios for practical reasons. I'm just thinking out loud about the value of these things as learning and evaluation tools, rather than packages that students prepare for the job market and so forth. It also occurs to me that portfolios aren't just testaments to one student's development, either -- they're also case studies in the successes and failures of a curriculum, and a means toward improving a major/program (among the faculty who discuss them). "Showcasing" can obscure that part of the process.
Indeed, Dr. Arnzen, my portfolio is awesome. And, I do agree that CDs could be a great solution to the issue...
Yes, online portfolios can be very convenient, but every paper portfolio is pretty much organized like every other... an online portfolio can be organized in many different, creative ways. But a prof who has a stack of documents to get through probably doesn't want to be amused and amazed by a creative organizational scheme. Requiring printouts of all online pages won't solve all problems -- a printout of Julie's hypertext story would be illegible and nonsensical. And since most of the content of online portfolio will be documents that were originally written to be read on paper, when they are poured into an online template, or just uploaded as word files, they might have been good print documents, but that doesn't make them good online documents. I don't think it would make sense to ask a senior English Lit major, in the last two or three weeks of his or her final semester, to write an opera or weld a steel sculpture in order to present his or her academic work. Neither is it completely fair to ask faculty members who aren't especially trained in new media to evalute online documents.
I strongly agree that during the final presentation, there is little real value to having the student click through the online portfolio -- a web page should stand on its own, since most visitors won't have the benefit of having the author standing right there telling them what links to click.
One of the reasons I value reading student portfolios so much is because otherwise I never really get the chance to see papers marked by my colleagues. Reading what my peers have said about students in other classes, and even reading student responses to their professors' comments, really helps bring the student's whole educational process to life. Simply looking at a "Save to HTML" version of the Word file that the student turned in isn't the same thing as looking at a paper that has a big circled "A" on the top page, with a "Good job!" or "I'm so impressed!" comment.