Tag Archives: success

Student Assessment of Their Experience, Not Their Learning

Educational methodologies often emphasize the value of self-reflection and assessment among learners. However, when it comes to evaluating their own academic progress, college students might not be the most dependable judges. In his 2005 book, Self-insight:  Roadblocks and Detours on the Path to Knowing Thyself, David Dunning noted that individuals with limited knowledge or competence in a domain are ill-equipped to accurately assess their own performance or understanding. This phenomenon, read more

Improve Students’ Learning by Surprising Them

Incorporating surprises into college classrooms can significantly enhance students’ learning experiences by capitalizing on the brain's release of dopamine. By employing thought-provoking experiments and demonstrations, unexpected questions and discussion prompts, and guest speakers and field trips, you can harness the power of surprises to cultivate active engagement, critical thinking, deeper understanding, and long-lasting motivation among your students.

Highly-Skilled Craft Workers Who Make Guitars Face the Same “Winner-Take-All” Competitive Market As Other Creative Professions

In her ethnographic study of guitar makers in North America over the past century, Guitar Makers: the Endurance of Artisanal Values in North America (University of Chicago press, 2014) Kathryn Marie Dudley provides a penetrating analysis of the dilemma facing high-end guitar makers. After World War II, it appeared that mass-produced guitars were going to put handcrafted guitars out of business. On top of that, the popularity of electric guitars pushed acoustic guitars to the periphery. Nonetheless, a hardy band of craft workers held on, shared information, created craft fairs, magazines, associations, and other mechanisms for taking collective action to preserve the craft.

Because she was interested in learning how to play the guitar, as well as to learn more about the craft, Dudley got to meet some of the key players in the industry as she conducted her fieldwork throughout the first decade of the 21st century. She attended meetings, went to trade fairs, and thus learned first-hand the vicissitudes of being a craft worker in a machine age.

Like Matthew Crawford in his New Atlantis article, “Shop Class As Soul Craft,” her book celebrates the materiality of craftwork and the intrinsic satisfaction craft workers get in producing beautiful artifacts that other people want to own. She emphasizes that almost all the craft workers she studied were drawn to the occupation not because of financial considerations – – until the collecting boom hit the market in the 1990s, many lived off the wages of their spouses – – but rather because they just wanted to make something.

What makes her book relevant to the maker movement is her depiction of the struggle in the industry between craft workers who are happy with low-volume production and a penurious lifestyle versus those who discovered that they can earn a nice living, but only if they scale up production by using modern technologies, particularly CNC machines. Beginning in the early 1990s, the cash value of vintage guitars soared, surpassing wine and fine art. The pursuit of collectible high-end guitars spilled over into guitars made by contemporary guitar makers, raising their value as well.

Some makers had the surreal experience of selling one of their guitars for less than $2000 and seeing it subsequently auctioned off for 5 to 10 times that amount. $100 guitars suddenly became $1000 guitars, and more. The economic incentive to produce at a higher volume was irresistible to many, but not all. The arrival of wealthy collectors, many of them who made their fortunes and the high technology boom of the 1990s, benefited only some of the guitar makers. Those who were able to get their guitars into the hands of celebrity guitarists and onto the performing stages of concert halls or clubs gain the reputation that radically boosted the value of their products. As in other winner-take-all markets, the number of people who could do this was inherently limited, and so other guitar craft workers had to be content with continuing to earn money with refurbishing and repairs on guitars, with the occasional sale of their own work.

A large part of the narrative in this book concerns the struggles in the guitar-making community over the issue of automation, scaling up, and potential destruction of the sharing ethos which guided early and mid-20th century guitar makers. Just as Richard Ocejoe’s book, Masters of Craft, describes the dilemma of distillery owners who received huge offers to sell out to big distributors, so too does Dudley portray the dilemma of guitar makers, living out their golden years in semi-poverty or buying CNC technology, scaling up, and reaping the rewards of large-scale production & distribution.

In case you were not aware, CNC machining refers to a manufacturing process in which pre-programmed computer software dictates the movement of industrial tools and machinery. This process can be used to control a range of complex machinery, including grinders, lathes, mills and, routers. There are even 5 axis cnc machining tools that can produce a variety of complex objects that would be impossible to make without this tool. Moreover, thanks to CNC machining, three-dimensional cutting tasks can be accomplished in a single set of prompts. You can learn more about CNC machinery by taking a look at some of the resources over on the Tsinfa website.

Hanging over all this are the CITES (Convention on International Trade in Endangered Species) regulations designed to prevent the importation of rare & endangered wood products, making it very difficult for makers to get the materials they need.

To scale or not to scale, that is the question facing skilled artisans today.

Talk Less, Teach More. But How?

“Talk less, teach more” sums up the mantra of the active learning approach to pedagogy. But how can you do that? I have four suggestions.

First, if you ask students a question, listen to their answers. We all know the research showing that most instructors wait two seconds or less before answering their own questions. Don’t do that! Ask a question, count to 10 silently, and if no one has responded, ask the question again. Still no response? Paraphrase the question and ask it one more time. I find I almost never need even the first 10 seconds, as sooner or later, one of the students “cracks” and volunteers. To do this effectively, however, you’re going to have to learn to appreciate silence. Trust me, it is actually refreshing in the classroom to sit silently and contemplate something, rather than coping with a constant wall of words.

Ryōan-ji Temple

Ryōan-ji Temple, Kyoto, Japan. Only 14 of the 15 rocks are visible from all vantage points

Second, instead of jumping right into asking for responses, give students time to jot down their thoughts. This will probably take no longer than a minute or two, but it does wonders for freeing up the blockage that students often encounter when they are immediately asked for an oral response to a question. I’ve use this technique successfully in many countries, especially in Southeast Asia, where students are often reluctant to speak. The very act of writing down their thoughts seems to show students that they do, in fact, have something to say. You can then ask them “read me what you’ve written on your papers,” if they’re still reluctant to speak off the cuff.

Third, use the board to list the answers that students offer. Writing on the board has a number of benefits. It slows you down, giving you a chance to process what the students had said and come up with follow-up question, if need be. It also gives you a justification for probing a student response, as you can say that “I’m not sure I completely understand what you said – – could you elaborate?” Writing on the board, in the student’s own words, shows the students that you take them seriously. It privileges their voice, especially when you resist the impulse to pre-edit their responses and write down what you were going to say anyway. Seeing their own words on the board seems to embolden the students and encourage them to volunteer to answer the next question. Finally, writing in the board also gives you a written record for later review, either in the class or – – if you photograph the board – – later, when you decide on what should be covered in the next class session.

Fourth, put students in groups to work on your questions or problem sets. Tell the group that you will be calling on a member of the group to give an oral response to your question and then walk around the room, coaching them as needed. When you ask groups to report, you don’t need to run through every single group. After a member of the first group gives an answer to the question, you can ask other groups if they have amendments, revisions, objections, supplements, and so forth. Refrain from commenting yourself until you given the students sufficient time to hash things out among themselves. Often, you will find that everything you would plan to say yourself has now been voiced by the students.

Colleagues sometimes object that using these techniques means you can’t cover as much. My response? First, who cares! Second, and more substantively, if the goal is to teach for understanding, there’s no better way to find out if your students are learning their lessons than to hear it in their own words.

Papers into PowerPoint: Help Your Students Turn Their Papers into PowerPoint Slides

Academic papers are not good candidates for PowerPoint slides. Instructors, conference organizers, and seminar conveners expect submitted assignments and papers to have all the trappings of academic legitimacy, which means a literature review, justification for hypotheses, extensive description of methods used, and evidence used to support empirical conclusions. I have seen students build PowerPoint presentations by beginning at the title page and systematically working their way through every section, faithfully following their papers’ layouts.

Consequently, they create presentations with massive walls of text, few visual aids, too many embedded references, and so many slides that they can’t finish in the time allotted. Because they are afraid of leaving out essential points, slides are crowded with text from top to bottom. Some even copy whole paragraphs from their papers onto the slides. Inevitably, two things happen. First, to assuage their fears of overlooking something, students use slides as their scripts, mindlessly reading the slides to us, word for word. Second, audience members who try to read what’s on the slides while at the same time listening to what the student says – – after all, it is possible that presenters will slip up and say something unplanned – – find the task impossible. Our brains are not wired to listen and read at the same time, regardless of what some people believe about “multitasking.”

With so many slides to cover, students soon find that they are running out of time. What to do? Should they omit some of their precious slides, pushing past minor slides to get to the major points? Or, should they just talk faster? Nine times out of 10, “faster” wins because they hadn’t prepared for the possibility that they would need to edit on the fly. Consequently, they can’t do it. Their only option is to talk faster.

Raven Discovers Humans

Raven Discovers Humans, by Bill Reid, UBC Anthropology Museum, Vancouver

I suggest a better design process. First, tell the students to organize the presentation as if there were no paper. Ask them to put the paper away and not consult it again until they have a first draft. If they have read the literature, created a paper outline, written the paper, and then copyedited it, they should know the story by heart. No need to continuously consult the paper while preparing the slides. Second, they should find out exactly how much time they will have for the presentation. In a typical 15-minute presentation, presenters can probably cover six or seven slides, or maybe a few more if they are just graphs and pictures. If it is a seminar presentation and they have 20 or 30 minutes, they can add a few more slides, although I prefer to add more words to my oral presentation than slides to the slide deck. Regardless of much time is allotted, presenters should practice the entire talk at least twice.

Third, using as few slides as possible gives presenters flexibility in how they use their time. With more slides, each of which must be displayed/described, presenters’ hands are tied when they realize they are running out of time. (Or in exceptional cases, they discover a time surplus!) Having a small number of slides, from the very beginning, means that presenters prepare to talk more and consciously work harder to maintain their connection with the audience.

Fourth, presenters should reflect on the story they want to tell. How will it begin, how will it end, and what needs to go in the middle to justify the ending? I emphasize again: do this without going back to the paper!

Try this experiment: Imagine yourself in a conversation with a friend. Explain to them the problem you set out to address in your paper, what motivated you to take it up, what previous work was critical in shaping your own thoughts, how was your research designed, where did you get the data, how did you do the analysis, what did you find, and what does it all mean?

Fifth, plan the flow of the presentation. For a 15-minute presentation, presenters should lay out six or seven blank sheets of paper on the table and moving from left to right, write down the main point they will make with that slide. These slides will be the script, but not a script is read. Instead, the slides, and especially the graphics on them, will be their cues as to where they are in the story. Think of the slides as analogous to the story-board that movie directors use to plan their shots. Some of the slides might just have a title and a picture or two, whereas others might have a few bullet points. Full sentences are deadly for PowerPoint – – they encourage people to read, rather than listen.

The Internet allows access to thousands of images, and under the Creative Commons licensing system, if you give credit to the originator of the image, you’re free to use it however you choose. Find relevant images that convey the point of the slide. Ideally, they should advance the story and comment on it.

Finally, when presenters have finished the first draft of the story, with each slide having a title and possibly an image, consider turning on the built-in design assistant from PowerPoint. I found it makes great suggestions and you can create eye catching graphics by following its advice.

No amount of fancy design work will make up for a poor story, but many a good story has been ruined by poor design. Help your students get a leg up on the process by telling them to put the paper away and craft a story from their own understanding and imagination.

Derek Lidow’s Terrific New Book on Entrepreneurship

Derek Lidow’s book, Building on Bedrock: What Sam Walton, Walt Disney, and Other Great Self-Made Entrepreneurs Can Teach Us About Building Valuable Companies, is a welcome corrective to the overhyped promotion these days of high capitalization, high-technology, and high-risk businesses. Bedazzled by the wild hype surrounding gazelles and unicorns, entrepreneurship researchers have continued to focus on the black swans, even though the total IPOs in any given year would fit comfortably into a large lecture hall, as on average just over 100 U.S. firms went public annually between 2001 and 2016. The number of new ventures receiving venture capital funding annually in the United States has not changed appreciably in the last 20 years, hovering around 1400 per year. Nonetheless, business books and prominent entrepreneurs continue whipping up enthusiasm, encouraging entrepreneurs to take big risks in anticipation of big gains.

Robert Davidson sculpture

Meeting at the Centre, by Robert Davidson

In contrast, Derek Lidow points to “bedrock entrepreneurs” as the true foundation of economic prosperity in the United States. Every year, hundreds of thousands of ordinary businesses are started in the United States, many by people who have no idea what they are doing and who are not prepared for the challenges they will face. Martin Ruef and I wrote about these “mundane entrepreneurs” in our book, Organizations Evolving, and Paul Reynolds has diligently documented their existence through large scale representative samples of business starts. Lidow offers sage advice to would-be entrepreneurs, suggesting that many of them would be better off taking wage and salary jobs. But, for those who are willing to prepare themselves for the challenges, he recommends going for it.

But, “going for it” does not mean in the reckless way encouraged by entrepreneurial self-help books, but rather in a mindful, reflexive, and experimental way. He shows that successful entrepreneurs are not differentiated from the rest of us by any inherent talents, but rather by their willingness to learn from their experiences. He recommends that entrepreneurs continue experimenting until they either get it right or realize that the venture they’ve planned will not work.

This is a delightful book, written by somebody who has had a productive career running a family business, starting his own business, being CEO of a listed company, and then transitioning to a university position. He has the life experiences and educational training, including a PhD in applied physics from Stanford, to offer valuable advice. He readily admits his mistakes and is humble about his successes.

I highly recommend this book to anyone who’s contemplating entrepreneurship and to anyone who is consulting, teaching, or otherwise involved in the entrepreneurial community.

 

Setting Assignment Due Dates: Early, Late, or In-Between?

Students often complain that they can’t get enough sleep because they have too much work to do (Hershner and Chervin 2014). My first response has been to suggest that they are just not managing their time well. I seemed to have found evidence for my view when I taught a first-year honors seminar in the fall of 2016 with 24 students. Because I had the students submit their assignments through Sakai, each two-page paper came with a timestamp and I could see exactly when they were submitted. Following my customary practice, the papers were due at 9 AM in the morning, right before class met at 9:30 AM. Most of the assignments were turned in after midnight: 71%, on average, across the four assignments. Some students clearly stayed up most of the night, as for example with paper three, when seven assignments came in between midnight and 2 AM and three came in between 2 AM and 5 AM! For the last paper, eight came in between 2 AM and 5 AM. I was stunned, but what could I do?

Ghosts in the trees

Ghosts in the trees

In the fall of 2017, for the same course, I tried a simple modification: papers were “due” at 9 PM the night before and then “accepted” until 9 AM the next morning, before class. Papers that came in “late” were not penalized. The difference between the two semesters was dramatic: across the four papers, only 15% on average came in after midnight. And that number was inflated because on the fourth paper, six of the students chose to review their papers once more before turning them in, and so they came in between 8 AM and 9 AM, not during the midnight hours. For the first three papers, 85% of the papers, on average, were turned in by 9 PM the night before.

With this simple modification in the due dates and times, students stopped “maniacal binging” (Boice 2000), completed their work well before midnight, and presumably got a good night’s sleep in the bargain. Using a simple tactic of signaling that papers were “due” at 9 PM, I gave the students a hard constraint that they used in planning how they allocated their time. They didn’t want to be “late,” even though “late” carried no penalty. (And no one ever asked me if there would be a penalty.)

I now use this technique on all my assignments, whether they are graded or just checked off when submitted. Having assignments due the night before not only gives students the opportunity for a good night’s sleep but also, if I so desire, gives me an opportunity to review their work and to make modifications in my lesson plan, if the submitted papers reveal any misunderstandings that I need to clear up. What is particularly attractive about this technique is that it works without the imposition of any penalties for “late” assignments. Following Lowman’s (2000) lead, I behave as if there will no such a thing as a “late” assignment and the students make my words come true.

Interested in learning more about late assignments? See this post.

Save

Save

Save

Save

Save

Save

Strategies for Managing Team-Based Research (co-authored with Akram Al-turk)

The scientific community celebrates individual achievements by conferring prestige and honors on scientists who win out in the competitive game of being the first to publish innovative research. Paradoxically, however, modern scientific expertise rests heavily upon work carried out by teams, rather than scholars working on their own. Tensions between the forces of competition and cooperation thus infuse every aspect of scholarly activities: grant writing, publishing, leadership in scientific organizations, and so forth. Thus, it is understandable that graduate students and junior scholars would be perplexed by how to manage such tensions.

We believe the key to successful collaborative relationships lies in preparing for them ahead of time, rather than attempting to deal with problems as they arise. In fact, some research suggests that the effectiveness of collaborative work is determined before any of the work is carried out. Collaborative work could be made easier using software solutions that adapt existing Microsoft software so that it can be put to more productive use – to find out how SharePoint technology can be improved further, read this to learn how Bamboo Solutions can provide a centralized, searchable, and secure knowledge management system in no time at all. We have identified four structural elements that increase the likelihood of creating and sustaining collaborative relationships.

Define the Scope and Logic of the Project

At the start, the parties to a collaborative relationship should agree on a project’s scope and logic of inquiry. The researchers should ask themselves a few questions that will ensure that they are all on the same page. For example, will the project be open-ended, continuing until all possible avenues of interpretation have been explored and as many papers as possible published? Or, is the project more self-contained, with target journals or conferences identified and the project ended when a paper is accepted? Is the relevant data for the project already in hand or clearly identified, or will building a new dataset be a major thrust of the effort? Sharing “mental models” of the work to be done and how it should be carried out leads to effective teamwork.

In addition to being able to answer these questions, the types of goals a team comes up with will likely affect how well the collaboration goes. Although “write a paper together and get it published” is a common goal for academic collaborations, the success of the research project may depend on having a compelling goal. Is the research question challenging and (by academic standards) somewhat consequential? And, is the goal focused enough so that researchers are working toward a final product but open-ended enough that researchers have some level of autonomy and can be creative when the need arises? Interdisciplinary teams need to communicate with one another the reward systems of their disciplines, as some may place higher values on books than journal articles, or may value certain kinds of journals over others.

Agree about Responsibilities

Teams should also be deliberative and explicit about each researcher’s responsibilities. External factors often dictate how well an organization (or group) does, but individual interventions, especially by team leaders, can lead to more effective team performance . Teams should decide whether one person will be identified as the “leader” of the project, ultimately responsible for taking major decisions (after consulting with the team) or whether leadership responsibilities will be rotated. In either case, a leader can increase effectiveness by ensuring that the research team comprises individuals whose skills and competencies complement each other and all contribute to the overall goal of the project, designing tasks that give everyone enough autonomy to make their contributions personally fulfilling and meaningful to the project and establishing norms of how the group will work and interact . Teams should identify each team member’s competencies, clarify what that member will do to move the project forward, and make sure everyone on the team knows the others’ roles.

Enforce Deadlines and Give/Receive Timely Feedback

Failure to meet deadlines often sinks collaborative relationships. However, failure to even set deadlines is probably a bigger headache. Without deadlines, members have no way of holding one another accountable for holding up their end of the relationship, as a member can always say that they’re not quite finished yet or they will have their part done “soon.” To receive the benefits of collaborating with people who have complementary skills, team members must be ready to comment in a timely fashion on intermediate products produced by others. First, team leaders can make sure that all researchers on the team are kept in the loop about how the project is going. Second, leaders can try to encourage everyone on the research team (and model ways) to provide good, timely feedback, e.g. by scheduling regular feedback sessions. This can be assisted by using project scheduling software so that everyone is on the same page.

Use Coordination Mechanisms That Facilitate the Collaboration Process

Coordination and communication challenges can hinder the success of collaborative research. Although email and video conferencing services such as Skype have become ubiquitous, these technologies do not necessarily ensure that collaboration is successful. For example, although email and video conferencing allow researchers to communicate more easily, these kinds of tools may not be the best for task coordination, information sharing, and intra-project learning. One of the main challenges for teamwork is juggling multiple and simultaneous work tasks. Researchers, therefore, should use tools that help them manage these multiple tasks, allowing them to know what’s expected of them and see changes to the project almost instantaneously. A plethora of programs and software now allow for this. We recommend that researchers start with one that has low start-up costs-both in terms of time and money-and not be lured by fancy features, as they can be a time sink. Sometimes, investing in innovative technologies is worth the time, but teams should be deliberate about whether the investment is worth it for their project.

Summary

We have identified strategies for mitigating or eliminating collaboration problems in team-based research. At the beginning of a project, face-to-face meetings can establish the ground rules and expectations were all members of the team. Free riding, shirking, and social loafing are much harder when team members agree on responsibilities and create monitoring and enforcement mechanisms. Candid and timely feedback limits the damage that emergent problems can create, but requires strong leadership and commitment by all members to be effective. Finally, as in other collaborative efforts, state-of-the-art coordination and communication technologies facilitates effective team governance.

Save

Save

Journal submissions: Playing up (or down) to the competition

Every fall I look forward to the opening of the college sports season: football, soccer, field hockey, volleyball, and so forth. People get so into it they go and look at the FanDuel betting odds to see how they could do if they participated in a bet. In particular, I enjoy the discussions in the sports press about the choices athletic directors and coaches have made in setting up their schedule of games. Unlike the professional sports leagues, where scheduling is taken care of by the league office and considerations of equity and robust competition are explicitly taken into account, college schedules are under no such strictures.

Carolina soccer player

photo credit: IMG_9551 via photopin (license)

In scheduling games, college athletic directors face two stark choices. They can make their teams look good by padding their records with early games against lesser opponents, thus ensuring at least a winning record for the early part of the season. Or, they can put their teams through a trial-by-fire by scheduling tough opponents. Why wouldn’t athletic directors choose the easier path, giving teams an early-season break and setting them up with a winning record?

As sports commentators are quick to point out, the danger of taking the easy road early on is that playing against lesser competition lulls teams into a false sense of confidence. Running up the score against weaker teams covers up mistakes and gaps in preparation, such as athletes’ lack of endurance. Players who look like All-Americans against East Overshoe Tech become sloppy, take plays off, and are overwhelmed when they come up against teams in their own league. No matter how much the coaches tell them that the early-season games against weaker opponents are no gauge of their true strength, players may start believing their own press clippings. Training with a professional mindset remains as crucial for these players as it would have been since they stepped on a soccer pitch for the very first time. Without some of the equipment provided by the likes of Gear Up Sports, it is highly unlikely many would be as good a soccer player as they are now.

The other danger of scheduling easy games early in the season comes back to haunt teams at the end of the season, in those sports where teams are invited to championship competition based on the strength of their schedule. Committees deciding on which teams to include in the playoffs, such as in women’s soccer or men’s basketball, can easily spot the flaws in a winning record based on playing weak competition. Florida State’s overwhelming early season win against the Texas State Bobcats will be heavily discounted!

Athletic directors with their eyes on the future are advised to schedule at least a few tough opponents early in the hope that difficult competition will pay off and prepare the team for its league schedule against stronger opponents. Such planning may also ease a team’s path into the postseason.

I’m reminded of this scheduling dilemma every time graduate students and junior faculty come to me, seeking advice on where to send their papers. As I see it, academics just beginning their careers face the same conundrum: do they aim for the top journals in the field or do they try for the easier route, in journals with weaker review boards and softer selection criteria? Why not try to pad your resume by aiming for the Journal of Lost Causes, which you know accepts almost half the papers it receives?

My answer to the authors seeking advice is the same that savvy athletic directors offer to desperate coaches: if you began by playing down to the weakest level of competition you can find, you set in motion a process that becomes hard to reverse, after a few iterations. Getting into a top journal is hard work, requiring sophisticated literature reviews, excellent research designs, and state-of-the-art analysis, regardless of the kind of data collected. If the paper is a theoretical/conceptual contribution, rigorous analytical thinking will be required, as well as lots of revisions before the paper is submitted.

I tell students that even if a paper is ultimately rejected at a top journal, the experience gained in the process is priceless. Most top academic journals use what they call a “developmental” review process, a much kinder and gentler process than authors faced three or four decades ago. (I hasten to add that I discourage “frivolous” submissions which just clog up the review process – – a senior colleague can quickly tell a junior scholar whether a paper is worth submitting to a top journal.) As a colleague reminded me, you must be prepared to invest anywhere from 2 to 6 months, on average, with every submission. That’s another reason to “start early.

Recruitment and promotion committees are seldom fooled by resumes padded with acceptances at weaker journals. So, I would turn to the weaker journals only after I had tried the top journals.

Although the odds of acceptance are low, gaining experience with the practices necessary to compete at the highest levels pays off in the long run.

What Sustains a Belief in Success Among the Unsuccessful?

I’ve been haunted by the question of what sustains belief in success among the unsuccessful ever since I read Reinhard Bendix’ magisterial book, Work and Authority in Industry. Bendix wrote about the economic ideology that kept millions of people in England, the United States, and other Western read more