Using Independent Research to Avoid the Bullseye of Bias

A bullseyeOver the past ten years the Justkul research team has worked on hundreds of customer surveys for investment deals and strategic initiatives. Many of our clients could execute research themselves, but they have come to value the quality of our work, our expertise in knowing what questions to ask, our skill in avoiding common mistakes, and the way we free up their team’s time to concentrate on other aspects of a deal or strategic initiative. However, there is perhaps one factor more important than all of these: the independence of our research. Unlike most other parties in a particular deal or initiative, Justkul never has significant vested interest in any particular outcome or conclusion: Justkul is paid the same amount whether a deal or strategic initiative goes forward or whether it does not. We believe this type of independence is essential for minimizing bias.

Bias, or an inherent prejudice for or against a given outcome, can have a significant impact on the conclusions of a research study. It is often underestimated how easy it is for bias to enter a research project. Bias can creep into a survey at almost any stage in the process:

  • In the decisions of which questions to include,
  • In who is invited to take part in the survey (digital redlining, etc.),
  • In the phrasing of particular questions and the order and phrasing of answer choices,
  • In adopting a narrative flow that favors certain answers over others,
  • In decisions as to which data points are included or removed from the final data set,
  • In how the data is interpreted or summarized.

A lack of independence at any of these stages can produce misleading results, which lead to poorer and more risky decisions.

Hence, in order to make sound decisions, it is important to understand the potential causes of bias so that conscious decisions can be made about how to minimize the impact of these causes.

The Bullseye of Bias

The causes of bias are various, but one way to organize these causes is as the bullseye at the top of this article with intentionally malicious causes of bias in the center, intentionally non-malicious causes of bias in the next concentric circle, and unintentional causes of bias in the outer circle.

In this schema the most nefarious type of bias is in the center, but as its relative area suggests, in our experience it is fortunately also the rarest type. Far more commonly, biases arise from the causes in the outer circles. Because of the importance of avoiding this bias, it is worth looking at each of these types of causes in more detail.

Intentional and Malicious Causes of Bias

Intentionally-malicious causes of bias occur when decision-makers make a conscious decision to either lie or omit important details that would be likely to change the overall outcome of a project or decision. “Intentionality” is a complicated concept (See Anscombe, Intention), but in this case, we only mean that it is the result of explicit choices.

Justkul team members have encountered this situation on more than one project in the past. For instance, in one project we worked on the buy-side of a private equity deal and were asked to gather customer data on a high-end consumer product company. The potential investment looked great from its own presentations: its products were attractive, prior survey work showed that clients liked the products when they initially bought them, the management team seemed experienced, and the short-term financial data looked solid. Nevertheless, at the time the potential investment had a dark secret it was actively seeking to repress: its products were prone to breaking down. In an apparently deliberate effort to conceal this fact, none of the prior survey work or reports mentioned issues about repair and maintenance, and the company deliberately went out of its way to delay sharing customer contacts with the Justkul research team. The malice of this strategy was made explicit when a leader at the company asked if they could just wait a few more days to share customer contacts, which would mean that we would only get the contacts after the deal closed. This raised red flags and after we communicated it to our private equity client, the deal was eventually called off.

In this case, the explicit request from the executive made it fairly easy to identify the bias in the information the company shared. However, in our experience such obviously malicious cases are fortunately rare. More commonly, biases are introduced for non-malicious reasons, either intentionally or unintentionally.

Intentional and Non-Malicious Causes of Bias

In intentional and non-malicious causes of bias, a conscious decision is made to provide incomplete or potentially misleading data, but unlike the malicious case, decision-makers have grounds to justify their decision. Decision-makers might even convince themselves that they are making the right decision under the circumstances, such as when a company gives into the temptation to ignore survey results that do not fit in with their overall narrative. For instance, a company might nearly always receive a very customer satisfaction score in their internal survey results, but one independently-conducted survey might show a far lower score. Perhaps the company could provide a fairly good argument that because 95% of surveys showed a different result, this result is merely an outlier and can be ignored.

However, it might also be the case that there is something wrong with the other 95% of surveys. This suggestion may seem radical, but it’s actually not unusual: perhaps the company’s survey tool was inherently biased to begin with by making respondents only focus on positive experiences, or perhaps there were factors in the recruiting process that encouraged only respondents who were more enthusiastic about the company to complete the survey, or perhaps survey respondents were not assured the anonymity of their results. The importance of anonymity has been underscored for us many times on telephone interviews — ­especially in B2B industries where customer-sales rep relationships are key. In such interviews, a respondent will often ask for reassurance that the interview is truly anonymous before proceeding to give critical feedback. This is the reason Justkul generally insists that our survey respondents be assured anonymity in addition to confidentiality.

Unintentional and Non-Malicious Causes of Bias

Finally, the most common case is non-malicious and unintentional causes of bias. Examples are numerous. An investor who has an interest in having a deal go forward might overlook some key hypotheses that would suggest it should not go forward. A consultant who thinks a company should focus on countering the strategies of a specific competitor may overlook the challenges posed by other competitors. A clothing company that believes the quality of its fabrics are obviously better than competitors might be less inclined to put that hypothesis to the test, even though customers may actually perceive the fabric as lower in quality. All of these assumptions can have a significant impact on the outcome of research, and thus produce data that is inferior to research that is conducted independently.

Finally, even if data is conducted well—using surveys that are designed not to favor any particular outcome and recruiting participants in an un-biased manner so that the resulting data is truly representative of the underlying population—there is still considerable possibility for bias in the interpretation of those results. Negative data points can be ignored, other positive data points may be artificially promoted, and almost any survey result is potentially manipulated through spin or by ignoring important qualifications. The solution to all of this is to take steps to ensure the interpretation of the research is also independent.

Conclusion

Companies often have to rely on self-collected data to make routine business decisions, and this is good and entirely appropriate, provided the company take steps to limit bias in the data set. However, if an unusually important or difficult strategic decision needs to be made, for the reasons outlined here, we believe there is no substitute for data from an independent third-party research partner.

Why Would A Private Equity Firm Hire An Outside Customer Research Company?

One could argue that no component is more important for an investment's long-term success than understanding the relationship between a company and its current and potential customers.

As the CEO of a customer research firm that works primarily with private equity, I am often asked what value customer research can bring to a private equity deal. People outside the private equity industry sometimes find it surprising that customer research can have a role in transactions that are so often portrayed as driven solely by deal-making and hard numbers. Even some people within the industry undervalue customer research, thinking that a few telephone calls or general market analysis is all that is required. However, the private equity industry has changed significantly over the last few decades. Whereas a simple LBO model with minimal customer research might have been sufficient for good returns two decades ago, high valuations and increased competition among firms is leading the industry to more sophisticated and strategic thinking. This is reflected in who is involved in a deal: whereas in the early days an investment might be largely driven by bankers or financial officers, now strategic consultants – whether in-house or hired from external strategy houses – are playing an increasingly important role in investment decisions. This rise in strategic thinking coincides with an increased focus on the “softer” sides of a deal, such as customer research. Despite often being classified as a “softer” component, one could argue that no component is more important for an investment’s long-term success than understanding the relationship between a company and its current and potential customers. In the end, the success of every business depends on this crucial relationship: it is where growth comes from, and it is what gives a company an advantage over its competition. Why would a private equity firm want to conduct customer research? In my experience there are at least five reasons why private equity firms conduct detailed customer research before a deal closes:

  • Good customer research can help investors identify unexpected strengths or weaknesses of an investment.  This is perhaps the most traditional reason for conducting due diligence research. Knowing what risks investors may incur and learning how the investment’s products and services compare to its competitors can be important not only for adjusting valuations, but also for deciding whether the deal is even worth pursuing to begin with.
  • Good customer research can help investors develop and validate future growth strategies. Often an investment hinges on a number of very specific strategic growth hypotheses. By testing each of these hypotheses in detail with the current and potential client base, a private equity firm can get a sense of whether their assumptions are correct and what strategic changes will have the biggest impact on a deal’s success.
  • Good customer research can reduce uncertainty. Good research can also help answer a multitude of smaller questions and thereby reduce the uncertainty inherent in a deal. What effect will relocating a company headquarters have on sales? Will a potential acquisition be an asset to the brand? Will customers be open to purchasing an adjacent product or service? All these questions can be answered through good customer research.
  • Providing an acquisition with the results of good research can help set future expectations. Companies often initially succeed with a great idea, a superior product, and funding from angel and VC investors. At these early stages, a company may perform A/B testing and benchmark performance against its competition, but detailed market research is seen as an expensive distraction. However, when a firm reaches sufficient growth to enter the middle market and become a potential private equity investment, the role of research can change dramatically. Now, not only will research be important for setting wider brand strategies, but it is also necessary to fulfill board reporting requirements and for ensuring a firm is sufficiently transparent with investors. Conducting good customer research before a deal closes can help set expectations for what these future reports should look like.
  • Good research can create a useful dialogue between a company’s management and investors. Good dialogue between investors and a company’s leadership is essential for the success of an investment. Research helps a private equity firm gauge their ability to work with a company’s leaders. A management team that engages with unexpected insights rather than seeking to merely dismiss them is a good first sign that a successful partnership based on mutual trust will develop. I know of deals that were called off because such dialogue failed to be productive or management was unusually defensive. More than this, by talking through a research study’s findings and developing strategies together, both investors and the company will begin to see a deal as not just a transaction, but as the first step in a long-term partnership together.
By talking through a research study's findings & developing strategies together, both investors & the company will begin to see a deal as not just a transaction, but as the first step in a long-term partnership together.

As these five reasons suggest, customer research can be an important tool in the due diligence process. It not only provides investors with better information at the time of an investment decision, but it also can be useful for helping set future expectations and strategy. I emphasize above that “good” customer research does all these things. However, research that is performed without sufficient care and attention can lead investors seriously astray. Examples of these types of errors include insufficient care in phrasing or in ordering questions, paying insufficient attention to the UX of survey participants, not appropriately stratifying sample, not sufficiently pilot-testing tools to avoid technical errors, or not sufficiently exploring unexpected findings. These kinds of mistakes can often provide misleading data that makes bad investments look good or conversely can lead an investment team to pass on a very good investment. Despite the ubiquity of fast and inexpensive survey tools, getting research right can often require considerable thought, time and expertise. Why would a private equity firm want to work with a third-party research firm? Some private equity firms may have research expertise in house, and others may obtain the required expertise through strategy consulting firms. Even in these cases, though, considerable advantages can be obtained by partnering with a specialty customer research firm. A third-party research firm can provide four additional advantages to the process:

  • A third-party research firm can provide experience and expertise. Good business research requires skills that can be very different from those that make for a good investor or management consultant. A company with a culture that values and promotes employees who have these skills will often produce more solid results. In addition, third-party research firms often conduct research in a variety of industries and geographies, some of which may be outside of a private equity firm’s or consultant’s expertise. A third-party firm may therefore better know how to properly adjust research methodologies for these different markets and recognize unexpected questions that have cross-market application. For instance, a question that produces fruitful results in consumer packaged goods may also have applications in B2B contexts, and a research approach that makes sense in the U.S. may not make sense in Singapore.
  • A third-party research firm can help provide an additional level of discretion. Deals are complicated transactions that can have significant impact on different stakeholders. It is often useful for a board and potential investors to investigate a potential deal or partnership without causing unnecessary disruption if the parties involved in the deal decide to go in different directions. A third-party research firm can serve as a firewall between the research and the larger public, thereby preventing a potential deal from garnering unnecessary attention until it reaches a stage at which it makes sense to do so.
  • A third-party research firm can help reduce bias. There sometimes can be intentional biases in a deal: a company seeking to be acquired may only report positive data or fail to report potential risks adequately. In this case, independent research can ensure important questions are asked before a deal closes. However, more often biases enter unintentionally: a company that has a strong culture may be blind to its own weaknesses, and a company that only relies on A/B testing of current customers may have unrealistic expectations of the potential in the larger market. In addition, even research conducted internally by a private equity firm may carry some bias: team members who are personally invested in the success of a deal may be unable to step back sufficiently to recognize risks. Research from a third party that has no stake in whether a deal closes or not can significantly reduce this bias.
  • A third-party research firm can be a valuable resource for an acquisition after a deal closes. As I mentioned earlier, many companies that PE firms invest in are in the process of making a transition between a startup/VC-fueled business model and a business model that is focused on expansion and growth. An independent research firm can serve as a bridge, providing research guidance until those capabilities can be built up in-house. Furthermore, even after a company develops extensive internal research capabilities, the company’s executives may nevertheless find it useful to bring in the external company that conducted the due diligence research in order to verify assumptions before making important strategic decisions.

As company multiples steadily increase, and as it becomes consequently less likely that a private equity firm will find an amazing company at a great price, good customer research is becoming an increasingly important component of successful private equity deals. Given that good customer research adds little to the overall cost of a deal, and given the significant benefits and insight independent research can provide, we think good customer research should be an important part of any private equity deal. By @jfhannon, CEO at Justkul Inc., a research firm focused on the needs of strategy and private equity.

Steve Jobs and Market Research in Contexts of Uncertainty

Steve Jobs in 1990

According to some, market research is pretty useless in contexts of uncertainty. These contexts include disrupted markets, the introduction of radical new innovations, or the launch of new products and services. Steve Jobs explained this view in an interview:

“The problem is that market research can tell you what your customers think of something you show them, or it can tell you what your customers want as an incremental improvement on what you have, but very rarely can your customers predict something that they don’t even quite know they want yet. As an example, no market research could have led to the development of the Macintosh or the personal computer in the first place. So there are these sorts of non-incremental jumps that need to take place where it is very difficult for market research to really contribute much in the early phases of the thinking about, you know, what those should be. However, once you have made that jump, possibly before the product is on the market or even after, it’s a great time to go check your instincts with the marketplace and verify that you’re on the right track.” (PBS/Nova Interview,1990)

Steve Jobs could recognize the usefulness of market research, but he suggests it is not useful when the market is going through these non-incremental jumps. A similar mindset is found in an even stronger form in certain parts of the present-day startup community: it is often thought that it’s better to just bring a product to market and see what happens, rather than rely on misleading market research that is incapable of envisioning the future.

We have no idea how many failed startups would have succeeded if they had paid more attention to the findings of market research.

There is no doubt that many companies succeed by adopting approaches that do not involve much market research. However, this in itself is not a sound proof for ruling out the usefulness of market research, because we have no idea how many failed startups would have succeeded if they had paid more attention to the findings of market research. Instead of being based on a sound empirical argument, the plausibility of this argument seems to rest, in part, on a number of assumptions about what market research is, and how it works.

Standard Market Research and the Principle of Continuity

When Steve Jobs spoke about market research, he was likely speaking about a particular kind of research. These are the surveys asking you to rate services on a scale of 1 to 10, asking you whether you prefer red cars or blue cars, or giving you complicated conjoint trees to determine if it is more important for you to get more product or lower prices. All of these studies depend implicitly on a principle of continuity: that your present opinions can be used to reliably predict your future actions.
As Jobs appears to recognize, this principle can break down in disrupted markets. If we look at this principle in more detail, it typically implies at least four sub-principles, all of which can fail when one is conducting research:
1.   The overall market will be the same in the future as it is now. This principle is reasonable in many situations, but Jobs proved it false when his teams introduced the Macintosh, the iPod, the iPhone and the iPad, each of which changed the markets in fundamental ways. Furthermore, it fails all the time in ordinary business practice: financial bubbles burst, companies that are on the top of the world go bankrupt a few years later, entire industries disappear.
2.   A respondent’s beliefs will be the same in the future. Closely aligned with the preceding principle, a respondent’s views can change even if the other components of the market do not. Someone might be against sharing credit card numbers or personal information online when they take a survey, but come to accept the practice a few months later.
3.   Respondents are accurately conveying their present beliefs when they take a survey. It’s common knowledge that people sometimes lie on surveys, or under-report activities they are ashamed of. However, even when people are trying to accurately convey their present beliefs, they may fail to do so. In particular, we tend to think of our personalities as uniform over time and place, but many of us adopt very different personas when we spend time with our family, or with our friends, or with our colleagues, or when we are on our own. A view we reveal on a survey may not reflect the view we act on later while partying with friends.
4.   What someone says accurately reflects what they will do. This belief is questioned frequently today as big data enables us to actually track the difference between saying and doing. In certain cases, it may turn out that basing predictions on past actions rather than opinions produces more accurate results.

In markets that remain constant over a long period of time, it may be unnecessary to question any of these principles. For instance, a mere correlation between what people say and an increase in sales might be all that is needed for an incremental gain, and no one may care to think any more deeply about why it’s the case.

Market Research in Uncertain Times

However, as soon as contexts arise when the principle of continuity does not hold, companies and whole markets can be led badly astray if they merely follow past correlations. In these situations, as Jobs notes, respondents may very well not know what they will want.

Yet, even in the most disrupted markets, where there are many discontinuities at the surface, there may be underlying factors that do not change, and therefore at deeper levels the principle of continuity can still hold, and research still has something to say.
In these cases, instead of mechanically asking respondents, “How likely is it that you would buy this new product?,” one should begin by thinking hard about the context of purchasing and using the product and ask, “What things have to be true if people are going to buy this product?” Moving from the general question to a hypothesis about its components in this way does at least four things:

  • First, it forces us to articulate and address the most important assumptions we are making. Often, we are implicitly assuming things that will prove to be false. Identifying the assumptions before conducting research allows us to explicitly test them.
  • Second, once we have identified a broader range of assumptions, we may be led to reconceive the range of possibilities we need to take into account in our questions and in the subsequent analysis. For instance, we may determine that a particular assumption does not hold in general and thereby identify new segments. These different segments may have different needs and decision-criteria.
  • Third, it can lead us to identify important outliers that do not necessarily conform to our expectations. If we think that a factor is essential, and it turns out to be false for a small number of respondents, this may be a cue to talk further with those individuals. Perhaps they are anticipating the next big trend in the market.
  • Fourth, it makes us think more deeply about the enterprise we are undertaking. Part of this comes from the fact that good research leads us to ask “Why?” questions that we may not have even thought about before.

Analyzing decisions into components makes it possible to find continuities in conditions of uncertainty. Moreover, when we have the whole framework of assumptions and possibilities available, it then becomes possible to track underlying factors that do change through proxies and analogical trend analyses.

An online survey constructed to test hypotheses about decision factors can tell you not only why your customers make the decisions they do, but also help you make better predictions in uncertain contexts.

Implementing this approach well requires a different mindset and a broader range of skills than most standard market research companies offer. Identifying assumptions requires being able to break things down into their components like an engineer or analytical philosopher. Exploring possibilities and outliers requires a certain openness to possibility characteristic of design-thinking approaches. Thinking more deeply may require additional skills such as big-data analysis, statistics, expert interviews, or ethnographic studies. Yet, all of these approaches can be incorporated into a research strategy.

Many skills may be required, but great consultants and entrepreneurs often bring together many of these research skills. I’m thinking of when Orit Gadiesh talked to customers and metallurgists when she introduced a Bain client to continuous casting techniques in steel manufacturing. Or, when survey data led Howard Moskowitz to discover that there was no perfect recipe for Prego tomato sauce. Steve Jobs, especially, shows the passion of a good researcher. This is quite apparent in his interviews in which he enthusiastically discusses quantifying data, visiting 80 automated manufacturers in Japan to understand automation, or revising products after observing people using them. People can bring about the future through research, albeit of a non-standard type.

This much may be obvious. However, what might not be obvious is that even the most humble research tools can benefit from this approach. An online survey constructed to test hypotheses about decision factors can tell you not only why your customers make the decisions they do, but also can help you make better predictions in uncertain contexts.

Follow Jobs’ Advice: Ask the Right Questions

In another interview five years later, Steve Jobs was asked about his transition from being a hobbyist to being the executive of a multimillion dollar company. “How do you learn to run a company?,” he was asked. He observed, “You know, throughout the years in business I found something, which is, I always asked why you do things. And the answer you invariably get is that it’s just the way it’s done. Nobody knows why they do what they do. Nobody thinks about things very deeply in business, that’s what I found.” (Steve Jobs, The Lost Interview, 1995)

It turns out Steve Jobs didn’t like market research when introducing non-incremental changes, because he was a great researcher himself.  According to his own account, the secret to his success in business was asking the right questions and not settling for status quo responses. Unless you have the luxury of being in an industry without innovation or disruption, you and your research company shouldn’t settle for the status quo either.

By @jfhannon, CEO at Justkul Inc., a research firm focused on the needs of strategy and private equity.

Key to Innovation: Hire a Philosophy Major

philosophy majors score amont the highest verbal, quantitative and analytical GRE scores in 2011-2012In a recent article in the New York Times (September 13, 2013), Susan Dominus described how the Office of Personal and Career Development at Wake Forest University is transforming the liberal arts by emphasizing the importance of job placement. Although the discipline of philosophy was only mentioned off-hand at the end of the article, the New York Times decided to entitle the article, “How to Get a Job With a Philosophy Degree.” I am not sure exactly why the New York Times decided to give this article this particular title, but given the rhetorical build up at the end, one surmises that it is because philosophy is thought to be obviously one of the most impractical subjects one can study. And when Andy Chan, who is quoted throughout the article, tells parents to “hold their tongue” if their child expresses a desire to be a philosophy major, because they may “decide they love math anyway,” and that he will help turn “academic risks into résumé-ready experiences,” it sounds like Chan agrees. Philosophy is a risk, but a good college placement office will teach your child to be successful anyway.

I have sympathy with the idea that there is something “impractical” about philosophy. The discipline has a long tradition of taking pride in this fact, and Plato famously argued that one would have to use force to get a philosopher to become involved in the common affairs of the world. In addition, many of the problems that philosophers think about have very little direct impact on day-to-day business. However, many of the problems they think about do have direct impact, especially in the ambiguous area of contemporary ethics. This is one of the reasons why Google has hired a philosopher.

However, the case for hiring a philosophy major is much stronger than this. Ms. Dominus’ article quotes the CEO Alan Naumann saying that he hopes graduates have “analytical skills.” It is difficult to find a subject area that provides better analytical skills than philosophy. Students intending to be philosophy majors consistently score among the top verbal, quantitative and analytical writing scores of the GRE, and in many years they score higher than all other majors. Philosophy majors do better on LSATs than any other majors, and easily outperform business students on GMATs. This should not be in the least surprising: contemporary analytical philosophy teaches logical reasoning, and philosophy majors have to deal with some of the most difficult texts and issues human beings have ever come up with, whether it be the foundations of morality, Kant’s transcendental dialectic, Aristotle’s metaphysics, or defining concepts like rotation in relativistic physics.

It is not an exaggeration to say that philosophy is the art of innovation.In the age of business innovation, however, the argument for hiring a philosophy major is even stronger than this. Philosophy has been many things, but since the time of Socrates, the art of questioning assumptions, asking, “Why?,” and drawing out the implications of alternative assumptions are the most fundamental activities of the discipline. Businesses now call this activity, “thinking outside the box,” but in the ancient world it was called dialectic, and it was the very core of the discipline. Even today, it is not an exaggeration to say that philosophy is the art of innovation, because it is the discipline most focused on questioning the status quo. If a company is not good at developing innovations, or is facing a situation in which existing frameworks are failing, then they may seriously want to add a philosopher to their payrolls. In addition, many philosophy majors have been extremely successful in business: George Soros, Reid Hoffman, Don Brownstein, Carly Fiorina, Larry Sanger, and Patrick Byrne among others.

In my own experience in business consulting, I find myself constantly drawing on the skills I acquired as a philosophy major. My experience learning philosophy is what enables me to reframe client challenges at the very beginning of a project, to take difficult problems and reformulate them into simple examples, to seek out the underlying reason for a correlation, or to identify analogous situations to a problem at hand. Talking to a philosophy major who is a successful consultant at one of the largest consulting firms, he said that he often finds himself asking the question “Why?,” when no one else in the room is. I find that it is this move from the how to the why that enables me to avoid errors others are prone to make, or to obtain a fresh perspective on an ambiguous problem.  Having been a philosophy major I can ask these questions and explore the underlying logic of ambiguous and complex situations with more confidence than other more technically-focused majors. (Why-questions are also important for leadership too, see Simon Sinek’s Ted talk.)

Of course, not all philosophy majors will be at home in a business context. The very same skepticism that allows great innovations to happen also can lead philosophers to challenge the underlying assumptions of a business culture, capitalism in general, or to choose to pursue a life of the mind. In addition, contemporary business is often driven by mathematical models that some philosophers are ill-equipped to deal with. But philosophers do come in all stripes: in my own sub-discipline of philosophy of science many philosophers are experienced mathematicians, physicists, psychiatrists and biologists and quite comfortable with statistical concepts. Because these individuals have both mastered a science and philosophy, they can both do the math and understand deeply why the math works. It is curious that this subdiscipline is not on the radar of most corporations.

According to many business leaders today, they want employees with analytical skills who can questions assumptions and develop entirely new approaches for the 21st century. People who not only can handle complex or ambiguous problems, but also truly thrive in such environments. Yet, at the same time, HR departments in these very same companies routinely select for mere technical proficiency or for people who have only proven they can operate well within already existing frameworks. It’s about time that companies start realizing that in an age driven by innovation, hiring a philosophy major is not a risk, but not hiring one may be.

By @jfhannon, CEO at Justkul Inc., a research firm focused on the needs of strategy and private equity.

Image by Ty Fagan, courtesy of Katrina Sifferd.
See also the additional charts here.

61 Rules for a Culture of Innovation

How do you structure a corporation for innovation? There are many answers to this question, which vary depending on the size and purpose of the organization. However, if any company can claim to be a model for innovation in the past decade it has been Google. Not only has the company brought innovative products to market such as Gmail, Google Maps and the Android operating system, but also its open business model and culture challenge many assumptions of a more traditional, 20th century corporation. One person responsible for much of this innovative business model and culture is Jonathan Rosenberg. Jonathan was VP of Product Development at Google, and was responsible for much of the culture that yielded these innovative products. (He still is a Google employee.) In 2010 Jonathan presented a talk to his alma mater about the lessons he has learned as a manager. In the talk he outlined 61 rules for success. What you realize reading the list is that even though only six of the rules are explicitly focused on innovation, many of the others are important catalysts to the innovation process and helped make Google the effective company it is. The talk is useful, and has become a key reference point for founding my own corporation, Justkul Inc. Because an online video is not the easiest format to access individual rules, I decided to make a list of the rules he outlines in that video. In keeping with Jonathan’s emphasis on open innovation, I thought it would be useful to share the list here. Keep in mind that what follows is my version of Jonathan’s rules, and I make no claims that Jonathan would endorse this outline, or that I have captured every one of his rules correctly. You’ll have to watch his talk to decide. The list below is also no substitute for the actual talk, which supplements the rules with very useful and entertaining commentary and stories. I include some commentary of my own in italics in the post. If you would like to comment further, feel free to do so. I’d be particularly interested in any experiences you’ve had following or not following these rules, and what additional rules have been important for running your own innovative corporation.

Communication, 9 Rules

  1. Over-communicate in all ways all the time.

This is true, provided that actual communication is happening. Never take a lot of time in order to say very little.

  1. Openly share everything with your colleagues.

Some caveats are obviously necessary here. The point is to share things that are actually useful for colleagues. Sharing such information not only gives a company a competitive advantage, but can enhance the connections between team members. This last fact is important, because if it is implemented incorrectly and does not foster these team connections, it can lead to a stifling, ineffective organization.

  1. “Repetition does not spoil the prayer.”
  2. Each word matters. Remember Blaise Pascal’s dictum: “If I had more time, I would have written a shorter letter.”
  3. Great leaders are great teachers, and great teachers are great storytellers. Narrative is how we learn.
  4. As leaders you learn more by listening than talking. “When you listen, you learn how things work as opposed to how you think they work.”
  5. If you must talk, ask questions. People learn more from your questions than your answers.
  6. If you actually know the answer in a business situation, stop listening and by all means talk. However, show what you mean through data.
  7. Strive to respond to emails instantly. A manager is nothing but an expensive router, be a good one. Always ask, “Who needs to know this?”

I know people who have had great success following the rule of responding to e-mails immediately, but it doesn’t necessarily work for everyone, especially people engaged in work that requires concentration. Also, as Sandra Bond Chapman has discussed in her Forbes Next Avenue post, there are real risks associated with the multitasking mindset that results if one is constantly responding to e-mails. Personally, I would much rather have people take advice from Blaise Pascal’s dictum above, and take a little extra time to ensure communication is shorter and more efficient. However, the question “Who needs to know this?” should always be asked. If some people may or may not need to know it, thenGrexit offers a nice app for that.

Company Culture, 16 rules

  1. Avoid hippos (“Highest paid person’s opinions”).
  2. You shouldn’t be able to figure out the pecking order of org chart by looking at the product.
  3. Help organizations crush bureaucracy in all its forms. Dying organizations foment it.
  4. When you are trying to accomplish something ask for a winning strategy AND the tactics needed to win.

Our variant of this is whenever we come up with a good idea, we always try to also ask what are the first few steps to implement it. It is always useful to take an idea one step further than you need to at any given moment on the path to implementation.

  1. People are more productive when they are crowded.

This is not always true. Susan Cain’s provides a fairly good defense of the need not be be crowded in her TED talk about introverts

  1. Empower the smallest of teams.
  2. Working from home is a malignant metastasizing cancer. Ban it.

Given her recent actions at Yahoo, you can tell Marissa Meyer worked for the same company as Jonathan from this rule. Marissa qualified her response in light of the backlash it generated, but Jonathan appears to hold an even stronger version of the position. There are good reasons to have people in the office, especially given the importance of serendipitous interactions for innovation and the importance of co-location for agile workflow. However, I think that time away from the office can be equally valuable, not just for work-life balance, but also because it can promote other useful serendipities.

  1. Engineers and product managers add complexity. Marketing adds management layers. Sales adds coordinators. Manage this.
  2. “Knights are knights and knaves are knaves.”
  3. Once someone reveals himself to be a liar, he is a liar.

In my experience context can force even honest people to lie. Philosophy abounds with examples of these cases. Design and manage a company in such a way that you these contexts do not happen.

  1. Trust, but verify.

My favorite version is the Persian proverb, “Trust in God, but tie your camel tight.”

  1. Focus on values rather than costs. In business more revenue solves all your problem. Use the 80/20 rule to determine what to focus on.

Good advice in general contexts, but one should add the exception famously identified by Clayton Christensen: in contexts of disruptive innovation following the 80/20 rule can sometimes lead a company astray. Fortunately, Google has a great antidote for this: the fact that employees can spend 20% of their time working on projects of their own design.

  1. Never suggest copying a competitor.
  2. Hope is not a plan.
  3. Success breeds the green-eyed monster. Take away its key weapon, surprise; fight it with its kryptonite, humility.
  4. Do all reorganization in a day.

Hiring and Development, 14 Rules

  1. Know how to interview well.
  2. Great people make a great company, which in turn attracts great people.
  3. Managers don’t hire people, hiring committees should hire people.
  4. Promotions should be a peer review process.
  5. Don’t hire specialists.

This resonates with me, because so many companies seem obsessed with specialists now. For a lot of companies the situation is even more extreme: it’s not just that a company wants a Python programmer, but now it has to be a Python programmer with five years’ worth of experience who also knows how to do statistics in R who lives in Houston, and has led a team for 3 years (not 2 or not 4), and so on. If you define the parameters stringently enough, soon there will be no one who could possibly fulfill them. Equally important, it prioritizes proxies that have little correlation with performance over actual performance. Basically, most hiring processes are broken, and the current reliance on algorithms and big data may even make it worse. See the excellent post by Nick Corcodilos

  1. You cannot teach passion.
  2. Urgency of the role isn’t sufficiently important to compromise quality of hiring.
  3. Identify bad eggs.
  4. Get rid of bad eggs.
  5. Diversity is your best defense against myopia.
  6. You can’t punt the management training program.
  7. Life is not fair; don’t try to make it fair. Disproportionately reward risk-takers and performers.
  8. If you are going to pay Alex Rodriguez $33 million a year, feed him the ball. Build around people who have the most impact.
  9. The best way to get rid of bad eggs is penguin-pecking.

I’m not sure I agree with this point. I know this approach is common in many legal firms, but sometimes a transparent direct conversation has value too. Equally important is taking extra steps to ensure the process is as painless for everyone involved as possible. All the consulting firms know that ex-employees make for future clients, so it is worth ensuring that no bridges will be burned. I also like firms that take creative approaches to this, such as how ?WhatIf! Innovation apparently provided job placement and detailed letters of recommendations when employees were forced to leave Decision-Making, 6 rules

  1. Decision making is about consensus, not unanimity.
  2. There is no consensus without dissent.
  3. If there is doubt about what to do, consider your customer’s perspective.
  4. Choose your goals wisely.
  5. None of us are as smart as all of us.
  6. Where there is harmony, there is no innovation. Innovation comes from disagreement, not from harmony.

Fostering Innovation, 6 rules

  1. Most companies manage creativity in order to manage risk. Don’t do this.
  2. Innovation comes from creativity. Creativity cannot be managed. It can be allocated, budgeted, measured, tracked, encouraged, but it can’t be dictated.
  3. Create a culture of yes, based on optimism and big thinking.
  4. Never stop someone from moving forward with a good idea because you have a better one.
  5. A leader’s job is not to prevent risk, but to build the capability to recover when failures occur. A good failure happens quickly and provides many lessons. A bad failure takes a long time and you don’t learn anything.
  6. A good crisis is a terrible thing to waste.

Humility, 10 rules

  1. Learn something new so you can remember how hard it is to learn. Teach something so you can learn.
  2. Never stop learning.
  3. Humility is correlated with age. Arrogance is inversely correlated with age.
  4. You get personal leverage through empowerment, delegation and inspection.
  5. Judgment comes from experience, and experience comes from errors. Publish post-mortems when something fails.
  6. Smart people can smell hypocrisy. Culture is set from the top, and once set it cannot be changed.
  7. Don’t burn bridges.
  8. Always ask yourself, would you work for yourself?
  9. Write a self-review and be critical about yourself. Do this every year.
  10. Communicate, confess, comply.

Jonathan emphasizes at the end of the talk that people should make their own lists and not simply follow his rules verbatim. However, I think Jonathan’s list is a fantastic place to start. Let us know what you think.

By @jfhannon, CEO at Justkul Inc., a research firm focused on the needs of strategy and private equity.