Introduction
Managing social impact is not merely a matter of technical success reporting; it is, above all, about building a culture of high cognitive resolution. Matt Stevenson-Dodd argues that organizations must shift from a "Do" model to a "Difference" model to truly maximize social change.
Readers will discover how to transform failures into informational assets and why optimal resource allocation requires the courage to sunset ineffective programs. The text bridges the gap between psychological safety, marginal economics, and portfolio theory.
Psychological Safety as Data Quality Infrastructure
Advanced reporting systems do not guarantee learning if an organization is epistemically closed. Matt Stevenson-Dodd notes that the fear of reputational loss—the so-called "Daily Mail Test"—forces data selection and the concealment of errors.
For data to be reliable, team psychological safety is essential. According to Amy Edmondson, this allows team members to report mistakes without fear that they will be viewed as evidence of incompetence. Without it, dashboards become mere representations of a defensive culture.
An example of maturity is Street League, which openly reports the number of people they were unable to help. Such transparency builds epistemic reputation—it proves that the organization tells the truth even when it is inconvenient.
Not Every Failure is a Lesson: Distinguishing Errors from Intelligent Exploration
Not every failure in the social sector is valuable. Amy Edmondson distinguishes basic and complex errors from intelligent failure, which occurs during the thoughtful exploration of a new area at a limited cost.
An error resulting from negligence does not become a lesson simply because conclusions were drawn from it. The difference lies in intent and rigor: intelligent failure is based on a hypothesis and minimizes risk to beneficiaries.
Matt Stevenson-Dodd suggests adopting an Impact Risk Appetite. This allows organizations to differentiate between routine services and innovation. In the case of the latter, a null result is valuable if it allows for the exclusion of a costly hypothesis and prevents the waste of funds in the future.
Negative Case Analysis as a Source of Knowledge
Organizations can improve effectiveness by employing negative case analysis. Instead of removing outliers from a success pattern, they should investigate why a program failed for specific groups. This reveals the boundaries of the Theory of Change.
It is crucial to distinguish between internal errors and external systemic barriers (the "Good, The Bad and The Ugly" model). This prevents organizations from either blaming the system indiscriminately or taking responsibility for factors beyond their control.
True learning requires the design of incentives. Matt Stevenson-Dodd points out that funders should reward the quality of knowledge gained from an experiment, rather than just the outcome itself. By doing so, organizations will stop hiding errors and instead treat them as an investment in future efficiency.
Summary
Maximizing impact is a problem of allocating scarce resources and managing opportunity cost. A mature organization does not only ask if a program is good, but whether the marginal dollar spent on it yields more value than if applied elsewhere.
Is an organization that never reports failures truly effective, or is it simply employing an unfalsifiable definition of success? True maturity is the ability to detect one's own fallibility before the cost becomes too high.
Frequently Asked Questions
Why do advanced success reporting systems not guarantee that an organization actually learns from its mistakes?
Advanced reporting systems can become mere representations of a defensive culture if psychological safety is lacking within the organization. In such an environment, the fear of losing reputation or the search for culprits leads to the selection of positive information and the reinterpretation of data, making it impossible to draw conclusions from mistakes.
Is every failure within an organization valuable, and how can one distinguish between a mistake resulting from negligence and one that provides valuable knowledge?
Not every failure is valuable; basic errors result from negligence in known processes, whereas only 'intelligent failures' provide valuable knowledge. A valuable mistake occurs during the thoughtful exploration of a new area, is based on a specific hypothesis, and has limited cost and scope.
How can an organization utilize failures and reporting errors to realistically improve the effectiveness of its actions?
An organization can leverage failures by analyzing negative cases to identify groups for whom operational mechanisms are ineffective and to define the boundaries of its theory of change. It is crucial to separate internal errors (requiring process correction) from external systemic constraints (requiring adaptation), while simultaneously combining high psychological safety with high standards of accountability.
How should the level of acceptable risk be defined in a social organization, and why does the relationship with the founder often hinder honest reporting of failures?
The Impact Risk Appetite is defined as the degree of failure an organization accepts in exchange for the chance to achieve radical social change, assessed through the lens of probability, the weight of harm, and the value of potential knowledge. Reporting difficulties stem from the imbalance of financial power held by the founder and information asymmetry; when funding depends on success, organizations are motivated to professionalize their narrative and present data that favors maintaining funds rather than honestly reporting failures.
How can we ensure that organizations and grantees stop hiding mistakes and start treating them as a source of valuable knowledge?
Incentives should be designed so that credible failure analysis and the documentation of knowledge are treated as elements of project quality, rather than reasons to limit funding. It is key to distinguish between evaluating the outcome itself and evaluating the value of the knowledge gained from the experiment, while ensuring that the conclusions drawn realistically influence subsequent organizational decisions.
Can every failure in the social sector be treated as a valuable lesson?
Not every failure is valuable; it can be cognitively sterile if the organization draws no conclusions from it, or morally reprehensible when it results from repeating a known mistake. A failure becomes a valuable lesson only when the experiment was rational, safe, and designed to provide an informational answer to a significant question.
Why can admitting failures paradoxically strengthen the credibility of a social organization?
Admitting failures acts as a costly signal of credibility, because in a complex world, error-free reporting arouses skepticism. Forgoing short-term communication gains makes information about successes more convincing and builds the belief that the organization reports honestly even those things it would prefer not to disclose.
What is the difference between an organization that truly learns from its mistakes and one that simply justifies failures?
An organization that learns from mistakes possesses epistemic mechanisms that allow it to distinguish success from error and can define the criteria under which a program would be considered ineffective. In contrast, an organization that justifies failures employs a flexible definition of success, ensuring that every action is presented ex post as valuable, which makes the falsification of its mission impossible.
How to move from checking whether a program works to optimally managing all of the organization's activities?
One should shift toward treating impact maximization as a problem of allocating limited resources, analyzing opportunity cost and the marginal effect of actions. This requires continuously shifting funds and attention toward interventions that bring the greatest social value, while maintaining the ability to phase out ineffective programs.
Why might an effective program not deserve further funding?
An effective program may not deserve further funding if it has reached a point of diminishing marginal returns and an additional zloty would provide more value in another application. The budget decision depends on allocative efficiency, namely comparing the benefits of an additional unit of resource against alternatives.
How should an organization allocate resources and attention between proven activities and risky innovations to maximize social impact?
The organization should apply a portfolio heuristic, deliberately dividing resources between the exploitation of proven mechanisms and the exploration of new opportunities (e.g., in an 80/20 ratio). The optimal split depends on the environment and the organization's goals, with the integration of finance and impact, as well as the diversification of approaches to increase resilience to change, being key.
How to effectively manage the budget of social projects under conditions of uncertainty, and how to avoid continuing ineffective activities simply because significant resources have already been invested in them?
Under conditions of uncertainty, phased funding (e.g., pilot, scaling) should be applied, allowing for the flexible postponement or abandonment of programs depending on results. To avoid the sunk cost fallacy, decisions regarding further expenditures should be based on future benefits and the marginal utility of additional funds, rather than on amounts invested in the past.
How to resolve the dilemma between maximizing the number of people helped and providing aid to those in the most difficult situations?
The choice between maximizing the number of beneficiaries and helping those in the most difficult situations depends on the adopted weights and axiological criteria, as arithmetic alone does not provide an answer. One can apply a utilitarian approach (sum of well-being), a prioritarian approach (weighting benefits for those worst off), or tools such as Multi-Criteria Decision Analysis (MCDA), which allow both goals to be explicitly defined and weighted.
How to maximize social impact without sacrificing ethical values and the quality of interventions for the sake of scale alone?
Ethical and qualitative values should be treated as hard constraints rather than criteria subject to weight optimization. Maximizing impact should be a multidimensional process that considers the breadth, depth, and sustainability of changes, instead of focusing exclusively on scaling the number of beneficiaries.
How to interpret an increase in organizational revenue after implementing impact measurement systems, and why is core funding crucial for the effectiveness of activities?
The increase in revenue coincided with the implementation of impact measurement systems and, according to management, supported fundraising and decision-making; however, it cannot be assigned an exclusive role without a counterfactual project. Core funding is crucial because it invests in infrastructure and organizational capacity, preventing the nonprofit starvation cycle, which impairs both operational effectiveness and measurement.
When is investing in infrastructure and data more cost-effective than direct social action?
Investing in infrastructure and data is more cost-effective when an additional amount spent increases the organization's future impact more than directly funding a service. This is particularly justified to increase future productivity and reduce risk by acquiring information (value of information), which allows the budget to be directed toward the correct action.
Can the pursuit of maximizing measurable social impact be contrary to law or ethics?
Yes, a program with the highest measurable impact may be unacceptable if it violates the principle of legality or leads to arbitrary differentiation between citizens. Administration must combine the pursuit of efficiency with respect for constitutional constraints, procedural fairness, and the principles of equality and transparency.
What does the actual maximization of social impact mean in management practice?
Actual maximization of impact means moving from local optimization to systemic optimization, where an organization strives to improve the entire ecosystem, even if it requires supporting other entities instead of its own growth. In management practice, this involves allocating multiple resources (not just financial ones) based on portfolio analysis that considers shock resilience, opportunity costs, and systemic dependencies.
