Knowledge Silo Breakers (KSBs) are Communities of Practice in the WBG. The KSB Impact Framework is used to assess the “maturity” of any given Community of Practice, and to provide a menu of indicators from which to choose to measure impact.
Impact Indicators are important for assessing how a community is contributing to the achievement of the goals of the organization. The KSB Impact Framework gives you examples of how you might apply their insights to creating your own context-specific Impact Indicators in your own organizations.
To use the KSB Impact Framework or any impact framework, first assess where your community is in terms of its maturity, and then decide on which indicators to use based on your objectives and feasibility for your community.
Knowledge Silo Breakers (KSBs) are Communities of Practice in the WBG. They are full Communities of Practice branded KSBs and designed to be the main conduits for cross-Global Practice (GP) and Cross-Cutting Solution Area (CCSA) collaboration within the Bank in various Global Solution Groups (GSGs) on issues such as smart cities, climate and and smart cities, and Culture, Heritage and Sustainable Tourism, and so on,
The KSB Impact Framework is used for two purposes: to assess the “maturity” of any given Community of Practice, and also to provide a menu of indicators from which to choose to measure impact. The more mature the Community of Practice, the greater the possibility that a community will achieve its goals, and continue to achieve its goals over a sustainable period of time.
Why use the KSB Impact Framework?
Community Impact Indicators are important for assessing how a community is contributing to the achievement of the goals of the organization. They enable you to plan, manage, learn and feed back into the community building process. They are also a key component for reports to senior management, stakeholders, and members, over and above internal community analytics or Community Health Metrics.
The projects at the World Bank vary greatly in scope. Also, just as any Community of Practice, the KSBs vary significantly in terms of age, maturity, and size as well as context. For these reasons, it would be impossible to come up with a single, simple set of metrics.
Given that the more mature a community is, the greater the impact a community will have, the KSB Impact Framework provides a way of assessing the maturing of your community, so that you can choose appropriately from a “menu” of Impact Indicators and indicators to choose from based on that maturity.
Note: The KSB Impact Framework is one way of assessing the impact of Communities of Practice. Refer to the articles about Theory of Change and Community Impact Indicators for more information about assessing the impact of a CoP.
How do you use the KSB Impact Framework?
To use the KSB Impact Framework, you:
Assess the maturity of your Community of Practice.
Decide on appropriate indicators - ones that best match your objectives and are most feasible for your community given its state of maturity.
Assess the maturity of your Community
The KSB Impact Framework includes the following table showing different stages of community maturity:
Use the following table for examples of indicators that might match your objectives and are appropriate for your community’s level of maturity. To repeat, these are KSB-specific indicators and are here for you to find inspiration for your own context-specific communities.
KSB Impact Indicators
Example tracking methods
%age of KSB members who are active participants in the KSB at a specific threshold.
KSB program application
Positive evaluation of the KSB charter or plan by leadership based on a scoring rubric.
Scoring rubric
Utilization rates of portals, knowledge bases, expert finder systems and/or databases.
Count visits, downloads, hits etc. of systems on a repeated time interval & chart change over time.
Increase in the number of projects that leverage professionals outside originators immediate group or focus area.
Review all projects that include the topic area on a regular time interval and map extraordinary professional resources included and what KSB they belong to.
Success rates of collaborative efforts as compared against success rates of non-collaborative efforts (requires a baseline market).
Determine standardized list of success markers for projects or project areas and definitions. Determine success percentages at large or within the discrete success factors. Determine success rates using criteria for a select number of existing projects that have no KSB involvement. Compare outcomes of a similar set of projects that have KSB involvement.
Increase in size of stakeholder group.
Survey or event attendance
Impact of knowledge mobilization - # of new proposals that integrate the KSB topic over time.
Manual review of proposals
# of new ideas introduced to knowledge products and processes.
Self-reporting with document submission for validation or quarterly survey
Utilization of ideas from outside the WBG: # or % of projects that include KSB Impact Frameworks or toolkits.
Manual review of attributions within project deliverables
Change in perception about the topic area over time
Wide variety of methods, survey or questionnaire before and after knowledge mobilization events or education
Increase in # or % of projects awarded.
Chart growth in project or % of awarded projects
Increase in the financial value of projects.
Financial analysis of project income and category
A new line of business emerges.
Increase # and category of partners WBG does business with.
Compare current list of WBG partner per KSB with future lists
Increase in speed to solution.
Approach is contextual to KSB and solution being delivered
Formal recognition of KSB innovation that leads to an increase in project proposals.
Approach is contextual to KSB and solution being delivered
The preceding indicators are not an exhaustive list by any means, and are supplied only as examples. Indicators will always have to be tailored to specific community objectives and contexts.
Example of KSB indicators regarding the goal of creating more affordable housing:
INQUIRIES RECEIVED AND RESPONDED TO
NUMBER OF WBG PRODUCTS BEING SUPPORTED BY KSB THROUGH INDIVIDUAL (KSB MEMBERS) OR COMMUNITY CONTRIBUTIONS
NUMBER OF PROJECTS ON KSB TOPICS OR WITH DEDICATED PROJECT COMPONENT ON THE TOPIC
21 requests for assistance answered:
· Videos to showcase WBG housing work
· Contributions to toolkit
· Literature on public housing
· Housing strategy PPT - in French - plus social housing examples
· Urban Housing Sector Recovery Guidance Note
· Seeking information on demand management systems for housing
· Letter from the Special Rapporteur on adequate housing as a component of the right to an adequate standard of living, and on the right to non-discrimination in this context
· Housing Finance Call for Papers: Full Paper Submissions for Review by Judging Panel
12 products/projects where assistance was provided:
· Rwanda Affordable Housing Finance Project
· Colombia: Financing Infrastructure for Urban Redevelopment
· India: Tamil Nadu Housing and Habitat Development (
· Nigeria Affordable Housing Project
· Bhutan: Housing Policy Note
· Jordan: National Housing Strategy
· Urban Poverty and Housing Concept Note
· Bulgaria Housing Sector Assessment (
· Understanding seismic risk in pre-1990 multi-family buildings
· Ecuador: Advisory on Development of a Housing Guarantee Scheme
· Peru: Technical advisory to Fondo Mi Vivienda
16 projects on KSB topics:
· Pakistan Housing Finance Project
· Funding for Earthquake Housing Reconstruction Project
· Affordable Housing Finance
· Metro Manila Flood Management Project
· Dominica - Housing Recovery Project
· Argentina - Integrated Habitat and Housing Project
· Indonesia - National Affordable Housing Program
· Mexico - Improving Access to Affordable Housing Project
· Bangladesh - Low Income Community Housing Support Project
This article is part of the Communities of Practice Toolkit, featuring practical resources to help you develop impactful Communities of Practice. Access the Toolkit.
Blog » Community Impact Evaluation using the KSB Impact Framework [EXAMPLE]
Community Impact Evaluation using the KSB Impact Framework [EXAMPLE]
Summary:
Resources:
If you are WBG Staff, you can click here for the full KSB Impact Indicators Report.
What is the KSB Impact Framework?
Knowledge Silo Breakers (KSBs) are Communities of Practice in the WBG. They are full Communities of Practice branded KSBs and designed to be the main conduits for cross-Global Practice (GP) and Cross-Cutting Solution Area (CCSA) collaboration within the Bank in various Global Solution Groups (GSGs) on issues such as smart cities, climate and and smart cities, and Culture, Heritage and Sustainable Tourism, and so on,
The KSB Impact Framework is used for two purposes: to assess the “maturity” of any given Community of Practice, and also to provide a menu of indicators from which to choose to measure impact. The more mature the Community of Practice, the greater the possibility that a community will achieve its goals, and continue to achieve its goals over a sustainable period of time.
Why use the KSB Impact Framework?
Community Impact Indicators are important for assessing how a community is contributing to the achievement of the goals of the organization. They enable you to plan, manage, learn and feed back into the community building process. They are also a key component for reports to senior management, stakeholders, and members, over and above internal community analytics or Community Health Metrics.
The projects at the World Bank vary greatly in scope. Also, just as any Community of Practice, the KSBs vary significantly in terms of age, maturity, and size as well as context. For these reasons, it would be impossible to come up with a single, simple set of metrics.
Given that the more mature a community is, the greater the impact a community will have, the KSB Impact Framework provides a way of assessing the maturing of your community, so that you can choose appropriately from a “menu” of Impact Indicators and indicators to choose from based on that maturity.
Note: The KSB Impact Framework is one way of assessing the impact of Communities of Practice. Refer to the articles about Theory of Change and Community Impact Indicators for more information about assessing the impact of a CoP.
How do you use the KSB Impact Framework?
To use the KSB Impact Framework, you:
Assess the maturity of your Community of Practice.
Decide on appropriate indicators - ones that best match your objectives and are most feasible for your community given its state of maturity.
Assess the maturity of your Community
The KSB Impact Framework includes the following table showing different stages of community maturity:
Another widely-used approach can be found in the Community Roundtable Maturity Model.
Select the right indicators
Use the following table for examples of indicators that might match your objectives and are appropriate for your community’s level of maturity. To repeat, these are KSB-specific indicators and are here for you to find inspiration for your own context-specific communities.
KSB Impact Indicators
Example tracking methods
%age of KSB members who are active participants in the KSB at a specific threshold.
KSB program application
Positive evaluation of the KSB charter or plan by leadership based on a scoring rubric.
Scoring rubric
Utilization rates of portals, knowledge bases, expert finder systems and/or databases.
Count visits, downloads, hits etc. of systems on a repeated time interval & chart change over time.
Increase in the number of projects that leverage professionals outside originators immediate group or focus area.
Review all projects that include the topic area on a regular time interval and map extraordinary professional resources included and what KSB they belong to.
Success rates of collaborative efforts as compared against success rates of non-collaborative efforts (requires a baseline market).
Determine standardized list of success markers for projects or project areas and definitions. Determine success percentages at large or within the discrete success factors. Determine success rates using criteria for a select number of existing projects that have no KSB involvement. Compare outcomes of a similar set of projects that have KSB involvement.
Increase in size of stakeholder group.
Survey or event attendance
Impact of knowledge mobilization - # of new proposals that integrate the KSB topic over time.
Manual review of proposals
# of new ideas introduced to knowledge products and processes.
Self-reporting with document submission for validation or quarterly survey
Utilization of ideas from outside the WBG: # or % of projects that include KSB Impact Frameworks or toolkits.
Manual review of attributions within project deliverables
Change in perception about the topic area over time
Wide variety of methods, survey or questionnaire before and after knowledge mobilization events or education
Increase in # or % of projects awarded.
Chart growth in project or % of awarded projects
Increase in the financial value of projects.
Financial analysis of project income and category
A new line of business emerges.
Increase # and category of partners WBG does business with.
Compare current list of WBG partner per KSB with future lists
Increase in speed to solution.
Approach is contextual to KSB and solution being delivered
Formal recognition of KSB innovation that leads to an increase in project proposals.
Approach is contextual to KSB and solution being delivered
The preceding indicators are not an exhaustive list by any means, and are supplied only as examples. Indicators will always have to be tailored to specific community objectives and contexts.
Example of KSB indicators regarding the goal of creating more affordable housing:
INQUIRIES RECEIVED AND RESPONDED TO
NUMBER OF WBG PRODUCTS BEING SUPPORTED BY KSB THROUGH INDIVIDUAL (KSB MEMBERS) OR COMMUNITY CONTRIBUTIONS
NUMBER OF PROJECTS ON KSB TOPICS OR WITH DEDICATED PROJECT COMPONENT ON THE TOPIC
21 requests for assistance answered:
· Videos to showcase WBG housing work
· Contributions to toolkit
· Literature on public housing
· Housing strategy PPT - in French - plus social housing examples
· Urban Housing Sector Recovery Guidance Note
· Seeking information on demand management systems for housing
· Letter from the Special Rapporteur on adequate housing as a component of the right to an adequate standard of living, and on the right to non-discrimination in this context
· Housing Finance Call for Papers: Full Paper Submissions for Review by Judging Panel
12 products/projects where assistance was provided:
· Rwanda Affordable Housing Finance Project
· Colombia: Financing Infrastructure for Urban Redevelopment
· India: Tamil Nadu Housing and Habitat Development (
· Nigeria Affordable Housing Project
· Bhutan: Housing Policy Note
· Jordan: National Housing Strategy
· Urban Poverty and Housing Concept Note
· Bulgaria Housing Sector Assessment (
· Understanding seismic risk in pre-1990 multi-family buildings
· Ecuador: Advisory on Development of a Housing Guarantee Scheme
· Peru: Technical advisory to Fondo Mi Vivienda
16 projects on KSB topics:
· Pakistan Housing Finance Project
· Funding for Earthquake Housing Reconstruction Project
· Affordable Housing Finance
· Metro Manila Flood Management Project
· Dominica - Housing Recovery Project
· Argentina - Integrated Habitat and Housing Project
· Indonesia - National Affordable Housing Program
· Mexico - Improving Access to Affordable Housing Project
· Bangladesh - Low Income Community Housing Support Project
· Nepal - Earthquake Housing Reconstruction Project
· Egypt - Inclusive Housing Finance Program
· Nigeria – Affordable Housing Project
· India Low-Income Housing Finance
· Tanzania - Housing Finance Project
This article is part of the Communities of Practice Toolkit, featuring practical resources to help you develop impactful Communities of Practice. Access the Toolkit.