Methodologies & Tools

Our mixed-methods approach to evaluation combines the breadth of quantitative methods with the depth of qualitative methods. We tailor these to the needs of each client and each project.

Case Studies

Case studies usually involve interviews with multiple stakeholders at an organization, in person or by phone. We develop the interview protocols for all case study interviews in conjunction with our clients to capture relevant information, and to ensure the interview is sensitive to the case study participants.

Focus Groups

We often conduct focus groups before program implementation to help formulate program design. Focus groups are also useful during program implementation to acquire feedback, or after a program is completed to assess its overall impact and understand how to improve future programs. We recruit focus group members directly from our clients' programs or conduct community-based recruitment.

We manage all aspects of focus group implementation including recruitment, logistics, incentives, facilitation, notetaking, transcription, and translation. Our skilled facilitators bring years of experience in developing protocols and managing group dynamics.

Participant Surveys

Surveys offer clients the opportunity to gauge program impact from a large sample of program participants. As with all of our data collection tools, the survey itself is carefully designed in partnership with our clients. We tailor the survey's implementation and administration to the unique service delivery pattern of our clients to minimize client and service provider burden.

For data management, we can develop Access or Excel databases on-site, allowing our clients to enter the data. Or, we have alternative processes for retrieving survey results and managing the data entry process ourselves.

Mail Surveys

We develop and administer large-scale mail surveys for local and national clients. Our mail surveys are designed to be easily understood by respondents, and we strive to make the intention of the research project clear. Depending on the availability of program participant lists, and the scope of the desired sample size, we can develop a sampling plan for a mailing survey and work to receive the highest response rate possible.

We frequently employ the Total Design Method (TDM), which ensures that the surveys minimize respondent burden, are personalized for each respondent, and encourage a high response rate through non-respondent follow-up.

Participatory Photography

Program stakeholders, entrusted with cameras, act as documentarians of program impact or reflect community need. Agencies and organizations have used this method as a means of sharing experience to help shape public policy and decision-making. Participatory photography places information collection and presentation firmly in the hands of community members.

When implementing this type of project, we work closely with identified community participants to reflect upon and present their stories through photographs. Our team manages all aspects of the experience, including providing cameras, facilitating group discussions, and processing and presenting the resulting images.

Participatory Action Research

Participatory Action Research (PAR) is a methodology that engages community stakeholders in the process of identifying needs and assets, assessing priorities, developing proposed recommendations or interventions, and evaluating the results. PAR methods not only enable under-represented stakeholders to participate in dialogue with the client organization, they build local capacity related to data collection and analysis, draw upon the knowledge of local residents and community-based organizations, and develop leadership and build partnerships within the community.

We work with our clients to assess whether PAR methods are suited to their needs and goals. Then together we design, implement and facilitate the various steps, a process that begins with community identification and prioritization of needs and resources, followed by a community presentation of findings and the development of a proposed response or intervention. From there, interventions or demonstration projects are designed, an agency/provider is identified, and services begin, with the community participating in evaluating the intervention.

For more information on Harder + Company, please contact us at 415-522-5400.