This section will guide you on how to ensure your research findings are representative and reliable.

In this section:

• Collect your data
  1. Before launch
  2. Launch
  3. During launch
• Prepare your data for analysis
  1. Clean your data
  2. Code open-ended responses
  3. Remove unecessary data
  4. Make it safe
• Create your topline report
• Analyze your data
  1. Statistical programs
  2. Suggested points for analysis

Collect your data

1. Before launch

• First determine the best way to reach your survey population.
  For example, if you want to focus on indigenous women’s rights organizers, do you know who the key networks are? Do you have contacts there, people who can introduce you to these organizations or ways of reaching them?
• Determine if your key population can be easily reached with an online survey, if you need to focus on paper survey distribution and collection or a mix of both. This decision is very important to ensure accessibility and inclusiveness.
• Be prepared! Prior to advertizing, create a list of online spaces where you can promote your survey.
  If you are distributing paper versions, create a list of events, spaces and methods for distributing and collecting results.
• Plan your timeline in advance, so you can avoid launching your survey during major holidays or long vacation periods.
• Make it easy for your advisors and partners to advertize the survey – offer them pre-written Twitter, Facebook and email messages that they can copy and paste.

2. Launch

• Send the link to the survey via email through your organization’s email databases.
• Advertize on your organization’s social media. Similar to your newsletter, you can regularly advertize the survey while it is open.
• If your organization is hosting events that reach members of your survey population, this is a good space to advertize the survey and distribute paper versions as needed.
• Invite your advisors to promote the survey with their email lists and ask them to copy you so you are aware of their promotional messages. Remember to send them follow-up reminders if they’ve agreed to disseminate.
• Approach funders to share your survey with their grantees. It is in their interest that their constituencies respond to a survey that will improve their own work in the field.

3. During launch

• Keep the survey open for a minimum of four weeks to ensure everyone has time to take it and you have time to widely advertize it.
• Send reminders through your email databases and your partners databases asking people to participate in the survey. To avoid irritating recipients with too many emails, we recommend sending two additional reminder emails: one at  midway point while your survey is open and another a week before your survey closes.
• As part of your outreach, remember to state that you are only collecting one response per organization. This will make cleaning your data much easier when you are preparing it for analysis.
• Save an extra week! Halfway through the open window for survey taking, check your data set. How have you done so far? Run initial numbers to see how many groups have responded, from which locations, etc. If you see gaps, reach out to those specific populations. Also, consider extending your deadline by a week – if you do so, include this extension deadline in one of your reminder emails, informing people know there is more time to complete the survey. Many answers tend to come in during the last week of the survey or after the extended deadline.

If you also plan to collect data from applications sent to grant-making institutions, this is a good time to reach out them.

When collecting this data, consider what type of applications you would like to review. Your research framing will guide you in determining this.

Also, it may be unnecessary to see every application sent to the organization – instead, it will be more useful and efficient to review only eligible applications (regardless of whether they were funded).

You can also ask grant-making institutions to share their data with you.

See a sample letter to send to grant-making institutions

Back to top

Prepare your data for analysis

Your survey has closed and now you have all this information! Now you need to ensure your data is as accurate as possible.

Depending on your sample size and amount of completed surveys, this step can be lengthy. Tapping into a strong pool of detail-oriented staff will speed up the process and ensure greater accuracy at this stage.

Also, along with your surveys, you may have collected data from applications sent to grant-making institutions. Use these same steps to sort that data as well. Do not get discouraged if you cannot compare the two data sets! Funders collect different information from what you collected in the surveys. In your final research report and products, you can analyze and present the datasets (survey versus grant-making institution data) separately.

1. Clean your data

• Resolve and remove duplications: If there is more than one completed survey for one organization, reach out to the organization and determine which one is the most accurate.
• Remove ineligible responses: Go through each completed survey and remove any responses that did not properly answer the question. Replace it with “null”, thus keeping it out of your analysis.
• Consistently format numerical data: For example, you may remove commas, decimals and dollar signs from numerical responses. Financial figures provided in different currencies may need to be converted.

2. Code open-ended responses

There are two styles of open-ended responses that require coding.

Questions with open-ended responses

For these questions, you will need to code responses in order to track trends.

Some challenges you will face with this is:

1. People will not use the exact same words to describe similar responses
2. Surveys with multiple language options will require translation and then coding
3. Staff capacity to review and code each open-ended response.

If using more than one staff member to review and code, you will need to ensure consistency of coding. Thus, this is why we recommend limiting your open-ended questions and as specific as possible for open-ended questions you do ask. 

For example, if you had the open-ended question “What specific challenges did you face in fundraising this year?” and some common responses cite “lack of staff,” or “economic recession,” you will need to code each of those responses so you can analyze how many participants are responding in a similar way.

For closed-end questions

If you provided the participant with the option of elaborating on their response, you will also need to “up-code” these responses.

For several questions in the survey, you may have offered the option of selecting the category “Other” With “Other” options, it is common to offer a field in which the participant can elaborate.

You will need to “up-code” such responses by either:

• Converting open-ended responses to the correct existing categories (this is known as “up-coding”). As a simple example, consider your survey asks participants “what is your favorite color?” and you offer the options “blue,” “green,” and “other.” There may be some participants that choose “other” and in their explanation they write “the color of the sky is my favorite color.” You would then “up-code” answers like these to the correct category, in this case, the category “blue.”
• Creating a new category if there are several “others” that have a common theme. (This is similar to coding the first type of open-ended responses). Consider the previous example question of favorite color. Perhaps many participants chose “other” and then wrote “red” is their favorite. In this case, you would create a new category of “red” to track all responses that answered “red.”
• Removing “others” that do not fit any existing or newly created categories.

3. Remove unecessary data

Analyze the frequency of the results

For each quantitative question, you can decide whether you should remove the top or bottom 5% or 1% to prevent outliers* from skewing your results. You can also address the skewing effect of outliers by using median average rather than the mean average. Calculate the median by sorting responses in order, and selecting the number in the middle. However, keep in mind that you may still find outlier data useful. It will give you an idea of the range and diversity of your survey participants and you may want to do case studies on the outliers.

* An outlier is a data point that is much bigger or much smaller than the majority of data points. For example, imagine you live in a middle-class neighborhood with one billionaire. You decide that you want to learn what the range of income is for middle-class families in your neighborhood. In order to do so, you must remove the billionaire income from your dataset, as it is an outlier. Otherwise, your mean middle-class income will seem much higher than it really is.

Remove the entire survey for participants who do not fit your target population. Generally you can recognize this by the organizations’ names or through their responses to qualitative questions.

4. Make it safe

To ensure confidentiality of the information shared by respondents, at this stage you can replace organization names with a new set of ID numbers and save the coding, matching names with IDs in a separate file.

With your team, determine how the coding file and data should be stored and protected.

For example, will all data be stored on a password-protected computer or server that only the research team can access?

Back to top

Create your topline report

A topline report will list every question that was asked in your survey, with the response percentages listed under each question. This presents the collective results of all individual responses. 

Tips:

• Consistency is important: the same rules should be applied to every outlier when determining if it should stay or be removed from the dataset.
• For all open (“other”) responses that are up-coded, ensure the coding matches. Appoint a dedicated point person to randomly check codes for consistency and reliability and recode if necessary.
• If possible, try to ensure that you can work at least in a team of two, so that there is always someone to check your work.

Back to top

Analyze your data

Now that your data is clean and sorted, what does it all mean? This is the fun part where you begin to analyze for trends.

Are there prominent types of funders (government versus corporate)? Are there regions that receive more funding? Your data will reveal some interesting information.

1. Statistical programs

• Smaller samples (under 150 responses) may be done in-house using an Excel spreadsheet.

• Larger samples (above 150 responses) may be done in-house using Excel if your analysis will be limited to tallying overall responses, simple averages or other simple analysis.

• If you plan to do more advanced analysis, such as multivariate analysis, then we recommend using statistical software such as SPSS, Stata or R.
  NOTE: SPSS and Stata are expensive whereas R is free.
  All three types of software require staff knowledge and are not easy to learn quickly.

Try searching for interns or temporary staff from local universities. Many students must learn statistical analysis as part of their coursework and may have free access to SPSS or Stata software through their university. They may also be knowledgeable in R, which is free to download and use.

2. Suggested points for analysis

• Analysis of collective budget sizes
• Analysis of budget sizes by region or type of organization
• Most common funders
• Total amount of all funding reported
• Total percentages of type of funding (corporate, government, etc)
• Most funded issues/populations
• Changes over time in any of these results.

Back to top

Previous step

3. Design your survey

Next step

5. Conduct interviews

Estimated time:

• 2 - 3 months

People needed:

• 1 or more research person(s)
• Translator(s), if offering survey in multiple languages
• 1 or more person(s) to assist with publicizing survey to target population
• 1 or more data analysis person(s)

Resources needed:

• List of desired advisors: organizations, donors, and activists
• Optional: an incentive prize to persuade people to complete your survey
• Optional: an incentive for your advisors

Resources available:

Survey platforms:

• Survey Monkey
• Survey Gizmo (Converts to SPSS for analysis very easily)

Examples:
• 2011 WITM Global Survey
• Sample of WITM Global Survey
• Sample letter to grantmakers requesting access to databases

Visualising Information for Advocacy:
• Cleaning Data Tools
• Tools to present your data in compelling ways
• Tutorial: Gentle Introduction to Cleaning Data

Previous step

3. Design your survey

Next step

5. Conduct interviews

Ready to Go? Worksheet

Download the toolkit in PDF

Si tienes alguna pregunta o duda, contáctanos a través del formulario disponible aquí, indicando «Encuesta ¿Dónde está el dinero?» en el título del mensaje. También puede escribirnos a witm@awid.org.

Чтобы поделиться опытом финансирования в вашей организации

En tant que féministes luttant pour la justice de genre, la paix, la justice économique, sociale et environnementale, nous savons qu'il n'existe pas de recette miracle, mais plutôt un éventail de possibilités qui peuvent faire changer les choses, et qui les font changer.

Cet éventail d’options est aussi diversifié que nos mouvements et les communautés dans lesquelles nous vivons et nous luttons.

Avant de vous présenter quelques-unes de ces propositions féministes pour un autre monde, voici les principes qui encadrent nos propositions :

1. Un développement autodéterminé, du local au global

Nous croyons qu'il ne doit pas y avoir un seul modèle pour tous, et que chacun-e doit avoir le droit de revendiquer et de contribuer à la construction d'un autre monde possible, comme le formule le slogan du Forum social mondial.

Cela inclut le droit de participer à la gouvernance démocratique et d'influer sur son avenir, politiquement, économiquement, socialement et culturellement.

L'autodétermination économique permet aux peuples de prendre le contrôle de leurs ressources naturelles et d'utiliser ces ressources pour atteindre leurs propres objectifs ou pour un usage collectif. En outre, le pouvoir d’agir des femmes dans la sphère économique est fondamental pour atténuer le caractère souvent cyclique de la pauvreté, le déni de l'éducation, de la sécurité et de la sûreté.

2. Les droits, l'égalité réelle et la justice au cœur de l'économie

Le principe de l'égalité réelle est énoncé dans la Convention sur l'élimination de toutes les formes de discrimination à l'égard des femmes (CEDAW) et d'autres instruments internationaux relatifs aux droits humains. Ce principe est fondamental pour le développement et la transformation vers une économie juste, car il affirme que tous les êtres humains naissent libres et égaux.

La non-discrimination fait partie intégrante du principe d'égalité, qui veille à ce que personne ne soit privé de ses droits en raison de facteurs tels que la race, le sexe, la langue, la religion, l'orientation sexuelle, l'identité sexuelle, une opinion politique ou autre, l’origine nationale ou sociale, la fortune ou la naissance.

La dignité inhérente à toute personne sans distinction doit être maintenue et respectée. Alors que les États doivent veiller à l'utilisation d’un maximum de ressources disponibles pour la réalisation des droits humains, le fait d’exiger ces droits et la dignité est un enjeu clé pour la lutte de la société civile et la mobilisation populaire.

3. Une redistribution juste pour tous et toutes, sans monopolisation ou accaparement (le principe d’anti-avidité)

Ce principe, mis en œuvre par les efforts coordonnés visant à transformer les institutions injustes, soutient le rétablissement de l’équilibre entre la « participation » (entrées) et la « distribution » (sorties), lorsque celui-ci est rompu.

Il permet de poser des limites à l'accumulation monopolistique de capital et d'autres abus liés à la propriété. Ce concept est fondé sur un modèle économique qui repose sur l'équité et la justice.

4. La solidarité féministe et inter-mouvements est fondamentale

Pour changer les choses, nous avons besoin de réseaux féministes solides et diversifiés. Nous avons besoin de mouvements qui renforcent la solidarité du niveau personnel au niveau politique, du niveau local au niveau global, et inversement.
 
Construire le pouvoir collectif grâce aux mouvements permet de convertir la lutte pour les droits humains, l'égalité et la justice en une force politique pour le changement qui ne peut être ignorée.

 « Seuls les mouvements sont en mesure de créer des changements durables à des niveaux que la politique et les lois seules ne permettraient pas d’atteindre. »

Pour en savoir plus sur ce sujet, consulter S. Batliwala, 2012 Changer leur monde. Mouvements féministes, concepts et pratiques.

Voir également

Le projet

5 menaces principales

Nos partenaires

Context

The current global economic crisis provides stark evidence that the economic policies of the last 3 decades have not been working.

The devastation that the crisis has wrought on the most vulnerable households in the Global North and Global South is a reminder that the formulation of economic policy and the realization of human rights (economic, social, political, civil and cultural) have for too long been divorced from one another. Economic policy and human rights do not have to be opposing forces, but can exist symbiotically.

Macroeconomic policies affect the operation of the economy as a whole, shaping the availability and distribution of resources. Within this context, fiscal and monetary policies are key.

Definition

• Fiscal policy refers to both public revenue and public expenditure, and the relationships between them as expressed in the government budget.
• Monetary policy includes policies on interest and exchange rates and the money supply, as well as the regulation of the financial sector.
• Macroeconomic policies are implemented using instruments such as taxation, government spending, and control over the supply of money and credit.

These policies affect key prices such as interest and exchange rates that directly influence, among other things, the level of employment, access to affordable credit, and the housing market.

Applying a human rights framework to macroeconomic policy allows States to better comply with their obligation to respect, protect, and fulfill economic and social rights. Human rights are internationally agreed-upon universal standards. These legal norms are articulated in United Nations treaties including, the Universal Declaration of Human Rights (UDHR), the International Covenant on Civil and Political Rights (ICCPR), and the International Covenant on Economic, Social and Cultural Rights (ICESCR).

Article 1 of the UDHR states that, “All human beings are born free and equal in dignity and rights.”

Although the UDHR was written about six decades ago its relevance is enduring. Many of the ideas address concerns and critical issues that people continue to face globally. Issues regarding inhuman punishment (Art. 5), discrimination (Art. 7), property ownership (Art. 17), equal pay for equal work (Art. 23/2), and access to education (Art. 26/1) are pertinent matters in countries South and North of the equator.

More specifically, States have an obligation under international law to respect, protect and fulfill human rights, including the economic and social rights of people within their jurisdiction. This is particularly relevant now given the financial crisis. In the U.S., regulation is skewed in favor of certain interests. The failure to extend government’s supervisory role in the context of social and economic change is a failure with regard to the obligation to protect human rights.

Feminist perspective

States should abide by key human rights principles to achieve economic and social rights. Some of the principles have potentially important implications for governance of financial institutions and markets, yet these possibilities have been underexplored.

Economic and social rights have a concrete institutional and legal grounding. Global declarations, international treaties, covenants, and, in a number of cases, national constitutions have incorporated aspects of the economic and social rights framework—providing an institutional infrastructure in national and international law.

Some have suggested that a consideration of global justice may not be a useful pursuit because of the institutional complexities involved. However, this does not get around that fact that global institutions already have an impact on social justice, both positive and negative.

It is useful to tease out the implications that elements of alternative frameworks have for economic governance, specifically those supported by existing institutions. Economic and social rights represent one such concrete framework. The framework is an evolving one, and ongoing discussion and deliberation is necessary to address underdeveloped areas and potential deficiencies.

Learn more about this proposition

• How to Apply a Human Rights Framework to Macroeconomic Strategies by Center for Women’s Global Leadership (CWGL)

This section is based on CWGL’s blog “Applying a Human Rights Framework to Macroeconomic Policies” (2012).