SAGI - Secretaria de Avaliação e Gestão da Informação Committee on World Food Security...

SAGI - Secretaria de Avaliação e Gestão da Informação

Committee on World Food Security

Monitoring Food Security

Comments on Session 4: Measuring Hunger: what is required for policy-making ?

Paulo Jannuzzi Secretariat of Evaluation and Information Management of Ministry of Social Development and the Fight against Hunger

(SAGI/MDS)

SAGI – Secretariat of Evaluation and Information Management


My comments aims also to contribute to the questions raised in the first panel

• Developing a suite of indicators– Dimensions to be monitored– Which indicators– How to select them

• Platform for commom dissemination– An Interactive Tool to present and analyze the indicators – Suite vs. Composite Index

• International standards on food measurement– International cooperation on designing Surveys and Registers,

organizing existing data on monitoring panels and using them as tools for policy and program improvements.


Measuring Hunger: what is required for policy-making ?

• Evidence based Policy-makers and program managers need a suite of indicators that reflect key dimensions of a normative or logical framework of Food Policy on food production/distribution, food access/consumption and food diversity, quantitative and qualitative intake, to allow the improvement of public initiatives - as programs and legislation- and the achievement of goals on one or more of the policy objectives as alleviate of hunger, guarantee adequate nourishment and promote food and nutrition security.



• Evidence based Policy-makers and program managers do not need an exhaustive suite of indicators, but mainly relevant, valid, consistent and easy-to-understand indicators , organized by the operational aspect, geographical and decision-level they are involved, in a timely and costly basis, build by means of information available on different sources– national census and household surveys, administrative registers, data produced by programs, contracted specific surveys etc- that can answer the questions they have over the Policy-Program Cycle (indicators for Diagnosing the problem, Planning the programs, Monitoring the public actions, Evaluating the overall effort).



A Possible Logical Framework on Food Policy-Making

Food ProductionFood Production

External factors not or not totally controled by Food Policy-MakersExternal factors not or not totally controled by Food Policy-Makers

Food Intern. TradeFood Intern. TradeFood AvaliabilityFood Avaliability

Garantee adequate nourishment

Garantee adequate nourishment

Alleviate Hunger Alleviate Hunger

Food and Nutrition Security

Food and Nutrition Security

Policy objectives/impactsPolicy objectives/impactsPolicy instruments: programs and legislationPolicy instruments: programs and legislation

Food AccessFood Access

Family incomeFamily incomeFood consumptionFood consumption

Food equipamentsFood equipaments



Key indicators chain based on Logical Framework on Food Policy-Making

Impacts indicatorsImpacts indicatorsPolicy, Program and Context indicatorsPolicy, Program and Context indicators

Crop production indCrop production ind

China´s food demand ind

China´s food demand ind

Ethanol internal demand ind

Ethanol internal demand ind

Govern Cash Tranfers ind

Govern Cash Tranfers ind

Food purchases Food purchases

Unemployment indUnemployment ind

Food sales indFood sales ind

Extreme poverty ind Extreme poverty ind

Anthropometric ind Anthropometric ind

Nutrition surveys ind Nutrition surveys ind

Food prices indFood prices ind

Food stocks indFood stocks ind

The impact measure depends on the nature of public intervention

The impact measure depends on the nature of public intervention

Environment indEnvironment ind Commodities Stos ind

Commodities Stos ind

SAGI - Secretaria de Avaliação e Gestão da InformaçãoSAGI – Secretariat of Evaluation and Information Management

www4.planalto.gov.br/consea/publicacoes www4.planalto.gov.br/consea/publicacoes

Brazil´s experience on Indicators for Food Related Policy-MakingBrazil´s experience on Indicators for Food Related Policy-MakingInstitutional framework

– National Policy on Food and Nutrition Security Law

– Food Security National Information System– National Council composed by civil society and

governmental institutions representatives, supported by Presidency

Technical aspects– 7 dimensions: Production, Avaliability, Income,

Access, Health, Education, Public Policy Efforts– More than 50 indicators– National, state and local indicators– More than 20 sources of information (Statistical

Agency, Public Registers, Program data etc)



Evidence based Policy-Makers and Program Managers do not need a exhaustive set of indicators, but set of indicators on context, input, resource, process, intermediate, output and impact dimensions, to follow

the Public Budget and resources being transformed into social well-being.

Effect and Impact indicators

Effect and Impact indicators

Budget and Resource indicators refleting the public effort on food programs

Budget and Resource indicators refleting the public effort on food programs

Process and Output indicators refleting the products and deliveries of food programs

Process and Output indicators refleting the products and deliveries of food programs

Context indicators that may affect Food programs achievements Context indicators that may affect Food programs achievements


Measuring Hunger: what is required for policy-making ? Evidence based Policy-Makers and Program Managers do not need a

exhaustive set of indicators, but a set of indicators organized in panels of level of relevance for decision making and explicative power.

An even broader set of indicators to contextualize, diagnose and analyze the previous, computed in more detailed geography

An even broader set of indicators to contextualize, diagnose and analyze the previous, computed in more detailed geography

Key indicators, sensitive and timely avaliable

Key indicators, sensitive and timely avaliable

A broader set of indicators, to help to understand the evolution of the key ones

A broader set of indicators, to help to understand the evolution of the key ones

2nd level Indicators for first understanding

2nd level Indicators for first understanding

Key indicators for action

Key indicators for action

3rd level Indic

for explication the whole picture

3rd level Indic

for explication the whole picture

Could be the FAO/CFS´s priority indicators

Could be the FAO/CFS´s priority indicators



Evidence based Policy-Makers and Program Managers need easy-to-understand indicators, that can be very complex to build but catches/points what they are suppose to mean, and which limitations are clearly known.

Reality of Food Related Problems

Reality of Food Related Problems

Suite of good Indicators

Suite of good Indicators

Composite Indicators

Composite Indicators


Sistema de M&A

Food related problems

Evidence based Policy-Makers and Program Managers need a different set of indicators- with specific properties- depending on their step on Policy cycle

Evaluation

Specific measures built

by surveys designed to evaluate the

program impact and its

improvements

indicators

needs

Public agenda

A broad set of indicators to

quantify, qualify and localize the

food problem

Formulation

Ad hoc Indicators to help program design

Decision making

Multicriteria or composite indicators to help choosing

alternatives

Implementation

Timely indicators to monitor implementation

process

SAGI – Secretariat of Evaluation and Information Management



Measuring Hunger: what is required for policy-making ? Evidence based Policy-Makers and Program Managers may need indicators

from different sources, because of costs and timeliness, but also because they need to get a better comprehension of the food issues phenomena. Measure Triangulation should not be a problem, if they know the potential and limitations of each indicator.

Hunger Hunger

Extreme poverty and consumption ind

Extreme poverty and consumption ind

Household Food Security Scale ind Household Food Security Scale ind

FAO undernourishment indicator

FAO undernourishment indicator


Measuring Hunger: what is required for policy-making ?• Evidence based Policy-makers and program managers do not

blame for too many indicators or a single composite one, but ask for :– a normative or logical framework to understand the whole picture – indicators of some key dimensions of this framework– detailed information for diagnosing population vulnerability and for policy/program

formulation, which takes time, large budget and less frequent data collection – monitoring indicators, timely, based on low-costly official records, quick data

collecting strategies or simplified surveys – evaluation indicators, carried on a reasonable period of time, including specific

population and geographical areas, balancing internal/external validity and costs– cost-efectiveness measures, as food programs get maturity, to support budget

allocation discussion– analytical tools to investigate relations not just to check goals



• Some of the Brazilian institutions, research centers and agencies that produce data, information and studies on Food Policy Agenda

Institution Food Related Themes/SurveysIBGE – Brazilian Statistical Agencywww.ibge.gov.brInformation for mainly Diagnosis and Monitoring, feed Logical Framework at macro-level, evaluate overall Policy (not programs)

•Crop and Cattle annual surveys (Food production) •Food products quaterly surveys (Food avaliability)•Crops Prospective estimates (Food production in near future)•Price Consumer Index (Food costs, monthly basis for 11 major areas)•Price Producer Index (Commodities costs, planned for next years)•Market and sales annual and monthly surveys (Food sales)•Agriculture-Cattle-Farm Census (Food production, area used, 10/10-year)•Decennial Demographic Census (Water,Sewage, Poverty/Income in very small areas )•HHold surveys (Water, Sewage/Pov/Income, state-lev, on 3-month basis (2011 on)•Expenditure and Income Survey (Food acquisition and intake, poverty subjective indicators, anthropometric and food security ind, 5/5-year, state, urban, rural)•Students Health National Survey (Anthopometric indicators, 2009 )




Institution Food Related Themes/SurveysMinistry of Social Delopment and the Fight against Hungerwww.mds.gov.brInformation for mainly evaluation of deliveries and impact of specific MDS programs

•Bolsa Familia Longitudinal Impact Evaluation Study (Food acquisition, access to health services, subjective poverty, sewage, anthropometric indicators, national, 3-macro-areas, 2005, 2009 and planned 2013)•National HH Supplement questionnaire on Food Security done with IBGE ( Food Security Scale, state, urban, rural areas, 2004 and 2009)•Nutrition Surveys (Anthropometric indicators, live conditions, access to programs)

– Semiárido (deprived region in Northern ) : 2005 , planned 2012– Quilombola (originated by refugee slaves in last centuries): 2006/07, current 2011– Urban Amazonas State: 2006/07 – Ribeirinhos (familes living over Amazonia rivers): planned 2012/13

• Milk Acquisition/Distribution Program Evaluation ( Food production, beneficiares´s profile and satisfaction)•Food Equipament Evaluations (Food quantity and diversity offering, user´s profile and satisfaction)


Evaluation studies on Social Programs and Food Security AgendaEvaluation studies on Social Programs and Food Security Agenda

MDS Experience on Evaluation Studies– Since 2004 till september 2011, 88

evaluation studies done– Mainly done by external contracted

studies, as IBGE, universities, research centers, NGOs, consultancy firms

– Tight supervision on sample planning, questionnaire design, field operations, final report, microdata provision

– Mix-methods approach: quantitative, qualitative, quasi-experimental techniques

– Developing Tools for Information Gathering and Program Monitoring

www.mds.gov.br/gestaodainformacao/disseminacao/2010/no-13-sintese-das-pesquisas-de-avaliacao-de-programas-sociais-do-mds-versao-atualizada-e-revisada-2006-2010/no-13-sintese-das-pesquisas-de-avaliacao-de-programas-sociais-do-mds-versao-atualizada-e-revisada-2006-2010

www.mds.gov.br/gestaodainformacao/disseminacao/2010/no-13-sintese-das-pesquisas-de-avaliacao-de-programas-sociais-do-mds-versao-atualizada-e-revisada-2006-2010/no-13-sintese-das-pesquisas-de-avaliacao-de-programas-sociais-do-mds-versao-atualizada-e-revisada-2006-2010




Institution Food Related Themes/Surveys/RegistersMinistry of Healthwww.saude.gov.brwww.datasus.gov.br Information for mainly monitoring health programs

• National Demographic and Health Surveys ( Anthropometric ind, Women and Children Health Status, HH Food Security Scale, national, 5 macro-areas, 1996/2006)•National Health Survey, partnership with IBGE (Health indicators, feeding habbits, anthropometry, morbidity indicators, state level, each 5 years) •Health National Registers with information organized in a user-friendly web plataform to gather micro-local-data

– Basic attendance made by Household-attedance-teams (Children malnutrition ind, local-level , monthly basis )–Hospitalization attendance (Malnutrition-caused hospitalization, local-level , monthly basis )–Vital Statistics Registers (7-day, 28-day, 1-year Child mortality measures, local level, yearly basis)


www.ibge.gov.br/home/estatistica/populacao/seguranca_alimentar_2004_2009/default.shtm www.ibge.gov.br/home/estatistica/populacao/seguranca_alimentar_2004_2009/default.shtm


• Figures on Food Security in Brazil: data from Food Security Scale Supplement


www.ibge.gov.br/home/estatistica/populacao/condicaodevida/pof/2008_2009_encaa/default.shtm www.ibge.gov.br/home/estatistica/populacao/condicaodevida/pof/2008_2009_encaa/default.shtm


• Figures on Food Security in Brazil: data from Consumer Expenditure Survey• Figures on Food Security in Brazil: data from Consumer Expenditure Survey


www.ibge.gov.br/home/estatistica/populacao/pense_avaliacao_nutricional_2009/pense_avaliacao_nutricional_2009.pdf www.ibge.gov.br/home/estatistica/populacao/pense_avaliacao_nutricional_2009/pense_avaliacao_nutricional_2009.pdf


• Figures on Food Security in Brazil: data from National Students Heath Survey • Figures on Food Security in Brazil: data from National Students Heath Survey



• Figures on Food Security in Brazil: data from HHold Socioeconomic Survey • Figures on Food Security in Brazil: data from HHold Socioeconomic Survey

www.ipea.gov.br www.ipea.gov.br


Thank you !!

www.mds.gov.br

[email protected]

Thank you !!

www.mds.gov.br

[email protected]

SAGI - Secretaria de Avaliação e Gestão da Informação Committee on World Food Security...

Documents

Transcript of SAGI - Secretaria de Avaliação e Gestão da Informação Committee on World Food Security...