The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service...
Transcript of The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service...
Technical PaperAssessment of the applicability of the InCiSE methodology to BrazilApril 2019
The International Civil Service Effectiveness (InCiSE) Index
Executive Summary 4
Objectives and methodology 5
The structure of the civil service 6
Availability of metrics 8
Potential new data sources and metrics 13
Applicability of the InCiSE methodology to Brazil 16
Bibliography 17
Annex: Detailed assessment of the applicability of the InCiSE methodology 18
Contents
2 InternationalCivilServiceEffectiveness(InCiSE)Index
Assessment of the applicability of the InCiSE methodology to Brazil
André Carlos Busanelli de Aquino and André Feliciano Lino,Universidade de São Paulo
InCiSE Technical Paper 2019-1
Commissioned by the Blavatnik School of Government on behalf of the InCiSE partner organisations
Paper submitted: December 2018Published: April 2019
The International Civil ServiceEffectiveness(InCiSE)Indexprojectisa collaboration between the BlavatnikSchool of Government and the Institutefor Government. It has been supportedby the UK Civil Service and funded bythe Open Society Foundations.
Please cite this work as: Busanelli de Aquino ACandLinoAF(2019)Assessmentoftheapplicability of the InCiSE methodology to Brazil, InCiSE Technical Paper 2019-1, Oxford:BlavatnikSchoolofGovernment
Assessment of the applicability of the InCiSE methodology to Brazil 3
TheInCiSEIndexwasdevelopedtobenchmarktheeffectivenessofthecivilserviceinOECDcountries.TheIndexiscomprised of 12 indicators1 and 60 themes relating to processes used in the civil service. Thisreportexaminestheviabilityofincludingthe Brazilian federal civil service in the InCiSE Indexusingthesameorsimilarindicators,themes, and data sources as those used incompilingthe2017Index.Acompanionreport similarly assesses the viability of includingNigeriaintheInCiSEIndex.
Of the 12 indicators covered in the 2017 report,wefounddataon10(digitalservicewas a notable gap, and capabilities were covered only by one proposed alternative metric; social security administration indicators were not checked, as agreed in advance).Foreachoftheseindicators,weassessed whether the sources used in the 2017 report were available for Brazil, and the existenceofcomparablealternativesand/orregional and local supplementary sources.Our analysis concludes that it is possible to do the InCiSE analysis in Brazil.
� Good quality data are available for 37 of the60themes(62%)intheIndex.
1 The measurement framework includes 17 indicators, but the 2017 Index only used 12 of these in practice.
� Of the 76 metrics used in the 2017 report, wefound65metrics(86%)forwhichthesame data sources could be used, with some potential additional sources that could be considered to increase this further.
� We found good metrics for all indicators exceptdigitalservicesandcapabilities,where no usable metrics were found, and regulation, where only one of three themes was adequately covered.
We propose the following considerations be taken into account in future work on the InCiSEIndex:
� Additional themes and sources that would amplify the assessment of policy making, fiscalandfinancialmanagement, and crisis and risk management.
� In the Brazilian case and perhaps othercontextstoo,questionsof(i)therespectiverolesoftheexecutiveand legislative in fiscalandfinancialmanagement,(ii)theindependenceofregulators,(iii)theeffectofpoliticizedappointment, payment and promotion onhumanresourcemanagement,(iv)theeffectoninclusiveness not only of recruitment and promotion practices but also of equality of treatment and of discretionary payments.
ExecutiveSummary
4 InternationalCivilServiceEffectiveness(InCiSE)Index
Thisreportispartofajointstudyinvestigating the feasibility of applying the InCiSE methodology to Brazil and Nigeria, withthefollowingobjectives:
� Outline aspects of the structure and functions of the civil service of both countriesthatmayaffectapplicationofthe InCiSE framework;
� Identify international and national data sources relevant to the InCiSE framework and comment on the availability of data, the ease of accessing data, and the strengths and weaknesses of these sources for this purpose;
� Comment on the applicability of the InCiSEIndextocoverthesecountries,anddiscuss(i)challengesthatmightbefacedinusingitand(ii)waysinwhichtheIndexmightneedtobeadjustedtobemore relevant, applicable, and feasible.
Thisprojectdoesnotaimtoevaluatetheperformance of the civil service in Brazil, but only to comment on the potential applicability and relevance of the InCiSE methodology to the country, and in particular to assess the availability of relevant data compatible with the current InCiSE methodology.
We have attempted as far as possible to match the same sources and metrics for the same themes as in the 2017 InCiSE Report. That report sought data for 12 indicators, althoughdidnotfindsufficientdatatoinclude
the social security administration indicator. In consultation with the Blavatnik School of Government, we similarly did not include the indicator on social security administration, and focused on the remaining 11 indicators. For each indicator, the analysis went through the following steps:
a. Are the sources used in InCiSE 2017 available? Assess whether, for Brazil, the themes and indicators in the InCiSE framework were covered by the same metrics and sources as were used in the 2017 InCiSE Report, and comment on the quality of the data for each country.
b. What is the availability and quality of comparable alternative metrics? For the remaining themes, where the InCiSE team had found metrics for OECD countries but where the same data source does not cover Brazil, search for alternative regional or local data sources that address the same themes. Where comparable alternativesexist,wecommentonthequality of these metrics.
c. Are there supplementary regional and local sources? Identify supplementary metrics,wherewefindthatregionalandlocal sources could be used alongside or instead of the metrics that the 2017 InCiSE Report had selected.
Objectivesandmethodology
Assessment of the applicability of the InCiSE methodology to Brazil 5
Thestructureoftheexecutivebranchatthefederal level in Brazil is similar to that of other federal countries, where the president appoints a Cabinet to run a corps of tenured civil servantsforafouryearterm,extendablebyone more term.
The development of the federal civil service in Brazil has passed through three phases: patrimonialist,Weberian(from1937),andpost-Weberian(from1993).Thereformsin Cardoso’s presidency, inspired by the New Public Management movement, did notachievetheintendedresults(Abrucio,2007).Theeffectofprofessionalizingthebureaucracy and evaluating its performance by implementing outcome indicators could have reducedthespaceforpoliticalinfluenceintheallocationofjobpositions(Abrucio,2007),butin fact this has increased over time.
In 2018, the federal level has about 620,000 civilservants(excludingstate-ownedcompanies),withmorethan90,000receivingsometypeoftemporarygratification(salaryincrease)associatedwithspecificroles.MostrelevanttotheInCiSEIndexisthegroupof240,000 civil servants of the central ministries and their departments. Although some of this grouparesubjecttoperformanceevaluation(basedontargetsandoutputs)whichisusedtosupportpromotionsandconfirmationofjobtenure, payment-for-performance is rare.
1 ENAP, 2017, Pesquisa sobre Serviços Públicos de Atendimento do Governo Federal, Escola Nacional deAdministraçãoPública(Brasil),http://repositorio.enap.gov.br/handle/1/3217
Of these 240,000 civil servants, 22,500 are in high level advisory positions across 23ministriesandtheirexecutiveagencies(excludingstate-ownedcompanies).Suchadvisory positions act mainly in policy design and implementation, and in leading central service delivery associated with the InCiSE indicators. At least 5,900 such positions are temporary political appointments to non-tenured positions. Of these high level positions, 36%areoccupiedbyblackorindigenouspeople,and45%bywomen.Theproportionsof women occupying the very highest positions (levelsDAS-6andDAS-5)are18%and22%respectively(ENAP,2018).Morefemalethan male civil servants have post-graduate degrees, while fewer female than male civil servants are less educated.
A survey undertaken in 2017 by the Brazilian National School of Public Administration found 1740 services delivered by 85 agencies and departments of the federal government. The clientsforthoseservicesincludecitizens(for50%ofthelistedservices),privatecompanies(57%),state-ownedcompanies(45%),othergovernmentagencies(20%),statesandmunicipalities(24%)(servicesmayhavemorethanonetypeofclient).Currently,46%oftheservicesareweb-based,and71%arefree-of-charge(ENAP,20171).
As indicated in Table 1, some InCiSE functions are delivered essentially by one
The structure of the civil service
6 InternationalCivilServiceEffectiveness(InCiSE)Index
Ministry, facilitating data collection, while others are decentralized, requiring multiple surveys to access a broader range of federal organisations.
AsignificantfeatureoftheBraziliancivilserviceis the large number of politically appointed civil servants. These political appointments are made through political bargains between the
president and leaders of political parties that occupyasignificantproportionofseatsinthecongressionallowerchamber(theCâmara dos Deputados).Despitereformsin2016/2017,whenunderthePresidencyofDilmaRousseffthenumberofsuchpositionswassignificantlyreduced,thosejobsarestillpresentalloverthefederalstructure(includingfederalagencies,state-ownedcompaniesandministries).
Located at Functions and levels of government
Dispersion of function and difficulty of data collection
Central executivePolicy-making Each ministry Related to federal level ModerateFiscal and financial management
Ministry of Finance Related to federal level Low
Regulation Federal executive agencies (ANA, CVM, ANEEL, etc)
Related to federal level High
Crisis/risk management Ministry of Planning and Budgeting, and Decentralized
Related to federal level Moderate
Mission supportProcurement* Ministry of Planning and
BudgetingRelated to federal level Low
HR management Ministry of Planning and Budgeting
Related to federal level Low
IT* Decentralized and State-owned enterprise (CERPRO)
Related to federal level High
Finance* Ministry of Finance Related to federal level LowDirect service deliveryTax Ministry of Finance Shared, local and state taxes LowSocial security Ministry of Social Security National system LowDigital services Decentralized Related to federal level HighAttributesIntegrity All ministries All levels of government.
Includes politically appointed positions.
HighOpennessCapabilitiesInclusivenessStaff engagement*Innovation*
* Not yet measured or included in the InCiSE (2017) Index due to data availability
Table 1: The InCiSE central functions and attributes in Brazil
Assessment of the applicability of the InCiSE methodology to Brazil 7
Availability of metrics
TheInCiSEIndexanalyses12indicators,composed of 60 themes. For the countries coveredinthe2017Index,datawerefoundtobe available for 40 of the themes, measured by76metricscomingfrom19differentsources of data. Table 2 shows that 14 of these sources of data are available for the Brazilian case. These comprise 65 metrics, meaningthat86%ofthedataareavailable.The InCiSE framework sets a threshold for acountry’sinclusionintheIndexof75%ofthe metrics being available, so we conclude that it is possible to do the InCiSE analysis in Brazil. Hereafter we describe the availability of metrics per indicator and themes.
Additional themes or metrics. We suggest two additional themes for this indicator. Following therecommendationsofOECD(2015),governmentsmust(a)ensurethatbudgetdocuments and data are open, transparent andaccessible,and(b)promotetheintegrity and quality of budgetary forecasts, fiscalplansandbudgetaryimplementationthrough rigorous quality assurance including independent audit. Thus, we suggest the inclusion of new themes and underlying metrics that capture more phases of the budgetary cycle than its preparation, namely themonitoringphaseandexternalaudit.
The themes and the following metrics are:
Theme: Openness of budgetary practices; metric: IBP Open Budget Index“Transparency”indicator.
Theme: Integrity of budgetary practices; metric: IBP Open Budget Index“BudgetOversight”indicator.
Overall, there are good metrics for this indicator in the Brazilian case. Moreover, these new themes and metrics may be useful forallcountriesinnextyear’sInCiSEIndex.
RegulationExistenceofmetrics. All three of the themes comprisingthe“Regulation”indicatorarecoveredbytheOECD’s“IndicatorsofRegulatoryPolicyandGovernance”(iREG).In 2016 the iREG indicators were applied to seven Latin America countries that are OECD member and partner countries: Brazil, Chile, Colombia,CostaRica,Ecuador,MexicoandPeru.
8 InternationalCivilServiceEffectiveness(InCiSE)Index
Table 2: Availability of data sources included in InCiSE 2017 for Brazil
Sources used in InCiSE 2017 available for Brazil
Sources used in InCiSE 2017 NOT available for Brazil
� Bertelsmann Sustainable Governance Indicators
� Doing Business index
� Hyogo Framework for Action
� OECD conflict of interest, private interest, and whistle-blower data
� OECD Tax Administration 2015
� OECD’s ‘Indicators of Regulatory Policy and Governance’*
� OECD’s OURdata Index
� Open Knowledge Foundation’s Open Data Index
� Quality of Government Expert Survey Data
� Transparency International’s Global Corruption Barometer
� UN’s E-participation Index
� World Economic Forum (WEF) Global Competitiveness Index (GCI)
� World Justice Project’s Open Government Index
� World Wide Web Foundation’s Open Data Barometer
� European Commission E-Government Benchmarks
� Government at a Glance 2013
� OECD medium-term budgeting
� OECD performance budgeting
� OECD PIAAC
Note: * OECD’s iREG is not available in full detail. See more information below.
Assessment of the applicability of the InCiSE methodology to Brazil 9
Thus, Brazil is covered, and we have available metrics. However, we need to take a closer look at each of the themes that form the“Regulation”indicator.
Theme–“Exanteappraisal:application, quality, sustainability, transparency,oversight”.Forthisthemeitispossibletoseewhether(i)there is a requirement to conduct a RegulatoryImpactAssessment(RIA);(ii)theRIAisconductedinpractice;(iii)thequalityofRIAischeckedbyagovernment body outside the ministry undertakingtheregulation;and(iv)there is written guidance on the preparation of an RIA. However, there isnocompositeindexavailable.
Theme–“Stakeholderengagement:application, quality, transparency, oversight”.Forthistheme,thereisa composite indicator available for Brazil, following the methodology of OECD’s 2015 Indicators of Regulatory Policy and Governance1.
Theme–“Expostevaluation:application, quality, sustainability, transparency,oversight”.Again,thereisnocompositeindexavailable–butthere is data on the report that might be useful.
Theterm“Secondaryregulation”isalsoreferredtoas“Subordinateregulation”inrecentOECDsurveys(seetheGlossaryonthe methodology on OECD’s 2015 Indicators ofRegulatoryPolicyandGovernance).
Alternative metrics were not found for these themes.
1 http://dx.doi.org/10.1787/5jrnwqm3zp43-en2 http://www.inform-index.org/
Additional themes or metrics are not proposed for this indicator.
Overall, there is good data for one of the three metrics that make up this indicator.
Crisis and Risk ManagementExistenceofmetrics.Fiveofthesixthemescomprisingthe“CrisisandRiskManagement”indicatorarecoveredbyHyogo Framework for Action reports (‘preparednessfordisasterresponse’ismissing).TherearefivereportsforBrazil(including(i)Brazil:Nationalprogressreport on the implementation of the Hyogo FrameworkforAction[2011-2013];and(ii)Brazil: Sendai Framework data readiness reviewreport[2017])coveringallmetricsneeded for this indicator.
Alternative metrics were not found for these themes.
Additional themes or metrics. We propose for consideration a potential new theme relatedto“RiskExposure”.Theperceivedvulnerability of a country is an important factor to guide implementation of anticipatory capacities,influencingcopingcapacitiesin periods of strain. Thus, based on the EuropeanCommission’s“INFORM–IndexforRiskManagement”2, we propose the “HazardandExposure”indexasaproxyforRiskExposure.However,whiletheInformindexincludeselementsrelatedtocopingcapacity which may be related to civil service effectiveness,itencompassesmanyotherfactors as well, so is not a particularly strong metric for the civil service.
Overall, we conclude that there are good metrics for the Brazilian case.
10 InternationalCivilServiceEffectiveness(InCiSE)Index
Human Resource ManagementExistenceofmetrics.Sixthemescomprisethe“HumanResourceManagement”indicatorbutintheInCiSEIndex2017data are only available for two of them, namely(i)“Meritocracyofrecruitment”and(ii)“Attractingandretainingtalent”.Thesethemes are also covered for the Brazilian case,basedonthe“QualityofGovernmentExpertSurveyData”.
Alternative metrics. We suggest that for the firsttheme,analternativecouldbe“Civilservicemerit”availableintable6.4,pp105ofGovernment at a Glance: Latin America and the Caribbean 2017.
Additional themes or metrics are not proposed for this indicator.
Overall, there are good metrics for the Brazilian case.
Tax AdministrationExistenceofmetrics.Five themes comprise the“TaxAdministration”indicatorintheInCiSEIndex2017,butonlythreeofthemare already covered. The 2017 report did not identify any data for the themes ‘preventionoftaxevasion’and‘leveloftaxgap measurement’, and we were likewise unabletofindalternativemetricsforthesethemes for Brazil. All of the remaining themes covered in InCiSE 2017 are available forBrazil,basedondatafromOECDTaxAdministration surveys.
Alternative metrics.The“InstitutionalProfileDatabase”(IPD),organizedbytheCEPII,havesomemetricson(i)efficiencyoftaxadministration in the collection of corporation tax,incometax,acrossthenationalterritory,andalsoon(ii)onecountryabilitytolimittaxevasion.
Additional themes or metrics are not proposed for this indicator.
Overall, there are good metrics for the Brazilian case.
Digital ServicesExistenceofmetrics. Four themes comprise the “DigitalServices”indicatorintheInCiSEIndex2017. These data come from the European Commission, and none of the metrics used in InCiSE 2017 are available for Brazil.
Alternative metrics.Wedidnotfindalternative sources of data. However, there is a forthcoming publication by OECD-the“DigitalGovernmentReviewofBrazil”thatmightbeuseful(https://doi.org/10.1787/9789264307636-en).
Additional themes or metrics are not proposed for this indicator.
Overall,wedonotfindanyusablemetricsforthe Brazilian case.
IntegrityExistenceofmetrics.Sixthemescomprisethe“Integrity”indicatorintheInCiSEIndex2017. The sources of data are Transparency International’s Global Corruption Barometer, QualityofGovernment(QoG)ExpertSurveys,WorldEconomicForum’s(WEF)GlobalCompetitivenessIndex(GCI)andOECD.Datafor all of these themes are available for Brazil.
Alternative metrics. The LatinoBarometro 2018 could be an alternative source for the levels/perceptionofcorruptionthemeforLatin countries.
Additional themes or metrics are not proposed for this indicator.
Overall, there are good metrics for the Brazilian case.
Assessment of the applicability of the InCiSE methodology to Brazil 11
OpennessExistenceofmetrics.Sixthemescomprisethe“Openness”indicatorintheInCiSEIndex2017.ThesourcesofdataareTheWorldJusticeProject’sOpenGovernmentIndex,TheUN’sE-participationIndex,Bertelsmann’s Sustainable Governance Indicators(SGIs),TheWorldWideWebFoundation’s Open Data Barometer, The Open Knowledge Foundation’s Open Data IndexandOECD’sOURdataindex.Dataforall themes are available for Brazil. However, the Bertelsmann SGI could be weak on the “degreeandqualityofsocietalconsultation”theme, because it is based on a special report for BRICS, issued in 2014 which may beaone-offexercise.
Alternative metrics.Forthe“Thedegreeandqualityofsocietalconsultation”theme,we suggest for consideration a potential alternativemetric,item3.6.6ofthe“VarietiesofDemocracyindex”,namely,“Engagedsociety(v2dlengage)”,withthequestion“Whenimportantpolicychangesarebeingconsidered, how wide and how independent arepublicdeliberations?”Thismetricrelatesto the openness of policy-making, but is only an indirect indication of civil service effectiveness.
Additional themes or metrics are not proposed for this indicator.
Overall, there are good metrics for the Brazilian case.
CapabilitiesExistenceofmetrics.Sixthemescomprisethe“Capabilities”indicatorintheInCiSEIndex2017.ThesedatacomefromtheOECD PIAAC, and none of the metrics used in InCiSE 2017 are available for Brazil.
Alternative metrics. We suggest that one alternativemetricforthe“Corecapability”themecouldbethe“HRpersonneltechnicalskills”–availableatGovernmentataGlance:Latin America and the Caribbean 2017 - pp. 103 , table 6.2.
Additional themes or metrics are not proposed for this indicator.
Overall,wedonotfindsuitablemetricsforthe Brazilian case.
InclusivenessExistenceofmetrics. Five themes comprise this indicator, but data are only available for two of them in the 2017 InCiSE report. These datacomefromQualityofGovernmentexpertsurveysandOECD’sGovernmentataGlance. The Brazilian case is partly covered but the two metrics from GaaG are not available.
Alternative metrics. The Brazilian Government National School of Public Administration (ENAP)producesreportsbasedonsurveysof quantitative data of gender, LGBT and other minorities that could be useful for the Brazilian case. However, these data are countryspecificandnotcomparablewithother countries.
Additional themes or metrics are not proposed for this indicator.
Overall, there are good metrics for the Brazilian case.
12 InternationalCivilServiceEffectiveness(InCiSE)Index
The proposed new data sources for Brazil are summarised in table 3 below.
Our aim was to identify data for 12 indicators comprising 60 themes. Table 3, shows which indicators and themes we feel can be well represented(✔),approximatelyrepresented(~),ornotrepresented(✘)forBrazil,andwhether the data sources would be the same as the sources that were used in the 2017 InCiSE report or whether new metrics are suggested, either instead of or in addition to the original sources.
Potential new data sources and metrics
Table 3: Proposed new data sources for Brazil
Organisation Instrument Period Frequency
CEPII Institutional Profile Databases 2001, 2006, 2009, 2012 and 2016
Unsure
Freedom House Freedom in the World index 1998-2018 Annual
International Budget Partnership
Open budget Survey 2006-2018 Bi-annual
Latinobarómetro Informe Latinobarómetro 1995-2018 Annual
OECD Government at a Glance: Latin America and the Caribbean
2014 and 2017 Unsure
Varieties of Democracy Institute
V-DEM Annual Democracy Report 1900-2018 Annual
Assessment of the applicability of the InCiSE methodology to Brazil 13
Indicator Theme Data availability
Same sources as InCiSE 2017?
New metrics proposed?
Policy making The quality of policy advice ✘ No
Degree of strategic policy direction ✘ No
Coordination of policy proposals ✘ No
Timeliness and accuracy of policy delivery ✘ No
Degree of policy monitoring ✘ No
Fiscal and financial management
Economic appraisal (use, quality, guidance) ✔ Yes
Economic evaluation (use, quality, guidance) ✔ Yes
Medium-term budgeting ✔ No Yes
Performance budgeting ✔ No Yes
Regulation Ex ante appraisal: application, quality, sustainability, transparency, oversight.
✘ No
Stakeholder engagement: application, quality, transparency, oversight
✘ No
Ex post evaluation: application, quality, sustainability, transparency, oversight
✘ No
Crisis/risk management
Integrated risk planning ✔ Yes
Risk monitoring ✔ Yes
Public information dissemination and public awareness strategies
✔ Yes
International cooperation and risk coordination ✔ Yes
Preparedness for disaster response ✘ No
Post disaster assessment methodology ✔ Yes
Human resource management
Meritocracy of recruitment ✔ Yes
Attracting and retaining talent ✔ Yes
Talent deployment (i.e. minimising skills gaps) ✘ No
Performance management ✘ No
Quality of learning and development ✘ No
Level of customer (i.e. civil servant) satisfaction ✘ No
Tax administration Overall efficiency of collection ✘ No
User centricity of services ~ Yes
Extent and quality of digital provision ✘ No
Prevention of tax evasion ✘ No
Level of tax gap measurement ✘ No
Social security administration
Overall efficiency of distribution ✘ No
User centricity of services ✘ No
Extent and quality of digital provision ✘ No
Prevention of fraud ✘ No
Digital service User centricity of services ~ No Yes
Transparency of service ~ No Yes
Cross-border mobility of services ✘ No
The availability of ‘key enablers’ ✘ No
14 InternationalCivilServiceEffectiveness(InCiSE)Index
Indicator Theme Data availability
Same sources as InCiSE 2017?
New metrics proposed?
Integrity Levels/perceptions of corruption ✔ Yes
Fairness and impartiality ✔ Yes
Adherence to rules and procedures ✔ Yes
Striving to serve citizens and ministers ✔ Yes
Work ethic ✔ Yes
Processes in place to preserve integrity and prevent conflicts of interest
✔ Yes
Openness The degree and quality of societal consultation ✔ Yes
The existence and quality of complaint mechanisms
✔ Yes
Government data availability and accessibility ~ No Yes
Government data impact and support for re-use ✘ No
Right to information (e.g. FOIs) ✘ No
Publicised laws ✔ Yes
Capabilities Leadership capability ✘ No
Commercial capability ✘ No
Analytical capability ✘ No
Digital capability ✘ No
Core capability (e.g. problem-solving, numeracy, literacy skills)
✘ No
Educational attainment of the workforce ✘ No
Inclusiveness Proportionate gender representation ✔ No Yes
Proportionate ethnic minority representation ✔ Yes
Proportionate disability representation ✘ No
Proportionate socio-economic representation ✘ No
Proportionate Lesbian Gay Bi-sexual Transgender Other sexuality representation
✘ No
Assessment of the applicability of the InCiSE methodology to Brazil 15
Applicability of the InCiSE methodology to Brazil
FortheBraziliancasethereareindexesthatfocusontheeffectivenessofprocedureswithin the civil service, as well as output measures. Here we indicate the relevance ofmetricsintheBraziliancontext.Our comments may also be relevant considerationsforextendingthecoverageoftheInCiSEIndextocountriessimilartoBrazil.
a. Fiscal and Financial Management: The“qualityofthebudgetingprocess”ultimately depends on the legislative branch of government, but legal mandatesvaryatdifferentpointsin the budgetary process. For a federal presidential country like Brazil, budgetarybills,policyexecutionandpolicy monitoring are the concern of theexecutivebranch,butthelegislativebranch has autonomy to amend and monitorthebudgetinregardtoitsfiscalaspects.Consequently,the“qualityofthebudgetingprocess”spillsoverfromtheexecutivetothelegislativebranch,inwaysthatmayaffectcomparabilitywith other governmental systems. It is important that the InCiSE metrics focus on processes that are within the legal mandateoftheexecutivebranchforallcountriescoveredbytheIndex.
b. Regulation: The“extentandquality”ofassessments and stakeholder engagement donotentirelycapturetheeffectivenessoftheexecutiveagency.Thequestionofthe independence of the regulator from
regulated bodies is not covered by the Index.Thisisaparticularlyrelevantissuein clientelistic countries, where political appointments to regulatory agencies can undermine the regulatory process.
c. Human Resource Management: Althoughthe“meritocracyofrecruitment”is an important dimension of HRM, other important features of meritocracy are how performance is evaluated and connected to promotion, how high level strategic positions are assigned, and how far down the hierarchic chain politically assigned supplementary payments and gratificationscanbeawarded.Thesefactorscandistractofficials’motivationfrom performance to the development of paternalistic ties.
d. Inclusiveness: Problems of the representation of groups in public administration(women;racial,ethnicand religious minorities; the disabled; indigenouspopulations)canbeobservednot only in their opportunities for recruitment, promotion and rewards, but also in equality of treatment and openness to their voice and ideas. Another metric currently not included in the Inclusiveness indicator relates to the discretionary assignmentofextrapaymentsforpolitically appointed temporary roles. In Brazil, such payments are concentrated on men occupying high level positions, butarealsousedtofavourspecificgroups in medium level positions.
16 InternationalCivilServiceEffectiveness(InCiSE)Index
Abrucio,F.L.(2007).Trajetóriarecentedagestãopúblicabrasileira: um balanço crítico e a renovação da agenda de reformas. Revista de Administração Pública-RAP, 41.
ENAP(2018).Servidores(as) por raça/cor: sumário estatístico, Escola Nacional de Administração Pública (Brasil),http://repositorio.enap.gov.br/handle/1/3259
OECD(2013).Government at a Glance 2013. OECD Publishing, Paris. https://www.oecd-ilibrary.org/governance/government-at-a-glance-2013_gov_glance-2013-en
OECD(2015).Recommendation of the Council on Budgetary Governance. OECD Publishing, Paris. http://www.oecd.org/gov/budgeting/Recommendation-of-the-Council-on-Budgetary-Governance.pdf
Bibliography
Assessment of the applicability of the InCiSE methodology to Brazil 17
Thetablesinthisannexoutlineindetailtheapplicability of the methodology set out in the Technical Report for the 2017 edition of theInCiSEIndex,assessingwhetherdataisavailable for Brazil and proposing potential alternatives where possible.
Annex:Detailedassessmentoftheapplicability of the InCiSE methodology
18 InternationalCivilServiceEffectiveness(InCiSE)Index
Them
eM
etric
s us
ed in
InC
iSE
Inde
xC
omm
ents
on
the
qual
ity/
avai
labi
lity
of th
e In
CiS
E m
etric
s fo
r Bra
zil
Alte
rnat
ive
m
etric
s
sugg
este
d
Com
men
ts o
n th
e qu
ality
of
the
alte
rnat
ive
met
rics
Polic
y m
akin
g
The
qual
ity o
f pol
icy
advi
ceBe
rtels
man
n ‘S
chol
arly
Adv
ice’
sub
-indi
cato
r is
used
as
a pr
oxy
for t
he e
vide
nce
base
to p
olic
y de
cisi
ons
by a
sses
sing
the
degr
ee o
f civ
il se
rvan
t to
acad
emic
coo
rdin
atio
n: ‘H
ow in
fluen
tial
are
non-
gove
rnm
enta
l aca
dem
ic e
xper
ts fo
r gov
ernm
ent
deci
sion
-mak
ing?
’
Berte
lsm
ann
‘Gov
ernm
ent O
ffice
Exp
ertis
e’ s
ub-in
dica
tor
asse
sses
: ‘Do
es th
e go
vern
men
t offi
ce/p
rime
min
iste
r’s o
ffice
(G
O/P
MO
) hav
e th
e ex
perti
se to
eva
luat
e m
inis
teria
l dra
ft bi
lls
subs
tant
ivel
y?’
(1) T
he s
ame
met
ric is
ava
ilabl
e in
a s
peci
fic c
ount
ry re
port
from
20
14. I
t is
unsu
re if
it is
a “o
ne-o
ff” e
xper
ienc
e or
if B
erte
lsm
ann
inte
nd to
ela
bora
te th
ese
repo
rts fr
eque
ntly.
Berte
lsm
ann’
s SG
I Rep
ort f
or B
razil
is re
liabl
e, s
ince
it is
co
-aut
hore
d by
two
Braz
ilian
rese
arch
ers
who
hav
e fo
rmal
an
d ta
cit k
now
ledg
e ab
out t
he in
stitu
tiona
l and
eco
nom
ic
envi
ronm
ent o
f the
cou
ntry
.
NO
N/A
Degr
ee o
f stra
tegi
c po
licy
dire
ctio
nBe
rtels
man
n ‘S
trate
gic
Plan
ning
’ sub
-indi
cato
r ass
esse
s: ‘H
ow
muc
h in
fluen
ce d
o st
rate
gic
plan
ning
uni
ts a
nd b
odie
s ha
ve o
n go
vern
men
t dec
isio
n-m
akin
g?’
See
com
men
t (1)
NO
N/A
Coo
rdin
atio
n of
pol
icy
prop
osal
sBe
rtels
man
n ‘M
inis
teria
l Bur
eauc
racy
’ sub
-indi
cato
r ass
esse
s:
‘How
effe
ctiv
ely
do m
inis
try o
ffici
als/
civi
l ser
vant
s co
ordi
nate
po
licy
prop
osal
s?’
Berte
lsm
ann
‘Lin
e M
inis
tries
’ sub
-indi
cato
r ass
esse
s ‘T
o w
hat
exte
nt d
o lin
e m
inis
tries
invo
lve
the
gove
rnm
ent o
ffice
/prim
e m
inis
ter’s
offi
ce in
the
prep
arat
ion
of p
olic
y pr
opos
als?
’
See
com
men
t (1)
YES
CEP
II In
stitu
tiona
l Pro
files
Dat
abas
eC
EPII
IPD
is n
ow a
vaila
ble
in 1
44 c
ount
ries
of th
e w
orld
.
The
data
are
relia
ble
sinc
e th
ey a
re g
athe
red
via
surv
eys
of
colla
bora
tors
at t
he M
inis
try o
f Eco
nom
y an
d Fi
nanc
e of
the
sele
cted
cou
ntry
+ th
e Fr
ench
Dev
elop
men
t Age
ncy
(if it
ex
ists
in th
e co
untry
)
Tim
elin
ess
and
accu
racy
of p
olic
y de
liver
yN
o da
ta id
entifi
edN
/AN
ON
/A
Assessment of the applicability of the InCiSE methodology to Brazil 19
Them
eM
etric
s us
ed in
InC
iSE
Inde
xC
omm
ents
on
the
qual
ity/
avai
labi
lity
of th
e In
CiS
E m
etric
s fo
r Bra
zil
Alte
rnat
ive
m
etric
s
sugg
este
d
Com
men
ts o
n th
e qu
ality
of
the
alte
rnat
ive
met
rics
Degr
ee o
f pol
icy
mon
itorin
gBe
rtels
man
n ‘M
onito
ring
Min
istri
es’ s
ub-in
dica
tor a
sses
ses:
‘H
ow e
ffect
ivel
y do
es th
e G
O/P
MO
mon
itor l
ine
min
istry
act
iviti
es
with
rega
rd to
impl
emen
tatio
n?’
Berte
lsm
ann
sub-
indi
cato
r ‘M
onito
ring
Agen
cies
’, as
sess
es:
‘How
effe
ctiv
ely
do fe
dera
l and
sub
natio
nal m
inis
tries
mon
itor
the
activ
ities
of b
urea
ucra
cies
/exe
cutiv
e ag
enci
es w
ith re
gard
to
impl
emen
tatio
n?’
Berte
lsm
ann
‘Nat
iona
l Sta
ndar
ds’ s
ub-in
dica
tor a
sses
ses:
‘To
wha
t ext
ent d
oes
cent
ral g
over
nmen
t ens
ure
that
sub
natio
nal
self-
gove
rnm
ents
real
ise
natio
nal s
tand
ards
of p
ublic
se
rvic
es?’
See
com
men
t (1)
NO
N/A
Fisc
al a
nd fi
nanc
ial m
anag
emen
t
Econ
omic
app
rais
al (u
se, q
ualit
y, gu
idan
ce)
‘Pub
lic S
pend
ing’
: WEF
GC
I bus
ines
s ex
ecut
ive
opin
ion:
‘How
w
ould
you
rate
the
com
posi
tion
of p
ublic
spe
ndin
g in
you
r co
untry
?’ (1
) ext
rem
ely
was
tefu
l; (7
) hig
hly
effici
ent i
n pr
ovid
ing
nece
ssar
y go
ods
and
serv
ices
.
(2) T
he s
ame
met
ric is
ava
ilabl
e an
d di
sclo
sed
frequ
ently
.
WEF
GC
I use
s a
mix
of s
econ
dary
dat
a an
d co
untry
sur
veys
co
nduc
ted
by p
artn
er o
rgan
isat
ions
bas
ed o
n th
e co
untry
an
alys
ed –
incr
easi
ng th
e re
liabi
lity
of th
e in
dex
due
to fo
rmal
an
d ta
cit k
now
ledg
e ab
out t
he in
stitu
tiona
l and
eco
nom
ic
envi
ronm
ent o
f the
cou
ntry
.
NO
N/A
Econ
omic
eva
luat
ion
(use
, qua
lity,
guid
ance
)N
ON
/A
Med
ium
-term
bud
getin
gO
ECD
‘Med
ium
-Ter
m B
udge
ting’
inde
xSa
me
met
ric is
NO
T av
aila
ble
YES
Inte
rnat
iona
l Bud
get P
artn
ersh
ip O
pen
Budg
et S
urve
yQ
uest
ion
48 o
f the
OBS
cap
ture
exa
ctly
the
dyna
mic
s of
M
ediu
m-te
rm b
udge
ting
– i.e
. “is
the
Exec
utiv
e’s
Budg
et
Prop
osal
or a
ny s
uppo
rting
bud
geta
ry d
ocum
enta
tion
pres
ent
20 InternationalCivilServiceEffectiveness(InCiSE)Index
Them
eM
etric
s us
ed in
InC
iSE
Inde
xC
omm
ents
on
the
qual
ity/
avai
labi
lity
of th
e In
CiS
E m
etric
s fo
r Bra
zil
Alte
rnat
ive
m
etric
s
sugg
este
d
Com
men
ts o
n th
e qu
ality
of
the
alte
rnat
ive
met
rics
info
rmat
ion
on h
ow th
e pr
opos
ed b
udge
t (bo
th n
ew p
ropo
sals
an
d ex
istin
g po
licie
s) is
link
ed to
gov
ernm
ent’s
pol
icy
goal
s fo
r a m
ulti-
year
per
iod
(for a
t lea
st tw
o ye
ars
beyo
nd th
e bu
dget
yea
r)?”
The
data
are
relia
ble.
IBP
Met
hodo
logy
ask
s fo
r a g
over
nmen
t re
spon
se a
nd a
n ac
adem
ic p
eer r
evie
w b
efor
e th
e pu
blic
atio
n of
the
resp
onse
s fo
r the
que
stio
nnai
re.
Mor
e m
etric
s co
min
g fro
m th
e sa
me
data
sou
rce
can
be
usef
ul fo
r InC
iSe
team
on
this
them
e (a
nd o
vera
ll in
dica
tor).
Perfo
rman
ce b
udge
ting
OEC
D ‘P
erfo
rman
ce B
udge
ting’
inde
xSa
me
met
ric is
NO
T av
aila
ble
YES
Inte
rnat
iona
l Bud
get P
artn
ersh
ip O
pen
Budg
et S
urve
yTh
e qu
estio
n 51
of t
he O
BS c
aptu
re e
xact
ly th
e dy
nam
ics
of P
BB
– i.e
., 'A
re p
erfo
rman
ce ta
rget
s as
sign
ed to
non
finan
cial
dat
a on
resu
lts in
the
Exec
utiv
e’s
Budg
et P
ropo
sal o
r any
sup
porti
ng
budg
et d
ocum
enta
tion?
”
The
data
are
relia
ble.
IBP
Met
hodo
logy
ask
s fo
r a g
over
nmen
t re
spon
se a
nd a
n ac
adem
ic p
eer r
evie
w b
efor
e th
e pu
blic
atio
n of
the
resp
onse
s fo
r the
que
stio
nnai
re.
Mor
e m
etric
s co
min
g fro
m th
e sa
me
data
sou
rce
may
be
usef
ul fo
r InC
iSE
team
on
this
them
e (a
nd o
vera
ll in
dica
tor).
Reg
ulat
ion
Ex a
nte
appr
aisa
l: ap
plic
atio
n, q
ualit
y, su
stai
nabi
lity,
trans
pare
ncy,
over
sigh
t.O
ECD
i-reg
indi
cato
rs –
Reg
ulat
ory
‘Impa
ct A
sses
smen
t –
Prim
ary
Law
s’
OEC
D i-r
eg in
dica
tors
– R
egul
ator
y ‘Im
pact
Ass
essm
ent –
Se
cond
ary
Law
s’
Stak
ehol
der e
ngag
emen
t and
ex
post
eva
luat
ion
asse
ssm
ents
ar
e m
ade
on fo
ur a
reas
of p
erfo
rman
ce: m
etho
dolo
gy,
syst
emat
ic a
dopt
ion,
tran
spar
ency
and
ove
rsig
ht/q
ualit
y co
ntro
l.
The
sam
e da
ta is
ava
ilabl
e, b
ut th
ere
is n
o co
mpo
site
indi
cato
r in
the
Braz
ilian
coun
try R
epor
t.
NO
N/A
Assessment of the applicability of the InCiSE methodology to Brazil 21
Them
eM
etric
s us
ed in
InC
iSE
Inde
xC
omm
ents
on
the
qual
ity/
avai
labi
lity
of th
e In
CiS
E m
etric
s fo
r Bra
zil
Alte
rnat
ive
m
etric
s
sugg
este
d
Com
men
ts o
n th
e qu
ality
of
the
alte
rnat
ive
met
rics
Stak
ehol
der e
ngag
emen
t: ap
plic
atio
n, q
ualit
y, tra
nspa
renc
y, ov
ersi
ght
OEC
D i-r
eg in
dica
tors
– ‘S
take
hold
er E
ngag
emen
t – P
rimar
y La
ws’
OEC
D i-r
eg in
dica
tors
– ‘S
take
hold
er E
ngag
emen
t –
Seco
ndar
y La
ws’
The
sam
e da
ta a
re a
vaila
ble
and,
for t
his
them
e, th
ere
is a
co
mpo
site
indi
cato
r ava
ilabl
e fo
r Bra
zil. T
he in
dica
tor f
ollo
ws
the
met
hodo
logy
of O
ECD’
s 20
15 In
dica
tors
of R
egul
ator
y Po
licy
and
Gov
erna
nce.
NO
N/A
Ex p
ost e
valu
atio
n: a
pplic
atio
n, q
ualit
y, su
stai
nabi
lity,
trans
pare
ncy,
over
sigh
tO
ECD
i-reg
indi
cato
rs –
Ex-
post
‘Eva
luat
ion
– Pr
imar
y La
ws’
OEC
D i-r
eg in
dica
tors
– E
x-po
st ‘E
valu
atio
n –
Seco
ndar
y La
ws’
The
sam
e da
ta a
re a
vaila
ble,
but
ther
e is
no
com
posi
te in
dica
tor
in th
e Br
azilia
n co
untry
repo
rt.N
ON
/A
Cris
is/r
isk
man
agem
ent
Inte
grat
ed ri
sk p
lann
ing
‘Ris
k Pl
anni
ng E
xten
t’: T
he e
xten
t to
whi
ch d
isas
ter r
isk
is
inte
grat
ed in
to n
atio
nal p
olic
y pl
anni
ng is
mea
sure
d by
cou
ntin
g th
e ty
pes
of p
olic
y pl
anni
ng in
to w
hich
risk
is in
tegr
ated
(out
of 7
, e.
g. n
atio
nal d
evel
opm
ent p
lans
).
‘Dis
aste
r Spe
ndin
g Ap
prai
sal’:
A s
core
for e
cono
mic
app
rais
al
look
s at
whe
ther
the
cost
s an
d be
nefit
s of
spe
ndin
g re
late
d to
di
sast
er s
pend
ing
are
cons
ider
ed.
(3) T
he s
ame
met
ric is
ava
ilabl
e in
a s
peci
fic c
ount
ry re
port.
As
in
othe
r cou
ntrie
s, it
is u
nsur
e if
it is
a “o
ne-o
ff” e
xper
ienc
e.
The
repo
rt fo
r Bra
zil is
relia
ble,
sin
ce it
relie
s on
a fo
cal p
oint
w
orki
ng a
t the
cen
tral g
over
nmen
t - th
at h
as fo
rmal
and
taci
t kn
owle
dge
abou
t the
inst
itutio
nal a
nd e
cono
mic
env
ironm
ent
of th
e co
untry
.
NO
N/A
Risk
mon
itorin
g‘R
isk
Asse
ssm
ent Q
ualit
y’: T
he q
ualit
y of
mul
ti-ha
zard
risk
as
sess
men
t is
mea
sure
d by
ass
essi
ng th
e pr
oces
ses
behi
nd
risk
asse
ssm
ents
(out
of 5
, e.g
. whe
ther
risk
ass
essm
ents
hav
e ag
reed
nat
iona
l sta
ndar
ds);
The
‘Deg
ree
of R
isk
Mon
itorin
g’ is
mea
sure
d by
ass
essi
ng th
e ex
tent
and
use
of r
epor
ts a
nd d
atab
ases
of t
his
type
.Se
e co
mm
ent (
3)N
ON
/A
Publ
ic in
form
atio
n di
ssem
inat
ion
and
publ
ic a
war
enes
s st
rate
gies
‘Ear
ly W
arni
ng S
yste
ms’
: The
qua
lity
of e
arly
war
ning
sys
tem
s is
ass
esse
d by
look
ing
at th
e pr
oces
ses
in p
lace
(out
of 3
, e.g
. w
heth
er p
roto
cols
are
use
d an
d ap
plie
d).
22 InternationalCivilServiceEffectiveness(InCiSE)Index
Them
eM
etric
s us
ed in
InC
iSE
Inde
xC
omm
ents
on
the
qual
ity/
avai
labi
lity
of th
e In
CiS
E m
etric
s fo
r Bra
zil
Alte
rnat
ive
m
etric
s
sugg
este
d
Com
men
ts o
n th
e qu
ality
of
the
alte
rnat
ive
met
rics
‘Pub
lic In
form
atio
n’ d
isse
min
atio
n is
sco
red
by lo
okin
g at
the
type
s of
com
mun
icat
ions
in p
lace
(out
of 4
, e.g
. is
a na
tiona
l di
sast
er in
form
atio
n sy
stem
pub
licly
ava
ilabl
e?).
‘Pub
lic A
war
enes
s St
rate
gy’ l
ooks
at t
he re
leva
nt
wor
kstre
ams
in p
lace
(out
of 5
, e.g
. whe
ther
pub
lic e
duca
tion
cam
paig
ns fo
r ris
k aw
aren
ess
exis
t).
See
com
men
t (3)
NO
N/A
Inte
rnat
iona
l coo
pera
tion
and
risk
coor
dina
tion
‘Inte
rnat
iona
l Coo
pera
tion’
is m
easu
red
by a
sses
sing
the
num
ber
of p
roce
sses
/act
iviti
es in
pla
ce fo
r int
erna
tiona
l coo
pera
tion
and
inte
rnat
iona
l ris
k m
anag
emen
t (ou
t of 6
, e.g
. whe
ther
tra
nsbo
unda
ry p
roto
cols
are
in p
lace
).
See
com
men
t (3)
NO
N/A
Prep
ared
ness
for d
isas
ter r
espo
nse
No
data
iden
tified
N/A
NO
N/A
Post
dis
aste
r ass
essm
ent m
etho
dolo
gy‘P
ost D
isas
ter A
sses
smen
t’: A
sco
re is
giv
en fo
r pos
t dis
aste
r da
mag
e an
d lo
ss a
sses
smen
t by
cons
ider
ing,
for e
xam
ple,
w
heth
er a
spe
cifie
d m
etho
dolo
gy fo
r thi
s ex
ists
(out
of 3
).
See
com
men
t (3)
NO
N/A
Hum
an re
sour
ce m
anag
emen
t
Mer
itocr
acy
of re
crui
tmen
t‘A
pplic
ant S
kills
’: Q
oG e
xper
t ass
essm
ent o
f ext
ent t
o w
hich
the
skills
and
mer
its o
f the
app
lican
ts d
ecid
e w
ho g
ets
the
job
whe
n re
crui
ting
publ
ic s
ecto
r em
ploy
ees;
‘Con
nect
ions
Bia
s in
Rec
ruitm
ent:
Polit
ical
’: Q
oG e
xper
t as
sess
men
t of e
xten
t to
whi
ch p
oliti
cal c
onne
ctio
ns o
f the
ap
plic
ants
dec
ide
who
get
s th
e jo
b;
‘Con
nect
ions
Bia
s in
Rec
ruitm
ent:
Pers
onal
’: Q
oG e
xper
t as
sess
men
t of e
xten
t to
whi
ch p
erso
nal c
onne
ctio
ns o
f the
ap
plic
ants
dec
ide
who
get
s th
e jo
b;
‘Rec
ruitm
ent v
ia F
orm
al E
xam
Sys
tem
’: Q
oG e
xper
t as
sess
men
t of e
xten
t to
whi
ch p
ublic
sec
tor e
mpl
oyee
s ar
e hi
red
usin
g a
form
al e
xam
inat
ion
syst
em.
(4) T
he s
ame
met
ric is
ava
ilabl
e an
d di
sclo
sed
frequ
ently
.
QoG
sur
veys
are
con
duct
ed w
ith B
razil
ian
expe
rts –
in
crea
sing
the
relia
bilit
y of
the
inde
x du
e to
form
al a
nd ta
cit
know
ledg
e ab
out t
he in
stitu
tiona
l and
eco
nom
ic e
nviro
nmen
t of
the
coun
try.
YES
Assessment of the applicability of the InCiSE methodology to Brazil 23
Them
eM
etric
s us
ed in
InC
iSE
Inde
xC
omm
ents
on
the
qual
ity/
avai
labi
lity
of th
e In
CiS
E m
etric
s fo
r Bra
zil
Alte
rnat
ive
m
etric
s
sugg
este
d
Com
men
ts o
n th
e qu
ality
of
the
alte
rnat
ive
met
rics
OEC
D’s
Gov
ernm
ent a
t a G
lanc
e: L
atin
Am
eric
a an
d th
e C
arib
bean
The
data
are
ava
ilabl
e, a
nd it
is re
liabl
e. H
owev
er, t
he
frequ
ency
is u
nsur
e: th
e da
ta is
dis
clos
ed d
iscr
etio
naril
y by
O
ECD.
Attra
ctin
g an
d re
tain
ing
tale
nt‘C
ompa
rabl
e Sa
larie
s’: Q
oG e
xper
t ass
essm
ent o
f ext
ent t
o w
hich
sen
ior o
ffici
als
have
sal
arie
s th
at a
re c
ompa
rabl
e w
ith th
e sa
larie
s of
priv
ate
sect
or m
anag
ers
with
roug
hly
sim
ilar t
rain
ing
and
resp
onsi
bilit
ies.
See
com
men
t (4)
NO
N/A
Tale
nt d
eplo
ymen
t (i.e
. min
imis
ing
skills
gap
s)N
o da
ta id
entifi
edN
/AN
ON
/A
Perfo
rman
ce m
anag
emen
tN
o da
ta id
entifi
edN
/AN
ON
/A
Qua
lity
of le
arni
ng a
nd d
evel
opm
ent
No
data
iden
tified
N/A
NO
N/A
Leve
l of c
usto
mer
(i.e
. civ
il se
rvan
t) sa
tisfa
ctio
nN
o da
ta id
entifi
edN
/AN
ON
/A
Tax
adm
inis
trat
ion
Ove
rall
effici
ency
of c
olle
ctio
n‘C
olle
ctio
n C
ost’:
Dat
a fro
m O
ECD
Tax
Adm
inis
tratio
n on
: cos
t of
colle
ctio
n ra
tios
(adm
inis
trativ
e co
sts/
net r
even
ue c
olle
cted
);
‘Tax
Deb
t’ ra
tios
(tota
l yea
r-end
tax
debt
(exc
ludi
ng d
ispu
ted)
/ne
t rev
enue
col
lect
ed).
(6) T
he s
ame
met
ric is
ava
ilabl
e an
d re
liabl
e. It
is d
iscl
osed
di
scre
tiona
rily
by O
ECD.
YE
S
CEP
II In
stitu
tiona
l Pro
files
Dat
abas
eC
EPII
IPD
is n
ow a
vaila
ble
in 1
44 c
ount
ries
of th
e w
orld
.
The
data
is re
liabl
e si
nce
it is
gat
tere
d vi
a su
rvey
s ap
plie
d to
col
labo
rato
rs a
t the
Min
istry
of E
cono
my
and
Fina
nce
of
the
sele
cted
cou
ntry
+ th
e Fr
ench
Dev
elop
men
t Age
ncy
(if it
ex
ists
in th
e co
untry
)
Use
r cen
trici
ty o
f ser
vice
s‘T
ime
to P
ay T
axes
– B
usin
ess’
: Dat
a fro
m th
e W
orld
Ban
k’s
‘Doi
ng B
usin
ess’
Inde
x on
the
time
it ta
kes
busi
ness
es to
pay
ta
xes.
(5) T
he s
ame
met
ric is
ava
ilabl
e an
d di
sclo
sed
frequ
ently
.
24 InternationalCivilServiceEffectiveness(InCiSE)Index
Them
eM
etric
s us
ed in
InC
iSE
Inde
xC
omm
ents
on
the
qual
ity/
avai
labi
lity
of th
e In
CiS
E m
etric
s fo
r Bra
zil
Alte
rnat
ive
m
etric
s
sugg
este
d
Com
men
ts o
n th
e qu
ality
of
the
alte
rnat
ive
met
rics
Doi
ng B
usin
ess’
team
use
s a
mix
sec
onda
ry d
ata
and
a gr
oup
of c
ontri
buto
rs (b
oth
indi
vidu
als
and
orga
nisa
tions
) ba
sed
on th
e co
untry
ana
lyse
d –
incr
easi
ng th
e re
liabi
lity
of th
e in
dex
due
to fo
rmal
and
taci
t kno
wle
dge
abou
t the
in
stitu
tiona
l and
eco
nom
ic e
nviro
nmen
t of t
he c
ount
ry.
NO
N/A
Exte
nt a
nd q
ualit
y of
dig
ital p
rovi
sion
‘E-F
iled
Tax
Retu
rns
– Pe
rson
al’:
Data
from
OEC
D Ta
x Ad
min
istra
tion
on: t
he p
erce
ntag
e of
tax
retu
rns
e-fil
ed d
urin
g th
e la
st fi
scal
yea
r for
per
sona
l tax
es;
‘E-F
iled
Tax
Retu
rns
– C
orpo
rate
’: Da
ta fr
om O
ECD
Tax
Adm
inis
tratio
n on
: the
per
cent
age
of ta
x re
turn
s e-
filed
dur
ing
the
last
fisc
al y
ear f
or c
orpo
rate
taxe
s;
‘E-F
iled
Tax
Retu
rns
– VA
T’: D
ata
from
OEC
D Ta
x Ad
min
istra
tion
on: t
he p
erce
ntag
e of
tax
retu
rns
e-fil
ed d
urin
g th
e la
st fi
scal
yea
r for
VAT
taxe
s.
See
com
men
t (6)
NO
N/A
Prev
entio
n of
tax
evas
ion
No
data
iden
tified
N/A
YES
CEP
II In
stitu
tiona
l Pro
files
Dat
abas
eC
EPII
IPD
is n
ow a
vaila
ble
in 1
44 c
ount
ries
of th
e w
orld
.
The
data
is re
liabl
e si
nce
it is
gat
tere
d vi
a su
rvey
s ap
plie
d to
col
labo
rato
rs a
t the
Min
istry
of E
cono
my
and
Fina
nce
of
the
sele
cted
cou
ntry
+ th
e Fr
ench
Dev
elop
men
t Age
ncy
(if it
ex
ists
in th
e co
untry
)
Leve
l of t
ax g
ap m
easu
rem
ent
No
data
iden
tified
N/A
NO
N/A
Soci
al s
ecur
ity a
dmin
istr
atio
n
Ove
rall
effici
ency
of d
istri
butio
n
Adm
inis
tratio
n co
sts
as a
per
cent
age
of to
tal e
xpen
ditu
re o
n so
cial
sec
urity
.N
ON
/A
Use
r cen
trici
ty o
f ser
vice
sN
o da
ta id
entifi
edN
/AN
ON
/A
Exte
nt a
nd q
ualit
y of
dig
ital p
rovi
sion
No
data
iden
tified
N/A
NO
N/A
Prev
entio
n of
frau
dN
o da
ta id
entifi
edN
/AN
ON
/A
Assessment of the applicability of the InCiSE methodology to Brazil 25
Them
eM
etric
s us
ed in
InC
iSE
Inde
xC
omm
ents
on
the
qual
ity/
avai
labi
lity
of th
e In
CiS
E m
etric
s fo
r Bra
zil
Alte
rnat
ive
m
etric
s
sugg
este
d
Com
men
ts o
n th
e qu
ality
of
the
alte
rnat
ive
met
rics
Dig
ital s
ervi
ce
Use
r cen
trici
ty o
f ser
vice
sEu
rope
an C
omm
issi
on E
-Gov
ernm
ent b
ench
mar
k: ‘U
ser
Cen
trici
ty’,
indi
cate
s to
wha
t ext
ent (
info
rmat
ion
abou
t) a
serv
ice
is p
rovi
ded
onlin
e.
Sam
e m
etric
is N
OT
avai
labl
eN
ON
/A
Tran
spar
ency
of s
ervi
ceEu
rope
an C
omm
issi
on E
-Gov
ernm
ent b
ench
mar
k:
‘Tra
nspa
renc
y’, i
ndic
ates
to w
hat e
xten
t gov
ernm
ents
are
tra
nspa
rent
as
rega
rds
a) th
eir o
wn
resp
onsi
bilit
ies
and
perfo
rman
ce, b
) the
pro
cess
of s
ervi
ce d
eliv
ery
and
c) p
erso
nal
data
invo
lved
.
Sam
e m
etric
is N
OT
avai
labl
eN
ON
/A
Cro
ss-b
orde
r mob
ility
of s
ervi
ces
Euro
pean
Com
mis
sion
E-G
over
nmen
t ben
chm
ark:
‘Cro
ss B
orde
r M
obilit
y’, i
ndic
ates
to w
hat e
xten
t Eur
opea
n us
ers
can
use
onlin
e se
rvic
es in
ano
ther
cou
ntry
;
Sam
e m
etric
is N
OT
avai
labl
eN
ON
/A
The
avai
labi
lity
of ‘k
ey e
nabl
ers’
Euro
pean
Com
mis
sion
E-G
over
nmen
t ben
chm
ark:
‘Key
En
able
rs’,
indi
cate
s th
e ex
tent
to w
hich
five
tech
nica
l pre
-co
nditi
ons
for e
Gov
ernm
ent a
re u
sed.
Sam
e m
etric
is N
OT
avai
labl
eN
ON
/A
Inte
grity
Leve
ls/p
erce
ptio
ns o
f cor
rupt
ion
‘Cor
rupt
ion
Perc
eptio
ns’:
Glo
bal C
orru
ptio
n Ba
rom
eter
– %
of
peop
le v
iew
ing
publ
ic o
ffici
als/
civi
l ser
vant
s as
cor
rupt
;
‘Pub
lic O
ffici
als
Stea
ling’
: QoG
– e
xper
t opi
nion
of h
ow o
ften
publ
ic s
ecto
r offi
cial
s st
eal o
r em
bezz
le p
ublic
fund
s;
‘Pub
lic O
ffici
als
Favo
urs
for B
ribes
’: Q
oG –
exp
ert o
pini
on o
f ho
w o
ften
publ
ic s
ecto
r offi
cial
s gr
ant f
avou
rs fo
r brib
es;
‘Gov
ernm
ent F
avou
ritis
m o
f Bus
ines
s’: W
EF G
CI –
bus
ines
s ex
ecut
ive
opin
ion
of e
xten
t gov
ernm
ent o
ffici
als
show
fa
vour
itism
to w
ell-c
onne
cted
firm
s.
Glo
bal C
orru
ptio
n Ba
rom
eter
is fr
eque
nt a
nd re
liabl
e se
t of d
ata.
Su
rvey
s ar
e co
nduc
ted
via
phon
e or
inte
rnet
with
adu
lts li
ving
in
the
coun
try o
f ana
lysi
s.
See
com
men
t (2)
& (4
)YE
S
Latin
obar
ómet
roLa
tinob
aróm
etro
is a
freq
uent
and
relia
ble
set o
f dat
a. A
lead
ing
loca
l pol
ling
com
pany
is c
ontra
cted
. All
geog
raph
ic re
gion
s of
Br
azil
are
cove
red
in th
e sa
mpl
e.
26 InternationalCivilServiceEffectiveness(InCiSE)Index
Them
eM
etric
s us
ed in
InC
iSE
Inde
xC
omm
ents
on
the
qual
ity/
avai
labi
lity
of th
e In
CiS
E m
etric
s fo
r Bra
zil
Alte
rnat
ive
m
etric
s
sugg
este
d
Com
men
ts o
n th
e qu
ality
of
the
alte
rnat
ive
met
rics
Fairn
ess
and
impa
rtial
ity‘F
air T
reat
men
t by
Publ
ic O
ffici
als’
: QoG
exp
ert a
sses
smen
t of
exte
nt to
whi
ch p
ublic
sec
tor e
mpl
oyee
s tre
at s
ome
grou
ps in
so
ciet
y un
fairl
y;
‘Pub
lic O
ffici
als
Act I
mpa
rtial
ly’:
QoG
exp
ert a
sses
smen
t of
exte
nt to
whi
ch p
ublic
sec
tor e
mpl
oyee
s ac
t im
parti
ally
whe
n de
cidi
ng h
ow to
impl
emen
t pol
icy.
See
com
men
t (4)
NO
N/A
Adhe
renc
e to
rule
s an
d pr
oced
ures
‘Pub
lic O
ffici
als
Follo
w R
ules
’: Q
oG e
xper
t ass
essm
ent o
f ext
ent
to w
hich
pub
lic s
ecto
r em
ploy
ees
striv
e to
follo
w ru
les.
See
com
men
t 4N
ON
/A
Striv
ing
to s
erve
citi
zens
and
min
iste
rs‘P
ublic
Offi
cial
s St
rive
to H
elp
Citi
zens
’: Q
oG e
xper
t ass
essm
ent
of e
xten
t to
whi
ch p
ublic
sec
tor e
mpl
oyee
s st
rive
to h
elp
citiz
ens;
‘Pub
lic O
ffici
als
Striv
e to
Impl
emen
t Pol
icie
s’ Q
oG e
xper
t as
sess
men
t of e
xten
t to
whi
ch p
ublic
sec
tor e
mpl
oyee
s st
rive
to im
plem
ent p
olic
ies
deci
ded
by p
oliti
cal l
eade
rs;
‘Pub
lic O
ffici
als
Striv
e to
Ful
fill I
deol
ogy’
: QoG
exp
ert
asse
ssm
ent o
f ext
ent t
o w
hich
pub
lic s
ecto
r em
ploy
ees
striv
e to
fulfi
l ide
olog
y of
par
ty in
gov
ernm
ent.
See
com
men
t (4)
NO
N/A
Wor
k et
hic
‘Em
ploy
ee A
bsen
ces’
: QoG
exp
ert a
sses
smen
t of e
xten
t to
whi
ch p
ublic
sec
tor e
mpl
oyee
s ar
e ab
sent
with
out p
erm
issi
on;
‘Em
ploy
ee E
ffici
ency
’: Q
oG e
xper
t ass
essm
ent o
f ext
ent t
o w
hich
pub
lic s
ecto
r em
ploy
ees
striv
e to
be
effici
ent.
See
com
men
t (4)
NO
N/A
Proc
esse
s in
pla
ce to
pre
serv
e in
tegr
ity a
nd p
reve
nt c
onfli
cts
of in
tere
st‘P
ost E
mpl
oym
ent C
oolin
g O
ff’: O
ECD
data
on
whe
ther
a p
ost-
empl
oym
ent c
oolin
g off
per
iod
exis
ts a
nd w
heth
er it
’s pa
id;
‘Lob
byis
t Pro
tect
ion’
: OEC
D da
ta o
n de
gree
of p
rote
ctio
n ag
ains
t lob
byis
ts a
nd o
ther
priv
ate
inte
rest
s in
fluen
cing
ad
viso
ry g
roup
s;
‘Whi
stle
blow
er P
rote
ctio
n: C
over
age’
: OEC
D da
ta o
n nu
mbe
r of
gro
ups
who
rece
ive
whi
stle
blow
er p
rote
ctio
n;
‘Whi
stle
blow
er P
rote
ctio
n: D
egre
e’: Q
oG e
xper
t ass
essm
ent
of d
egre
e of
whi
stle
blow
er p
rote
ctio
n.Se
e co
mm
ent (
6)N
ON
/A
Assessment of the applicability of the InCiSE methodology to Brazil 27
Them
eM
etric
s us
ed in
InC
iSE
Inde
xC
omm
ents
on
the
qual
ity/
avai
labi
lity
of th
e In
CiS
E m
etric
s fo
r Bra
zil
Alte
rnat
ive
m
etric
s
sugg
este
d
Com
men
ts o
n th
e qu
ality
of
the
alte
rnat
ive
met
rics
Ope
nnes
s
The
degr
ee a
nd q
ualit
y of
soc
ieta
l con
sulta
tion
The
‘Civ
ic P
artic
ipat
ion’
com
pone
nt o
f the
Ope
n G
over
nmen
t In
dex,
whi
ch “m
easu
res
the
effec
tiven
ess
of c
ivic
par
ticip
atio
n m
echa
nism
s, in
clud
ing
the
prot
ectio
n of
the
freed
oms
of o
pini
on
and
expr
essi
on, a
nd a
ssem
bly
and
asso
ciat
ion,
and
the
right
to
petit
ion
the
gove
rnm
ent.
It al
so m
easu
res
whe
ther
peo
ple
can
voic
e co
ncer
ns to
var
ious
gov
ernm
ent o
ffice
rs a
nd m
embe
rs
of th
e le
gisl
atur
e, a
nd w
heth
er g
over
nmen
t offi
cial
s pr
ovid
e su
ffici
ent i
nfor
mat
ion
and
notic
e ab
out d
ecis
ions
affe
ctin
g th
e co
mm
unity
, inc
ludi
ng o
ppor
tuni
ties
for c
itize
n fe
edba
ck”;
‘E-G
over
nmen
t Eng
agem
ent’:
The
UN
’s E-
Parti
cipa
tion
Inde
x,
whi
ch re
view
s th
e qu
ality
and
use
fuln
ess
of e
-gov
ernm
ent
prog
ram
s fo
r the
pur
pose
of e
ngag
ing
peop
le in
pub
lic p
olic
y-m
akin
g an
d im
plem
enta
tion;
‘Neg
otia
ting
Publ
ic S
uppo
rt’ B
erte
lsm
ann
sub-
indi
cato
r, w
hich
“ass
esse
s ho
w s
ucce
ssfu
lly th
e go
vern
men
t con
sults
w
ith s
ocie
tal a
ctor
s su
ch a
s tra
de u
nion
s, e
mpl
oyer
s’
asso
ciat
ions
, lea
ding
bus
ines
s as
soci
atio
ns, r
elig
ious
co
mm
uniti
es, a
nd s
ocia
l and
env
ironm
enta
l int
eres
t gro
ups
in
prep
arin
g its
pol
icy.”
(7) T
he O
GI i
s re
liabl
e an
d fre
quen
t. A
lead
ing
loca
l pol
ling
com
pany
is c
ontra
cted
out
+ e
xper
t sur
veys
take
n.
UN
dat
a is
relia
ble
and
frequ
ent.
The
data
is g
atte
red
via
surv
ey w
ith fo
cal p
oint
s on
cen
tral g
over
nmen
ts, c
ase
stud
ies
and
seco
ndar
y da
ta a
vaila
ble
on g
over
nmen
t web
site
s.
For B
erte
lsm
ann,
see
com
men
t (1)
YES
Varie
ties
of D
emoc
racy
VDem
is re
liabl
e an
d fre
quen
t. Da
ta is
gat
tere
d vi
a su
rvey
s w
ith
expe
rts in
the
coun
tries
ana
lyse
d.
28 InternationalCivilServiceEffectiveness(InCiSE)Index
Them
eM
etric
s us
ed in
InC
iSE
Inde
xC
omm
ents
on
the
qual
ity/
avai
labi
lity
of th
e In
CiS
E m
etric
s fo
r Bra
zil
Alte
rnat
ive
m
etric
s
sugg
este
d
Com
men
ts o
n th
e qu
ality
of
the
alte
rnat
ive
met
rics
The
exis
tenc
e an
d qu
ality
of c
ompl
aint
mec
hani
sms
The
‘Com
plai
nt M
echa
nism
s’ c
ompo
nent
of t
he O
pen
Gov
ernm
ent I
ndex
, whi
ch “m
easu
res
whe
ther
peo
ple
are
able
to
brin
g sp
ecifi
c co
mpl
aint
s to
the
gove
rnm
ent a
bout
the
prov
isio
n of
pub
lic s
ervi
ces
or th
e pe
rform
ance
of g
over
nmen
t offi
cers
in
carry
ing
out t
heir
lega
l dut
ies
in p
ract
ice,
and
how
gov
ernm
ent
offici
als
resp
ond
to s
uch
com
plai
nts.
It a
lso
mea
sure
s w
heth
er
peop
le c
an c
halle
nge
gove
rnm
ent d
ecis
ions
bef
ore
anot
her
gove
rnm
ent a
genc
y or
a ju
dge.
”
See
com
men
t (7)
NO
N/A
Gov
ernm
ent d
ata
avai
labi
lity
and
acce
ssib
ility
‘Ope
n Da
ta P
ract
ice
and
Impa
ct’:
The
Ope
n Da
ta B
arom
eter
(O
DB) m
easu
res
the
impl
emen
tatio
n of
ope
n da
ta p
ract
ice
and
is
the
only
inde
x to
als
o m
easu
re th
e im
pact
of o
pen
data
(e.g
. how
m
any
use
it).
‘Gov
ernm
ent D
atas
ets
Ope
nnes
s’: T
he O
pen
Data
Inde
x (O
DI) m
easu
res
whe
ther
pub
licly
hel
d da
ta a
cros
s 13
are
as is
de
fined
as
open
, with
resu
lts c
row
dsou
rced
from
vol
unte
ers
revi
ewin
g w
ebsi
tes.
‘Dat
a Av
aila
bilit
y an
d G
over
nmen
t Sup
port’
: The
OU
Rdat
a in
dex
also
aim
s to
cap
ture
the
avai
labi
lity
and
acce
ssib
ility
of d
ata
but u
niqu
ely
it al
so a
ttem
pts
to m
easu
re th
e le
vel o
f pr
o-ac
tive
supp
ort g
over
nmen
ts p
rovi
de to
fost
er in
nova
tive
re-u
se o
f the
dat
a.
NO
N/A
Gov
ernm
ent d
ata
impa
ct a
nd s
uppo
rt fo
r re-
use
NO
N/A
Righ
t to
info
rmat
ion
(e.g
. FO
Is)
The
‘Rig
hts
to In
form
atio
n’ c
ompo
nent
of t
he O
pen
Gov
ernm
ent
Inde
x w
hich
“mea
sure
s w
heth
er re
ques
ts fo
r inf
orm
atio
n he
ld
by a
gov
ernm
ent a
genc
y ar
e gr
ante
d. It
als
o m
easu
res
whe
ther
th
ese
requ
ests
are
gra
nted
with
in a
reas
onab
le ti
me
perio
d, if
the
info
rmat
ion
prov
ided
is p
ertin
ent a
nd c
ompl
ete,
and
if re
ques
ts
for i
nfor
mat
ion
are
gran
ted
at a
reas
onab
le c
ost a
nd w
ithou
t ha
ving
to p
ay a
brib
e. T
his
dim
ensi
on a
lso
mea
sure
s w
heth
er
peop
le a
re a
war
e of
thei
r rig
ht to
info
rmat
ion,
and
whe
ther
re
leva
nt re
cord
s –
such
as
budg
et fi
gure
s of
gov
ernm
ent o
ffici
als,
om
buds
man
repo
rts, a
nd in
form
atio
n re
lativ
e to
com
mun
ity
proj
ects
– a
re a
cces
sibl
e to
the
publ
ic u
pon
requ
est.”
See
com
men
t (7)
NO
N/A
Assessment of the applicability of the InCiSE methodology to Brazil 29
Them
eM
etric
s us
ed in
InC
iSE
Inde
xC
omm
ents
on
the
qual
ity/
avai
labi
lity
of th
e In
CiS
E m
etric
s fo
r Bra
zil
Alte
rnat
ive
m
etric
s
sugg
este
d
Com
men
ts o
n th
e qu
ality
of
the
alte
rnat
ive
met
rics
Publ
icis
ed la
ws
The
‘Pub
licis
ed L
aws’
com
pone
nt o
f the
Ope
n G
over
nmen
t In
dex,
whi
ch “m
easu
res
whe
ther
bas
ic la
ws
and
info
rmat
ion
on
lega
l rig
hts
are
publ
icly
ava
ilabl
e, p
rese
nted
in p
lain
lang
uage
, an
d ar
e m
ade
acce
ssib
le in
all
lang
uage
s us
ed b
y si
gnifi
cant
se
gmen
ts o
f the
pop
ulat
ion.
Thi
s di
men
sion
als
o m
easu
res
the
qual
ity a
nd a
cces
sibi
lity
of in
form
atio
n pu
blis
hed
by
the
gove
rnm
ent i
n pr
int o
r onl
ine
(i.e.
act
ive
trans
pare
ncy)
, an
d w
heth
er a
dmin
istra
tive
regu
latio
ns, d
rafts
of l
egis
latio
n,
adm
inis
trativ
e de
cisi
ons,
and
hig
h co
urt d
ecis
ions
are
mad
e ac
cess
ible
to th
e pu
blic
in a
tim
ely
man
ner.”
See
com
men
t (7)
NO
N/A
Cap
abili
ties
Lead
ersh
ip c
apab
ility
No
data
iden
tified
N/A
NO
N/A
Com
mer
cial
cap
abilit
yN
o da
ta id
entifi
edN
/AN
ON
/A
Anal
ytic
al c
apab
ility
No
data
iden
tified
N/A
NO
N/A
Digi
tal c
apab
ility
No
data
iden
tified
N/A
NO
N/A
Cor
e ca
pabi
lity
(e.g
. pro
blem
-sol
ving
, num
erac
y, lit
erac
y sk
ills)
‘Lite
racy
Ski
lls’:
Take
n fro
m th
e O
ECD’
s PI
AAC
(Sur
vey
of A
dult
Skills
) dat
a (a
naly
sis
of th
e m
icro
data
): th
e pr
opor
tion
of th
e pu
blic
sec
tor g
ettin
g le
vel 4
or 5
for l
itera
cy s
kills
;
‘Num
erac
y Sk
ills’:
The
prop
ortio
n of
the
publ
ic s
ecto
r get
ting
leve
l 4 o
r 5 fo
r num
erac
y sk
ills;
‘Pro
blem
Sol
ving
Ski
lls’:
The
prop
ortio
n of
the
publ
ic s
ecto
r ge
tting
leve
l 3 fo
r pro
blem
ski
lls.
Sam
e m
etric
is N
OT
avai
labl
eYE
S
OEC
D’s
Gov
ernm
ent a
t a G
lanc
e: L
atin
Am
eric
a an
d th
e C
arib
bean
This
is a
vaila
ble
and
it is
relia
ble.
It is
dis
clos
ed d
iscr
etio
naril
y by
O
ECD.
Educ
atio
nal a
ttain
men
t of t
he w
orkf
orce
‘Edu
catio
nal A
ttain
men
t’: T
he p
ropo
rtion
of t
he p
ublic
sec
tor w
ith
terti
ary
educ
atio
n, ta
ken
from
the
OEC
D’s
PIAA
C (S
urve
y of
Adu
lt Sk
ills) d
ata
(ana
lysi
s of
the
mic
roda
ta).
Sam
e m
etric
is N
OT
avai
labl
eN
ON
/A
30 InternationalCivilServiceEffectiveness(InCiSE)Index
Them
eM
etric
s us
ed in
InC
iSE
Inde
xC
omm
ents
on
the
qual
ity/
avai
labi
lity
of th
e In
CiS
E m
etric
s fo
r Bra
zil
Alte
rnat
ive
m
etric
s
sugg
este
d
Com
men
ts o
n th
e qu
ality
of
the
alte
rnat
ive
met
rics
Incl
usiv
enes
s
Prop
ortio
nate
gen
der r
epre
sent
atio
n‘G
ende
r: C
entra
l Gov
ernm
ent S
hare
’: O
ECD
data
– th
e ab
solu
te
diffe
renc
e be
twee
n th
e sh
are
of to
tal c
entra
l gov
ernm
ent
empl
oym
ent fi
lled
by w
omen
and
the
shar
e of
wom
en in
the
labo
ur fo
rce;
‘Gen
der:
Publ
ic S
ecto
r Sha
re’:
QoG
dat
a –
the
abso
lute
di
ffere
nce
betw
een
prop
ortio
n of
wom
en in
pub
lic s
ecto
r and
in
the
labo
ur fo
rce;
‘Gen
der:
Man
agem
ent S
hare
’: O
ECD
data
– th
e ab
solu
te
diffe
renc
e be
twee
n th
e sh
are
of e
mpl
oym
ent i
n to
p m
anag
emen
t pos
ition
s w
ithin
cen
tral g
over
nmen
t fille
d by
w
omen
and
the
shar
e of
wom
en in
the
labo
ur fo
rce;
‘Gen
der:
Seni
or M
anag
emen
t Sha
re’:
QoG
dat
a –
the
abso
lute
diff
eren
ce b
etw
een
prop
ortio
n of
wom
en in
cen
tral
gove
rnm
ent s
enio
r pos
ition
s an
d in
the
labo
ur fo
rce
See
com
men
t (4)
YES
Braz
ilian
Nat
iona
l Pub
lic A
dmin
istra
tion
Scho
ol (c
ount
ry
spec
ific)
This
is a
vaila
ble
and
it is
relia
ble.
It is
dis
clos
ed d
iscr
etio
naril
y by
EN
AP.
Prop
ortio
nate
eth
nic
min
ority
repr
esen
tatio
n‘E
thni
c an
d Re
ligio
us G
roup
Rep
rese
ntat
ion’
: QoG
dat
a –
expe
rt op
inio
n as
to w
heth
er ‘K
ey e
thni
c an
d re
ligio
us g
roup
s in
soc
iety
ar
e pr
opor
tiona
lly re
pres
ente
d am
ong
publ
ic s
ecto
r em
ploy
ees
(1=h
ardl
y ev
er, 7
=alm
ost a
lway
s)’
See
com
men
t (4)
NO
N/A
Prop
ortio
nate
dis
abilit
y re
pres
enta
tion
No
data
iden
tified
N/A
YES
Braz
ilian
Nat
iona
l Pub
lic A
dmin
istra
tion
Scho
ol (c
ount
ry
spec
ific)
This
is a
vaila
ble
and
it is
relia
ble.
It is
dis
clos
ed d
iscr
etio
naril
y by
EN
AP.
Prop
ortio
nate
soc
io-e
cono
mic
repr
esen
tatio
nN
o da
ta id
entifi
edN
/AN
ON
/A
Prop
ortio
nate
Les
bian
Gay
Bi-s
exua
l Tra
nsge
nder
Oth
er
sexu
ality
repr
esen
tatio
nN
o da
ta id
entifi
edN
/AYE
S
Braz
ilian
Nat
iona
l Pub
lic A
dmin
istra
tion
Scho
ol (c
ount
ry
spec
ific)
This
is a
vaila
ble
and
it is
relia
ble.
It is
dis
clos
ed d
iscr
etio
naril
y by
EN
AP.
The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School of Government and the Institute for Government. It has been supported by the UK Civil Service and funded by the Open Society Foundations.