The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service...

34
Technical Paper Assessment of the applicability of the InCiSE methodology to Brazil April 2019 The International Civil Service Effectiveness (InCiSE) Index

Transcript of The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service...

Page 1: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

Technical PaperAssessment of the applicability of the InCiSE methodology to BrazilApril 2019

The International Civil Service Effectiveness (InCiSE) Index

Page 2: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School
Page 3: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

Executive Summary 4

Objectives and methodology 5

The structure of the civil service 6

Availability of metrics 8

Potential new data sources and metrics 13

Applicability of the InCiSE methodology to Brazil 16

Bibliography 17

Annex: Detailed assessment of the applicability of the InCiSE methodology 18

Contents

Page 4: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

2 InternationalCivilServiceEffectiveness(InCiSE)Index

Assessment of the applicability of the InCiSE methodology to Brazil

André Carlos Busanelli de Aquino and André Feliciano Lino,Universidade de São Paulo

InCiSE Technical Paper 2019-1

Commissioned by the Blavatnik School of Government on behalf of the InCiSE partner organisations

Paper submitted: December 2018Published: April 2019

The International Civil ServiceEffectiveness(InCiSE)Indexprojectisa collaboration between the BlavatnikSchool of Government and the Institutefor Government. It has been supportedby the UK Civil Service and funded bythe Open Society Foundations.

Please cite this work as: Busanelli de Aquino ACandLinoAF(2019)Assessmentoftheapplicability of the InCiSE methodology to Brazil, InCiSE Technical Paper 2019-1, Oxford:BlavatnikSchoolofGovernment

Page 5: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

Assessment of the applicability of the InCiSE methodology to Brazil 3

TheInCiSEIndexwasdevelopedtobenchmarktheeffectivenessofthecivilserviceinOECDcountries.TheIndexiscomprised of 12 indicators1 and 60 themes relating to processes used in the civil service. Thisreportexaminestheviabilityofincludingthe Brazilian federal civil service in the InCiSE Indexusingthesameorsimilarindicators,themes, and data sources as those used incompilingthe2017Index.Acompanionreport similarly assesses the viability of includingNigeriaintheInCiSEIndex.

Of the 12 indicators covered in the 2017 report,wefounddataon10(digitalservicewas a notable gap, and capabilities were covered only by one proposed alternative metric; social security administration indicators were not checked, as agreed in advance).Foreachoftheseindicators,weassessed whether the sources used in the 2017 report were available for Brazil, and the existenceofcomparablealternativesand/orregional and local supplementary sources.Our analysis concludes that it is possible to do the InCiSE analysis in Brazil.

� Good quality data are available for 37 of the60themes(62%)intheIndex.

1 The measurement framework includes 17 indicators, but the 2017 Index only used 12 of these in practice.

� Of the 76 metrics used in the 2017 report, wefound65metrics(86%)forwhichthesame data sources could be used, with some potential additional sources that could be considered to increase this further.

� We found good metrics for all indicators exceptdigitalservicesandcapabilities,where no usable metrics were found, and regulation, where only one of three themes was adequately covered.

We propose the following considerations be taken into account in future work on the InCiSEIndex:

� Additional themes and sources that would amplify the assessment of policy making, fiscalandfinancialmanagement, and crisis and risk management.

� In the Brazilian case and perhaps othercontextstoo,questionsof(i)therespectiverolesoftheexecutiveand legislative in fiscalandfinancialmanagement,(ii)theindependenceofregulators,(iii)theeffectofpoliticizedappointment, payment and promotion onhumanresourcemanagement,(iv)theeffectoninclusiveness not only of recruitment and promotion practices but also of equality of treatment and of discretionary payments.

ExecutiveSummary

Page 6: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

4 InternationalCivilServiceEffectiveness(InCiSE)Index

Thisreportispartofajointstudyinvestigating the feasibility of applying the InCiSE methodology to Brazil and Nigeria, withthefollowingobjectives:

� Outline aspects of the structure and functions of the civil service of both countriesthatmayaffectapplicationofthe InCiSE framework;

� Identify international and national data sources relevant to the InCiSE framework and comment on the availability of data, the ease of accessing data, and the strengths and weaknesses of these sources for this purpose;

� Comment on the applicability of the InCiSEIndextocoverthesecountries,anddiscuss(i)challengesthatmightbefacedinusingitand(ii)waysinwhichtheIndexmightneedtobeadjustedtobemore relevant, applicable, and feasible.

Thisprojectdoesnotaimtoevaluatetheperformance of the civil service in Brazil, but only to comment on the potential applicability and relevance of the InCiSE methodology to the country, and in particular to assess the availability of relevant data compatible with the current InCiSE methodology.

We have attempted as far as possible to match the same sources and metrics for the same themes as in the 2017 InCiSE Report. That report sought data for 12 indicators, althoughdidnotfindsufficientdatatoinclude

the social security administration indicator. In consultation with the Blavatnik School of Government, we similarly did not include the indicator on social security administration, and focused on the remaining 11 indicators. For each indicator, the analysis went through the following steps:

a. Are the sources used in InCiSE 2017 available? Assess whether, for Brazil, the themes and indicators in the InCiSE framework were covered by the same metrics and sources as were used in the 2017 InCiSE Report, and comment on the quality of the data for each country.

b. What is the availability and quality of comparable alternative metrics? For the remaining themes, where the InCiSE team had found metrics for OECD countries but where the same data source does not cover Brazil, search for alternative regional or local data sources that address the same themes. Where comparable alternativesexist,wecommentonthequality of these metrics.

c. Are there supplementary regional and local sources? Identify supplementary metrics,wherewefindthatregionalandlocal sources could be used alongside or instead of the metrics that the 2017 InCiSE Report had selected.

Objectivesandmethodology

Page 7: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

Assessment of the applicability of the InCiSE methodology to Brazil 5

Thestructureoftheexecutivebranchatthefederal level in Brazil is similar to that of other federal countries, where the president appoints a Cabinet to run a corps of tenured civil servantsforafouryearterm,extendablebyone more term.

The development of the federal civil service in Brazil has passed through three phases: patrimonialist,Weberian(from1937),andpost-Weberian(from1993).Thereformsin Cardoso’s presidency, inspired by the New Public Management movement, did notachievetheintendedresults(Abrucio,2007).Theeffectofprofessionalizingthebureaucracy and evaluating its performance by implementing outcome indicators could have reducedthespaceforpoliticalinfluenceintheallocationofjobpositions(Abrucio,2007),butin fact this has increased over time.

In 2018, the federal level has about 620,000 civilservants(excludingstate-ownedcompanies),withmorethan90,000receivingsometypeoftemporarygratification(salaryincrease)associatedwithspecificroles.MostrelevanttotheInCiSEIndexisthegroupof240,000 civil servants of the central ministries and their departments. Although some of this grouparesubjecttoperformanceevaluation(basedontargetsandoutputs)whichisusedtosupportpromotionsandconfirmationofjobtenure, payment-for-performance is rare.

1 ENAP, 2017, Pesquisa sobre Serviços Públicos de Atendimento do Governo Federal, Escola Nacional deAdministraçãoPública(Brasil),http://repositorio.enap.gov.br/handle/1/3217

Of these 240,000 civil servants, 22,500 are in high level advisory positions across 23ministriesandtheirexecutiveagencies(excludingstate-ownedcompanies).Suchadvisory positions act mainly in policy design and implementation, and in leading central service delivery associated with the InCiSE indicators. At least 5,900 such positions are temporary political appointments to non-tenured positions. Of these high level positions, 36%areoccupiedbyblackorindigenouspeople,and45%bywomen.Theproportionsof women occupying the very highest positions (levelsDAS-6andDAS-5)are18%and22%respectively(ENAP,2018).Morefemalethan male civil servants have post-graduate degrees, while fewer female than male civil servants are less educated.

A survey undertaken in 2017 by the Brazilian National School of Public Administration found 1740 services delivered by 85 agencies and departments of the federal government. The clientsforthoseservicesincludecitizens(for50%ofthelistedservices),privatecompanies(57%),state-ownedcompanies(45%),othergovernmentagencies(20%),statesandmunicipalities(24%)(servicesmayhavemorethanonetypeofclient).Currently,46%oftheservicesareweb-based,and71%arefree-of-charge(ENAP,20171).

As indicated in Table 1, some InCiSE functions are delivered essentially by one

The structure of the civil service

Page 8: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

6 InternationalCivilServiceEffectiveness(InCiSE)Index

Ministry, facilitating data collection, while others are decentralized, requiring multiple surveys to access a broader range of federal organisations.

AsignificantfeatureoftheBraziliancivilserviceis the large number of politically appointed civil servants. These political appointments are made through political bargains between the

president and leaders of political parties that occupyasignificantproportionofseatsinthecongressionallowerchamber(theCâmara dos Deputados).Despitereformsin2016/2017,whenunderthePresidencyofDilmaRousseffthenumberofsuchpositionswassignificantlyreduced,thosejobsarestillpresentalloverthefederalstructure(includingfederalagencies,state-ownedcompaniesandministries).

Located at Functions and levels of government

Dispersion of function and difficulty of data collection

Central executivePolicy-making Each ministry Related to federal level ModerateFiscal and financial management

Ministry of Finance Related to federal level Low

Regulation Federal executive agencies (ANA, CVM, ANEEL, etc)

Related to federal level High

Crisis/risk management Ministry of Planning and Budgeting, and Decentralized

Related to federal level Moderate

Mission supportProcurement* Ministry of Planning and

BudgetingRelated to federal level Low

HR management Ministry of Planning and Budgeting

Related to federal level Low

IT* Decentralized and State-owned enterprise (CERPRO)

Related to federal level High

Finance* Ministry of Finance Related to federal level LowDirect service deliveryTax Ministry of Finance Shared, local and state taxes LowSocial security Ministry of Social Security National system LowDigital services Decentralized Related to federal level HighAttributesIntegrity All ministries All levels of government.

Includes politically appointed positions.

HighOpennessCapabilitiesInclusivenessStaff engagement*Innovation*

* Not yet measured or included in the InCiSE (2017) Index due to data availability

Table 1: The InCiSE central functions and attributes in Brazil

Page 9: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

Assessment of the applicability of the InCiSE methodology to Brazil 7

Availability of metrics

TheInCiSEIndexanalyses12indicators,composed of 60 themes. For the countries coveredinthe2017Index,datawerefoundtobe available for 40 of the themes, measured by76metricscomingfrom19differentsources of data. Table 2 shows that 14 of these sources of data are available for the Brazilian case. These comprise 65 metrics, meaningthat86%ofthedataareavailable.The InCiSE framework sets a threshold for acountry’sinclusionintheIndexof75%ofthe metrics being available, so we conclude that it is possible to do the InCiSE analysis in Brazil. Hereafter we describe the availability of metrics per indicator and themes.

Additional themes or metrics. We suggest two additional themes for this indicator. Following therecommendationsofOECD(2015),governmentsmust(a)ensurethatbudgetdocuments and data are open, transparent andaccessible,and(b)promotetheintegrity and quality of budgetary forecasts, fiscalplansandbudgetaryimplementationthrough rigorous quality assurance including independent audit. Thus, we suggest the inclusion of new themes and underlying metrics that capture more phases of the budgetary cycle than its preparation, namely themonitoringphaseandexternalaudit.

The themes and the following metrics are:

Theme: Openness of budgetary practices; metric: IBP Open Budget Index“Transparency”indicator.

Theme: Integrity of budgetary practices; metric: IBP Open Budget Index“BudgetOversight”indicator.

Overall, there are good metrics for this indicator in the Brazilian case. Moreover, these new themes and metrics may be useful forallcountriesinnextyear’sInCiSEIndex.

RegulationExistenceofmetrics. All three of the themes comprisingthe“Regulation”indicatorarecoveredbytheOECD’s“IndicatorsofRegulatoryPolicyandGovernance”(iREG).In 2016 the iREG indicators were applied to seven Latin America countries that are OECD member and partner countries: Brazil, Chile, Colombia,CostaRica,Ecuador,MexicoandPeru.

Page 10: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

8 InternationalCivilServiceEffectiveness(InCiSE)Index

Table 2: Availability of data sources included in InCiSE 2017 for Brazil

Sources used in InCiSE 2017 available for Brazil

Sources used in InCiSE 2017 NOT available for Brazil

� Bertelsmann Sustainable Governance Indicators

� Doing Business index

� Hyogo Framework for Action

� OECD conflict of interest, private interest, and whistle-blower data

� OECD Tax Administration 2015

� OECD’s ‘Indicators of Regulatory Policy and Governance’*

� OECD’s OURdata Index

� Open Knowledge Foundation’s Open Data Index

� Quality of Government Expert Survey Data

� Transparency International’s Global Corruption Barometer

� UN’s E-participation Index

� World Economic Forum (WEF) Global Competitiveness Index (GCI)

� World Justice Project’s Open Government Index

� World Wide Web Foundation’s Open Data Barometer

� European Commission E-Government Benchmarks

� Government at a Glance 2013

� OECD medium-term budgeting

� OECD performance budgeting

� OECD PIAAC

Note: * OECD’s iREG is not available in full detail. See more information below.

Page 11: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

Assessment of the applicability of the InCiSE methodology to Brazil 9

Thus, Brazil is covered, and we have available metrics. However, we need to take a closer look at each of the themes that form the“Regulation”indicator.

Theme–“Exanteappraisal:application, quality, sustainability, transparency,oversight”.Forthisthemeitispossibletoseewhether(i)there is a requirement to conduct a RegulatoryImpactAssessment(RIA);(ii)theRIAisconductedinpractice;(iii)thequalityofRIAischeckedbyagovernment body outside the ministry undertakingtheregulation;and(iv)there is written guidance on the preparation of an RIA. However, there isnocompositeindexavailable.

Theme–“Stakeholderengagement:application, quality, transparency, oversight”.Forthistheme,thereisa composite indicator available for Brazil, following the methodology of OECD’s 2015 Indicators of Regulatory Policy and Governance1.

Theme–“Expostevaluation:application, quality, sustainability, transparency,oversight”.Again,thereisnocompositeindexavailable–butthere is data on the report that might be useful.

Theterm“Secondaryregulation”isalsoreferredtoas“Subordinateregulation”inrecentOECDsurveys(seetheGlossaryonthe methodology on OECD’s 2015 Indicators ofRegulatoryPolicyandGovernance).

Alternative metrics were not found for these themes.

1 http://dx.doi.org/10.1787/5jrnwqm3zp43-en2 http://www.inform-index.org/

Additional themes or metrics are not proposed for this indicator.

Overall, there is good data for one of the three metrics that make up this indicator.

Crisis and Risk ManagementExistenceofmetrics.Fiveofthesixthemescomprisingthe“CrisisandRiskManagement”indicatorarecoveredbyHyogo Framework for Action reports (‘preparednessfordisasterresponse’ismissing).TherearefivereportsforBrazil(including(i)Brazil:Nationalprogressreport on the implementation of the Hyogo FrameworkforAction[2011-2013];and(ii)Brazil: Sendai Framework data readiness reviewreport[2017])coveringallmetricsneeded for this indicator.

Alternative metrics were not found for these themes.

Additional themes or metrics. We propose for consideration a potential new theme relatedto“RiskExposure”.Theperceivedvulnerability of a country is an important factor to guide implementation of anticipatory capacities,influencingcopingcapacitiesin periods of strain. Thus, based on the EuropeanCommission’s“INFORM–IndexforRiskManagement”2, we propose the “HazardandExposure”indexasaproxyforRiskExposure.However,whiletheInformindexincludeselementsrelatedtocopingcapacity which may be related to civil service effectiveness,itencompassesmanyotherfactors as well, so is not a particularly strong metric for the civil service.

Overall, we conclude that there are good metrics for the Brazilian case.

Page 12: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

10 InternationalCivilServiceEffectiveness(InCiSE)Index

Human Resource ManagementExistenceofmetrics.Sixthemescomprisethe“HumanResourceManagement”indicatorbutintheInCiSEIndex2017data are only available for two of them, namely(i)“Meritocracyofrecruitment”and(ii)“Attractingandretainingtalent”.Thesethemes are also covered for the Brazilian case,basedonthe“QualityofGovernmentExpertSurveyData”.

Alternative metrics. We suggest that for the firsttheme,analternativecouldbe“Civilservicemerit”availableintable6.4,pp105ofGovernment at a Glance: Latin America and the Caribbean 2017.

Additional themes or metrics are not proposed for this indicator.

Overall, there are good metrics for the Brazilian case.

Tax AdministrationExistenceofmetrics.Five themes comprise the“TaxAdministration”indicatorintheInCiSEIndex2017,butonlythreeofthemare already covered. The 2017 report did not identify any data for the themes ‘preventionoftaxevasion’and‘leveloftaxgap measurement’, and we were likewise unabletofindalternativemetricsforthesethemes for Brazil. All of the remaining themes covered in InCiSE 2017 are available forBrazil,basedondatafromOECDTaxAdministration surveys.

Alternative metrics.The“InstitutionalProfileDatabase”(IPD),organizedbytheCEPII,havesomemetricson(i)efficiencyoftaxadministration in the collection of corporation tax,incometax,acrossthenationalterritory,andalsoon(ii)onecountryabilitytolimittaxevasion.

Additional themes or metrics are not proposed for this indicator.

Overall, there are good metrics for the Brazilian case.

Digital ServicesExistenceofmetrics. Four themes comprise the “DigitalServices”indicatorintheInCiSEIndex2017. These data come from the European Commission, and none of the metrics used in InCiSE 2017 are available for Brazil.

Alternative metrics.Wedidnotfindalternative sources of data. However, there is a forthcoming publication by OECD-the“DigitalGovernmentReviewofBrazil”thatmightbeuseful(https://doi.org/10.1787/9789264307636-en).

Additional themes or metrics are not proposed for this indicator.

Overall,wedonotfindanyusablemetricsforthe Brazilian case.

IntegrityExistenceofmetrics.Sixthemescomprisethe“Integrity”indicatorintheInCiSEIndex2017. The sources of data are Transparency International’s Global Corruption Barometer, QualityofGovernment(QoG)ExpertSurveys,WorldEconomicForum’s(WEF)GlobalCompetitivenessIndex(GCI)andOECD.Datafor all of these themes are available for Brazil.

Alternative metrics. The LatinoBarometro 2018 could be an alternative source for the levels/perceptionofcorruptionthemeforLatin countries.

Additional themes or metrics are not proposed for this indicator.

Overall, there are good metrics for the Brazilian case.

Page 13: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

Assessment of the applicability of the InCiSE methodology to Brazil 11

OpennessExistenceofmetrics.Sixthemescomprisethe“Openness”indicatorintheInCiSEIndex2017.ThesourcesofdataareTheWorldJusticeProject’sOpenGovernmentIndex,TheUN’sE-participationIndex,Bertelsmann’s Sustainable Governance Indicators(SGIs),TheWorldWideWebFoundation’s Open Data Barometer, The Open Knowledge Foundation’s Open Data IndexandOECD’sOURdataindex.Dataforall themes are available for Brazil. However, the Bertelsmann SGI could be weak on the “degreeandqualityofsocietalconsultation”theme, because it is based on a special report for BRICS, issued in 2014 which may beaone-offexercise.

Alternative metrics.Forthe“Thedegreeandqualityofsocietalconsultation”theme,we suggest for consideration a potential alternativemetric,item3.6.6ofthe“VarietiesofDemocracyindex”,namely,“Engagedsociety(v2dlengage)”,withthequestion“Whenimportantpolicychangesarebeingconsidered, how wide and how independent arepublicdeliberations?”Thismetricrelatesto the openness of policy-making, but is only an indirect indication of civil service effectiveness.

Additional themes or metrics are not proposed for this indicator.

Overall, there are good metrics for the Brazilian case.

CapabilitiesExistenceofmetrics.Sixthemescomprisethe“Capabilities”indicatorintheInCiSEIndex2017.ThesedatacomefromtheOECD PIAAC, and none of the metrics used in InCiSE 2017 are available for Brazil.

Alternative metrics. We suggest that one alternativemetricforthe“Corecapability”themecouldbethe“HRpersonneltechnicalskills”–availableatGovernmentataGlance:Latin America and the Caribbean 2017 - pp. 103 , table 6.2.

Additional themes or metrics are not proposed for this indicator.

Overall,wedonotfindsuitablemetricsforthe Brazilian case.

InclusivenessExistenceofmetrics. Five themes comprise this indicator, but data are only available for two of them in the 2017 InCiSE report. These datacomefromQualityofGovernmentexpertsurveysandOECD’sGovernmentataGlance. The Brazilian case is partly covered but the two metrics from GaaG are not available.

Alternative metrics. The Brazilian Government National School of Public Administration (ENAP)producesreportsbasedonsurveysof quantitative data of gender, LGBT and other minorities that could be useful for the Brazilian case. However, these data are countryspecificandnotcomparablewithother countries.

Additional themes or metrics are not proposed for this indicator.

Overall, there are good metrics for the Brazilian case.

Page 14: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

12 InternationalCivilServiceEffectiveness(InCiSE)Index

The proposed new data sources for Brazil are summarised in table 3 below.

Our aim was to identify data for 12 indicators comprising 60 themes. Table 3, shows which indicators and themes we feel can be well represented(✔),approximatelyrepresented(~),ornotrepresented(✘)forBrazil,andwhether the data sources would be the same as the sources that were used in the 2017 InCiSE report or whether new metrics are suggested, either instead of or in addition to the original sources.

Potential new data sources and metrics

Table 3: Proposed new data sources for Brazil

Organisation Instrument Period Frequency

CEPII Institutional Profile Databases 2001, 2006, 2009, 2012 and 2016

Unsure

Freedom House Freedom in the World index 1998-2018 Annual

International Budget Partnership

Open budget Survey 2006-2018 Bi-annual

Latinobarómetro Informe Latinobarómetro 1995-2018 Annual

OECD Government at a Glance: Latin America and the Caribbean

2014 and 2017 Unsure

Varieties of Democracy Institute

V-DEM Annual Democracy Report 1900-2018 Annual

Page 15: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

Assessment of the applicability of the InCiSE methodology to Brazil 13

Indicator Theme Data availability

Same sources as InCiSE 2017?

New metrics proposed?

Policy making The quality of policy advice ✘ No

Degree of strategic policy direction ✘ No

Coordination of policy proposals ✘ No

Timeliness and accuracy of policy delivery ✘ No

Degree of policy monitoring ✘ No

Fiscal and financial management

Economic appraisal (use, quality, guidance) ✔ Yes

Economic evaluation (use, quality, guidance) ✔ Yes

Medium-term budgeting ✔ No Yes

Performance budgeting ✔ No Yes

Regulation Ex ante appraisal: application, quality, sustainability, transparency, oversight.

✘ No

Stakeholder engagement: application, quality, transparency, oversight

✘ No

Ex post evaluation: application, quality, sustainability, transparency, oversight

✘ No

Crisis/risk management

Integrated risk planning ✔ Yes

Risk monitoring ✔ Yes

Public information dissemination and public awareness strategies

✔ Yes

International cooperation and risk coordination ✔ Yes

Preparedness for disaster response ✘ No

Post disaster assessment methodology ✔ Yes

Human resource management

Meritocracy of recruitment ✔ Yes

Attracting and retaining talent ✔ Yes

Talent deployment (i.e. minimising skills gaps) ✘ No

Performance management ✘ No

Quality of learning and development ✘ No

Level of customer (i.e. civil servant) satisfaction ✘ No

Tax administration Overall efficiency of collection ✘ No

User centricity of services ~ Yes

Extent and quality of digital provision ✘ No

Prevention of tax evasion ✘ No

Level of tax gap measurement ✘ No

Social security administration

Overall efficiency of distribution ✘ No

User centricity of services ✘ No

Extent and quality of digital provision ✘ No

Prevention of fraud ✘ No

Digital service User centricity of services ~ No Yes

Transparency of service ~ No Yes

Cross-border mobility of services ✘ No

The availability of ‘key enablers’ ✘ No

Page 16: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

14 InternationalCivilServiceEffectiveness(InCiSE)Index

Indicator Theme Data availability

Same sources as InCiSE 2017?

New metrics proposed?

Integrity Levels/perceptions of corruption ✔ Yes

Fairness and impartiality ✔ Yes

Adherence to rules and procedures ✔ Yes

Striving to serve citizens and ministers ✔ Yes

Work ethic ✔ Yes

Processes in place to preserve integrity and prevent conflicts of interest

✔ Yes

Openness The degree and quality of societal consultation ✔ Yes

The existence and quality of complaint mechanisms

✔ Yes

Government data availability and accessibility ~ No Yes

Government data impact and support for re-use ✘ No

Right to information (e.g. FOIs) ✘ No

Publicised laws ✔ Yes

Capabilities Leadership capability ✘ No

Commercial capability ✘ No

Analytical capability ✘ No

Digital capability ✘ No

Core capability (e.g. problem-solving, numeracy, literacy skills)

✘ No

Educational attainment of the workforce ✘ No

Inclusiveness Proportionate gender representation ✔ No Yes

Proportionate ethnic minority representation ✔ Yes

Proportionate disability representation ✘ No

Proportionate socio-economic representation ✘ No

Proportionate Lesbian Gay Bi-sexual Transgender Other sexuality representation

✘ No

Page 17: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

Assessment of the applicability of the InCiSE methodology to Brazil 15

Applicability of the InCiSE methodology to Brazil

FortheBraziliancasethereareindexesthatfocusontheeffectivenessofprocedureswithin the civil service, as well as output measures. Here we indicate the relevance ofmetricsintheBraziliancontext.Our comments may also be relevant considerationsforextendingthecoverageoftheInCiSEIndextocountriessimilartoBrazil.

a. Fiscal and Financial Management: The“qualityofthebudgetingprocess”ultimately depends on the legislative branch of government, but legal mandatesvaryatdifferentpointsin the budgetary process. For a federal presidential country like Brazil, budgetarybills,policyexecutionandpolicy monitoring are the concern of theexecutivebranch,butthelegislativebranch has autonomy to amend and monitorthebudgetinregardtoitsfiscalaspects.Consequently,the“qualityofthebudgetingprocess”spillsoverfromtheexecutivetothelegislativebranch,inwaysthatmayaffectcomparabilitywith other governmental systems. It is important that the InCiSE metrics focus on processes that are within the legal mandateoftheexecutivebranchforallcountriescoveredbytheIndex.

b. Regulation: The“extentandquality”ofassessments and stakeholder engagement donotentirelycapturetheeffectivenessoftheexecutiveagency.Thequestionofthe independence of the regulator from

regulated bodies is not covered by the Index.Thisisaparticularlyrelevantissuein clientelistic countries, where political appointments to regulatory agencies can undermine the regulatory process.

c. Human Resource Management: Althoughthe“meritocracyofrecruitment”is an important dimension of HRM, other important features of meritocracy are how performance is evaluated and connected to promotion, how high level strategic positions are assigned, and how far down the hierarchic chain politically assigned supplementary payments and gratificationscanbeawarded.Thesefactorscandistractofficials’motivationfrom performance to the development of paternalistic ties.

d. Inclusiveness: Problems of the representation of groups in public administration(women;racial,ethnicand religious minorities; the disabled; indigenouspopulations)canbeobservednot only in their opportunities for recruitment, promotion and rewards, but also in equality of treatment and openness to their voice and ideas. Another metric currently not included in the Inclusiveness indicator relates to the discretionary assignmentofextrapaymentsforpolitically appointed temporary roles. In Brazil, such payments are concentrated on men occupying high level positions, butarealsousedtofavourspecificgroups in medium level positions.

Page 18: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

16 InternationalCivilServiceEffectiveness(InCiSE)Index

Abrucio,F.L.(2007).Trajetóriarecentedagestãopúblicabrasileira: um balanço crítico e a renovação da agenda de reformas. Revista de Administração Pública-RAP, 41.

ENAP(2018).Servidores(as) por raça/cor: sumário estatístico, Escola Nacional de Administração Pública (Brasil),http://repositorio.enap.gov.br/handle/1/3259

OECD(2013).Government at a Glance 2013. OECD Publishing, Paris. https://www.oecd-ilibrary.org/governance/government-at-a-glance-2013_gov_glance-2013-en

OECD(2015).Recommendation of the Council on Budgetary Governance. OECD Publishing, Paris. http://www.oecd.org/gov/budgeting/Recommendation-of-the-Council-on-Budgetary-Governance.pdf

Bibliography

Page 19: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

Assessment of the applicability of the InCiSE methodology to Brazil 17

Thetablesinthisannexoutlineindetailtheapplicability of the methodology set out in the Technical Report for the 2017 edition of theInCiSEIndex,assessingwhetherdataisavailable for Brazil and proposing potential alternatives where possible.

Annex:Detailedassessmentoftheapplicability of the InCiSE methodology

Page 20: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

18 InternationalCivilServiceEffectiveness(InCiSE)Index

Them

eM

etric

s us

ed in

InC

iSE

Inde

xC

omm

ents

on

the

qual

ity/

avai

labi

lity

of th

e In

CiS

E m

etric

s fo

r Bra

zil

Alte

rnat

ive

m

etric

s

sugg

este

d

Com

men

ts o

n th

e qu

ality

of

the

alte

rnat

ive

met

rics

Polic

y m

akin

g

The

qual

ity o

f pol

icy

advi

ceBe

rtels

man

n ‘S

chol

arly

Adv

ice’

sub

-indi

cato

r is

used

as

a pr

oxy

for t

he e

vide

nce

base

to p

olic

y de

cisi

ons

by a

sses

sing

the

degr

ee o

f civ

il se

rvan

t to

acad

emic

coo

rdin

atio

n: ‘H

ow in

fluen

tial

are

non-

gove

rnm

enta

l aca

dem

ic e

xper

ts fo

r gov

ernm

ent

deci

sion

-mak

ing?

Berte

lsm

ann

‘Gov

ernm

ent O

ffice

Exp

ertis

e’ s

ub-in

dica

tor

asse

sses

: ‘Do

es th

e go

vern

men

t offi

ce/p

rime

min

iste

r’s o

ffice

(G

O/P

MO

) hav

e th

e ex

perti

se to

eva

luat

e m

inis

teria

l dra

ft bi

lls

subs

tant

ivel

y?’

(1) T

he s

ame

met

ric is

ava

ilabl

e in

a s

peci

fic c

ount

ry re

port

from

20

14. I

t is

unsu

re if

it is

a “o

ne-o

ff” e

xper

ienc

e or

if B

erte

lsm

ann

inte

nd to

ela

bora

te th

ese

repo

rts fr

eque

ntly.

Berte

lsm

ann’

s SG

I Rep

ort f

or B

razil

is re

liabl

e, s

ince

it is

co

-aut

hore

d by

two

Braz

ilian

rese

arch

ers

who

hav

e fo

rmal

an

d ta

cit k

now

ledg

e ab

out t

he in

stitu

tiona

l and

eco

nom

ic

envi

ronm

ent o

f the

cou

ntry

.

NO

N/A

Degr

ee o

f stra

tegi

c po

licy

dire

ctio

nBe

rtels

man

n ‘S

trate

gic

Plan

ning

’ sub

-indi

cato

r ass

esse

s: ‘H

ow

muc

h in

fluen

ce d

o st

rate

gic

plan

ning

uni

ts a

nd b

odie

s ha

ve o

n go

vern

men

t dec

isio

n-m

akin

g?’

See

com

men

t (1)

NO

N/A

Coo

rdin

atio

n of

pol

icy

prop

osal

sBe

rtels

man

n ‘M

inis

teria

l Bur

eauc

racy

’ sub

-indi

cato

r ass

esse

s:

‘How

effe

ctiv

ely

do m

inis

try o

ffici

als/

civi

l ser

vant

s co

ordi

nate

po

licy

prop

osal

s?’

Berte

lsm

ann

‘Lin

e M

inis

tries

’ sub

-indi

cato

r ass

esse

s ‘T

o w

hat

exte

nt d

o lin

e m

inis

tries

invo

lve

the

gove

rnm

ent o

ffice

/prim

e m

inis

ter’s

offi

ce in

the

prep

arat

ion

of p

olic

y pr

opos

als?

See

com

men

t (1)

YES

CEP

II In

stitu

tiona

l Pro

files

Dat

abas

eC

EPII

IPD

is n

ow a

vaila

ble

in 1

44 c

ount

ries

of th

e w

orld

.

The

data

are

relia

ble

sinc

e th

ey a

re g

athe

red

via

surv

eys

of

colla

bora

tors

at t

he M

inis

try o

f Eco

nom

y an

d Fi

nanc

e of

the

sele

cted

cou

ntry

+ th

e Fr

ench

Dev

elop

men

t Age

ncy

(if it

ex

ists

in th

e co

untry

)

Tim

elin

ess

and

accu

racy

of p

olic

y de

liver

yN

o da

ta id

entifi

edN

/AN

ON

/A

Page 21: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

Assessment of the applicability of the InCiSE methodology to Brazil 19

Them

eM

etric

s us

ed in

InC

iSE

Inde

xC

omm

ents

on

the

qual

ity/

avai

labi

lity

of th

e In

CiS

E m

etric

s fo

r Bra

zil

Alte

rnat

ive

m

etric

s

sugg

este

d

Com

men

ts o

n th

e qu

ality

of

the

alte

rnat

ive

met

rics

Degr

ee o

f pol

icy

mon

itorin

gBe

rtels

man

n ‘M

onito

ring

Min

istri

es’ s

ub-in

dica

tor a

sses

ses:

‘H

ow e

ffect

ivel

y do

es th

e G

O/P

MO

mon

itor l

ine

min

istry

act

iviti

es

with

rega

rd to

impl

emen

tatio

n?’

Berte

lsm

ann

sub-

indi

cato

r ‘M

onito

ring

Agen

cies

’, as

sess

es:

‘How

effe

ctiv

ely

do fe

dera

l and

sub

natio

nal m

inis

tries

mon

itor

the

activ

ities

of b

urea

ucra

cies

/exe

cutiv

e ag

enci

es w

ith re

gard

to

impl

emen

tatio

n?’

Berte

lsm

ann

‘Nat

iona

l Sta

ndar

ds’ s

ub-in

dica

tor a

sses

ses:

‘To

wha

t ext

ent d

oes

cent

ral g

over

nmen

t ens

ure

that

sub

natio

nal

self-

gove

rnm

ents

real

ise

natio

nal s

tand

ards

of p

ublic

se

rvic

es?’

See

com

men

t (1)

NO

N/A

Fisc

al a

nd fi

nanc

ial m

anag

emen

t

Econ

omic

app

rais

al (u

se, q

ualit

y, gu

idan

ce)

‘Pub

lic S

pend

ing’

: WEF

GC

I bus

ines

s ex

ecut

ive

opin

ion:

‘How

w

ould

you

rate

the

com

posi

tion

of p

ublic

spe

ndin

g in

you

r co

untry

?’ (1

) ext

rem

ely

was

tefu

l; (7

) hig

hly

effici

ent i

n pr

ovid

ing

nece

ssar

y go

ods

and

serv

ices

.

(2) T

he s

ame

met

ric is

ava

ilabl

e an

d di

sclo

sed

frequ

ently

.

WEF

GC

I use

s a

mix

of s

econ

dary

dat

a an

d co

untry

sur

veys

co

nduc

ted

by p

artn

er o

rgan

isat

ions

bas

ed o

n th

e co

untry

an

alys

ed –

incr

easi

ng th

e re

liabi

lity

of th

e in

dex

due

to fo

rmal

an

d ta

cit k

now

ledg

e ab

out t

he in

stitu

tiona

l and

eco

nom

ic

envi

ronm

ent o

f the

cou

ntry

.

NO

N/A

Econ

omic

eva

luat

ion

(use

, qua

lity,

guid

ance

)N

ON

/A

Med

ium

-term

bud

getin

gO

ECD

‘Med

ium

-Ter

m B

udge

ting’

inde

xSa

me

met

ric is

NO

T av

aila

ble

YES

Inte

rnat

iona

l Bud

get P

artn

ersh

ip O

pen

Budg

et S

urve

yQ

uest

ion

48 o

f the

OBS

cap

ture

exa

ctly

the

dyna

mic

s of

M

ediu

m-te

rm b

udge

ting

– i.e

. “is

the

Exec

utiv

e’s

Budg

et

Prop

osal

or a

ny s

uppo

rting

bud

geta

ry d

ocum

enta

tion

pres

ent

Page 22: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

20 InternationalCivilServiceEffectiveness(InCiSE)Index

Them

eM

etric

s us

ed in

InC

iSE

Inde

xC

omm

ents

on

the

qual

ity/

avai

labi

lity

of th

e In

CiS

E m

etric

s fo

r Bra

zil

Alte

rnat

ive

m

etric

s

sugg

este

d

Com

men

ts o

n th

e qu

ality

of

the

alte

rnat

ive

met

rics

info

rmat

ion

on h

ow th

e pr

opos

ed b

udge

t (bo

th n

ew p

ropo

sals

an

d ex

istin

g po

licie

s) is

link

ed to

gov

ernm

ent’s

pol

icy

goal

s fo

r a m

ulti-

year

per

iod

(for a

t lea

st tw

o ye

ars

beyo

nd th

e bu

dget

yea

r)?”

The

data

are

relia

ble.

IBP

Met

hodo

logy

ask

s fo

r a g

over

nmen

t re

spon

se a

nd a

n ac

adem

ic p

eer r

evie

w b

efor

e th

e pu

blic

atio

n of

the

resp

onse

s fo

r the

que

stio

nnai

re.

Mor

e m

etric

s co

min

g fro

m th

e sa

me

data

sou

rce

can

be

usef

ul fo

r InC

iSe

team

on

this

them

e (a

nd o

vera

ll in

dica

tor).

Perfo

rman

ce b

udge

ting

OEC

D ‘P

erfo

rman

ce B

udge

ting’

inde

xSa

me

met

ric is

NO

T av

aila

ble

YES

Inte

rnat

iona

l Bud

get P

artn

ersh

ip O

pen

Budg

et S

urve

yTh

e qu

estio

n 51

of t

he O

BS c

aptu

re e

xact

ly th

e dy

nam

ics

of P

BB

– i.e

., 'A

re p

erfo

rman

ce ta

rget

s as

sign

ed to

non

finan

cial

dat

a on

resu

lts in

the

Exec

utiv

e’s

Budg

et P

ropo

sal o

r any

sup

porti

ng

budg

et d

ocum

enta

tion?

The

data

are

relia

ble.

IBP

Met

hodo

logy

ask

s fo

r a g

over

nmen

t re

spon

se a

nd a

n ac

adem

ic p

eer r

evie

w b

efor

e th

e pu

blic

atio

n of

the

resp

onse

s fo

r the

que

stio

nnai

re.

Mor

e m

etric

s co

min

g fro

m th

e sa

me

data

sou

rce

may

be

usef

ul fo

r InC

iSE

team

on

this

them

e (a

nd o

vera

ll in

dica

tor).

Reg

ulat

ion

Ex a

nte

appr

aisa

l: ap

plic

atio

n, q

ualit

y, su

stai

nabi

lity,

trans

pare

ncy,

over

sigh

t.O

ECD

i-reg

indi

cato

rs –

Reg

ulat

ory

‘Impa

ct A

sses

smen

t –

Prim

ary

Law

s’

OEC

D i-r

eg in

dica

tors

– R

egul

ator

y ‘Im

pact

Ass

essm

ent –

Se

cond

ary

Law

s’

Stak

ehol

der e

ngag

emen

t and

ex

post

eva

luat

ion

asse

ssm

ents

ar

e m

ade

on fo

ur a

reas

of p

erfo

rman

ce: m

etho

dolo

gy,

syst

emat

ic a

dopt

ion,

tran

spar

ency

and

ove

rsig

ht/q

ualit

y co

ntro

l.

The

sam

e da

ta is

ava

ilabl

e, b

ut th

ere

is n

o co

mpo

site

indi

cato

r in

the

Braz

ilian

coun

try R

epor

t.

NO

N/A

Page 23: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

Assessment of the applicability of the InCiSE methodology to Brazil 21

Them

eM

etric

s us

ed in

InC

iSE

Inde

xC

omm

ents

on

the

qual

ity/

avai

labi

lity

of th

e In

CiS

E m

etric

s fo

r Bra

zil

Alte

rnat

ive

m

etric

s

sugg

este

d

Com

men

ts o

n th

e qu

ality

of

the

alte

rnat

ive

met

rics

Stak

ehol

der e

ngag

emen

t: ap

plic

atio

n, q

ualit

y, tra

nspa

renc

y, ov

ersi

ght

OEC

D i-r

eg in

dica

tors

– ‘S

take

hold

er E

ngag

emen

t – P

rimar

y La

ws’

OEC

D i-r

eg in

dica

tors

– ‘S

take

hold

er E

ngag

emen

t –

Seco

ndar

y La

ws’

The

sam

e da

ta a

re a

vaila

ble

and,

for t

his

them

e, th

ere

is a

co

mpo

site

indi

cato

r ava

ilabl

e fo

r Bra

zil. T

he in

dica

tor f

ollo

ws

the

met

hodo

logy

of O

ECD’

s 20

15 In

dica

tors

of R

egul

ator

y Po

licy

and

Gov

erna

nce.

NO

N/A

Ex p

ost e

valu

atio

n: a

pplic

atio

n, q

ualit

y, su

stai

nabi

lity,

trans

pare

ncy,

over

sigh

tO

ECD

i-reg

indi

cato

rs –

Ex-

post

‘Eva

luat

ion

– Pr

imar

y La

ws’

OEC

D i-r

eg in

dica

tors

– E

x-po

st ‘E

valu

atio

n –

Seco

ndar

y La

ws’

The

sam

e da

ta a

re a

vaila

ble,

but

ther

e is

no

com

posi

te in

dica

tor

in th

e Br

azilia

n co

untry

repo

rt.N

ON

/A

Cris

is/r

isk

man

agem

ent

Inte

grat

ed ri

sk p

lann

ing

‘Ris

k Pl

anni

ng E

xten

t’: T

he e

xten

t to

whi

ch d

isas

ter r

isk

is

inte

grat

ed in

to n

atio

nal p

olic

y pl

anni

ng is

mea

sure

d by

cou

ntin

g th

e ty

pes

of p

olic

y pl

anni

ng in

to w

hich

risk

is in

tegr

ated

(out

of 7

, e.

g. n

atio

nal d

evel

opm

ent p

lans

).

‘Dis

aste

r Spe

ndin

g Ap

prai

sal’:

A s

core

for e

cono

mic

app

rais

al

look

s at

whe

ther

the

cost

s an

d be

nefit

s of

spe

ndin

g re

late

d to

di

sast

er s

pend

ing

are

cons

ider

ed.

(3) T

he s

ame

met

ric is

ava

ilabl

e in

a s

peci

fic c

ount

ry re

port.

As

in

othe

r cou

ntrie

s, it

is u

nsur

e if

it is

a “o

ne-o

ff” e

xper

ienc

e.

The

repo

rt fo

r Bra

zil is

relia

ble,

sin

ce it

relie

s on

a fo

cal p

oint

w

orki

ng a

t the

cen

tral g

over

nmen

t - th

at h

as fo

rmal

and

taci

t kn

owle

dge

abou

t the

inst

itutio

nal a

nd e

cono

mic

env

ironm

ent

of th

e co

untry

.

NO

N/A

Risk

mon

itorin

g‘R

isk

Asse

ssm

ent Q

ualit

y’: T

he q

ualit

y of

mul

ti-ha

zard

risk

as

sess

men

t is

mea

sure

d by

ass

essi

ng th

e pr

oces

ses

behi

nd

risk

asse

ssm

ents

(out

of 5

, e.g

. whe

ther

risk

ass

essm

ents

hav

e ag

reed

nat

iona

l sta

ndar

ds);

The

‘Deg

ree

of R

isk

Mon

itorin

g’ is

mea

sure

d by

ass

essi

ng th

e ex

tent

and

use

of r

epor

ts a

nd d

atab

ases

of t

his

type

.Se

e co

mm

ent (

3)N

ON

/A

Publ

ic in

form

atio

n di

ssem

inat

ion

and

publ

ic a

war

enes

s st

rate

gies

‘Ear

ly W

arni

ng S

yste

ms’

: The

qua

lity

of e

arly

war

ning

sys

tem

s is

ass

esse

d by

look

ing

at th

e pr

oces

ses

in p

lace

(out

of 3

, e.g

. w

heth

er p

roto

cols

are

use

d an

d ap

plie

d).

Page 24: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

22 InternationalCivilServiceEffectiveness(InCiSE)Index

Them

eM

etric

s us

ed in

InC

iSE

Inde

xC

omm

ents

on

the

qual

ity/

avai

labi

lity

of th

e In

CiS

E m

etric

s fo

r Bra

zil

Alte

rnat

ive

m

etric

s

sugg

este

d

Com

men

ts o

n th

e qu

ality

of

the

alte

rnat

ive

met

rics

‘Pub

lic In

form

atio

n’ d

isse

min

atio

n is

sco

red

by lo

okin

g at

the

type

s of

com

mun

icat

ions

in p

lace

(out

of 4

, e.g

. is

a na

tiona

l di

sast

er in

form

atio

n sy

stem

pub

licly

ava

ilabl

e?).

‘Pub

lic A

war

enes

s St

rate

gy’ l

ooks

at t

he re

leva

nt

wor

kstre

ams

in p

lace

(out

of 5

, e.g

. whe

ther

pub

lic e

duca

tion

cam

paig

ns fo

r ris

k aw

aren

ess

exis

t).

See

com

men

t (3)

NO

N/A

Inte

rnat

iona

l coo

pera

tion

and

risk

coor

dina

tion

‘Inte

rnat

iona

l Coo

pera

tion’

is m

easu

red

by a

sses

sing

the

num

ber

of p

roce

sses

/act

iviti

es in

pla

ce fo

r int

erna

tiona

l coo

pera

tion

and

inte

rnat

iona

l ris

k m

anag

emen

t (ou

t of 6

, e.g

. whe

ther

tra

nsbo

unda

ry p

roto

cols

are

in p

lace

).

See

com

men

t (3)

NO

N/A

Prep

ared

ness

for d

isas

ter r

espo

nse

No

data

iden

tified

N/A

NO

N/A

Post

dis

aste

r ass

essm

ent m

etho

dolo

gy‘P

ost D

isas

ter A

sses

smen

t’: A

sco

re is

giv

en fo

r pos

t dis

aste

r da

mag

e an

d lo

ss a

sses

smen

t by

cons

ider

ing,

for e

xam

ple,

w

heth

er a

spe

cifie

d m

etho

dolo

gy fo

r thi

s ex

ists

(out

of 3

).

See

com

men

t (3)

NO

N/A

Hum

an re

sour

ce m

anag

emen

t

Mer

itocr

acy

of re

crui

tmen

t‘A

pplic

ant S

kills

’: Q

oG e

xper

t ass

essm

ent o

f ext

ent t

o w

hich

the

skills

and

mer

its o

f the

app

lican

ts d

ecid

e w

ho g

ets

the

job

whe

n re

crui

ting

publ

ic s

ecto

r em

ploy

ees;

‘Con

nect

ions

Bia

s in

Rec

ruitm

ent:

Polit

ical

’: Q

oG e

xper

t as

sess

men

t of e

xten

t to

whi

ch p

oliti

cal c

onne

ctio

ns o

f the

ap

plic

ants

dec

ide

who

get

s th

e jo

b;

‘Con

nect

ions

Bia

s in

Rec

ruitm

ent:

Pers

onal

’: Q

oG e

xper

t as

sess

men

t of e

xten

t to

whi

ch p

erso

nal c

onne

ctio

ns o

f the

ap

plic

ants

dec

ide

who

get

s th

e jo

b;

‘Rec

ruitm

ent v

ia F

orm

al E

xam

Sys

tem

’: Q

oG e

xper

t as

sess

men

t of e

xten

t to

whi

ch p

ublic

sec

tor e

mpl

oyee

s ar

e hi

red

usin

g a

form

al e

xam

inat

ion

syst

em.

(4) T

he s

ame

met

ric is

ava

ilabl

e an

d di

sclo

sed

frequ

ently

.

QoG

sur

veys

are

con

duct

ed w

ith B

razil

ian

expe

rts –

in

crea

sing

the

relia

bilit

y of

the

inde

x du

e to

form

al a

nd ta

cit

know

ledg

e ab

out t

he in

stitu

tiona

l and

eco

nom

ic e

nviro

nmen

t of

the

coun

try.

YES

Page 25: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

Assessment of the applicability of the InCiSE methodology to Brazil 23

Them

eM

etric

s us

ed in

InC

iSE

Inde

xC

omm

ents

on

the

qual

ity/

avai

labi

lity

of th

e In

CiS

E m

etric

s fo

r Bra

zil

Alte

rnat

ive

m

etric

s

sugg

este

d

Com

men

ts o

n th

e qu

ality

of

the

alte

rnat

ive

met

rics

OEC

D’s

Gov

ernm

ent a

t a G

lanc

e: L

atin

Am

eric

a an

d th

e C

arib

bean

The

data

are

ava

ilabl

e, a

nd it

is re

liabl

e. H

owev

er, t

he

frequ

ency

is u

nsur

e: th

e da

ta is

dis

clos

ed d

iscr

etio

naril

y by

O

ECD.

Attra

ctin

g an

d re

tain

ing

tale

nt‘C

ompa

rabl

e Sa

larie

s’: Q

oG e

xper

t ass

essm

ent o

f ext

ent t

o w

hich

sen

ior o

ffici

als

have

sal

arie

s th

at a

re c

ompa

rabl

e w

ith th

e sa

larie

s of

priv

ate

sect

or m

anag

ers

with

roug

hly

sim

ilar t

rain

ing

and

resp

onsi

bilit

ies.

See

com

men

t (4)

NO

N/A

Tale

nt d

eplo

ymen

t (i.e

. min

imis

ing

skills

gap

s)N

o da

ta id

entifi

edN

/AN

ON

/A

Perfo

rman

ce m

anag

emen

tN

o da

ta id

entifi

edN

/AN

ON

/A

Qua

lity

of le

arni

ng a

nd d

evel

opm

ent

No

data

iden

tified

N/A

NO

N/A

Leve

l of c

usto

mer

(i.e

. civ

il se

rvan

t) sa

tisfa

ctio

nN

o da

ta id

entifi

edN

/AN

ON

/A

Tax

adm

inis

trat

ion

Ove

rall

effici

ency

of c

olle

ctio

n‘C

olle

ctio

n C

ost’:

Dat

a fro

m O

ECD

Tax

Adm

inis

tratio

n on

: cos

t of

colle

ctio

n ra

tios

(adm

inis

trativ

e co

sts/

net r

even

ue c

olle

cted

);

‘Tax

Deb

t’ ra

tios

(tota

l yea

r-end

tax

debt

(exc

ludi

ng d

ispu

ted)

/ne

t rev

enue

col

lect

ed).

(6) T

he s

ame

met

ric is

ava

ilabl

e an

d re

liabl

e. It

is d

iscl

osed

di

scre

tiona

rily

by O

ECD.

YE

S

CEP

II In

stitu

tiona

l Pro

files

Dat

abas

eC

EPII

IPD

is n

ow a

vaila

ble

in 1

44 c

ount

ries

of th

e w

orld

.

The

data

is re

liabl

e si

nce

it is

gat

tere

d vi

a su

rvey

s ap

plie

d to

col

labo

rato

rs a

t the

Min

istry

of E

cono

my

and

Fina

nce

of

the

sele

cted

cou

ntry

+ th

e Fr

ench

Dev

elop

men

t Age

ncy

(if it

ex

ists

in th

e co

untry

)

Use

r cen

trici

ty o

f ser

vice

s‘T

ime

to P

ay T

axes

– B

usin

ess’

: Dat

a fro

m th

e W

orld

Ban

k’s

‘Doi

ng B

usin

ess’

Inde

x on

the

time

it ta

kes

busi

ness

es to

pay

ta

xes.

(5) T

he s

ame

met

ric is

ava

ilabl

e an

d di

sclo

sed

frequ

ently

.

Page 26: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

24 InternationalCivilServiceEffectiveness(InCiSE)Index

Them

eM

etric

s us

ed in

InC

iSE

Inde

xC

omm

ents

on

the

qual

ity/

avai

labi

lity

of th

e In

CiS

E m

etric

s fo

r Bra

zil

Alte

rnat

ive

m

etric

s

sugg

este

d

Com

men

ts o

n th

e qu

ality

of

the

alte

rnat

ive

met

rics

Doi

ng B

usin

ess’

team

use

s a

mix

sec

onda

ry d

ata

and

a gr

oup

of c

ontri

buto

rs (b

oth

indi

vidu

als

and

orga

nisa

tions

) ba

sed

on th

e co

untry

ana

lyse

d –

incr

easi

ng th

e re

liabi

lity

of th

e in

dex

due

to fo

rmal

and

taci

t kno

wle

dge

abou

t the

in

stitu

tiona

l and

eco

nom

ic e

nviro

nmen

t of t

he c

ount

ry.

NO

N/A

Exte

nt a

nd q

ualit

y of

dig

ital p

rovi

sion

‘E-F

iled

Tax

Retu

rns

– Pe

rson

al’:

Data

from

OEC

D Ta

x Ad

min

istra

tion

on: t

he p

erce

ntag

e of

tax

retu

rns

e-fil

ed d

urin

g th

e la

st fi

scal

yea

r for

per

sona

l tax

es;

‘E-F

iled

Tax

Retu

rns

– C

orpo

rate

’: Da

ta fr

om O

ECD

Tax

Adm

inis

tratio

n on

: the

per

cent

age

of ta

x re

turn

s e-

filed

dur

ing

the

last

fisc

al y

ear f

or c

orpo

rate

taxe

s;

‘E-F

iled

Tax

Retu

rns

– VA

T’: D

ata

from

OEC

D Ta

x Ad

min

istra

tion

on: t

he p

erce

ntag

e of

tax

retu

rns

e-fil

ed d

urin

g th

e la

st fi

scal

yea

r for

VAT

taxe

s.

See

com

men

t (6)

NO

N/A

Prev

entio

n of

tax

evas

ion

No

data

iden

tified

N/A

YES

CEP

II In

stitu

tiona

l Pro

files

Dat

abas

eC

EPII

IPD

is n

ow a

vaila

ble

in 1

44 c

ount

ries

of th

e w

orld

.

The

data

is re

liabl

e si

nce

it is

gat

tere

d vi

a su

rvey

s ap

plie

d to

col

labo

rato

rs a

t the

Min

istry

of E

cono

my

and

Fina

nce

of

the

sele

cted

cou

ntry

+ th

e Fr

ench

Dev

elop

men

t Age

ncy

(if it

ex

ists

in th

e co

untry

)

Leve

l of t

ax g

ap m

easu

rem

ent

No

data

iden

tified

N/A

NO

N/A

Soci

al s

ecur

ity a

dmin

istr

atio

n

Ove

rall

effici

ency

of d

istri

butio

n

Adm

inis

tratio

n co

sts

as a

per

cent

age

of to

tal e

xpen

ditu

re o

n so

cial

sec

urity

.N

ON

/A

Use

r cen

trici

ty o

f ser

vice

sN

o da

ta id

entifi

edN

/AN

ON

/A

Exte

nt a

nd q

ualit

y of

dig

ital p

rovi

sion

No

data

iden

tified

N/A

NO

N/A

Prev

entio

n of

frau

dN

o da

ta id

entifi

edN

/AN

ON

/A

Page 27: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

Assessment of the applicability of the InCiSE methodology to Brazil 25

Them

eM

etric

s us

ed in

InC

iSE

Inde

xC

omm

ents

on

the

qual

ity/

avai

labi

lity

of th

e In

CiS

E m

etric

s fo

r Bra

zil

Alte

rnat

ive

m

etric

s

sugg

este

d

Com

men

ts o

n th

e qu

ality

of

the

alte

rnat

ive

met

rics

Dig

ital s

ervi

ce

Use

r cen

trici

ty o

f ser

vice

sEu

rope

an C

omm

issi

on E

-Gov

ernm

ent b

ench

mar

k: ‘U

ser

Cen

trici

ty’,

indi

cate

s to

wha

t ext

ent (

info

rmat

ion

abou

t) a

serv

ice

is p

rovi

ded

onlin

e.

Sam

e m

etric

is N

OT

avai

labl

eN

ON

/A

Tran

spar

ency

of s

ervi

ceEu

rope

an C

omm

issi

on E

-Gov

ernm

ent b

ench

mar

k:

‘Tra

nspa

renc

y’, i

ndic

ates

to w

hat e

xten

t gov

ernm

ents

are

tra

nspa

rent

as

rega

rds

a) th

eir o

wn

resp

onsi

bilit

ies

and

perfo

rman

ce, b

) the

pro

cess

of s

ervi

ce d

eliv

ery

and

c) p

erso

nal

data

invo

lved

.

Sam

e m

etric

is N

OT

avai

labl

eN

ON

/A

Cro

ss-b

orde

r mob

ility

of s

ervi

ces

Euro

pean

Com

mis

sion

E-G

over

nmen

t ben

chm

ark:

‘Cro

ss B

orde

r M

obilit

y’, i

ndic

ates

to w

hat e

xten

t Eur

opea

n us

ers

can

use

onlin

e se

rvic

es in

ano

ther

cou

ntry

;

Sam

e m

etric

is N

OT

avai

labl

eN

ON

/A

The

avai

labi

lity

of ‘k

ey e

nabl

ers’

Euro

pean

Com

mis

sion

E-G

over

nmen

t ben

chm

ark:

‘Key

En

able

rs’,

indi

cate

s th

e ex

tent

to w

hich

five

tech

nica

l pre

-co

nditi

ons

for e

Gov

ernm

ent a

re u

sed.

Sam

e m

etric

is N

OT

avai

labl

eN

ON

/A

Inte

grity

Leve

ls/p

erce

ptio

ns o

f cor

rupt

ion

‘Cor

rupt

ion

Perc

eptio

ns’:

Glo

bal C

orru

ptio

n Ba

rom

eter

– %

of

peop

le v

iew

ing

publ

ic o

ffici

als/

civi

l ser

vant

s as

cor

rupt

;

‘Pub

lic O

ffici

als

Stea

ling’

: QoG

– e

xper

t opi

nion

of h

ow o

ften

publ

ic s

ecto

r offi

cial

s st

eal o

r em

bezz

le p

ublic

fund

s;

‘Pub

lic O

ffici

als

Favo

urs

for B

ribes

’: Q

oG –

exp

ert o

pini

on o

f ho

w o

ften

publ

ic s

ecto

r offi

cial

s gr

ant f

avou

rs fo

r brib

es;

‘Gov

ernm

ent F

avou

ritis

m o

f Bus

ines

s’: W

EF G

CI –

bus

ines

s ex

ecut

ive

opin

ion

of e

xten

t gov

ernm

ent o

ffici

als

show

fa

vour

itism

to w

ell-c

onne

cted

firm

s.

Glo

bal C

orru

ptio

n Ba

rom

eter

is fr

eque

nt a

nd re

liabl

e se

t of d

ata.

Su

rvey

s ar

e co

nduc

ted

via

phon

e or

inte

rnet

with

adu

lts li

ving

in

the

coun

try o

f ana

lysi

s.

See

com

men

t (2)

& (4

)YE

S

Latin

obar

ómet

roLa

tinob

aróm

etro

is a

freq

uent

and

relia

ble

set o

f dat

a. A

lead

ing

loca

l pol

ling

com

pany

is c

ontra

cted

. All

geog

raph

ic re

gion

s of

Br

azil

are

cove

red

in th

e sa

mpl

e.

Page 28: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

26 InternationalCivilServiceEffectiveness(InCiSE)Index

Them

eM

etric

s us

ed in

InC

iSE

Inde

xC

omm

ents

on

the

qual

ity/

avai

labi

lity

of th

e In

CiS

E m

etric

s fo

r Bra

zil

Alte

rnat

ive

m

etric

s

sugg

este

d

Com

men

ts o

n th

e qu

ality

of

the

alte

rnat

ive

met

rics

Fairn

ess

and

impa

rtial

ity‘F

air T

reat

men

t by

Publ

ic O

ffici

als’

: QoG

exp

ert a

sses

smen

t of

exte

nt to

whi

ch p

ublic

sec

tor e

mpl

oyee

s tre

at s

ome

grou

ps in

so

ciet

y un

fairl

y;

‘Pub

lic O

ffici

als

Act I

mpa

rtial

ly’:

QoG

exp

ert a

sses

smen

t of

exte

nt to

whi

ch p

ublic

sec

tor e

mpl

oyee

s ac

t im

parti

ally

whe

n de

cidi

ng h

ow to

impl

emen

t pol

icy.

See

com

men

t (4)

NO

N/A

Adhe

renc

e to

rule

s an

d pr

oced

ures

‘Pub

lic O

ffici

als

Follo

w R

ules

’: Q

oG e

xper

t ass

essm

ent o

f ext

ent

to w

hich

pub

lic s

ecto

r em

ploy

ees

striv

e to

follo

w ru

les.

See

com

men

t 4N

ON

/A

Striv

ing

to s

erve

citi

zens

and

min

iste

rs‘P

ublic

Offi

cial

s St

rive

to H

elp

Citi

zens

’: Q

oG e

xper

t ass

essm

ent

of e

xten

t to

whi

ch p

ublic

sec

tor e

mpl

oyee

s st

rive

to h

elp

citiz

ens;

‘Pub

lic O

ffici

als

Striv

e to

Impl

emen

t Pol

icie

s’ Q

oG e

xper

t as

sess

men

t of e

xten

t to

whi

ch p

ublic

sec

tor e

mpl

oyee

s st

rive

to im

plem

ent p

olic

ies

deci

ded

by p

oliti

cal l

eade

rs;

‘Pub

lic O

ffici

als

Striv

e to

Ful

fill I

deol

ogy’

: QoG

exp

ert

asse

ssm

ent o

f ext

ent t

o w

hich

pub

lic s

ecto

r em

ploy

ees

striv

e to

fulfi

l ide

olog

y of

par

ty in

gov

ernm

ent.

See

com

men

t (4)

NO

N/A

Wor

k et

hic

‘Em

ploy

ee A

bsen

ces’

: QoG

exp

ert a

sses

smen

t of e

xten

t to

whi

ch p

ublic

sec

tor e

mpl

oyee

s ar

e ab

sent

with

out p

erm

issi

on;

‘Em

ploy

ee E

ffici

ency

’: Q

oG e

xper

t ass

essm

ent o

f ext

ent t

o w

hich

pub

lic s

ecto

r em

ploy

ees

striv

e to

be

effici

ent.

See

com

men

t (4)

NO

N/A

Proc

esse

s in

pla

ce to

pre

serv

e in

tegr

ity a

nd p

reve

nt c

onfli

cts

of in

tere

st‘P

ost E

mpl

oym

ent C

oolin

g O

ff’: O

ECD

data

on

whe

ther

a p

ost-

empl

oym

ent c

oolin

g off

per

iod

exis

ts a

nd w

heth

er it

’s pa

id;

‘Lob

byis

t Pro

tect

ion’

: OEC

D da

ta o

n de

gree

of p

rote

ctio

n ag

ains

t lob

byis

ts a

nd o

ther

priv

ate

inte

rest

s in

fluen

cing

ad

viso

ry g

roup

s;

‘Whi

stle

blow

er P

rote

ctio

n: C

over

age’

: OEC

D da

ta o

n nu

mbe

r of

gro

ups

who

rece

ive

whi

stle

blow

er p

rote

ctio

n;

‘Whi

stle

blow

er P

rote

ctio

n: D

egre

e’: Q

oG e

xper

t ass

essm

ent

of d

egre

e of

whi

stle

blow

er p

rote

ctio

n.Se

e co

mm

ent (

6)N

ON

/A

Page 29: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

Assessment of the applicability of the InCiSE methodology to Brazil 27

Them

eM

etric

s us

ed in

InC

iSE

Inde

xC

omm

ents

on

the

qual

ity/

avai

labi

lity

of th

e In

CiS

E m

etric

s fo

r Bra

zil

Alte

rnat

ive

m

etric

s

sugg

este

d

Com

men

ts o

n th

e qu

ality

of

the

alte

rnat

ive

met

rics

Ope

nnes

s

The

degr

ee a

nd q

ualit

y of

soc

ieta

l con

sulta

tion

The

‘Civ

ic P

artic

ipat

ion’

com

pone

nt o

f the

Ope

n G

over

nmen

t In

dex,

whi

ch “m

easu

res

the

effec

tiven

ess

of c

ivic

par

ticip

atio

n m

echa

nism

s, in

clud

ing

the

prot

ectio

n of

the

freed

oms

of o

pini

on

and

expr

essi

on, a

nd a

ssem

bly

and

asso

ciat

ion,

and

the

right

to

petit

ion

the

gove

rnm

ent.

It al

so m

easu

res

whe

ther

peo

ple

can

voic

e co

ncer

ns to

var

ious

gov

ernm

ent o

ffice

rs a

nd m

embe

rs

of th

e le

gisl

atur

e, a

nd w

heth

er g

over

nmen

t offi

cial

s pr

ovid

e su

ffici

ent i

nfor

mat

ion

and

notic

e ab

out d

ecis

ions

affe

ctin

g th

e co

mm

unity

, inc

ludi

ng o

ppor

tuni

ties

for c

itize

n fe

edba

ck”;

‘E-G

over

nmen

t Eng

agem

ent’:

The

UN

’s E-

Parti

cipa

tion

Inde

x,

whi

ch re

view

s th

e qu

ality

and

use

fuln

ess

of e

-gov

ernm

ent

prog

ram

s fo

r the

pur

pose

of e

ngag

ing

peop

le in

pub

lic p

olic

y-m

akin

g an

d im

plem

enta

tion;

‘Neg

otia

ting

Publ

ic S

uppo

rt’ B

erte

lsm

ann

sub-

indi

cato

r, w

hich

“ass

esse

s ho

w s

ucce

ssfu

lly th

e go

vern

men

t con

sults

w

ith s

ocie

tal a

ctor

s su

ch a

s tra

de u

nion

s, e

mpl

oyer

s’

asso

ciat

ions

, lea

ding

bus

ines

s as

soci

atio

ns, r

elig

ious

co

mm

uniti

es, a

nd s

ocia

l and

env

ironm

enta

l int

eres

t gro

ups

in

prep

arin

g its

pol

icy.”

(7) T

he O

GI i

s re

liabl

e an

d fre

quen

t. A

lead

ing

loca

l pol

ling

com

pany

is c

ontra

cted

out

+ e

xper

t sur

veys

take

n.

UN

dat

a is

relia

ble

and

frequ

ent.

The

data

is g

atte

red

via

surv

ey w

ith fo

cal p

oint

s on

cen

tral g

over

nmen

ts, c

ase

stud

ies

and

seco

ndar

y da

ta a

vaila

ble

on g

over

nmen

t web

site

s.

For B

erte

lsm

ann,

see

com

men

t (1)

YES

Varie

ties

of D

emoc

racy

VDem

is re

liabl

e an

d fre

quen

t. Da

ta is

gat

tere

d vi

a su

rvey

s w

ith

expe

rts in

the

coun

tries

ana

lyse

d.

Page 30: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

28 InternationalCivilServiceEffectiveness(InCiSE)Index

Them

eM

etric

s us

ed in

InC

iSE

Inde

xC

omm

ents

on

the

qual

ity/

avai

labi

lity

of th

e In

CiS

E m

etric

s fo

r Bra

zil

Alte

rnat

ive

m

etric

s

sugg

este

d

Com

men

ts o

n th

e qu

ality

of

the

alte

rnat

ive

met

rics

The

exis

tenc

e an

d qu

ality

of c

ompl

aint

mec

hani

sms

The

‘Com

plai

nt M

echa

nism

s’ c

ompo

nent

of t

he O

pen

Gov

ernm

ent I

ndex

, whi

ch “m

easu

res

whe

ther

peo

ple

are

able

to

brin

g sp

ecifi

c co

mpl

aint

s to

the

gove

rnm

ent a

bout

the

prov

isio

n of

pub

lic s

ervi

ces

or th

e pe

rform

ance

of g

over

nmen

t offi

cers

in

carry

ing

out t

heir

lega

l dut

ies

in p

ract

ice,

and

how

gov

ernm

ent

offici

als

resp

ond

to s

uch

com

plai

nts.

It a

lso

mea

sure

s w

heth

er

peop

le c

an c

halle

nge

gove

rnm

ent d

ecis

ions

bef

ore

anot

her

gove

rnm

ent a

genc

y or

a ju

dge.

See

com

men

t (7)

NO

N/A

Gov

ernm

ent d

ata

avai

labi

lity

and

acce

ssib

ility

‘Ope

n Da

ta P

ract

ice

and

Impa

ct’:

The

Ope

n Da

ta B

arom

eter

(O

DB) m

easu

res

the

impl

emen

tatio

n of

ope

n da

ta p

ract

ice

and

is

the

only

inde

x to

als

o m

easu

re th

e im

pact

of o

pen

data

(e.g

. how

m

any

use

it).

‘Gov

ernm

ent D

atas

ets

Ope

nnes

s’: T

he O

pen

Data

Inde

x (O

DI) m

easu

res

whe

ther

pub

licly

hel

d da

ta a

cros

s 13

are

as is

de

fined

as

open

, with

resu

lts c

row

dsou

rced

from

vol

unte

ers

revi

ewin

g w

ebsi

tes.

‘Dat

a Av

aila

bilit

y an

d G

over

nmen

t Sup

port’

: The

OU

Rdat

a in

dex

also

aim

s to

cap

ture

the

avai

labi

lity

and

acce

ssib

ility

of d

ata

but u

niqu

ely

it al

so a

ttem

pts

to m

easu

re th

e le

vel o

f pr

o-ac

tive

supp

ort g

over

nmen

ts p

rovi

de to

fost

er in

nova

tive

re-u

se o

f the

dat

a.

NO

N/A

Gov

ernm

ent d

ata

impa

ct a

nd s

uppo

rt fo

r re-

use

NO

N/A

Righ

t to

info

rmat

ion

(e.g

. FO

Is)

The

‘Rig

hts

to In

form

atio

n’ c

ompo

nent

of t

he O

pen

Gov

ernm

ent

Inde

x w

hich

“mea

sure

s w

heth

er re

ques

ts fo

r inf

orm

atio

n he

ld

by a

gov

ernm

ent a

genc

y ar

e gr

ante

d. It

als

o m

easu

res

whe

ther

th

ese

requ

ests

are

gra

nted

with

in a

reas

onab

le ti

me

perio

d, if

the

info

rmat

ion

prov

ided

is p

ertin

ent a

nd c

ompl

ete,

and

if re

ques

ts

for i

nfor

mat

ion

are

gran

ted

at a

reas

onab

le c

ost a

nd w

ithou

t ha

ving

to p

ay a

brib

e. T

his

dim

ensi

on a

lso

mea

sure

s w

heth

er

peop

le a

re a

war

e of

thei

r rig

ht to

info

rmat

ion,

and

whe

ther

re

leva

nt re

cord

s –

such

as

budg

et fi

gure

s of

gov

ernm

ent o

ffici

als,

om

buds

man

repo

rts, a

nd in

form

atio

n re

lativ

e to

com

mun

ity

proj

ects

– a

re a

cces

sibl

e to

the

publ

ic u

pon

requ

est.”

See

com

men

t (7)

NO

N/A

Page 31: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

Assessment of the applicability of the InCiSE methodology to Brazil 29

Them

eM

etric

s us

ed in

InC

iSE

Inde

xC

omm

ents

on

the

qual

ity/

avai

labi

lity

of th

e In

CiS

E m

etric

s fo

r Bra

zil

Alte

rnat

ive

m

etric

s

sugg

este

d

Com

men

ts o

n th

e qu

ality

of

the

alte

rnat

ive

met

rics

Publ

icis

ed la

ws

The

‘Pub

licis

ed L

aws’

com

pone

nt o

f the

Ope

n G

over

nmen

t In

dex,

whi

ch “m

easu

res

whe

ther

bas

ic la

ws

and

info

rmat

ion

on

lega

l rig

hts

are

publ

icly

ava

ilabl

e, p

rese

nted

in p

lain

lang

uage

, an

d ar

e m

ade

acce

ssib

le in

all

lang

uage

s us

ed b

y si

gnifi

cant

se

gmen

ts o

f the

pop

ulat

ion.

Thi

s di

men

sion

als

o m

easu

res

the

qual

ity a

nd a

cces

sibi

lity

of in

form

atio

n pu

blis

hed

by

the

gove

rnm

ent i

n pr

int o

r onl

ine

(i.e.

act

ive

trans

pare

ncy)

, an

d w

heth

er a

dmin

istra

tive

regu

latio

ns, d

rafts

of l

egis

latio

n,

adm

inis

trativ

e de

cisi

ons,

and

hig

h co

urt d

ecis

ions

are

mad

e ac

cess

ible

to th

e pu

blic

in a

tim

ely

man

ner.”

See

com

men

t (7)

NO

N/A

Cap

abili

ties

Lead

ersh

ip c

apab

ility

No

data

iden

tified

N/A

NO

N/A

Com

mer

cial

cap

abilit

yN

o da

ta id

entifi

edN

/AN

ON

/A

Anal

ytic

al c

apab

ility

No

data

iden

tified

N/A

NO

N/A

Digi

tal c

apab

ility

No

data

iden

tified

N/A

NO

N/A

Cor

e ca

pabi

lity

(e.g

. pro

blem

-sol

ving

, num

erac

y, lit

erac

y sk

ills)

‘Lite

racy

Ski

lls’:

Take

n fro

m th

e O

ECD’

s PI

AAC

(Sur

vey

of A

dult

Skills

) dat

a (a

naly

sis

of th

e m

icro

data

): th

e pr

opor

tion

of th

e pu

blic

sec

tor g

ettin

g le

vel 4

or 5

for l

itera

cy s

kills

;

‘Num

erac

y Sk

ills’:

The

prop

ortio

n of

the

publ

ic s

ecto

r get

ting

leve

l 4 o

r 5 fo

r num

erac

y sk

ills;

‘Pro

blem

Sol

ving

Ski

lls’:

The

prop

ortio

n of

the

publ

ic s

ecto

r ge

tting

leve

l 3 fo

r pro

blem

ski

lls.

Sam

e m

etric

is N

OT

avai

labl

eYE

S

OEC

D’s

Gov

ernm

ent a

t a G

lanc

e: L

atin

Am

eric

a an

d th

e C

arib

bean

This

is a

vaila

ble

and

it is

relia

ble.

It is

dis

clos

ed d

iscr

etio

naril

y by

O

ECD.

Educ

atio

nal a

ttain

men

t of t

he w

orkf

orce

‘Edu

catio

nal A

ttain

men

t’: T

he p

ropo

rtion

of t

he p

ublic

sec

tor w

ith

terti

ary

educ

atio

n, ta

ken

from

the

OEC

D’s

PIAA

C (S

urve

y of

Adu

lt Sk

ills) d

ata

(ana

lysi

s of

the

mic

roda

ta).

Sam

e m

etric

is N

OT

avai

labl

eN

ON

/A

Page 32: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

30 InternationalCivilServiceEffectiveness(InCiSE)Index

Them

eM

etric

s us

ed in

InC

iSE

Inde

xC

omm

ents

on

the

qual

ity/

avai

labi

lity

of th

e In

CiS

E m

etric

s fo

r Bra

zil

Alte

rnat

ive

m

etric

s

sugg

este

d

Com

men

ts o

n th

e qu

ality

of

the

alte

rnat

ive

met

rics

Incl

usiv

enes

s

Prop

ortio

nate

gen

der r

epre

sent

atio

n‘G

ende

r: C

entra

l Gov

ernm

ent S

hare

’: O

ECD

data

– th

e ab

solu

te

diffe

renc

e be

twee

n th

e sh

are

of to

tal c

entra

l gov

ernm

ent

empl

oym

ent fi

lled

by w

omen

and

the

shar

e of

wom

en in

the

labo

ur fo

rce;

‘Gen

der:

Publ

ic S

ecto

r Sha

re’:

QoG

dat

a –

the

abso

lute

di

ffere

nce

betw

een

prop

ortio

n of

wom

en in

pub

lic s

ecto

r and

in

the

labo

ur fo

rce;

‘Gen

der:

Man

agem

ent S

hare

’: O

ECD

data

– th

e ab

solu

te

diffe

renc

e be

twee

n th

e sh

are

of e

mpl

oym

ent i

n to

p m

anag

emen

t pos

ition

s w

ithin

cen

tral g

over

nmen

t fille

d by

w

omen

and

the

shar

e of

wom

en in

the

labo

ur fo

rce;

‘Gen

der:

Seni

or M

anag

emen

t Sha

re’:

QoG

dat

a –

the

abso

lute

diff

eren

ce b

etw

een

prop

ortio

n of

wom

en in

cen

tral

gove

rnm

ent s

enio

r pos

ition

s an

d in

the

labo

ur fo

rce

See

com

men

t (4)

YES

Braz

ilian

Nat

iona

l Pub

lic A

dmin

istra

tion

Scho

ol (c

ount

ry

spec

ific)

This

is a

vaila

ble

and

it is

relia

ble.

It is

dis

clos

ed d

iscr

etio

naril

y by

EN

AP.

Prop

ortio

nate

eth

nic

min

ority

repr

esen

tatio

n‘E

thni

c an

d Re

ligio

us G

roup

Rep

rese

ntat

ion’

: QoG

dat

a –

expe

rt op

inio

n as

to w

heth

er ‘K

ey e

thni

c an

d re

ligio

us g

roup

s in

soc

iety

ar

e pr

opor

tiona

lly re

pres

ente

d am

ong

publ

ic s

ecto

r em

ploy

ees

(1=h

ardl

y ev

er, 7

=alm

ost a

lway

s)’

See

com

men

t (4)

NO

N/A

Prop

ortio

nate

dis

abilit

y re

pres

enta

tion

No

data

iden

tified

N/A

YES

Braz

ilian

Nat

iona

l Pub

lic A

dmin

istra

tion

Scho

ol (c

ount

ry

spec

ific)

This

is a

vaila

ble

and

it is

relia

ble.

It is

dis

clos

ed d

iscr

etio

naril

y by

EN

AP.

Prop

ortio

nate

soc

io-e

cono

mic

repr

esen

tatio

nN

o da

ta id

entifi

edN

/AN

ON

/A

Prop

ortio

nate

Les

bian

Gay

Bi-s

exua

l Tra

nsge

nder

Oth

er

sexu

ality

repr

esen

tatio

nN

o da

ta id

entifi

edN

/AYE

S

Braz

ilian

Nat

iona

l Pub

lic A

dmin

istra

tion

Scho

ol (c

ount

ry

spec

ific)

This

is a

vaila

ble

and

it is

relia

ble.

It is

dis

clos

ed d

iscr

etio

naril

y by

EN

AP.

Page 33: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School
Page 34: The International Civil Service Effectiveness (InCiSE) Index · The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School

The International Civil Service Effectiveness (InCiSE) Index project is a collaboration between the Blavatnik School of Government and the Institute for Government. It has been supported by the UK Civil Service and funded by the Open Society Foundations.