Improving Indicators to Inform PolicyKaye Husbands Fealing, Georgia Tech

Fred Gault, UNU-MERITBlue Sky III, Ghent, Belgium

21 September 2016

MAIN CONCLUSION

The main conclusion: There cannot be development of Blue Sky indicators without a framework in which to put them.

social returns to public and private expenditures

drivers of innovation that benefit the economy and society

geospatial hot spots for entrepreneurial activities

What are the...

countries that produce and receive the most commercializable scientific research

organizational structures or networks that spur bench-to-market activities

best practices for developing highly productive portfolios of research

data needed to answer these questions

Strategic Planning and PrioritizationChapter 8 Ch. 2 Ch. 3 Ch. 4 Ch. 5 Ch. 6 Ch. 7Recommendation 8-1—Data Quality Framework

Recommendation 8-2—Data Linking and Sharing

Rec. 2-2 Rec. 3-1 Recs. 4-24-3, 4-4

Recs. 5-1, 5-2, 5-3, 5-4

Recs. 6-2, 6-4, 6-5, 6-6

Rec. 7-5

Recommendation 8-3—Methodological Research

Rec. 2-1 Rec. 3-1 Recs. 4-2, 4-3, 4-4, 4-5

Recs.5-1, 5-2, 5-4

Recs. 6-1, 6-2, 6-3, 6-4, 6-5, 6-6, 6-7

Recs. 7-1, 7-2, 7-4, 7-6, 7-7

Recommendation 8-4—Use of NCSES and Other Data

Recs. 2-1, 2 2‑

Rec. 3-1

Rec. 4-2 Rec. 6-1 Recs. 7-3, 7-5

Recommendation 8-5—Chief Analyst

Rec. 3-1 Rec. 4-1 Recs. 6-2, 6-3

Recs. 7-2, 7-7

Strategic Planning and Prioritization• Data quality should be identified and made transparent to data

users, and methods of improving the data should also be published along with the data (R 8-1)

• Data linkage and sharing with other agencies, both inside and outside of government (R 8-2)

• A program of methodological research (R 8-3)• Building of a community of practice engaged in the use of data

managed by the agency, both its own and from other sources, which can support not only methodological but also research on new and revised ST&I indicators (R 8-4)

• Establishment of the position of a chief analyst who would interface with the users of the agency’s products to monitor changes in demand and would make recommendations on methods and data sources for the ST&I indicators program (R 8-5)

Snijkers et al. (2014, p. 2). Quality Diamond

Pathways for Building a Strategic Program

Need to engage new techniques to improve the statistical quality of the resulting metrics• Reengineering every component of the process

from survey development • from sourcing of raw data

• to publication processes and media for distribution

Pathways for Building a Strategic ProgramNeed to strengthen analytical capabilities,

improving abilities to: • Gauge the changing international

environment of innovation activities• Anticipate changing demand for STI

indicators, agilely prioritizing the timely release of indicators

• Develop and employ new methods for creating new, timely metrics

• Develop a talented workforce

Pathways for Building a Strategic Program

Need to network national & international collaboration of statistical agencies• Explore data-linking opportunities• Allow for the development of dynamic STI

indicators

Pathways for Building a Strategic Program

Need to use the blended community of practice• Use a grants program to get input from the research

community to improve the quality of ST&I internationally comparable indicators

• Private & public data and indicator providers• Not everything needs to be done by the agency• But ownership and continuity issues could prevail

MAIN CONCLUSION

The main conclusion: There cannot be development of Blue Sky indicators without a framework in which to put them.

Thank you!Contact information:

Kaye Husbands Fealingkhf@pubpolicy.gatech.edu

For more information and to download the report:http://www.nap.edu/catalog.php?record_id=18606