D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 1 of 53
Empowering Citizens to Transform European Public Administrations
Deliverable D7.5
Final Dissemination, communication and networking report
Editor(s): Judith Clifton, Gonzalo Llamosas García
Responsible Partner: University of Cantabria
Status-Version: Final – v1.0
Date: 30/09/2019
Distribution level (CO, PU): PU
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 2 of 53
Project Number: GA 726755
Project Title: CITADEL
Title of Deliverable: Final Dissemination, communication and networking report
Due Date of Delivery to the EC: 30/09/2019
Workpackage responsible for the Deliverable:
WP7 - Communication and Dissemination
Editor(s): University of Cantabria
Contributor(s): All partners
Reviewer(s): Leire Orue-Echevarria (TECNALIA)
Approved by: All Partners
Recommended/mandatory readers:
All WPs
Abstract: This deliverable will explain the dissemination and communication activities followed during the last year of the project as well as the results from these activities and will update project’s dissemination and communication plan respectively. This report will also contain the relevant activities executed to foster a close collaboration with projects related to CITADEL, as well as future networking plans. This document will also provide details about the annual activities with the Advisory group and outcomes of T6.4.
Keyword List: Communication, dissemination, networking, events, scientific publications, social networks
Licensing information: This work is licensed under Creative Commons Attribution-ShareAlike 3.0 Unported (CC BY-SA 3.0) http://creativecommons.org/licenses/by-sa/3.0/
Disclaimer This document reflects only the author’s views and neither Agency nor the Commission are responsible for any use that may be made of the information contained therein
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 3 of 53
Document Description
Document Revision History
Version Date Modifications Introduced
Modification Reason Modified by
v0.1 11/06/2019 First draft version (ToC) University of Cantabria, Innova Puglia
V0.2 25/06/2019 Second draft version (ToC) University of Cantabria, Innova Puglia
V0.3 30/08/2019 Comments and suggestions received by consortium partners
All partners
V0.5 09/09/2019 Pre-final document University of Cantabria, Innova Puglia
V0.6 23/09/2019 Modifications after the internal review University of Cantabria, Innova Puglia
V1.0 26/09/2019 Ready for submission TECNALIA
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 4 of 53
Table of Contents
Table of Contents .......................................................................................................................... 4
List of Figures ................................................................................................................................ 5
List of Tables .................................................................................................................................. 5
Terms and abbreviations ............................................................................................................... 6
Executive Summary ....................................................................................................................... 7
1 Introduction .......................................................................................................................... 8
1.1 About this deliverable .................................................................................................. 9
1.2 Document structure ..................................................................................................... 9
2 Considerations of overall CITADEL results .......................................................................... 11
2.1.1 Main CITADEL dissemination results ..................................................................... 11
2.1.2 Main CITADEL communication results .................................................................. 11
2.1.3 Main CITADEL networking results ......................................................................... 12
3 Elaboration and provisioning of dissemination material .................................................... 12
3.1 Website updates ........................................................................................................ 12
3.2 Dissemination materials ............................................................................................ 13
3.2.1 Brochure ................................................................................................................ 13
3.2.2 Demonstrative Videos of CITADEL ecosystem and promotional video ................. 14
3.3 Attended and organized events ................................................................................. 15
3.4 Scientific and business publications .......................................................................... 17
4 Analytic trends and considerations in monitoring and evaluation of main dissemination activities during the project lifetime ........................................................................................... 26
4.1 Overview .................................................................................................................... 26
4.2 Attended and organized events ................................................................................. 26
4.3 Scientific and Business Publications .......................................................................... 28
5 Elaboration and provisioning of communication material in the 3rd year .......................... 30
5.1 Social media measures .............................................................................................. 30
5.2 Materials .................................................................................................................... 30
5.3 Press releases ............................................................................................................. 31
5.4 Blog posts ................................................................................................................... 31
6 Analytic trends and considerations in monitoring and evaluation of main communication activities during the project lifetime ........................................................................................... 33
6.1 Analytics of project’s web site ................................................................................... 33
6.2 Social Network activities ............................................................................................ 36
7 Advisory Board meetings .................................................................................................... 43
8 Collaboration and networking activities ............................................................................. 43
8.1 Considerations on collaboration activities with EU funded projects ........................ 43
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 5 of 53
8.2 CITADEL focus groups ................................................................................................ 45
8.3 Further collaborations and reuse of CITADEL achievements beyond the end of the project 45
9 Final conclusions ................................................................................................................. 46
Annex 1 – Press release ............................................................................................................... 47
Annex 2 – Number of access to the project website from each country ................................... 50
List of Figures
FIGURE 1. A SCREEN OF THE PROMOTIONAL VIDEO ................................................................................ 15 FIGURE 2. CITADEL FEATURED IN CORDIS. ........................................................................................ 18 FIGURE 3. TYPES OF EVENTS BY YEAR ................................................................................................... 27 FIGURE 4. FREQUENCY OF ATTENDED EVENTS BY YEAR ........................................................................... 27 FIGURE 5. LEVEL OF IMPACT OF SCIENTIFIC PUBLICATIONS ...................................................................... 28 FIGURE 6. BUSINESS PUBLICATION BY YEAR .......................................................................................... 29 FIGURE 7. CITADEL AGENDA ............................................................................................................ 31 FIGURE 8. MAP CHART OF ACCESS BY COUNTRIES .................................................................................. 34 FIGURE 9. TREND CHART OF ACCESS MONTH BY MONTH ......................................................................... 34 FIGURE 10. CHARTS OF WEBSITE CONTENT ........................................................................................... 36 FIGURE 11. BART CHART OF TWITTER FOLLOWERS FROM EACH COUNTRY .................................................. 39 FIGURE 12. BAR CHART OF LINKEDIN FOLLOWERS FROM EACH COUNTRY................................................... 40 FIGURE 13. TREND CHART OF ENGAGEMENT IN TWITTER ........................................................................ 40 FIGURE 14. TREND CHART OF ENGAGEMENT IN LINKEDIN IN LAST 6 MONTHS............................................. 41 FIGURE 15. PIE CHART OF USER CATEGORIES IN TWITTER ........................................................................ 42 FIGURE 16. PIE CHART OF USER CATEGORIES IN LINKEDIN ....................................................................... 42 FIGURE 17. SLACK COMMUNITY CREATED FOR ALL CULT-COOP-11 PROJECTS .......................................... 44
List of Tables
TABLE 1. EXPECTED AND ACHIEVED OBJECTIVES AT THE END OF THE PROJECT ............................................... 8 TABLE 2. WEBSITE UPDATES IN THE 3ER YEAR ........................................................................................ 12 TABLE 3. LIST OF NEWSLETTERS PUBLISHED DURING THE PROJECT ............................................................ 14 TABLE 4. OTHER EVENTS ATTENDED/ORGANIZED IN THE 3ER YEAR ............................................................ 16 TABLE 5. LIST OF PUBLISHED ARTICLES IN THE SECOND YEAR OF PROJECT ................................................... 19 TABLE 6. TYPE OF ANALYSIS AND MEASURE OF DISSEMINATION................................................................ 26 TABLE 7. SOCIAL MEDIA NUMBERS IN THE 3ER YEAR (AS OF 15.09.2019) .................................................. 30 TABLE 8. LIST OF BLOGPOSTS PUBLISHED DURING THE PROJECT ................................................................ 32 TABLE 9. TYPE OF ANALYSES/MEAN OF COMMUNICATION ...................................................................... 33 TABLE 10. NUMBER OF ACCESS FROM EACH COUNTRY (FIRST 10 COUNTRIES) ............................................ 33 TABLE 11. TYPE OF WEBSITE CONTENT ................................................................................................ 35 TABLE 12. NUMBER OF TWITTER FOLLOWERS FROM EACH COUNTRY ........................................................ 36 TABLE 13. NUMBER OF LINKEDIN FOLLOWERS FROM EACH COUNTRY ....................................................... 37 TABLE 14. NUMBER OF FOLLOWERS/FRIENDS BY CATEGORY.................................................................... 41 TABLE 15. NUMBER OF ACCESS TO THE PROJECT WEBSITE FROM EACH COUNTRY ........................................ 50
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 6 of 53
Terms and abbreviations
EC European Commission
SJR SCImago Journal Rank
CDB Common Dissemination Booster
ICT Information and Communication Technologies
CIP Communicating Interacting Processes
NGOs Non-governmental organization
REA Research Executive Agency
FP7 7th Framework Programme for Research and Technological Development
PAs Public Administrations
PO Project officer
EU European Union
SMEs Medium-sized enterprises
JRC Joint Research Centre
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 7 of 53
Executive Summary
This dissemination, communication, and networking report collects information as regards activities carried out by CITADEL partners across the last year of project. In this third year (October 2018 – September 2019) CITADEL project has achieved such level of maturity that has allowed a great development in outputs. Several scientific and business publications have been published, accepted and others are still under review which will be important project results in a near future. In other cases, this knowledge has already been transferred to the scientific world and society through international conferences, workshops, seminars and other lecturing events. The CITADEL ecosystem does not finish with the end of the project, but also opens up multiple opportunities for expansion through the acquired knowledge during these three years as well as the possibilities offered by this accumulated experience for future research projects.
As the previous year, this deliverable includes relevant information as regards three main contexts: dissemination, communication and networking. As a novelty, this also includes a particular section on trends and considerations in terms of results in all project lifetime. The results are clearly explained using a simplified categorization system.
This delivery follows the advices and recommendations implemented in the second dissemination, communication, and networking report as result of the first project review held in November 2017 in Brussels.
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 8 of 53
1 Introduction
This third dissemination, communication and networking report reflects the final contributions that each CITADEL partner has made across this last year. This deliverable includes, as a new feature, a framework that analyzes the main trends and consideration in monitoring and evaluation of main dissemination activities carried out during the project lifetime. In terms of dissemination, the CITADEL project has achieved high impact in scientific publications as regards the involvement of citizens in public services’ co-creation and public-private partnership capabilities. In so doing, CITADEL partners have taken advantage of the CITADEL approach to explore different public administration issues concerning how to make citizens more involved in public services. The experience obtained from participation in multiple conferences, workshops, and seminars is that CITADEL results are very relevant and scientifically valued. Many publications, which have been achieved during this project, and some that remain to be achieved, have been possible to the work of CITADEL partners in publicizing project values.
This third year of project has improved the results obtained during the first and second years of project, both in terms of publications as well as scientific impact and quality. Scientific publications have been obtained in journals of the SJR first quartile such as Public Management Review and Strategic Management Journal. In addition, during this year, renowned academic workshops, organized and funded by CITADEL, have taken place, such as the IIAS Study Group on Coproduction of Public Services Conference This conference is the capstone in a process of extensive research on public services’ co-creation and it has hailed as a success by participants and organizers alike. Besides this event, CITADEL partners have participated in other international conferences related to public administration such as EGOV 2019, EGPA Conference 2019 in Belfast, and IRSPM Annual Conference 2018 in Edinburgh. Moreover, CITADEL partners have organized conferences more focused on public servants and other stakeholders such as the Riga event organized by VARAM and the Bari conference organized by InnovaPuglia, which have put in value the results and knowledge generated in the project.
All the activities registered in this deliverable have been collected by dissemination, communication, and networking reports provided to CITADEL partners. These reports are to be provided along with a file containing “evidence based on attended events” to prove that specific reported activities have been actually developed by partners. CITADEL dissemination, communication and, networking outcomes are therefore the basis for reflecting the project’s progress across its lifetime.
Table 1. Expected and achieved objectives at the end of the project
Expected objectives Achieved objectives
To widely disseminate and communicate the project concept, developments and findings to identified stakeholders (i.e. industry, academia, Public Authorities) using effective communication means and strategies.
Effective communication tools and strategies have been used to widely disseminate and communicate the project concept. Some examples are the following: the CITADEL website, social networking, dissemination materials, promotional CITADEL videos on Youtube, prestigious conferences and events, scientific publications in high impact journals and so on.
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 9 of 53
Expected objectives Achieved objectives
To ensure that all the relevant communities will be reached out to in an interactive way, integrating their feedback at key timestamps of the project: namely specification requirements, market analysis, design, development and evaluation periods, as well as during exploitation tasks.
Different dissemination and communication channels are used by CITADEL partner to achieve several communities in an interactive way: Blogposts, Youtube, Facebook, Twitter, LinkedIn, academic publications, business publications and so on.
To create and publish scientific contributions valuable for the research community.
Top-ranking publications in scientific journals located in the Q1 JCR
• To collaborate with other European projects in the relevant topics of CITADEL.
CITADEL has collaborated with CULT-COOP-11 project (TROPICO, CO-VAL and CO-GOV).
To participate in appropriate European and worldwide events (workshops, seminars, conferences, etc.) targeted at industry and academia with the ultimate goal not only to showcase CITADEL results and subsequently to prepare the way for a successful commercial exploitation of the project outcomes, but also to create a CITADEL community mobilizing its members whenever it is needed (requirements definition process, evaluation period, etc.).
Many scientific and business events have been attended and organized by CITADEL partners. Around 80 events held in more than 15 countries throughout Europe, America, Asia and Oceania.
1.1 About this deliverable
This document distinguishes between dissemination, communication and networking activities. First, dissemination activities consist of scientific articles, business publications, conferences and other events. Also, this includes a description of the material used by partners in the development of this activities. Tables in this section include original information on type of event, partners, country, link or reference to the activity and so on.
Second, CITADEL communication activities follow the principle of communication as clear and easy as possible. The communication strategy is focused on stimulating people to be informed about CITADEL events and promote active participation from them. To this end, the project has gone one step forward with the launch of a series of blogposts published by the partners, which have been used as an inbound marketing tool. Finally, to be active and look for interaction in websites and social networks are part of the steps to do a good communication activity.
Third, this document reports collaboration and networking activities that open new opportunities up to the potential of exploitation and scientific value of CITADEL project results.
1.2 Document structure
This deliverable is structured as follows. Section 2 provides considerations of overall CITADEL results in terms of dissemination, communication and networking. Section 3 and 4 include information related to dissemination aspects such as specific dissemination material, attended and organized events and scientific and business publications, and analytic trends and considerations as regards monitoring and evaluation of main dissemination activities during the
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 10 of 53
project lifetime. The communication material, the follow-up of communication activities, and the main analytical trends and considerations regarding communication activities during the project lifetime are presented in Section 5 and 6, respectively. Finally, section 7 summarizes the efforts of CITADEL partners for expanding the CITADEL community, seeking for networks and other collaborative initiatives with other funded projects. The conclusion reflects all the remarks and ideas included in these sections.
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 11 of 53
2 Considerations of overall CITADEL results
Based on the need that the CITADEL project aims to solve, the main communication objectives have been the following:
1) To promote the project’s activities and aims and contribute to the uptake of its results 2) To support the relevance of our audience among potential researchers interested in the
topic. 3) To engage in a two-way communication with the scientific community, potential
partners and European Commission’s workers, end-users, policy-makers, and particularly, citizens.
4) To raise public awareness on co-creation activities in which the role of digitalization has an important role to improve the public service provision.
2.1.1 Main CITADEL dissemination results
This section reflects the dissemination results in terms of objectives achieved since the beginning of the project. The implementation of the Common Dissemination Booster (CDB) in the project has been a positive action to enhance our dissemination results in terms of identifying a portfolio of results that shows how best to disseminate to end-users, with an eye on exploitation opportunities. As regards attended and organized events, these results demonstrate a clear growth, particularly in the quality of the attended conferences at scientific level. H2020 CITADEL project has achieved a high level of recognition among public administration researchers as it has been proved in scientific conferences such as EGPA, EGOV 2019, IIAS Study Group Conference, EuroAsia SPI 2018, the annual IRSPM Conference 2018 and so on. As regards scientific and business publications, CITADEL project has reached scientific excellence within the field of public administration and public services’ co-production. CITADEL scientific articles have been published in journals such as Strategic Management Journal, Public Management Review, Global Policy, Journal of European Public Policy, International Review of Administrative Sciences, Information Polity, and Media Communication. Besides these publications, there are other studies still under revision that are expected to be published in the following months.
2.1.2 Main CITADEL communication results
The outputs created during the last three years of project needs to be communicated through the use of effective channels according to the specific target audience to be achieved as well as the features of each of these channels. The implementation of the Common Dissemination Booster (CDB) has allowed to improve the analysis of our communication results. For example, the application of this tool has introduced different approaches such as temporal and geographical analysis. As regards the project’s web site, there has been a significant increase in the number of visits obtained after the introduction of blogposts. As regards social network activities, statistics reflects the engagement of users in terms of interactions with posts on Twitter and Facebook. The analysis carried out in section 6 reflects a predominance of the country of the partner involved in the project.
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 12 of 53
2.1.3 Main CITADEL networking results
As result of the recommendations provided by the CDB and the participation of CITADEL in the Common Dissemination Booster (CDB), important progress has been made in terms of networking activities. CITADEL initiated and has taken part in diverse networking activities performed together other EU funded projects such as TROPICO, CO-VAL, ENLARGE and CO-GOV. The central topic of these projects, the co-creation of public services, has been the main pivot in the backbone. Besides these networking initiatives, there has been other collaborations with CULT-COOP-11 projects as regards exchange practices. As regards partners, VARAM and Latvia University have shown interest in exploiting synergies with other projects such as the Latvian School of Public Administration focused on the use of ICTs in training purposes. VARAM and Latvia University has contributed to other collaborative initiatives with EU Interreg Europe programme project SKILLS+ focused on advancing public policies promoting ICT skills among SMEs.
3 Elaboration and provisioning of dissemination material
3.1 Website updates
During the third year, the project website was updated monthly or bi-monthly periodically. The updates have included new blogposts, the updating of news as regards the project and the inclusion of additional dissemination and communication materials. Table 1 shows all the project website’s updates in the last year.
Table 2. Website updates in the 3er year
Month Type of contents Links
M25 – October 2018
• News
• Blogpost
• www.citadel-h2020.eu/news/varam-actions-improve-use-case
• www.citadel-h2020.eu/news/latest-citadel-dissemination-and-networking-activities
• www.citadel-h2020.eu/news/more-citadel-results-available-and-next-steps
M26 – November 2018
• Blogpost • www.citadel-h2020.eu/news/digimat-%E2%80%93-egovernment-maturity-assessment
M27 – December 2018
• Blogpost • www.citadel-h2020.eu/news/historical-coproduction-excursus-and-citadel-latvian-case
M28 – January 2019
• News
• Blogpost
• www.citadel-h2020.eu/news/collaboration-municipality-bari
• www.citadel-h2020.eu/news/citadel-dissemination-and-networking-glance-new-initiatives-progress
• www.citadel-h2020.eu/news/co-creation-latvia-actions-numbers-and-consideration-varam
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 13 of 53
Month Type of contents Links
M29 – February 2019
• Blogpost • www.citadel-h2020.eu/news/co-creation-puglia-role-house-technical-partner-innovation-and-development-public-administration
M30 – March 2019
• News
• Blogpost
• www.citadel-h2020.eu/news/citadel-achievements-smart-working-italy
• www.citadel-h2020.eu/news/iias-study-group-2019-citadel-will-be-present-two-partners-event
• www.citadel-h2020.eu/news/citadel-key-performance-indicator-toolbox-calculating-kpis-using-linked-open-data
M31 – April 2019
• Blogpost • www.citadel-h2020.eu/news/coming-soon-citadel-legal-vademecum-practical-answer-legal-hurdles-pa-might-face-when-transforming-their-services
M32 – May 2019
• Blogpost
• Brochure
• www.citadel-h2020.eu/news/forthcoming-article-ict-enabled-co-production-public-services-barriers-and-enablers-systematic-review
• www.citadel-h2020.eu/sites/citadel.drupal.pulsartecnalia.com/files/documents/CITADEL_brochure_tools_0.pdf
M34 – July 2019
• News
• Blogpost
• www.citadel-h2020.eu/news/latest-citadel-dissemination-and-networking-activities-0
• www.citadel-h2020.eu/news/citadel-and-future-government
M36 -September 2019
• News
• Blogpost
• Press release
• www.citadel-h2020.eu/news/dissemination-activities-related-citadel
• www.citadel-h2020.eu/news/what-about-antwerp-use-case
• www.citadel-h2020.eu/sites/citadel.drupal.pulsartecnalia.com/files/documents/press-release-CITADEL.pdf
3.2 Dissemination materials
3.2.1 Brochure
The final version of the CITADEL ecosystem and the maturity reached by the implementation of the use cases has allowed to create a brochure that outlines the tools and the methodologies processed in the ecosystem as well as the final target of the use cases. The brochure was initially distributed to all participants during the meeting "Capire per poi Trasformare" (see section 3.3) held in Bari on 12th April 2019. Furthermore, the brochure was disseminated online on the social media pages of the project and on the Slideshare platform on www.slideshare.net/Citadelh2020/citadel-brochure-tools-155.644.500.
During the month of July of every year a newsletter was prepared including all the most important innovations and achievements in the project and accordingly published on the project’s website. Table 2 shows the main topics covered in the releases.
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 14 of 53
Table 3. List of newsletters published during the project
Release Link Topics
1st www.citadel-h2020.eu/documents2/first-newsletter-citadel
• CITADEL KICK OFF AND GENERAL ASSEMBLIES
• DISSEMINATION HIGHLIGHTS
• Where can you meet CITADEL next?
2nd www.citadel-h2020.eu/documents2/citadel-newsletter-2-online
• A Vignette Study experiment concerning the effects of input legitimacy on public officials’ willingness to care about public participation.
• CITADEL tools for users engagement and e-participation as a support in PAs digital transformation
• Monthly updated blogposts to favour debate and awareness of CITADEL ecosystem development.
• The co-creation methodology in CITADEL
• CITADEL Dissemination, Communication and Networking actions and prosecutions from 2017 to 2018.
3rd www.citadel-h2020.eu/documents2/available-citadel-newsletter-3
• The final scenarios of the usecase: the interaction with the Ecosystem and the estimated improvements
• CITADEL Ecosystem: tools improvements and Co-Creation methodology tool
• Blogposts, Materials and other Dissemination and Communication actions from 2018 to 2019 to favour debate and awareness of CITADEL ecosystem development
• CITADEL Networking: actions for the prosecution beyond the project lifetime.
3.2.2 Demonstrative Videos of CITADEL ecosystem and promotional video
In order to share the CITADEL knowledge with a non-technological specialized audience in a simple way, a demonstrative video has been created to explain the execution flow of the CIP tool implemented in the Ecosystem. These videos were developed using the presentation or the cartoon style with a total duration of about 2 minutes each one. The demonstrative videos have been uploaded to the CITADEL Youtube channel (link at www.youtube.com/channel/UCEel62sFX0Yo484q42rtQJA) and disseminated by the project social pages.
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 15 of 53
In addition, CITADEL partners have created a promotional video aimed at involving general audience and other social groups which may find difficulties to understand and use user stories dealing with everyday problems. The promotional video has also been uploaded to the CITADEL YouTube channel and the link is available at www.youtube.com/watch?v=E1SQlZkdX5E and www.youtube.com/watch?v=RQBB-WM9V0I for the subtitled version.
Figure 1. A screen of the promotional video
A video tutorial explaining the DIGIMAT is also available on Youtube. This video was aimed to be presented in the ReSPA Seasonal School on Digital Transformation in Montenegro and introduces the CITADEL project and how the eGovernment maturity model has been designed. The link of this video is: https://www.youtube.com/watch?v=zQJPRviJYDQ
3.3 Attended and organized events
The attended and organized events allowed the discussion of results and achievements of the project. In particular, the most significant events are described below, while other events are collected in the attaching table. A brief recap of the CITADEL events held in Riga and Bari, reporting the type of audience, the topics and purposes of the meetings, the awareness of the participating public of the potentialities of CITADEL ecosystem were provided by partners.
• Capire per poi Trasformare: this event was organized in Bari (Italy) on 12th April 2019 by CITADEL Italian partners with the aim to share the Ecosystem tools and methodologies. The event includes the lectures of Andrea Servida (Head of the Task Force Legislation Team, Directorate General Communication Networks, Content & Technology, European Commission), Marisa Escalante as technical coordinator of the project, and Inese Grospine who recounted the experience of her national use case. At the end of the event, a focus group (see section 7.2) was held during this event in which participants could express their ideas on the situation of digital public services in Regione Puglia.
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 16 of 53
To engage local stakeholders (representatives from other institutions outside VARAM, partners and NGOs) in the process, a conference was organized in Riga in 2019 to disseminate CITADEL approach and collect insights to shape further CITADEL activities:
• In January 2019, VARAM organized a conference on designing services based on different aspects: user needs, CITADEL co-creation approach, and other features of the citizen engagement. Presentations were held by CITADEL partners, as well as UK representatives, and local presenters from Latvia. Around 100 people from approximately 70 institutions, NGOs and some private companies attended the conference and more than 200 viewed it online.
• Other activities were also held within VARAM use case in the project where different stakeholders were engaged. For example, co-creation sessions with end-users at national and local level (www.latvija.lv) and meetings with other authorities and institutions of the Republic of Latvia. These activities are further described in D5.3. “Final technical Implementation of the use cases development”. In table 4 other attended events are reported.
Table 4. Other events attended/organized in the 3er year
Attended events Location Partner Date
Annual work conference at Netherlands institute of Government
Netherlands KUL 1-2 November 2018
Organization of H2020 CITADEL GA Meeting, with especial focus on public services’ co-creation results
Spain UC 17-18 September 2018
Symposium Digital transformation: a government (r)evolution
Belgium KUL 11 December 2018
Workshop-cocreation session with entrepreneurs about improvements in portal latvija.lv in collaboration with Ministry of Economics (EM) and Investment and Development Agency of Latvia (LIAA)
Latvia VARAM 11 October 2018
Workshop-cocreation session with computer science students about improvements in portal latvija.lv
Latvia VARAM 18 October 2018
Comune di Bari - Sperimentazione Lavoro Agile su DLT (blockchain)
Italy FINCONS 10 January 2019
Pakalpojumu koprade. Klientu vajadzìbu izpète
Latvia VARAM 10 December 2018
VARAM workshop about user involvement and data protection in (smart) city
Latvia VARAM-KUL-TECNALIA
18 January 2019
Attended one seminar to regional municipalities about public service delivery and presented presentation about co-creation and user centric service design
Latvia VARAM 23 January 2019
CITADEL INNOVATION PLATFORM presented by InnovaPuglia to the
Italy InnovaPuglia 4 events in January 2019
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 17 of 53
Attended events Location Partner Date
municipalities of Capurso, Acquaviva and Conversano and the Regione Puglia citizens participation office
EGOV 2019 - Joint conference EGOV-CedEM-ePART, University of Camerino
Italy KUL 2-5 September 2019
EGPA, Queen’s University Belfast United Kingdom
KUL 11-13 September 2019
Public Governance Institute, KU Leuven – Lunch seminars
Belgium KUL 14 May 2019
IIAS Study Group on Coproduction of Public Services Conference Belgium UC 28 May 2019
International Conference “Economy and Business”
Latvia LU 20-24 August 2019
International scientific conference: RSU Conference "Knowledge for Practice" and "Places"
Latvia LU 1 April 2019
Guest lecture on co-creation at University of Applied Sciences and Arts Northwestern Switzerland, Business Administration (International Management) bachelor’s degree programme)
Latvia LU 19 September 2019
3.4 Scientific and business publications
Scientific publications have significant importance in dissemination activities as regards CITADEL project. These project’s outcomes approach CITADEL project to a scientific audience, increasing interactions with other researchers, and creating new synergies.
During the third year of the project, the IAAS Study Group event held in Leuven in May 2019 was dedicated to the co-creation process. This conference included 4 scientific papers written by CITADEL partners.
Some CITADEL outcomes were also considered in the paper "Behind the Scenes of Coproduction of Smart Mobility: Evidence from a Public Values' Perspective" that received the Best Paper Award at the eGov2019 conference held in Italy in September 2019.
Another relevant publication was “Data Harvesting, Curation and Fusion Model to Support Public Service Recommendations for e-Governments”: the publication addresses the heterogeneity problem common to sources and formats of data related to e-Government services. This provides an architectural model that allows harvesting data from various sources, curating datasets that originate from a multitude of formats and fusing them into semantically enhanced data, on which key performance indicators for the utility of e-Government services can be calculated.
CITADEL is featured, as part of 10 additional e-government projects in CORDIS, in a Results Pack. The results pack is a thematic collection of project results tailored to the needs of specialized audiences who can further exploit them.
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 18 of 53
The article is included in the Results Pack on eGovernment, based on a request from REA and DG CONNECT and can be found in the link https://cordis.europa.eu/project/rcn/205682/brief/en
Figure 2. CITADEL featured in CORDIS.
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 19 of 53
Table 5. List of published articles in the second year of project
Title Name of authors and organizations
Title of the periodical or the series
Number, data or frequency
Publisher Place of publication
Year of publication
Relevant pages
Permanent identifiers (if available)
Is/Will open access be provided to this publication?
Technology Readiness and Acceptance Model” as a Predictor for the Use Intention of Data Standards in Smart Cities
Raf Buyle, Mathias Van Compernolle, Eveline Vlassenroot, Ziggy Vanlishout, Peter Mechant, Erik Mannens
Vol 6, No 4 (2018): E-Government and Smart Cities: Theoretical Reflections and Case Studies
Media and Communication
2018 https://bit.ly/2mg4vvd
Y
Co-creatie van overheidsdiensten door burgers, private organisaties en overheid samen: strooit de AVG roet in het eten?
Pieter Gryffroy Tijdschrift Privacy & Persoonsgegevens (Politeia)
2019 6-13 N
Factors influencing citizens’ co-production of environment services: a multi-level analysis
José Manuel Alonso, Rhys Andrews, Judith Clifton and Daniel Díaz-Fuentes
Public Management Review
Public Management Review
2019 https://doi.org/10.1080/14719037.2019.1619806
N
Explaining citizens’ co-production through
Judith Clifton, Daniel Díaz Fuentes &
IIAS Study Group on ‘Coproduction of Public Services’
2019 https://soc.kuleuven.be/io/english/researc
N
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 20 of 53
Title Name of authors and organizations
Title of the periodical or the series
Number, data or frequency
Publisher Place of publication
Year of publication
Relevant pages
Permanent identifiers (if available)
Is/Will open access be provided to this publication?
ICTs in health: A multi-level model analysis
Gonzalo Llamosas Garcia
seventh annual conference, Leuven, Belgium, 28 May 2019.
h/iias-conference/programme
Traditional vs ICT-enabled co-production in healthcare: The case of Northern Ireland
Judith Clifton, Daniel Díaz-Fuentes & Gonzalo Llamosas-García
Public Management Review (Under review)
Forthcoming
N
ICT-enabled co-production of public services: Barriers and enablers. A systematic review
Judith Clifton, Daniel Díaz-Fuentes & Gonzalo Llamosas-García
Information Polity
2019 https://content.iospress.com/articles/information-polity/ip190122
N
A behavioral perspective on saving decisions. Empirical evidence for policymakers in the European Union
Judith Clifton, Daniel Díaz-Fuentes & Gonzalo Llamosas-García
Global Policy 2019 N
Doctoral dissertation: Essays on Citizens’ Economic Behavior in
Gonzalo Llamosas-Garcia
Universidad de Oviedo, Universidad de
Santander (Spain)
September (2019)
Y
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 21 of 53
Title Name of authors and organizations
Title of the periodical or the series
Number, data or frequency
Publisher Place of publication
Year of publication
Relevant pages
Permanent identifiers (if available)
Is/Will open access be provided to this publication?
Services of Public Interest. A European Union Perspective
Cantabria & Universidad del País Vasco
Explaining Co-production in Compulsory Secondary Education by Children and Parents: the Influence of ICTs
Judith Clifton, Daniel Díaz Fuentes & Marcos Fernández Gutiérrez
Forthcoming
https://soc.kuleuven.be/io/english/research/iias-conference/programme
Governance by targets and the performance of cross-sector partnerships: Do partner diversity and partnership capabilities matter?
José Manuel Alonso & Rhys Andrews
Strategic Management Journal
2018 https://doi.org/10.1002/smj.2959
Y
Bari, Comune sperimenta lo smart working: dipendenti al
Fincons team Web 2019 https://bit.ly/2meEKLH
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 22 of 53
Title Name of authors and organizations
Title of the periodical or the series
Number, data or frequency
Publisher Place of publication
Year of publication
Relevant pages
Permanent identifiers (if available)
Is/Will open access be provided to this publication?
lavoro fuori ufficio 1 giorno a settimana
https://bit.ly/2kMKtrR https://bit.ly/2lOmsko https://bit.ly/2kBhoQb https://bit.ly/2kM4dM2 https://bit.ly/2kBhvLB https://bit.ly/2meEKLH https://bit.ly/2lVdW2N
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 23 of 53
Title Name of authors and organizations
Title of the periodical or the series
Number, data or frequency
Publisher Place of publication
Year of publication
Relevant pages
Permanent identifiers (if available)
Is/Will open access be provided to this publication?
https://bit.ly/2kKWBJU https://bit.ly/2lOmybK https://bit.ly/2kM6TJD https://bit.ly/2lQuKIx https://bit.ly/2lOmAAo
CITADEL: Un'esperienza europea verso il 2021-2027
Marco Di Ciano web 2019 Published on http://www.sistema.puglia.it/
Feasibility Study of Innovative Public Policy Client-Accordance Index
Romans Putans IIAS Study Group on ‘Coproduction of Public Services’ seventh annual
2019
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 24 of 53
Title Name of authors and organizations
Title of the periodical or the series
Number, data or frequency
Publisher Place of publication
Year of publication
Relevant pages
Permanent identifiers (if available)
Is/Will open access be provided to this publication?
conference, Leuven, Belgium, 28 May 2019.
From Design to Service Design, and Co-production
Solvita Zarina IIAS Study Group on ‘Coproduction of Public Services’ seventh annual conference, Leuven, Belgium, 28 May 2019.
2019
Digitalization in the Regional Context: The Case of E-Government Services in Latvia.
Dr. Muravska Tatjana, Dr, Stacenko Sergejs, Dr. Zeibote Zane
Studia Europejskie – Studies in European Affairs
Latvia 2019 ISSN 1428-149X
N
Behind the Scenes of Coproduction of Smart Mobility: Evidence from a Public Values’ Perspective.
Ana Paula Rodriguez SpringerLink 2019 DOI https://doi.org/10.1007/978-3-030-27325-5_26 -- Print ISBN 978-3-030-27324-8 -- Online ISBN 978-3-030-27325-5
Y
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 25 of 53
Title Name of authors and organizations
Title of the periodical or the series
Number, data or frequency
Publisher Place of publication
Year of publication
Relevant pages
Permanent identifiers (if available)
Is/Will open access be provided to this publication?
E-government and smart cities: theoretical reflections and case studies
Peter Mechant,. & N. Walravens
4 Media & Communication
2018 119-122 https://www.cogitatiopress.com/mediaandcommunication/article/view/1848
Y
Explaining non-adoption of electronic government services by citizens. A study among non-users of public e-services in Latvia.
Steven Van de Walle, Zane Zeibote, Sergejs Stacenko, Tatjana, Muravska, Koen Mgchelbrink
4 Information Polity
2018 399-409 https://content.iospress.com/articles/information-polity/ip170069
N
Digitalization in the Regional Context: The Case of E-Government Services in Latvia
T Muravska, S Stacenko, Zane Zeibote
4 Studies in European Affairs
2018 251-267 ISSN 1428-149X
N
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 26 of 53
4 Analytic trends and considerations in monitoring and evaluation of main dissemination activities during the project lifetime
4.1 Overview
In this section, the objective is to analyze the main trends that have characterized the data collected by partners across the lifetime of the project as regards to dissemination activities. The purpose of the analysis seeks to reflect the general trends in terms of publications as well as attended and organized events. In particular, the attention is first put on the analysis of attended and organized events in terms of year and country. Secondly, this section reflects an analysis on scientific publications by year, scientific impact and business publications by year. This analytical framework aims therefore at providing comparative knowledge to identify the evolution of the project over time. In particular, this stresses the importance of evaluating activities related to dissemination as regards the requests of the reviewers who stressed during the first year the need of a better follow-up approach. As result of these recommendations and advices, CITADEL decided to incorporate, following the indication provided by each project partner, an initiative promoted by EC to support FP7 that allows to amplify these dissemination activities thanks to a direct interaction with other projects (project clusters).
Table 6. Type of analysis and measure of dissemination
Type of analysis
Measures of dissemination
Frequency by year
Frequency by partner
Scientific relevance of publications
Event locations
Business and Scientific publications
X X
Attended and organized events
X X X
4.2 Attended and organized events
In this section, we evaluate the main trends as regards attended and organized events for the lifetime of the project. We can observe in Figure 3 that the second year of project was highly prolific in events’ activities in comparison with the first and second years of project. During this period, CITADEL partners organized or attended 39 events, among which, we find conferences, seminars, workshops, lectures, experiments, focus groups and others. Figure 3 shows the main trends related to different types of events by partners across the lifetime of project. For example, it can be observed that attendance to conferences, seminars and workshops was more important during the first and second year of project than the third one. This can be explained because during the last year of project CITADEL partners were more focused on the consolidation and publication of results.
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 27 of 53
Figure 3. Types of events by year
As regards to events by country, Figure 4 reports the frequency of attended and organized events across different countries. The results show that CITADEL partners mainly attended conferences and workshops in European Union’s countries such as Belgium, Latvia and Spain. We also can highlight attended events outside Europe such as Switzerland, Canada and China. Regarding specific features of these events by period of time, most events in Belgium, for example, were held in the second year of project, in Spain during the first year, and in Latvia during the third year of project. According to those events attended by CITADEL partners in countries outside the EU, they were held specifically during the second year of project.
Figure 4. Frequency of attended events by year
0
2
4
6
8
10
12
14
16
2017 2018 2019
Conference Seminar Workshop Lecture
Experiment Focus group Others
21
39
19
2017 2018 2019
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 28 of 53
4.3 Scientific and Business Publications
In this section, we include the main trends for scientific and business publications. We begin reporting a summary of the main results by year and impact of scientific publications. As regards the impact of scientific publications, we measure this impact by distinguishing between high impact, medium impact and low impact. High impact is related to scientific journals including an impact factor located between the first and second SJR quartiles (Scimago Journal Ranking). Medium Impact is related to scientific journals with an impact factor located between the third and four SJR quartiles. Finally, low impact is associated to scientific journals whose impact is not evaluated by SJR, but they included topics with a scientific interest or relevance for science.
In this vein, CITADEL partners have published during the lifetime of the project different scientific articles in high impact journals such as Strategic Management Journal, Public Management Review, Global Policy, Journal of European Public Policy, and International Review of Administrative Sciences. They have also published in other journals with a medium impact factor such as Information Polity and Media and Communication. Finally, other publications have been accepted or published in low impact journals such as International Journal of e-Planning Research, Studies in European Affairs, University of Latvia Press and so on.
Figure 5. Level of Impact of scientific publications
Moving now onto business publications, Figure 6 shows the distribution of business publications across the lifetime of the project. It should be noted that most business publications were carried out in the first year of project. CITADEL partners have an active role in updating posts in blogs, websites, and other Internet platforms related to CITADEL consortium and its ecosystem, particularly after the deployment of the CITADEL blog in the website.
8
6
6
Low Medium High
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 29 of 53
Figure 6. Business publication by year
14
5
2
2017 2018 2019
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 30 of 53
5 Elaboration and provisioning of communication material in the 3rd year
5.1 Social media measures
During the third year of the project, Communication activities were carried out on social networks, using the main social platforms such as Twitter, LinkedIn, Facebook, Slideshare, and Youtube. The following summary table shows all the measurements in accordance with the 4C’s model imported during the second year of the project, following the recommendation received in reporting period 1 to address the ‘so what’ question.
Table 7. Social media numbers in the 3er year (as of 15.09.2019)
Social Medium
Brand Awareness Brand Engagement Word of Mouth
Twitter Number of tweets about the brand
328 Number of followers 285 Number of retweets 304
LinkedIn Number of members
19 Number of views 633 Number of followers 58
Blogs
Number of unique visits (sum of all blog posts pages)
422 Average length of time on site (among all blog posts pages)
91,5 secs
Number of shares/retweets on social networks (Twitter + Facebook + LinkedIn)
36
Facebook Number of posts
62 Number of friends 35 Number of shares 21
YouTube Number of videos
11 Number of views 425 Number of reaches/impressions on social networks
58/ 376
Slideshare Number of presentations
24 Number of views 2457
Number of shares/retweets on social networks (Twitter + Facebook + LinkedIn)
18
5.2 Materials
The production of paper materials during the third year is characterized by the creation of customized agendas including the CITADEL logo. These materials are disseminated during the organized and attended events by partners to better capture the attention of the event audience. Figure 7 reflects some examples of CITADEL dissemination material.
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 31 of 53
Figure 7. CITADEL agenda
5.3 Press releases
Along with the press releases already declared in D7.4 section 5.3, during the second year of project, an additional press release was released by imec partners in English, which describes the activities carried out by them with particular reference to the implementation of use cases and some ecosystem tools and methodologies.
The text of press release is reported in annex 1 of this deliverable.
The CITADEL press release has been launched through various communication channels:
• www.ugent.be/mict/en/news-events/news/citadel.htm
• twitter.com/imec_mict_UGent/status/1150780514099482624
• www.facebook.com/imec.mict.ugent/
During the CITADEL 3rd year, the LU has published 2 press releases:
1. 03.12.2018 – press release on the LU website: “How to co-produce public services?” https://www.lu.lv/cets/news/t/45999/
2. 30.05.2019 – press release on the LU website and tweet. https://www.lu.lv/cets/news/t/50710/
5.4 Blog posts
All CITADEL partners published during the last two years a monthly blogpost with the objective of discussing topics on the subjects proposed in the project and related to partners’ competences and features.
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 32 of 53
Table 8. List of blogposts published during the project
Partner name Partner category
Date of delivery
Status Link
TECNALIA Technical Oct-18 Published on website
• www.citadel-h2020.eu/news/more-citadel-results-available-and-next-steps
Latvijas Universitate
Academic Nov-18
Published on website
• www.citadel-h2020.eu/news/historical-coproduction-excursus-and-citadel-latvian-case
VARAM Use case Dec-18 Published on website
• www.citadel-h2020.eu/news/co-creation-latvia-actions-numbers-and-consideration-varam
InnovaPuglia Technical Jan-19
Published on website
• www.citadel-h2020.eu/news/co-creation-puglia-role-house-technical-partner-innovation-and-development-public-administration
Regione Puglia
Use case Feb-19
Published on website
• www.citadel-h2020.eu/news/get-touch-citadel-apulian-use-case-assess-co-creation-and-digital-maturity
imec Academic/ Technical
Mar-19
Published on website
• www.citadel-h2020.eu/news/citadel-key-performance-indicator-toolbox-calculating-kpis-using-linked-open-data
Time.Lex Legal Apr-19
Published on website
• www.citadel-h2020.eu/news/coming-soon-citadel-legal-vademecum-practical-answer-legal-hurdles-pa-might-face-when-transforming-their-services
Universidad de Cantabria
Academic May-19
Published on website
• www.citadel-h2020.eu/news/forthcoming-article-ict-enabled-co-production-public-services-barriers-and-enablers-systematic-review
FINCONS Technical Jun-19 Published on website
• www.citadel-h2020.eu/news/citadel-and-future-government
Katholieke Universiteie Leuven
Academic Jul-19 Published on website
• www.citadel-h2020.eu/news/coproduction-smart-services-opening-discussion
Stad Antwerpen
Use case Sep-19 Published on website
• www.citadel-h2020.eu/news/what-about-antwerp-use-case
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 33 of 53
6 Analytic trends and considerations in monitoring and evaluation of main communication activities during the project lifetime
In this section, the objective is to analyze the main trends with respect to the data collected on communication activities. This analysis consists on observing the profiles and characteristics of users who accessed and consulted CITADEL communication channels. In particular, the attention is focused on the analytics related to the CITADEL website and its social networks that represent the main activities with measurable feedback. In both cases, temporal and geographical analyses are performed during the lifetime of project to study the improvements suggested by the Common Dissemination Boost described in D7.4 as well as the first review recommendations. As regards the CITADEL website, analyses are focused on most viewed pages and time spent on each page in order to understand the topics of greatest interest. As regards social networks, the statistics also concerning the engagement of the users (as the interaction with posts for Twitter and Facebook accounts and the number of views for LinkedIN) and the category of belonging of the users who have followed the social pages of CITADEL (Twitter and LinkedIN followers and Facebook friends) have been analysed.
Table 9. Type of analyses/mean of communication
Type of analysis
Mean of communication
Geographical origin of followers
Posts engagement during the
lifetime project
Visits number
during the lifetime project
Time of visit on
the pages
User categories
Project’s web site X X X
Project’s social pages X X X
6.1 Analytics of project’s web site
In respect to the geographical analysis of the website, a relevant number of visits from United States are found. Other activities held in other countries such as dissemination and networking events and the sharing of social posts by followers have allowed to spread the project results in other countries and public administrations. An interesting detail is that our website has been consulted from approximately 107 countries in all continents. The complete list of countries is available in Annex 2.
Table 10. Number of access from each country (first 10 countries)
Country Number of visits
United States of America 717
Spain 474
Italy 443
Belgium 442
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 34 of 53
Country Number of visits
Latvia 205
United Kingdom 140
Netherlands 124
Germany 92
India 81
Greece 56
Figure 8. Map chart of access by countries
In the following trend chart, we can observe the number of monthly visits to the project website. There has been a significant increase in the number of visits after introducing the blog, which made it possible to report different aspects from partners in the project context. Figure 9 identifies the main trends of monthly access to the website. The blog posts were publicized in the social network profiles in order to generate leads to the website, create interest in the readers and increase the time spent on the project’s site.
Worst value Best value
Figure 9. Trend chart of access month by month
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 35 of 53
The table below shows how the visits have been distributed. Analyzing the data, it indicates that most read contents were the Project description pages and the Project deliverables.
Table 11. Type of website content
Content Number of visits Time of visits
Legal blogposts 41 150,19
Academic blogposts 34 128,20
Use case blogposts 123 108,18
Technical blogposts 224 69,84
News 836 68,85
Project description pages 2670 86,73
Project deliverables 652 151
Others (newsletters, materials…) 22 39,17
The table is schematically shown in the following charts.
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 36 of 53
Figure 10. Charts of website content
6.2 Social Network activities
As far as the analysis of CITADEL social networks is concerned, this analysis is carried out separately for each social network in which the project is presented. This analysis shows relevant geographical aspects such as the importance of partners’ countries and a higher interaction of visitors from those countries where the CITADEL dissemination activities were conducted.
Table 12. Number of Twitter followers from each country
Country Number of followers
EU projects and initiatives 113
Belgium 32
Spain 37
1% 1% 3%5%
18%
58%
14%
0%
Number of visits
Legal blogposts Academic blogposts Use case blogposts
Technical blogposts News Project description pages
Project deliverables Others (newletters, materials,…)
150,19
128,2
108,18
69,84
68,85
86,73
151
39,17
0 20 40 60 80 100 120 140 160
Legal blogposts
Academic blogposts
Use case blogposts
Technical blogposts
News
Project description pages
Project deliverables
Others (newletters, materials,…)
Time of visits (secs)
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 37 of 53
Country Number of followers
Latvia 9
Netherlands 8
United Kingdom 9
Hungary 1
Italy 25
Germany 5
Australia 1
Switzerland 1
Not spec. 11
United States 9
Norway 5
Estonia 2
Portugal 2
Sweden 2
Turkey 2
East Europe 1
France 1
Mexico 1
Luxemburg 1
Ireland 1
India 1
Greece 1
Nepal 1
Denmark 1
Israel 1
Austria 1
Table 13. Number of LinkedIn followers from each country
Country Number of visits
EU projects and initiatives 22
Belgium 12
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 38 of 53
Country Number of visits
Spain 8
Latvia 5
United Kingdom 2
Netherlands 2
Hungary 2
Italy 1
Germany 1
Australia 1
Bulgaria 1
Cyprus 1
The data in the preceding tables is schematized in the following charts.
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 39 of 53
Figure 11. Bart chart of Twitter followers from each country
0 20 40 60 80 100 120
EU projects and initiatives
Spain
Belgium
Italy
Not spec.
Latvia
United Kingdom
United States
Netherlands
Germany
Norway
Estonia
Portugal
Sweden
Turkey
Australia
Austria
Denmark
East Europe
France
Greece
Hungary
India
Ireland
Israel
Luxemburg
Mexico
Nepal
Switzerland
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 40 of 53
Figure 12. Bar chart of LinkedIn followers from each country
Another relevant measure is the engagement related to the published posts, such as the number of interaction that the users had with the post (e.g. likes, retweets or mentions) that facilitated to measure in which periods there was a greater interest in projects’ activities. This analysis is monthly carried out and it is represented below through trend charts.
Figure 13. Trend chart of engagement in Twitter
0 5 10 15 20 25
EU projects and initiatives
Belgium
Spain
Latvia
United Kingdom
Netherlands
Hungary
Italy
Germany
Australia
Bulgaria
Cyprus
0
50
100
150
200
250
300
350
400
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 41 of 53
Figure 14. Trend chart of engagement in LinkedIn in last 6 months
The last analysis involves the type of users who interacted with CITADEL social networks: similar categories to the topics covered by the project were considered so that they could understand which users were most involved in the project’s achievements.
Table 14. Number of followers/friends by category
Category Number of Twitter followers
Number of LinkedIn followers
Legal 5 4
Academic 105 8
Public Administrations 11 6
Technical 30 13
General public 21 5
EU Projects and other collaboration initiatives pages
113 22
The following pie charts summarize the values declared above:
0
50
100
150
200
250
Mar-19 Apr-19 May-19 Jun-19 Jul-19 Aug-19 Sep-19
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 42 of 53
Figure 15. Pie chart of user categories in Twitter
Figure 16. Pie chart of user categories in LinkedIn
2%
37%
4%10%7%
40%
Number of Twitter followers
Legal
Academic
Public Administrations
Technical
General public
EU Projects and other collaboration initiatives pages
7%
14%
10%
22%9%
38%
Number of LinkedIn connections
Legal
Academic
Public Administrations
Technical
General public
EU Projects and other collaboration initiatives pages
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 43 of 53
7 Advisory Board meetings
In this period (M25 – M36) no advisory board meetings have been held. Instead, the CITADEL consortium considered more relevant to organize focus groups in pilot locations (e.g. Riga, Antwerp and Bari) as well as events holding a higher number of stakeholders, in particular civil servants.
The organization of focus groups have provided with more relevant and focused insights into the needs of public administrations and how CITADEL could take advantage of this. On the other hand, the organization of larger events such as the ones held in Riga and Bari have provided CITADEL with a thorough understanding of what the public sector is seeking for, as reported in section 4 and 8, especially in what respects to the policy perspective of the project.
These two approaches provided CITADEL partners with a deep knowledge as regards the engagement of civil servants (PA) and citizens in public administration, in some cases going beyond what it would have been expected from an advisory board.
8 Collaboration and networking activities
8.1 Considerations on collaboration activities with EU funded projects
On October 8th, 2018 the first cluster meeting with the rest of the CULT-COOP-11 (CC-11) projects was held. These projects are TROPICO, CO-VAL and CO-GOV. All four projects were present in different stages of the meeting, being CITADEL the most mature. The meeting was attended by the project coordinator, Leire Orue-Echevarria (TECNALIA), who was also the main driver for this meeting to take place.
The CC-11 relevance and expectations of the cluster meeting were as follows:
1. This a group of projects that is of interest for DG CONNECT because they are bringing
together the vision on (e)government
2. To re-use of information for PAs including EU: what have we learnt from these projects
that could be shared with other public administrations? What could another PAs reuse?
What works, and what does not? For instance, deliverables around the methodological
description and a new framework for co-creation across the EU, policy briefs, concrete
tools.
3. Support for the projects: how to link to other PAs and how to get external feedback on
their projects, share with the EC news and upcoming events, which can further
disseminate through the project means, etc.
4. Create a community around the topic: synergies / complementarities / added value
The goal of this meeting was firstly to understand which aspects of co-creation were covered by each project and secondly which type of collaboration was expected by each project. CITADEL shared some topics and aspects previously covered by the project in the online community, Slack, created by the PO.
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 44 of 53
Figure 17. Slack community created for all CULT-COOP-11 projects
The first meeting had two distinct blocks. The first session devoted time to discussing among all four projects the collaboration expectations as well as the means to collaborate. Three levels of collaboration were envisioned:
1. Processes / methodologies, which consists in developing new processes and methodologies.
2. Dissemination, is especially focused on trust and legitimacy, including the joint publication of papers.
3. Bridge the public sector and academia in a more strategic way, through the organization of joint events.
The second session devoted time to assessing a methodology and some serious games developed by the JRC as part of the FutureGov2030+ initiative.
CITADEL was also present in the European Week of Regions and Cities, which took place on 9th October 2019 in Brussels. The project coordinator participated in the following sessions with an active role:
- Citizen-centric Design and Delivery of Digital Public Services. This session discussed best practices in the domain of user-centricity in local and regional administrations. The final message that can be derived from that session is that successful user-centric public services can only be achieved when citizens are involved in the design and creation along with the public administrations.
- OpenGoV Co-production & Co-creation: Sharing experiences from Regions and Cities: this session included some presentations as well as roundtable discussions running in parallel, where aspects related to synergies and sustainability, the use of big data for Open Governance, and inclusiveness issues were discussed. The conclusions drawn from the discussions is that co-creation needs to have a clear scope, role, goals and methods where the expertise and knowledge of participants is key to understand what the community needs.
The second cluster meeting took place on July 4th, 2019. To this end, a position / discussion paper written by Mr. Paul Waller was shared among the projects so that they could express their position either before or during the event. On behalf of CITADEL, Inese Viktorija Grospine from VARAM and Leire Orue-Echevarria from TECNALIA were present.
The discussion revolved around the following topics:
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 45 of 53
- Key challenges and key findings per project - Topic 1 - Anchoring the research in the constitutional context of the EU and Member
States - The implications of the Rule of Law for collaboration in and transformation of public administration
- Topic 2 - Anchoring the research in the constitutional context of the EU and Member States - The adaptation required in applying private sector models and logic to the public sector
- Topic 3 - Adapting language for the project audiences and demonstrating impact in their terms - Clarifying concepts and terminology
- Topic 4 - Adapting language for the project audiences and demonstrating impact in their terms - Establishing a clear and robust methodology for generalising from cases
- Next steps
The concluding remarks of this meeting included the participation of CITADEL project representatives in the events that both TROPICO and CO-VAL plan to organize in 2020.
8.2 CITADEL focus groups
The importance of organizing focus groups lies in the fact that we should understand the needs of users interested in CITADEL outcomes and in many cases, they have performed the function of “reservoir” for data entries in some of the platforms proposed in CITADEL.
In the event "Capire per poi Trasformare" (see section 3.3) a focus group was organized and served to share the feelings and ideas of the participants in the event regarding digital public services in Puglia. Institutional representatives from the Regione Puglia and local Public Administrations of the SMEs exposed their opinions and the meeting allowed to increase the needs collected on CIP, the co-design platform used by Regione Puglia in its use case.
8.3 Further collaborations and reuse of CITADEL achievements beyond the end of the project
Project representatives of CITADEL, especially the coordinator is willing to participate in events (co-)organized by CC-11 projects, where the results of the project can be shared further.
Moreover, the project’s source code has been released in an open source repository and is accessible by anyone that wishes to reuse it or modify it. The address is: https://git.code.tecnalia.com/CITADEL_Public/CITADEL_Components.
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 46 of 53
9 Final conclusions
This final deliverable provides key trends on dissemination, communication and networking activities by partners during the lifetime of project. CITADEL partners have actively taken part in several events, including conferences, seminars, workshops, lectures and so on. Main trends in the project show, for example, a higher level of activity in attending these events in the second year of project. A similar trend is also found for scientific and business publications. This analysis reflects a greater scientific activity during the second year of project than during the rest of period. As regards business publications, we find a maximum of publications during 2017. The impact of these publications is measured using SJR impact factors. In this vein, these results show that scientific publications with a high and medium impact double those with a low impact, which clearly shows the great quality of the publications achieved by the consortium.
With respect to communication activities, our analysis of main trends identifies a significant increase in visits, interactions and followers related to CITADEL main social networks such as Twitter, and Linkedin. For example, the number of interactions in Twitter has substantially increased in the last year of project, with a peak of 361 interactions in February 2019. In particularly, the greatest number of interactions has been especially carried out from the countries of some project partners such as Belgium, Latvia, and Spain. This group of countries has joined the United States, which although it has no representation in the project, has been very present at conferences, seminars and other events.
Finally, in relation networking activities, many efforts have been carried out by CITADEL partners. CITADEL has been a part of the CULT-COOP-11 including European projects such as TROPICO, CO-VAL and CO-GOV. The CITADEL action in this cluster has consisted in looking for synergies with other projects as regards co-creation of public services across the EU, policy issues, best practices on dissemination and future collaborations. Furthermore, the source code used by CITADEL partners to develop their technological tools is located in an open source repository, accessible for anyone who wants to reuse it.
In conclusion, this deliverable provides clear evidence that improvements from the first review session and the Common Dissemination Booster’s implementation has been positive actions to enhance dissemination, communication and networking results. Our trend analysis offers evidence of a significant improvements in terms of identifying opportunities and best practices on how to disseminate to end-users.
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 47 of 53
Annex 1 – Press release
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 48 of 53
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 49 of 53
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 50 of 53
Annex 2 – Number of access to the project website from each country
Table 15. Number of access to the project website from each country
Country Number of visits
United States of America 717
Spain 474
Italy 443
Belgium 442
Latvia 205
United Kingdom 140
Netherlands 124
Germany 92
India 81
Greece 56
China 53
Brazil 50
France 46
Canada 46
Russia 45
Estonia 36
Austria 29
Poland 29
Portugal 29
Philippines 28
Sweden 28
Finland 26
Norway 24
Switzerland 20
(not set) 19
Denmark 17
Ukraine 17
South Korea 15
Romania 15
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 51 of 53
Country Number of visits
Hungary 12
Mexico 14
Slovenia 13
Ireland 13
Lithuania 12
Serbia 12
Turkey 12
South Africa 12
Czechia 11
Hong Kong 9
Japan 10
Australia 9
Croatia 8
Israel 7
Nigeria 8
United Arab Emirates 7
New Zealand 7
Slovakia 7
Singapore 6
Bulgaria 5
Egypt 5
Kazakhstan 5
Malaysia 5
Thailand 5
Luxembourg 3
North Macedonia 4
Malta 4
Saudi Arabia 4
Albania 3
Colombia 3
Cyprus 3
Algeria 3
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 52 of 53
Country Number of visits
Ecuador 3
Indonesia 3
Jordan 2
Morocco 3
Mozambique 3
Peru 3
Pakistan 3
Taiwan 3
Argentina 1
Bangladesh 2
Bahamas 2
Belarus 1
Chile 2
Ethiopia 2
Georgia 2
Iran 2
Sri Lanka 2
Mongolia 2
Somalia 2
Tunisia 2
Uganda 2
Vietnam 1
Kosovo 2
Andorra 1
Armenia 1
Aruba 1
Azerbaijan 1
Bolivia 1
Belize 1
Congo - Kinshasa 1
Congo - Brazzaville 1
Ghana 1
D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019
Project Title: CITADEL Contract No. GA 726755
www.citadel-h2020.eu
Page 53 of 53
Country Number of visits
Gibraltar 1
Jersey 1
Kenya 1
Cambodia 1
Lebanon 1
Moldova 1
Mauritius 1
Maldives 1
Nepal 1
Palau 1
Qatar 1
Trinidad & Tobago 1
Uruguay 1
St. Vincent & Grenadines 1
Top Related