Diego Gonzalezd.f.gonzalez@cgiar.org

Angela Hernándeza.hernandez@cgiar.org

GRIN-Global Pilot Data Migration for in vitro Cassava Collection

GRIN-Global Workshop8,12 February

Praha, Czech Republic

Plan

• Rationale behind• Data Migration Plan• Achievements and challenges• Synchronization between app for tablet and GRIN-Global using web services• Outputs• Conclusions• Issues for a successful adoption• Workplan phase II

CIAT –Genetic Resources ProgramGermplasm registered into Multilateral System of the Treaty

Crop Conservation Rank No. of Taxa No. of origin country

No of Accessions

Bean(Phaseolus)

Seeds 1 46 110 37.560

TropicalForages

Seeds 1 734 75 23.140

Cassava(Manihot)

in vitro 1 33 28 6.643

813 67.343Germplasm accessions as International Public Goods

Rationale behind

Over the last 15 years CIAT has developed an "in house" genetic resources information system, which makes data about the collections available on the web, and supports the genebank workflows.

Software (data entries, reports) technology is becoming outdated Poor scalability and problems with the new versions of operating systems and web

applications.

Evaluate an alternative for adoption: GRIN-Global• Pilot data migration for in vitro Cassava collection• To capitalize on possible community of practice

GRIN-Global Pilot Data Migration for in vitro Cassava Collection

Duration: 1 Year (2015)The objective of this Project is to develop a plan of data migration from the CIAT-GRP information system to GRIN-Global and integrate one of our mobile applications with this system in view of the possible adoption

Work team:• in vitro Cassava Genebank Staff (2): Coordinator, Assistance• documentation & databases Genebank Staff (2): Coordinator, Systems Analyst

Achievements and Challenges

Data migrated and validated

Genebank processes

Introduction/Acquisition Indexation Conservation Regeneration Safety duplication Characterization / EvaluationsDistribution

Data Mapping /Migration

requirements

CIAT GRP Cassava

Database

GRIN-

Global

data dictionar

y

Genebank documentation need

s

Source DBStaging tables

GG DB

Transform

LoadExtract

Cleansing

Tool developed with the rules of migration Curation data

• Disaggregate tables

• Duplicate data• Data with special

characters, misspelled

• Data consistency• Integrity

• Definition of Inventory Maintenance Policies for in vitro Cassava Collection• Changes in the names of the dataviews according with the genebank handling• Inventory definitions• Definition of code values (actions names)• Translation to Spanish the field names• Added trigger to GG Database to enable automatic indexation availability• Modifying SQL in some Dataviews

Add the third administration in geography, adapt the format of genebank accessions and correction the cooperator site on the website

• Add unique indexes in GG Database: many records from source database are composed of more than one attribute that makes them unique, because in bringing them to GG there were duplication problems

Achievements and Challenges

• Process selected• Requirements• Evaluate the

connectivity GRIN-Global

• GG schema

Analysis

• Mobile app

• Web services app

Design / Develop

Test and validations

Test User validationImplementation

Mobile Synchronization with GG

Mobile data capture and barcode/QR codes in order to support the data quality

GRIN-Global Mobile TabletMobile application allows users to capture data related to genebank

actions such as monitoring, subculture evaluations, etc.

GG Database

Invitro_Tablet

Outputs

Pilot data migration• Document Plan data migration • Tool for data migration (Java application stand

alone)• Mapping rules• Extraction• Transformation• Load

• Document Data Mapping• Document Migration validations• Document recommendations

Mobile synchronization with GRIN-Global• Mobile application for Android Tablet

• Register inventory actions• For one selected process for this pilot

• Web services for Synchronization (Java RestFul)• Technical documentation• Source code

Conclusions

• Migration all available data was successfully achieved and valid in GRIN-Global• Establish a plan and lessons learned for possible adoption • GG offers more and useful attributes for collections documentation

• Usability of search tool is very low, therefore it needs to be improved• As commonly observed by users, the usability of GG to manage Cassava

collection has an acceptable rating although there are many observations and recommendations to get an optimal management of clonal collections• Users perceive the adoption has a high learning curve

Issues for a successful adoption

GRIN-Global should improve in usability:• Dataviews names that are defined in the Curator Tool also reflected in the tabs or views of the

Search Tool• All labels must be customizable• The pseudo SQL search tool should keep the names of the label dataviews and not the

attributes• All labels in wizards meet the appropriate sizes for your text is fully visible• Admin tool should allow to create and update indexes• All codes values share customizable, in case of any default this should be documented

• E.g.: low inventory is by default. Auto deduction is performed in inventory as well• Expand the number of characters in the acronym (acronym for institution in Cooperators)• Search tool should allow to hide columns.

Issues for a successful adoption

CIAT side should meet the needs of usability for the in vitro genebank :The concepts of GRIN-Global are clearly oriented to the management of seed collections which requires the completion of certain adaptations for the management of in vitro collection for the adoption of this system.• Improve usability and make adjustments necessary to facilitate data

management for in vitro collection• Make adjustments to the dataviews, triggers• Tablets and web services• Using tablets to facilitate the identification of management QR codes

Issues for a successful adoption

• Expose to the GRIN-Global community the needs of tool improvement• Management requirements in terms of functionality should be clear (that I

like) -> Community GRIN-Global, Trust, USDA• Avoid changing the source code of GRIN-Global• Maintaining an "organic" scheme that allows for growth with the use of web

services to meet the needs of data collection with mobile solutions (Tablet applications)

• High demand for Training and Support (at the beginning)• Licensing costs for GG server are not assumed by CIAT; they are borne by the

Genetic Resources Program.

Interfaces with existing systems

Pilot Data MigrationPhase II

Continuity with the pilot of the GRIN-Global cassava collection in vitroWe need to fill gaps in GRIN-Global in order to meet the needs of usability in vitro bank• Improve usability and make adjustments necessary to facilitate data

management for in vitro collection• Make adjustments to the dataviews, triggers• Data entry using tablets and web services• Using tablets facilitate the identification of management QR codes

Activity Timeline Output

User Practical sessions February 2016 User feedback

Analysis and planning of usability requirements

March 2016 Document of analysis requirementsPlan of implementation

Design and develop interfaces (web services, app mobile) and adaptations (dataviews, triggers) according to the requirements

April – September 2016 Interfaces developedAdaptations developedTechnical documentation

Tests October-December 2016 Tests and correctionsTechnical documentation

Transition planning & maintains parallel systems

November –December 2016 Ensure resources (Licensing costs, server)Document of transition plan

Review and analyze the processes of management of seed collections

October –December 2016 Document of analysis requirements

Phase II