Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to...

42
Lois Delcambre, OSU CS Colloquium Series 1 Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM NSF DIGITAL GOVERNMENT PROGRAM Lois Delcambre, Professor Computer Science and Engineering OGI School of Science & Engineering Oregon Health & Science University CS Colloquium Series – Oregon State University
  • date post

    21-Dec-2015
  • Category

    Documents

  • view

    217
  • download

    3

Transcript of Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to...

Page 1: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 1

Harvesting Information to Sustain our Forests

NSF DIGITAL GOVERNMENT PROGRAMNSF DIGITAL GOVERNMENT PROGRAM

Lois Delcambre, ProfessorComputer Science and Engineering

OGI School of Science & Engineering

Oregon Health & Science University

CS Colloquium Series – Oregon State University

Page 2: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 2

Overview of the Talk

• Introduction to the project & application

• Metadata++

• Superimposed Schematics

Page 3: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 3

Partner: USDA Forest Service

(Region 6)Dr. Tim Tolle,

Co-Project Director

Focus: Adaptive Management

Areas

Agency documents

Natural resource manager

Page 4: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 4

The academic team

Computer ScienceLois Delcambre

Dave MaierMat Weaver

Shawn BowersBill Howe

Sun MurthyRupa Tummala

Environmental Science& EngineeringPatty ToccalinoJulia Norman

Kirsten Zillman

Management inScience & Tech.

Fred PhillipsNicole StecklerMarianne Koch

Balbinder Banga

Len Shapiro, PSUUndergraduate students

high-school apprentice(s)

Page 5: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 5

Documents

• Vary in format (text, map, dataset, …)

• Vary in purpose (formal assessment, informal letter, …)

• Represented by document proxies

Metadata++

documentproxies

Xkb Elkuo I Lksuero Mosei Xoi vet t;osu 0359u

url1

url2

Call John @(503)555-1234

Page 6: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 6

Capabilities of The Forest PortalDocumentDocumentUploadUpload

File:

Author:

Browse

Title:

Type:

Contact:

Notes:

More...

Page 7: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 7

Capabilities of The Forest PortalMetadataMetadataAttachmentAttachment

Metadata

Browse

Property Value

Browse

Browse

Browse

Page 8: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 8

Capabilities of The Forest Portal

SearchSearchKeyword Search

SearchKeyword:

Browse Category

Location > Region 6 > Wenatchee National Forest

BOR Road Issues A memo to the U.S. Department of the …[Metadata] [Similar Documents]

Appeal Decision: Plum Creek Checkerboard …Final decision, pursuant to 36 CFR 215, appeal on …[Metadata] [Similar Documents]

Interstate 90 Final Record of DecisionDocuments my rationale and selection of Alternatives …[Metadata] [Similar Documents]

Interstate 90 LegislationConference report on H.R. 438, making Omnibus …[Metadata] [Similar Documents]

Metadata Search

Page 9: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 9

Capabilities of The Forest PortalSimilarity Similarity SearchSearch

Find Similar DocumentsFind Similar Documents(through associated(through associatedMetadata)Metadata)

Browse Category

Location > Region 6 > Wenatchee National Forest

BOR Road Issues A memo to the U.S. Department of the …[Metadata] [Similar Documents]

Appeal Decision: Plum Creek Checkerboard …Final decision, pursuant to 36 CFR 215, appeal on …[Metadata] [Similar Documents]

Interstate 90 Final Record of DecisionDocuments my rationale and selection of Alternatives …[Metadata] [Similar Documents]

Interstate 90 LegislationConference report on H.R. 438, making Omnibus …[Metadata] [Similar Documents]

Metadata

Property Value Using

Page 10: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 10

USDA FS & Other Agency Staff Activities

• Identify domains of interest

• Identify controlled vocabularies, glossaries, …

• Evaluate and select one or more controlled vocabularies

• Identify cross-reference schemes

• Identify relationships of interest

Page 11: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 11

Page 12: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 12

Page 13: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 13

Page 14: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 14

AFIDkeywords.doc

mistletoesroot diseasesrots and decaysfoliage diseasescankersrustsseedling diseasesbark beetleswood borersdefoliatorsseed and cone insectsshoot and twig insectssucking insectssilvicultural treatmentsthinningsalvagesanitationpruning

Page 15: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 15

climate_terms.xls (excerpt)

CLIMATE - TERMSABSOLUTE TEMPERATUREADVECTIONADIABATICAIR MASSALBEDOANEMOMETERANNUAL FLOODANOMALYARIDITYASPECTBARBAROMETERBIOCLIMATICBOWEN RATIO

BPI PANBULK DENSITYCLASS A PANCLIMATOLOGICAL

OBSERVATIONCONVECTIONDAILY MEANDAYDEGREEDEGREE DAYDEWDEW POINTDROUGHTDRY BULB THERMOMETEREVAPOTRANSPIRATIONFETCH

Page 16: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 16

Overview of the Talk

• Introduction to the project & application

• Metadata++

• Superimposed Schematics

Page 17: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 17

Metadata++

terms

vocabulary vocabulary vocabulary

broader-term/narrower-termrelationships(shown ashierarchy)

Page 18: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 18

Metadata++: Terms & Relationships

same term may appear in more than one vocabulary – with

different, even contradictory broader-term/narrower-term

relationships

Page 19: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 19

Metadata++: Terms & Relationships

synonym relationships

Page 20: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 20

Metadata++: Associative Relationships

functional relationships such aswildlife-habitat relationships -

supports similarity search & browsing!

Page 21: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 21

Metadata++

• Exploiting broader-term-narrower-term– If you attach a narrow term…attach all broader

terms as well– If you search for a term…search for all narrow

terms as well

• Support multiple hierarchies - with cross-references indicated as synonyms (as available)

Page 22: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 22

Climatologist PerspectiveForester Perspective

Page 23: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 23

[Atmosphere] – [Air Quality] – [Air pollution] – [smoke]

Attachment Relationship using Climatologist Perspective

D1

[Vegetation Management] – [Air pollution] – [smoke]

Attachment Relationship using Forester Perspective

D2

Documents with Attachment Relationships

[Atmosphere] – [Air Quality] – [Air pollution] – [smoke]

Search specified in climatologist perspective

Page 24: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 24

Search: blue terms wild card, black terms mandatory

Shows the attachment path for the document

Page 25: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 25

Location Perspective (Heber)

Location perspective (Martin)

Page 26: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 26

Templates for Metadata Entry

Location

Climate

Keywords

Soil

Hydrology

Planning

Authorizing Location

Slot

each slot isassociatedwith oneterm from one perspective

slot label

Page 27: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 27

Metadata++

• Inspired by Dublin Core, Z39.19 (Thesaurus), …• Simple, uniform model: terms & relationships• No classes• No attributes (for terms or objects)• Basic idea – broader-term/narrower-term relationship

is intentionally overloaded to represent– Broader-term/narrower-term– Type – instance – Collection (set) – member– Traditional property name

• Model has been formalized; query and browse capability is being defined

Page 28: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 28

MetaData eXtract

• Metadata attachment may take some time

• MDX helps by suggesting terms from Metadata ++

• Results are suggested to the user … interactively

The district silviculturalist at the McKenzie Ranger District on the Willamette National Forest is working on an EIS for a timber sale located within the upper McKenzie watershed. During the scoping process, the silviculturalist and rest of the IDT identified two areas in particular where the objectives would be to promote and accelerate the development of late successional characteristics over time.

Both areas are located within Douglas-fir forest types; one within a Western hemlock/dwarf Oregon grape plant association, or potential vegetation type, and one in a riparian reserve that has a plant association of Western hemlock/Oregon oxalis......

McKenzie Ranger District

Willamette National Forest

Douglas

-firWestern hemlock

potential

vegetation

Page 29: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 29

Overview of the Talk

• Introduction to the project & application

• Metadata++

• Superimposed Schematics

Page 30: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 30

Schematics: Decision Letter

Page 31: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 31

Schematics: Review Letter

Page 32: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 32

The Appeal Decision Schematic

loc desc

issuer

address

role

title

respondentFor

1:*

0:*

1:1 0:*

0:*

1:1

1:1

1:1

1:1

0:1

1:1

1:1

1:1 1:*

name

AppealDecision

date

Appeal

result

id num

concern

Issue

cover Decision

DecidingOfficer

response

Determination resolve

ReviewingOfficer

Appellant

behalf

Organization

status desc

review

request

regard

name

name

title

respondentFor

name

desc order

define

0:*

0:*

1:1 1:*

1:1

1:*

Page 33: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 33

Part of a Populated SchematicDecision (D1)

AppealDecision (AD1)

cover (c1)

datelocissuerconcern

(n1)

Appeal (A1)regard (r1)

define (d1)

Issue (I1)

Page 34: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 34

Part of a (different) Populated Schematic

Determination(D1)

resolve(r1)

Issue (I2)

Appeal (A1)

define (d1)

define (d2)

define (d3)

Determination(D1)

resolve(r1)

Issue (I2)

Determination(D1)

resolve(r1)

Issue (I2)

Page 35: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 35

Querying a Superimposed Schematic

Issue [AppealDecision(id="1570-1-0032-10").concern(order=1)] The decision violates the Federal Advisory Committee Act (FACA). The illegal advisory committee played a central role in influencing the Forest Service Decision.

Issue [AppealDecision(id="1570-1-0032-10").concern(order=2)] The decision significantly reduces hunting opportunity and habitat for deer and elk.

Issue [AppealDecision(id="1570-1-0035-13").concern(order=1)] The District Ranger's decision is not in accordance with the legal requirements of the National Environmental Policy Act, the National Forest Management Act, and the Forest and Rangeland Renewable Resources Planning Act.

Issue [AppealDecision(id="1570-1-0038-19").concern(order=1)] Current stand condition is not adequately addressed, impacts on soil quality are not addressed, and that impacts to various species are not considered, including several late successional species, survey and manage species, and management indicator species.

“For Appeal Decisions made in the last two years, what Appellant Issues were raised for Decisions

concerning the Mount Hood National Forest”

Page 36: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 36

Enhanced AddressingIssue [AppealDecision(id="1570-1-0032-10").concern(order=1)] The decision violates the Federal Advisory Committee Act (FACA). The illegal advisory committee played a central role in influencing the Forest Service Decision.

Issue [AppealDecision(id="1570-1-0032-10").concern(order=2)] The decision significantly reduces hunting opportunity and habitat for deer and elk.

Issue [AppealDecision(id="1570-1-0035-13").concern(order=1)] The District Ranger's decision is not in accordance with the legal requirements of the National Environmental Policy Act, the National Forest Management Act, and the Forest and Rangeland Renewable Resources Planning Act.

Issue [AppealDecision(id="1570-1-0038-19").concern(order=1)] Current stand condition is not adequately addressed, impacts on soil quality are not addressed, and that impacts to various species are not considered, including several late successional species, survey and manage species, and management indicator species.

concern (n1)

Issue (I1)

AppealDecision (AD1)

Determination (D1)

result (r1)

resolve (v1)

Page 37: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 37

Superimposed Schematics

• Entity-relationship-style model is superimposed over arbitrary, base documents

• Each entity, each attribute, and each relationship can be “anchored” at some text excerpt

• Includes “authoritative” entities – such as for persontitle

respondentFor

1:1

0:1

1:1

1:1

name

AppealDecision

date id

DecidingOfficer

response

ReviewingOfficer

review

title

respondentFor

name

USDA FSEmployee

Page 38: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 38

Superimposed Schematics

• Represented using the uni-level description– Generic, uniform representation for structured information– Can accommodate a variety of data models (database

models, XML, RDF, topic maps, …)– Can accommodate schema-first, schema-later, schema-

optional information– Can accommodate multiple levels of schema-instance

relationships in a single model– Based on a metamodel (with basic structures such as set,

bag, list, struct, attribute, and scalar)

• Logic-based language (Datalog) can easily be used to transform data (model-model, schema-schema, …)

Page 39: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 39

What is Superimposed Information?

data “placed over” existing information sources to

highlight annotate elaborate select collect organize connect reuse

information elements

often to support new applications, beyond the original

Page 40: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 40

Examples of Superimposed Information

Non-electronic examples:

Commentaries on religious texts, law, literature Concordances, citation indexes

Electronic examples:

Bookmark file in your web browser RDF metadata

Page 41: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 41

The superimposed and base layers with marks

Superimposed Layer

BaseLayer Information

Source1

Information Source2

Information Sourcen

marks

Focus: building generic technologyTwo examples: Metadata++ and Superimposed Schematics

Page 42: Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to Sustain our Forests NSF DIGITAL GOVERNMENT PROGRAM Lois.

Lois Delcambre, OSU CS Colloquium Series 42