Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to...

Post on 21-Dec-2015

217 views 3 download

Tags:

Transcript of Lois Delcambre, OSU CS Colloquium Series1 NSF DIGITAL GOVERNMENT PROGRAM Harvesting Information to...

Lois Delcambre, OSU CS Colloquium Series 1

Harvesting Information to Sustain our Forests

NSF DIGITAL GOVERNMENT PROGRAMNSF DIGITAL GOVERNMENT PROGRAM

Lois Delcambre, ProfessorComputer Science and Engineering

OGI School of Science & Engineering

Oregon Health & Science University

CS Colloquium Series – Oregon State University

Lois Delcambre, OSU CS Colloquium Series 2

Overview of the Talk

• Introduction to the project & application

• Metadata++

• Superimposed Schematics

Lois Delcambre, OSU CS Colloquium Series 3

Partner: USDA Forest Service

(Region 6)Dr. Tim Tolle,

Co-Project Director

Focus: Adaptive Management

Areas

Agency documents

Natural resource manager

Lois Delcambre, OSU CS Colloquium Series 4

The academic team

Computer ScienceLois Delcambre

Dave MaierMat Weaver

Shawn BowersBill Howe

Sun MurthyRupa Tummala

Environmental Science& EngineeringPatty ToccalinoJulia Norman

Kirsten Zillman

Management inScience & Tech.

Fred PhillipsNicole StecklerMarianne Koch

Balbinder Banga

Len Shapiro, PSUUndergraduate students

high-school apprentice(s)

Lois Delcambre, OSU CS Colloquium Series 5

Documents

• Vary in format (text, map, dataset, …)

• Vary in purpose (formal assessment, informal letter, …)

• Represented by document proxies

Metadata++

documentproxies

Xkb Elkuo I Lksuero Mosei Xoi vet t;osu 0359u

url1

url2

Call John @(503)555-1234

Lois Delcambre, OSU CS Colloquium Series 6

Capabilities of The Forest PortalDocumentDocumentUploadUpload

File:

Author:

Browse

Title:

Type:

Contact:

Notes:

More...

Lois Delcambre, OSU CS Colloquium Series 7

Capabilities of The Forest PortalMetadataMetadataAttachmentAttachment

Metadata

Browse

Property Value

Browse

Browse

Browse

Lois Delcambre, OSU CS Colloquium Series 8

Capabilities of The Forest Portal

SearchSearchKeyword Search

SearchKeyword:

Browse Category

Location > Region 6 > Wenatchee National Forest

BOR Road Issues A memo to the U.S. Department of the …[Metadata] [Similar Documents]

Appeal Decision: Plum Creek Checkerboard …Final decision, pursuant to 36 CFR 215, appeal on …[Metadata] [Similar Documents]

Interstate 90 Final Record of DecisionDocuments my rationale and selection of Alternatives …[Metadata] [Similar Documents]

Interstate 90 LegislationConference report on H.R. 438, making Omnibus …[Metadata] [Similar Documents]

Metadata Search

Lois Delcambre, OSU CS Colloquium Series 9

Capabilities of The Forest PortalSimilarity Similarity SearchSearch

Find Similar DocumentsFind Similar Documents(through associated(through associatedMetadata)Metadata)

Browse Category

Location > Region 6 > Wenatchee National Forest

BOR Road Issues A memo to the U.S. Department of the …[Metadata] [Similar Documents]

Appeal Decision: Plum Creek Checkerboard …Final decision, pursuant to 36 CFR 215, appeal on …[Metadata] [Similar Documents]

Interstate 90 Final Record of DecisionDocuments my rationale and selection of Alternatives …[Metadata] [Similar Documents]

Interstate 90 LegislationConference report on H.R. 438, making Omnibus …[Metadata] [Similar Documents]

Metadata

Property Value Using

Lois Delcambre, OSU CS Colloquium Series 10

USDA FS & Other Agency Staff Activities

• Identify domains of interest

• Identify controlled vocabularies, glossaries, …

• Evaluate and select one or more controlled vocabularies

• Identify cross-reference schemes

• Identify relationships of interest

Lois Delcambre, OSU CS Colloquium Series 11

Lois Delcambre, OSU CS Colloquium Series 12

Lois Delcambre, OSU CS Colloquium Series 13

Lois Delcambre, OSU CS Colloquium Series 14

AFIDkeywords.doc

mistletoesroot diseasesrots and decaysfoliage diseasescankersrustsseedling diseasesbark beetleswood borersdefoliatorsseed and cone insectsshoot and twig insectssucking insectssilvicultural treatmentsthinningsalvagesanitationpruning

Lois Delcambre, OSU CS Colloquium Series 15

climate_terms.xls (excerpt)

CLIMATE - TERMSABSOLUTE TEMPERATUREADVECTIONADIABATICAIR MASSALBEDOANEMOMETERANNUAL FLOODANOMALYARIDITYASPECTBARBAROMETERBIOCLIMATICBOWEN RATIO

BPI PANBULK DENSITYCLASS A PANCLIMATOLOGICAL

OBSERVATIONCONVECTIONDAILY MEANDAYDEGREEDEGREE DAYDEWDEW POINTDROUGHTDRY BULB THERMOMETEREVAPOTRANSPIRATIONFETCH

Lois Delcambre, OSU CS Colloquium Series 16

Overview of the Talk

• Introduction to the project & application

• Metadata++

• Superimposed Schematics

Lois Delcambre, OSU CS Colloquium Series 17

Metadata++

terms

vocabulary vocabulary vocabulary

broader-term/narrower-termrelationships(shown ashierarchy)

Lois Delcambre, OSU CS Colloquium Series 18

Metadata++: Terms & Relationships

same term may appear in more than one vocabulary – with

different, even contradictory broader-term/narrower-term

relationships

Lois Delcambre, OSU CS Colloquium Series 19

Metadata++: Terms & Relationships

synonym relationships

Lois Delcambre, OSU CS Colloquium Series 20

Metadata++: Associative Relationships

functional relationships such aswildlife-habitat relationships -

supports similarity search & browsing!

Lois Delcambre, OSU CS Colloquium Series 21

Metadata++

• Exploiting broader-term-narrower-term– If you attach a narrow term…attach all broader

terms as well– If you search for a term…search for all narrow

terms as well

• Support multiple hierarchies - with cross-references indicated as synonyms (as available)

Lois Delcambre, OSU CS Colloquium Series 22

Climatologist PerspectiveForester Perspective

Lois Delcambre, OSU CS Colloquium Series 23

[Atmosphere] – [Air Quality] – [Air pollution] – [smoke]

Attachment Relationship using Climatologist Perspective

D1

[Vegetation Management] – [Air pollution] – [smoke]

Attachment Relationship using Forester Perspective

D2

Documents with Attachment Relationships

[Atmosphere] – [Air Quality] – [Air pollution] – [smoke]

Search specified in climatologist perspective

Lois Delcambre, OSU CS Colloquium Series 24

Search: blue terms wild card, black terms mandatory

Shows the attachment path for the document

Lois Delcambre, OSU CS Colloquium Series 25

Location Perspective (Heber)

Location perspective (Martin)

Lois Delcambre, OSU CS Colloquium Series 26

Templates for Metadata Entry

Location

Climate

Keywords

Soil

Hydrology

Planning

Authorizing Location

Slot

each slot isassociatedwith oneterm from one perspective

slot label

Lois Delcambre, OSU CS Colloquium Series 27

Metadata++

• Inspired by Dublin Core, Z39.19 (Thesaurus), …• Simple, uniform model: terms & relationships• No classes• No attributes (for terms or objects)• Basic idea – broader-term/narrower-term relationship

is intentionally overloaded to represent– Broader-term/narrower-term– Type – instance – Collection (set) – member– Traditional property name

• Model has been formalized; query and browse capability is being defined

Lois Delcambre, OSU CS Colloquium Series 28

MetaData eXtract

• Metadata attachment may take some time

• MDX helps by suggesting terms from Metadata ++

• Results are suggested to the user … interactively

The district silviculturalist at the McKenzie Ranger District on the Willamette National Forest is working on an EIS for a timber sale located within the upper McKenzie watershed. During the scoping process, the silviculturalist and rest of the IDT identified two areas in particular where the objectives would be to promote and accelerate the development of late successional characteristics over time.

Both areas are located within Douglas-fir forest types; one within a Western hemlock/dwarf Oregon grape plant association, or potential vegetation type, and one in a riparian reserve that has a plant association of Western hemlock/Oregon oxalis......

McKenzie Ranger District

Willamette National Forest

Douglas

-firWestern hemlock

potential

vegetation

Lois Delcambre, OSU CS Colloquium Series 29

Overview of the Talk

• Introduction to the project & application

• Metadata++

• Superimposed Schematics

Lois Delcambre, OSU CS Colloquium Series 30

Schematics: Decision Letter

Lois Delcambre, OSU CS Colloquium Series 31

Schematics: Review Letter

Lois Delcambre, OSU CS Colloquium Series 32

The Appeal Decision Schematic

loc desc

issuer

address

role

title

respondentFor

1:*

0:*

1:1 0:*

0:*

1:1

1:1

1:1

1:1

0:1

1:1

1:1

1:1 1:*

name

AppealDecision

date

Appeal

result

id num

concern

Issue

cover Decision

DecidingOfficer

response

Determination resolve

ReviewingOfficer

Appellant

behalf

Organization

status desc

review

request

regard

name

name

title

respondentFor

name

desc order

define

0:*

0:*

1:1 1:*

1:1

1:*

Lois Delcambre, OSU CS Colloquium Series 33

Part of a Populated SchematicDecision (D1)

AppealDecision (AD1)

cover (c1)

datelocissuerconcern

(n1)

Appeal (A1)regard (r1)

define (d1)

Issue (I1)

Lois Delcambre, OSU CS Colloquium Series 34

Part of a (different) Populated Schematic

Determination(D1)

resolve(r1)

Issue (I2)

Appeal (A1)

define (d1)

define (d2)

define (d3)

Determination(D1)

resolve(r1)

Issue (I2)

Determination(D1)

resolve(r1)

Issue (I2)

Lois Delcambre, OSU CS Colloquium Series 35

Querying a Superimposed Schematic

Issue [AppealDecision(id="1570-1-0032-10").concern(order=1)] The decision violates the Federal Advisory Committee Act (FACA). The illegal advisory committee played a central role in influencing the Forest Service Decision.

Issue [AppealDecision(id="1570-1-0032-10").concern(order=2)] The decision significantly reduces hunting opportunity and habitat for deer and elk.

Issue [AppealDecision(id="1570-1-0035-13").concern(order=1)] The District Ranger's decision is not in accordance with the legal requirements of the National Environmental Policy Act, the National Forest Management Act, and the Forest and Rangeland Renewable Resources Planning Act.

Issue [AppealDecision(id="1570-1-0038-19").concern(order=1)] Current stand condition is not adequately addressed, impacts on soil quality are not addressed, and that impacts to various species are not considered, including several late successional species, survey and manage species, and management indicator species.

“For Appeal Decisions made in the last two years, what Appellant Issues were raised for Decisions

concerning the Mount Hood National Forest”

Lois Delcambre, OSU CS Colloquium Series 36

Enhanced AddressingIssue [AppealDecision(id="1570-1-0032-10").concern(order=1)] The decision violates the Federal Advisory Committee Act (FACA). The illegal advisory committee played a central role in influencing the Forest Service Decision.

Issue [AppealDecision(id="1570-1-0032-10").concern(order=2)] The decision significantly reduces hunting opportunity and habitat for deer and elk.

Issue [AppealDecision(id="1570-1-0035-13").concern(order=1)] The District Ranger's decision is not in accordance with the legal requirements of the National Environmental Policy Act, the National Forest Management Act, and the Forest and Rangeland Renewable Resources Planning Act.

Issue [AppealDecision(id="1570-1-0038-19").concern(order=1)] Current stand condition is not adequately addressed, impacts on soil quality are not addressed, and that impacts to various species are not considered, including several late successional species, survey and manage species, and management indicator species.

concern (n1)

Issue (I1)

AppealDecision (AD1)

Determination (D1)

result (r1)

resolve (v1)

Lois Delcambre, OSU CS Colloquium Series 37

Superimposed Schematics

• Entity-relationship-style model is superimposed over arbitrary, base documents

• Each entity, each attribute, and each relationship can be “anchored” at some text excerpt

• Includes “authoritative” entities – such as for persontitle

respondentFor

1:1

0:1

1:1

1:1

name

AppealDecision

date id

DecidingOfficer

response

ReviewingOfficer

review

title

respondentFor

name

USDA FSEmployee

Lois Delcambre, OSU CS Colloquium Series 38

Superimposed Schematics

• Represented using the uni-level description– Generic, uniform representation for structured information– Can accommodate a variety of data models (database

models, XML, RDF, topic maps, …)– Can accommodate schema-first, schema-later, schema-

optional information– Can accommodate multiple levels of schema-instance

relationships in a single model– Based on a metamodel (with basic structures such as set,

bag, list, struct, attribute, and scalar)

• Logic-based language (Datalog) can easily be used to transform data (model-model, schema-schema, …)

Lois Delcambre, OSU CS Colloquium Series 39

What is Superimposed Information?

data “placed over” existing information sources to

highlight annotate elaborate select collect organize connect reuse

information elements

often to support new applications, beyond the original

Lois Delcambre, OSU CS Colloquium Series 40

Examples of Superimposed Information

Non-electronic examples:

Commentaries on religious texts, law, literature Concordances, citation indexes

Electronic examples:

Bookmark file in your web browser RDF metadata

Lois Delcambre, OSU CS Colloquium Series 41

The superimposed and base layers with marks

Superimposed Layer

BaseLayer Information

Source1

Information Source2

Information Sourcen

marks

Focus: building generic technologyTwo examples: Metadata++ and Superimposed Schematics

Lois Delcambre, OSU CS Colloquium Series 42