Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Introduction and Hands-on with Fedora 4
Search
David Wilcox
August 06, 2015
Technology
0
130
Introduction and Hands-on with Fedora 4
Given at the Islandora Conference, August 6, 2015.
David Wilcox
August 06, 2015
Tweet
Share
More Decks by David Wilcox
See All by David Wilcox
The Oxford Common File Layout
dwilcox
0
350
Choosing an Open Source IR Platform
dwilcox
0
87
Fedora Forward: Current Developments and Future Plans
dwilcox
0
140
Supporting Research Data Shared Services with Fedora
dwilcox
0
60
Introducing Fedora
dwilcox
0
2.1k
Fedora 4 Update
dwilcox
0
2.8k
Fedora 4 for Research Data
dwilcox
0
79
Introducing Fedora Repositories
dwilcox
0
2k
Fedora 4 Update
dwilcox
0
1.3k
Other Decks in Technology
See All in Technology
KubeCon EU: Unlocking new Platform Experiences with Open Interfaces
salaboy
1
380
統計的学習理論読み Chapter 1
kmatsui
4
960
サービス成長と共に肥大化するモノレポ、長くなるCI時間 / As services grow, monorepos get bigger and CI time gets longer
kohbis
5
2.1k
KubeCon EU 2024 : Knative Maintainers Session
salaboy
0
380
技術広報経験0のEMがエンジニアブランディングをはじめてみた
coconala_engineer
1
140
イチから学ぶdbt / Learn dbt from scratch
shinyaa31
0
150
初心者が行く!サーバレスWebアプリ開発の道
nagaharutogawa
0
450
エンジニア候補者向け資料2024.03.28.pdf
macloud
0
2.9k
Autopsy of a Cascading Outage from a MySQL Crashing Bug
jfg956
0
200
Challenges - Open Farming Hackdays 2024
loleg
0
570
データ品質をコード化! LINEヤフーのMLOpsを最適化する "ACP Data Quality" の紹介
lycorptech_jp
PRO
2
270
こんなに簡単!AWSマルチアカウント
takuya_terada
0
120
Featured
See All Featured
Making the Leap to Tech Lead
cromwellryan
123
8.4k
The Illustrated Children's Guide to Kubernetes
chrisshort
28
46k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
226
16k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
58
14k
Thoughts on Productivity
jonyablonski
57
3.8k
The World Runs on Bad Software
bkeepers
PRO
60
6.6k
What’s in a name? Adding method to the madness
productmarketing
PRO
14
2.6k
Bootstrapping a Software Product
garrettdimon
PRO
302
110k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
242
20k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
34
8.8k
Rebuilding a faster, lazier Slack
samanthasiow
72
8.2k
Learning to Love Humans: Emotional Interface Design
aarron
266
39k
Transcript
Introduction and Hands- on with Fedora 4 David Wilcox DuraSpace
Learning Outcomes Understand the purpose of a Fedora repository Understand
the key capabilities of the software Explore core and external features
Introduction to Fedora 4
What is a Fedora Repository? Secure software that stores, preserves,
and provides access to digital materials Supports complex semantic relationships between objects inside and outside the repository Supports millions of objects, both large and small Capable of interoperating with other applications and services
Exposing and Connecting Content Flexible, extensible content modeling Atomic resources
with semantic connections using standard ontologies RDF-based metadata using Linked Data RESTful API with native RDF response format
New Vocabulary Fedora 3 Fedora 4 Objects and Datastreams Resources
Objects Containers Datastreams Binaries
Core Features
Component Stack
Standards Focus on existing standards Fewer customizations to maintain Opportunities
to participate in related communities
Core Features and Standards CRUD - LDP Versioning - Memento?
Authorization - WebAC? Transactions Fixity Import/Export - RDF export?
Non-core Features
Two Feature Types Optional, pluggable components Separate projects that can
interact with Fedora 4 using a common pattern External components Consume and act off repository messages
Component Architecture
External Component Integrations Leverages the well-supported Apache Camel project Camel
is middleware for integration with external systems Can handle any asynchronous, event-driven workflow Indexing to Solr, external triplestore, etc.
None
Metrics A number of scalability tests have been run: Uploaded
a 1 TB file via REST API 16 million objects via federation 10 million objects via REST API
Hands-on with Fedora 4
Fedora Vagrant Components Solr Triplestore (Fuseki, Sesame) • Audit Service
• SPARQL-Query F4 LDP / WebAC?? / Memento?? Apache Camel
Final result (structure) • cover/ ◦ files/ ▪ cover.jpg ▪
cover.tiff • book/ ◦ members/ ▪ coverProxy • favorites/ ◦ members/ ▪ bookProxy
Final result (relationships) • cover/ ◦ pcdm:hasFile ▪ cover.jpg ▪
cover.tiff • book/ ◦ pcdm:hasMember ▪ cover/ • favorites/ ◦ pcdm:hasMember ▪ book/
Final result (relationships) <cover> pcdm:hasFile <cover.jpg> <cover> pcdm:hasFile <cover.tiff> <book>
pcdm:hasMember <cover> <favorites> pcdm:hasMember <book>
Create a Container named “cover” ...Note: names in demo are
only for readability
Make “cover” a pcdm:Object PREFIX pcdm: <http://pcdm.org/models#> INSERT { <http://localhost:8080/fcrepo/rest/cover>
rdf:type pcdm:Object } WHERE { }
Another way to make “cover” a pcdm: Object PREFIX pcdm:
<http://pcdm.org/models#> INSERT { <> a pcdm:Object } WHERE { }
Create “files” Container ...contained inside “cover”
Make “files” an ldp:DirectContainer PREFIX ldp: <http://www.w3.org/ns/ldp#> PREFIX pcdm: <http://pcdm.org/models#>
INSERT { </fcrepo/rest/cover/files> rdf:type ldp:DirectContainer . <> rdf:type pcdm:Object . <> ldp:membershipResource </fcrepo/rest/cover> . <> ldp:hasMemberRelation pcdm:hasFile . } WHERE { }
Another way to make “files” an ldp: DirectContainer PREFIX ldp:
<http://www.w3.org/ns/ldp#> PREFIX pcdm: <http://pcdm.org/models#> INSERT { <> a ldp:DirectContainer, pcdm:Object ; ldp:membershipResource </fcrepo/rest/cover> ; ldp:hasMemberRelation pcdm:hasFile . } WHERE { }
Create some cover binaries ...contained inside “files” cover.jpg cover.tif *
See auto-generated relationship on “cover” * Fixity
Create a “book” Container
Make “book” a pcdm:Object PREFIX pcdm: <http://pcdm.org/models#> INSERT { <>
a pcdm:Object } WHERE { }
Create a “members” Container ...contained inside “book”
Make “members” an ldp:IndirectContainer PREFIX ldp: <http://www.w3.org/ns/ldp#> PREFIX pcdm: <http://pcdm.org/models#>
PREFIX ore: <http://www.openarchives.org/ore/terms/> INSERT { <> a ldp:IndirectContainer, pcdm:Object ; ldp:membershipResource </fcrepo/rest/book> ; ldp:hasMemberRelation pcdm:hasMember ; ldp:insertedContentRelation ore:proxyFor . } WHERE { }
Create a “coverProxy” Container ...contained inside “members”
Make “coverProxy” proxy for... PREFIX pcdm: <http://pcdm.org/models#> PREFIX ore: <http://www.openarchives.org/ore/terms/>
INSERT { <> a pcdm:Object ; ore:proxyFor </fcrepo/rest/cover> ; ore:proxyIn </fcrepo/rest/book> . } WHERE { }
Bask in the magic... ...Generated relationship on “book”
Bonus Round
Create a “favourites” Container ...Just like “book”, except a pcdm:Collection
Make “favourites” a pcdm:Collection PREFIX pcdm: <http://pcdm.org/models#> INSERT { <>
a pcdm:Collection } WHERE { }
Create a “members” Container ...contained inside “favourites”
Make “members” an ldp:IndirectContainer PREFIX ldp: <http://www.w3.org/ns/ldp#> PREFIX pcdm: <http://pcdm.org/models#>
PREFIX ore: <http://www.openarchives.org/ore/terms/> INSERT { <> a ldp:IndirectContainer, pcdm:Object ; ldp:membershipResource </fcrepo/rest/favourites> ; ldp:hasMemberRelation pcdm:hasMember ; ldp:insertedContentRelation ore:proxyFor . } WHERE { }
Create a “bookProxy” Container ...contained inside “members”
Make “bookProxy” proxy for... PREFIX pcdm: <http://pcdm.org/models#> PREFIX ore: <http://www.openarchives.org/ore/terms/>
INSERT { <> a pcdm:Object ; ore:proxyFor </fcrepo/rest/book> ; ore:proxyIn </fcrepo/rest/favourites> . } WHERE { }
Success! ...See auto-created relationship on “favorites”
Other Features * Versioning * Transactions * Transform * Authorization
SPARQL Queries
Find Collections prefix pcdm: <http://pcdm.org/models#> select ?r where { ?r
a pcdm:Collection }
Find Resources with Members prefix pcdm: <http://pcdm.org/models#> select ?r ?m
where { ?r pcdm:hasMember ?m }
Find Resources with TIF files prefix pcdm: <http://pcdm.org/models#> prefix fedora:
<http://fedora.info/definitions/v4/repository#> prefix xsd: <http://www.w3.org/2001/XMLSchema#> select ?r ?m ?f where { ?r pcdm:hasMember ?m . ?m pcdm:hasFile ?f . ?f fedora:mimeType "image/tiff"^^xsd:string }
Find Resources with nested TIF files prefix pcdm: <http://pcdm.org/models#> prefix
fedora: <http://fedora.info/definitions/v4/repository#> prefix xsd: <http://www.w3.org/2001/XMLSchema#> select ?r ?m ?f where { ?r pcdm:hasMember+ ?m . ?m pcdm:hasFile ?f . ?f fedora:mimeType "image/tiff"^^xsd:string }
Find Binary larger than 1-MB prefix premis: <http://www.loc.gov/premis/rdf/v1#> prefix fedora:
<http://fedora.info/definitions/v4/repository#> select ?r ?s where { ?r a fedora:Binary . ?r premis:hasSize ?s . FILTER (?s > 100000) }
F4 / LDP / PCDM in action LDP-PCDM-F4+In+Action
Fedora 4 documentation Fedora 4 wiki Fedora 4 mailing lists
Useful Resources