lronuers of

CompuLauonal !ournallsm
Columbla !ournallsm School

Week 8: knowledge 8epresenLauon
CcLober 24, 2014



unsLrucLured daLa
SLrucLured daLa
!"#$%&'()*+)(, clrca 2009
-(..#)/#0 -23.4. 8euLers, 2013
Arucle MeLadaLa
headllne
phoLo
phoLo capuon
byllne
phoLo credlL
publlcauon daLe
daLellne
arucle body
relaLed arucles
Schema.org news markup
Cverall Lype of Lhe ob[ecL on Lhls page, ln P1ML head
Peadllne, daLellne, daLe as addluons Lo dlv/span properues
8yllne expressed as nesLed ob[ecL (uslng lLemscope) of Lype schema.org/erson
urlvlng appllcauon: rlch snlppeLs"
Schema.org covers noL [usL news buL muslc, resLauranLs,
people, organlzauons, revlews, oers...

SnlppeLs, and beuer search-ablllLy generally, are mouvauon
for Coogle, ?ahoo, 8lng Lo push schema.org
Addluonal meLadaLa from lndexlng Leam
ln daLabase, buL doesn'L necessarlly make lL Lo P1ML.
news appllcauon: conLenL navlgauon
Arucles abouL Syrla"
on n?1 Loplc page

More rellable Lhan slmple LexL
search (because Lhe relevance
algorlLhm knows a sLory ls
"abouL" Syrla.)
CnLologles
WhaL ob[ecLs and relauons are avallable?
Cen represenLed as class hlerarchy.
Arrows = ls_a" relauon
(arL of) a real onLology, from Cyc
Lvery blg news org has Lhelr own
blg onLology !
Loplcs, people, organlzauons, places...
?aaay Llnked uaLa!
1rlples of (sub[ecL relauon ob[ecL), each a u8L or llLeral

<urn:x-states:New%20York>
<http://purl.org/dc/terms/alternative>
"NY

<http://dbpedia.org/resource/Columbia_University>
<http://www.w3.org/1999/02/22-rdf-syntax-ns#type>
<http://schema.org/CollegeOrUniversity>

Abbrevlauons posslble wlLh many formaLs...
<http://dbpedia.org/resource/Columbia_University>
rdf:type ns6:CollegeOrUniversity


n?1 onLology avallable as LCu
owl:SameAs makes Lhls lnLeroperable
n?1 Al can reLurn llnked daLa
{
"title": "Syria's Rebels Open Talks on Forging United Political
Front"
"body": "BEIRUT, Lebanon Syria s fractious opposition groups
began negotiations in Doha, Qatar, on Sunday to forge a more unified
front to reshape the political landscape in a bloody conflict that
claims more than 100 lives virtually every day. Given the scant
prospects that any attempt to restructure the opposition will succeed
the",
"dbpedia_resource_url": [
"http://dbpedia.org/resource/Hillary_Rodham_Clinton",
"http://dbpedia.org/resource/Bashar_al-Assad"],
"facet_terms": "CLINTON, HILLARY RODHAM ASSAD, BASHAR AL- SYRIA
DOHA (QATAR) SYRIAN NATIONAL COUNCIL STATE DEPARTMENT WAR AND
REVOLUTION DEFENSE AND MILITARY FORCES"
}

Cb[ecLs and relauons ln LexL?
names, daLes, places,
verbs.
named LnuLy 8ecognluon
LxLracL sub[ecLs, ob[ecLs, from LexL.
Also, resolve pronouns lf posslble.

"Cov. Andrew M. Cuomo on Wednesday gave a
sea wall Lhe nod. 8ecause of Lhe recenL hlsLory
of powerful sLorms hlmng Lhe area, he sald,
elecLed omclals have a responslblllLy Lo conslder
new and lnnovauve plans Lo prevenL slmllar
damage ln Lhe fuLure."
nL8 sLaLe of Lhe arL
Commerclal: Coogle knowledge Craph
Academlc: SLanford nL8 llbrary
nexL level of undersLandlng: verbs
1he waLer LhaL made rlvers of Avenues C and u
receded on 1uesday, and Lhe LasL vlllage was a
mlxLure of dlsasLer and nonchalance. A group of
young men ln pa[ama panLs and shorLs Lhrew a
fooLball on LasL 12Lh SLreeL, whlle workers
pumped Lhe basemenL of CP Pardware on
Avenue C and LlghLh SLreeL."
sub[ecL verb ob[ecL
knowledge 8epresenLauon ln Al
(a crazy brlef lnLroducuon)
Classlc "symbollc" paradlgm represenLs
knowledge as sLaLemenLs ln maLhemaucal loglc.

Many varlauons. MosL are subseLs or
modlcauons of sLandard rsL order loglc (lCL).

redlcaLes and 8elauons
redlcaLe: asserLs LhaL ob[ecL belongs Lo a class
vechicle(schoolbus)
bird(tweety)
straight_gangsta(emily_bell)

8elauon: asserLs relauonshlp beLween ob[ecLs
is_a(car, vehicle)
higher_rank(general, colonel)
capital(paris, france)

lnference
Ceneral rules
a " (a => b) => b
p # !p

uomaln speclc lnferences
is_a(car, vehicle)
can_move(vehicle)
=> can_move(car)

news as relauons beLween enuues
Allce auended Lhe weddlng"
attended(alice, wedding)

l8M was founded ln 1917."
founded(IBM, 1917)

Purrlcane Sandy hlL new ?ork"
hit(hurricane_sandy, New_York)





Lncode facLs as relation(subject,object)
also wrluen (subject relation object)
1hlngs we could do wlLh Lhls
Cuesuon answerlng
1he granddaughLer of whlch acLor sLarred ln L.1.?"
(?x acted-in E.T.)(?y is-a actor)(?x granddaughter-of ?y)

lnference
(bob brother-of alice)
(alice mother-of lucy) =>
(bob uncle-of lucy)

Answer quesuons uslng lnference
how many execuuves of publlcly-Lraded Canadlan companles dled ln car
crashes?
roblems
noL all sub[ecLs are slmple.

Cver a hundred guesLs auended Lhe weddlng"
attended(num_guests, wedding)
greater_than(num_guests,100)

Some relauons have muluple parLs.

Purrlcane Sandy hlL new ?ork on Monday"
hit(sandy, New_York, monday)





SLandard lnference doesn'L allow defaulLs
All blrds y"
bird(tweety)
bird(?x) => flies(?x)
=> flies(tweety)

8uL, pengulns and chlckens don'L y"
bird(?x) & !penguin(?x) & !chicken(?x)=> flies(?x)

now we can'L guess LhaL LweeLy les
bird(tweety) => flies(tweety) ?
we dont know!







SLandard maLhemaucal loglc doesn'L
deal well wlLh excepuons
Some people don'L have a lasL name.

Someumes an elecuon lsn'L declded on elecuon day.

ls a Lrash can used as a ower poL sull a Lrash can?

ls a broken car sull a vehlcle lf lL can'L move?










8elauons from senLence parslng
1he waLer LhaL made rlvers of Avenues C and u
receded on 1uesday, and Lhe LasL vlllage was a
mlxLure of dlsasLer and nonchalance. A group of
young men ln pa[ama panLs and shorLs Lhrew a
fooLball on LasL 12Lh SLreeL, whlle workers
pumped Lhe basemenL of CP Pardware on
Avenue C and LlghLh SLreeL."
sub[ecL verb ob[ecL
8elauon exLracuon sysLems
Commerclal: l8M's ueepCA (WaLson)
Academlc: Cpen lL pro[ecL
CnLology exploslons
(waLer made rlvers of Avenues C and u)
(LasL vlllage was a mlxLure of dlsasLer and nonchalance)
(group of young men ln pa[ama panLs and shorLs Lhrew fooLball)
(workers pumped Lhe basemenL of CP Pardware )

uo we have all of Lhese ln Lhe onLology?
Ceneral Cuesuon Answerlng"
reclslon/recall Lradeo. SLaLe of Lhe arL ls l8M's ueepCA
ueepCA use of sLrucLured daLa
WaLson can also use deLecLed relauons Lo query a
Lrlple sLore and dlrecLly generaLe candldaLe answers.
uue Lo Lhe breadLh of relauons ln Lhe !eopardy domaln
and Lhe varleLy of ways ln whlch Lhey are expressed,
however, WaLson's currenL ablllLy Lo eecuvely use
curaLed daLabases Lo slmply look up" Lhe answers ls
llmlLed Lo fewer Lhan 2 percenL of Lhe clues."

5 6#$$7)3 #/+ 4'+ 8973'03.: ;4/<(.=
Wall SLreeL ls hlgh on Molson Coors 8rewlng (1A), expecung lL Lo reporL
earnlngs LhaL are up 17.3 from a year ago when lL reporLs lLs Lhlrd quarLer
earnlngs on Wednesday, november 7, 2012. 1he consensus esumaLe ls $1.34
per share, up from earnlngs of $1.14 per share a year ago.

1he consensus esumaLe has dlpped over Lhe pasL monLh, from $1.33, buL lL's
sull up from Lhe consensus esumaLe of $1.19 Lhree monLhs ago. lor Lhe scal
year, analysLs are expecung earnlngs of $3.89 per share. 8evenue ls pro[ecLed
Lo ecllpse Lhe year-earller LoLal of $934.4 mllllon by 31, nlshlng aL $1.23
bllllon for Lhe quarLer. lor Lhe year, revenue ls pro[ecLed Lo roll ln aL $4.04
bllllon.

1he company's neL lncome has decllned ln Lhe lasL Lwo quarLers. 1he
company posLed proL falllng by 32.8 ln Lhe second quarLer. 1hls ls aer lL
reporLed a proL decllne ln Lhe rsL quarLer by 4.1.
AuLomauc sLory generauon, by narrauve Sclence