Þubllcauon Þrocess

Cerhard lohler
Chalr for 8eal-ume SysLems
1echnlsche unlverslLaL kalserslauLern
rLs.elL.unl-kl.de
Þubllcauon Þrocess © Cerhard lohler, 2012 1
1he Llfe of a Sclenuñc 8esulL
lrom ldea Lo Þubllcauon
Cerhard lohler
Chalr for 8eal-ume SysLems
1echnlsche unlverslLaL kalserslauLern
rLs.elL.unl-kl.de
Þubllcauon Þrocess © Cerhard lohler, 2012 2
8esearch
Þubllcauon Þrocess © Cerhard lohler, 2012 4
WhaL ls research
• expand sLaLe-of Lhe-arL
• collaborauon of all researchers
– ºsLand on shoulders of glanLs"
• communlcaLed, known vla publlcauons
• sum of all publlcauons = enure knowledge of manklnd
• publlcauons cornersLone of knowledge and sclence
Þubllcauon Þrocess © Cerhard lohler, 2012 3
Þubllcauons
• lf lL ls noL publlshed, lL does noL exlsL
• documenL exLenslon of sLaLe-of-Lhe-arL
– lf lL ls new and correcL: publlcauon
– lf lL ls wrong: noL publlshed
– lL lL ls noL new: noL publlshed
• ºpubllshed":
– made publlc
– noL necessarlly on paper
Þubllcauon Þrocess © Cerhard lohler, 2012 6
Who decldes?
• wanL Lo ensure new and correcL
(ln parucular correcL)
• wanL Lo be able Lo LrusL resulLs publlshed
. so we don'L have Lo proof Lhem ourselves
• who can undersLand and check?
– oLher experLs
– noL a slngle ºboss"
• communlLy of sclenusLs checks and decldes
– whaL: publlcauons
– how: revlewlng process
Þubllcauon Þrocess © Cerhard lohler, 2012 7
ºnew" ºCorrecL"
new
• noL done before
• exLends sLaLe of Lhe arL
• noL Lrlvlal exLenslon
correcL
• proofs
• experlmenLs
• reproduclble
• sLausucs
– conñdence lnLervals eLcs
Þubllcauon Þrocess © Cerhard lohler, 2012 8
1ypes of Þubllcauons
Crowlng up for sclenuñc resulLs
Þubllcauon Þrocess © Cerhard lohler, 2012 9
. ln Lhe beglnnlng ls Lhe ldea
• ldea, LhoughL, lnslghL
• we have been curlous and found and answer
• we have an answer, now we look for a quesuon
• we made experlmenLs wlLh new resulLs
• lf lL ls only ln our head, lL does noL exlsL Lo Lhe ouLslde
(or Lo ourselves ln a few days)
Þubllcauon Þrocess © Cerhard lohler, 2012 10 Þubllcauon Þrocess © Cerhard lohler, 2012
1echnlcal 8eporL
we have worked ouL ldea wlLh Lhe meLhods learned
• done Lhe work
• compleLe proofs
• deLalled analysls
• slmulauon, varlous lLerauons
!"# %"&'()!#)% *"+, -. /".# *"+,
! documenLauon, !"#$%&#'( *"+,*!
11
Þubllcauon Þrocess © Cerhard lohler, 2012
1echnlcal reporL, cLd.
record all
– sclenuñc ñndlng
– meLhods
– resulLs
– concluslons
– analysls resulLs
– relevanL lnformauon
of a sclenuñc resulL
don'L selecL, puL lL all Lhere
12
1echnlcal reporL, cLd.
• auLhor(s)
memory ls shorL, handwrluen noLes hard Lo read
• pro[ecL Leam
• selecLed oLher researchers
– cooperauon parLners,
– geL feedback
Þubllcauon Þrocess © Cerhard lohler, 2012 13
Þubllcauon Þrocess © Cerhard lohler, 2012
1echnlcal reporL, cLd.
LengLh
• as long as needed, no resLrlcuons
CommenLs
• noL made publlcly avallable unul elLher publlshed or declded noL Lo publlsh
• usually unlverslues/deparLmenLs have Lechnlcal reporL serles (allow access)
14 Þubllcauon Þrocess © Cerhard lohler, 2012
Þubllc paper
• Lechnlcal reporLs senL ouL for commenLs Lo speclñc, known researchers for
feedback
• lf resulLs encouraglng, go publlc:
– workshop
– conference
– dlñerences are dlmlnlshlng
• collecuon of papers from presenLauons, eg, conference or workshop called
0+"&))%-!1.
13
Þubllcauon Þrocess © Cerhard lohler, 2012
Work-ln-Þrogress paper
Conferences encourage Lhe presenLauon of fresh and new ldeas ln *"+,2-!2
0+"1+).. (WlÞ) sesslons
• very shorL Lurn-around ume (< 6 weeks beLween submlsslon and
presenLauon)
• for sumulaung and new ldea
• speclal parL of conference, own chalr person
• 10 or less mlnuLes presenLauons
• publlcauon vla WWW
16 Þubllcauon Þrocess © Cerhard lohler, 2012
Workshop paper
• presenL lnLeresung ldeas whlch are noL fully esLabllshed or compleLed yeL
• geL feedback from oLher researchers, dlscuss ldea and area
• prepare for cooperauons or exchange of ldeas
• varlous formaLs
– genulne workshop
• presenLauons lnluaLe dlscusslons only
• worklng groups for speclñc Loplcs
– sloppy conference
17
Þubllcauon Þrocess © Cerhard lohler, 2012
Workshop paper, cLd.
Þurpose
• presenL baslc ldea
• geL feedback early on ln Lhe process
• geL hlnLs Lo open lssues, eLc.

8eadershlp
• auendanLs aL workshop
• oLher researchers
18 Þubllcauon Þrocess © Cerhard lohler, 2012
Workshop paper, cLd.
LengLh
• varlous formaLs
– )3#)!%)% 45.#+4&#: 1-2 pages, ~1000 words
– dlscusslon conLrlbuuon
– regular - or shorLer - conference paper

CommenLs
– oûen llmlLed publlcauon of proceedlngs
19
Þubllcauon Þrocess © Cerhard lohler, 2012
Conference paper
ldea reasonably maLure: conference
• presenL new sclenuñc resulLs Lo (compleLe) sclenuñc communlLy
• conLrlbuLes Lo general sclenuñc knowledge and exLends sLaLe-of-Lhe-arL
• presenL compleLed research
• enable conLacLs, cooperauons, eLc
20 Þubllcauon Þrocess © Cerhard lohler, 2012
Conference paper, cLd.
Þurpose
show sclenuñc resulLs
– relevanL problem
– new soluuon of slgnlñcanL lmprovemenL over exlsung one
– correcLness and valldlLy or soluuon
8eadershlp
• ln ñeld
LengLh
• usually 3000 words/ 8 lLLL pages (hup://www.leee.org/pubs/
auLhors.hLml)
• sLrlcL requlremenLs
21
Þubllcauon Þrocess © Cerhard lohler, 2012
Conference paper, cLd.

CommenLs
• usually presenLauons of 20 mlnuLes + 3 mlnuLes for quesuons
– sallenL resulLs only
– show problem ls relevanL
– soluuon
– why soluuon ls good
– evoke lnLeresL ln paper and research
• oûen references Lo Lechnlcal reporLs for more deLalls
22 Þubllcauon Þrocess © Cerhard lohler, 2012
!ournal paper
research on a number of deLalls coverlng a Loplc and ls compleLed: [ournal

Þurpose
• esLabllshed research resulL
• comprehenslve presenLauon
• Lhorough analysls, proofs, eLc.
• noL sLrlcL lengLh llmlLs as conferences
23
!ournal paper, cLd.
8eadershlp
enure sclenuñc communlLy, also ouLslde of lmmedlaLe ñeld (eg. lLLL
1ransacuons on Soûware Lnglneerlng hup://compuLer.org/Lse/)
• hlgh sLandards
– revlewlng
– lmpacL
– language, presenLauon, sLyle
• general Loplcs
• .0)&-4/ -..').
Þubllcauon Þrocess © Cerhard lohler, 2012 24
Lvaluauon of Þapers
lrom submlsslon Lo publcauon
Þubllcauon Þrocess © Cerhard lohler, 2012 23
Sclenuñc communlLy
• lnLernauonal sclenuñc communlLy ls noL hlerarchlcally organlzed
– no slngle person or body Lo [udge research
• Crganlzauonal bodles
– lLLL, ACM, Lu8CMlC8C
– for admlnlsLrauon, organlzauon, noL research
– Lo coordlnaLe and sumulaLe processes descrlbed below
Þubllcauon Þrocess © Cerhard lohler, 2012 26
8aslc paradlgm
• sclenusLs are all peers (same level)
– no ºboss" ñgures Loo declde alone
• consensus of peers decldes on whaL ls good aL a ume
• good ldeas wlll prevall
l.e., wlll geL selecLed oûen
• adopuon Lo developmenL of research and demands by
– dlverslLy of peers
– roLauon of funcuons
Þubllcauon Þrocess © Cerhard lohler, 2012 27
Who are Lhe peers?
how do Lhey shape research?
members of Lhe sclenuñc communlLy
• researcher lnvlslble research
• auLhors research vlslble
• revlewer glves oplnlon on slngle paper
• program commluee decldes program of a conference based
on revlewers oplnlon
• program commluee chalr decldes Lune of conference by
selecung program commluee
• researchers selecL program commluee chalr
Þubllcauon Þrocess © Cerhard lohler, 2012 28
Þrogram Commluee
• program commluee chalr ls asslgned anew for each lnsLance of conference
or dlñerenL conferences
• program commluee (ÞC) and revlewers consequenLly change ln Lurn
• ÞC members esLabllshed members of research communlLy wlLh proven
research record
• conference of varlous lmpacL (presuge)
– ma[or ln real-ume:
– lLLL 8eal-ume sysLems symposlum
– lLLL 8eal-ume Lechnology and appllcauon symposlum
– LC81S - Lu8CMlC8C Conference on real-ume sysLems
Þubllcauon Þrocess © Cerhard lohler, 2012 29
!ournals
• !ournal a llule more ñxed
– publlshed by organlzauon or company
– edlLorlal board, edlLors-ln-chlef
– guesL edlLors
• 8eal-ume (relaLed):
– 8eal-1lme SysLems - 1he lnLernauonal !ournal of 1lme-Crlucal
Compuung SysLems, kluwer - varylng quallLy
– lLLL 1ransacuon on Soûware Lnglneerlng hup://compuLer.org/Lse/
– lLLL 1ransacuon on CompuLers hup://compuLer.org/Lc/
– lLLL 1ransacuon on Þarallel and ulsLrlbuLed SysLems hup://
compuLer.org/Lpds/
Þubllcauon Þrocess © Cerhard lohler, 2012 30
Þaper Selecuon Þrocess
• 8esearchers selecL program commluee chalr
• Þrogram commluee chalr selecLs program commluee
• ÞC chalr lssues Call-for-papers (CfÞ), posslbly wlLh Lheme
• AuLhors submlL papers
• ÞC chalr dlsLrlbuLes papers for revlewlng Lo ÞC members
• ÞC members redlsLrlbuLe papers Lo addluonal revlewers
• ÞC and chalr declde aL ÞC meeung whlch papers Lo accepL
Þubllcauon Þrocess © Cerhard lohler, 2012 31
Þrogram Commluee Meeung
• aL good conferences physlcal, ln person meeung
• e.g. LC81S 12
– 111 papers submlued
– 39 ÞC members
– 119 secondary revlewers
– each paper aL leasL 3 revlews
– ca 330 revlews
Þubllcauon Þrocess © Cerhard lohler, 2012 32
Þrogram Commluee Meeung, cLd.
• ÞC meeung a full SaLurday
– ca. x papers prere[ecLed
all revlewer scores Loo low
– ca 10 papers qulck accepL
– leaves 30 papers for dlscusslon
• 8 hours neL ÞC meeung
• ca 9 mlns per paper for dlscusslon average
• conclse and lnformauve revlew reporLs essenual
– noL enough ume aL meeung Lo read and undersLand
Þubllcauon Þrocess © Cerhard lohler, 2012 33
8evlewlng
• supporL ÞC or edlLor wlLh lnformauon for declslon on paper accepLance
• lmporLanL conLrlbuuon Lo advance of research
• experLs ln parucular ñeld
• also Þhu sLudenLs (oûen very good and Lhorough revlews)
Þubllcauon Þrocess © Cerhard lohler, 2012 34
8evlew reporL

• varles, common shape
• numerlcal evaluauon
suggesLed formaL
• one paragraph: conclse summary of paper
– lncludlng assumpuons
– conLrlbuuon
– no oplnlon yeL
Þubllcauon Þrocess © Cerhard lohler, 2012 33
8evlew reporL, cLd.
• few paragraphs: evaluauon
– assessmenL of paper
– posluve and negauve sldes
– unclear polnLs
– all polnLs here wlLh facLs
• summary
– accepL/noL accepL, why
– one senLence
• furLher commenLs
– mlnor polnLs, eg, unclear, Lypos,.
– hlnL for lmprovemenL
Þubllcauon Þrocess © Cerhard lohler, 2012 36
ueclslons
• declslons on accepLance aL conferences are ñnal
– ln exLreme cases no perfecL
– buL noL enough ume
– Lry nexL conference
• !ournals
– oûen ºma[or" and ºmlnor" revlslon posslble
Þubllcauon Þrocess © Cerhard lohler, 2012 37
Pow do read revlew declslons
• ºLhe revlewer ls sLupld, dldn'L undersLand my paper"
– maybe, buL lL ls your [ob Lo ensure he does
• ºLhe revlewer dldn'L geL Lhe message"
– maybe, buL lL ls your [ob Lo Lell lL well
• address all revlewers' concern
– even lf you Lhlnk Lhey are sLupld
– Lhey mlghL be your revlewers agaln
– Lhere ls a good chance you dldn'L wrlLe lL well
Þubllcauon Þrocess © Cerhard lohler, 2012 38
ConßlcLs of lnLeresL
• only sclenuñc merlL decldes on publlcauon
– lf lL ls new and correcL
– lf noL correcL, mlghL have blg consequences
• conßlcLs of lnLeresL (Col)
– noL only sclenuñc merlL for declslon
– frlends, enemles, someone wlLh slmllar resulL, eLc
• very serlous lssues!
• lf you feel your oplnlon ls noL only lnßuenced by sclenuñc merlL:
– you have Col, don'L be lnvolved ln declslon
Þubllcauon Þrocess © Cerhard lohler, 2012 39
ConßlcLs of lnLeresL, cLd.
• acLual Col
– clear
• percelved Col
– e.g., people know you are frlend eLc of auLhor x
– oLher people mlghL noL speak freely, you are frlend and mlghL
remember/Lell, eLc
• anonymlLy of revlewlng/declslon
– basls for Col free declslons, based on merlL only
– essenual:
no lnformauon abouL Lhe process or people lnvolved can go back Lo
auLhor
• wlLh Col mlghL score few polnLs ln shorL Lerm, harm sclence ln long Lerm
Þubllcauon Þrocess © Cerhard lohler, 2012 40
Conference Þrogram
conslsLs of
• Lechnlcal presenLauons of accepLed papers
– Lyplcally 20 mlns + 3 mlns quesuons and swlLchlng
• coñee breaks
– essenual for dlscusslons and neLworklng
• speclal sesslons
– keynoLes, work-ln-progress, eLc
• soclal evenLs, awards, eLc
Þubllcauon Þrocess © Cerhard lohler, 2012 41