Professional Documents
Culture Documents
Ming-Hsuan Yang
Outline
• Conferences
• Journals
• Writing
• Presentation
• Lessons
Conferences
• CVPR – Computer Vision and Pattern
Recognition, since 1983
– Annual, held in US
• ICCV – International Conference on Computer
Vision, since 1987
– Every other year, alternate in 3 continents
• ECCV – European Conference on Computer
Vision, since 1990
– Every other year, held in Europe
Conferences
• ACCV – Asian Conference on Computer
Vision
• BMVC – British Machine Vision Conference
• ICPR – International Conference on Pattern
Recognition
• SIGGRAPH
• NIPS – Neural Information Processing
Systems
Conferences
• MICCAI – Medical Image Computing and Computer-
Assisted Intervention
• FG – IEEE Conference on Automatic Face and
Gesture Recognition
• ICCP – IEEE International Conference on
Computational Photography
• ICML – International Conference on Machine
Learning
• IJCAI, AAAI, MVA, ICDR, ICVS, DAGM, CAIP,
ICRA, ICASSP, ICIP, SPIE, DCC, WACV, 3DPVT,
ACM Multimedia, ICME, …
Conference Location
Conference Location
1593
1250 8.15%
1160 1131
8.00%
1000 6.63%
6.38%
1000 920 905
5.76%
6.00% 5.40%
4.77% 4.80%
4.52%
4.21%
551 544 3.95%
453 504 466 4.00% 3.52% 3.34% 3.30%
500 2.48%
2.00%
0 0.00%
96 97 98 99 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 96 97 98 99 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15
50.00% 47.21%
45.00% Overall
40.00%
35.00% 31.80% 31.89%
30.68%29.76% 29.88%
29.67%
30.00% 28.02%28.12%28.24% 28.40%
26.00% 26.41%26.74%26.12% 26.25%
24.86% 24.06%
25.00% 23.09%
20.00%
15.00%
10.00%
5.00%
0.00%
96 97 98 99 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15
ICCV
Submission Oral
1800 1698 9.00%
1629 8.00%
1600 8.00% 7.45% 7.55%
1400 1327 7.00%
1230 1190 1216
1200 6.00%
966
1000 5.00% 4.45%
3.95%
800 4.00% 3.66% 3.62% 3.70%
3.30%
550 575 596
600 3.00% 2.52%
400 2.00%
200 1.00%
0 0.00%
98 99 01 03 05 07 09 11 13 15 98 99 01 03 05 07 09 11 13 15
40.00%
34.40% Overall
35.00%
30.36% 30.30%
30.00% 28.35% 27.96%27.90%
25.00% 23.53%23.21%
20.60%19.84%
20.00%
15.00%
10.00%
5.00%
0.00%
98 99 01 03 05 07 09 11 13 15
ECCV
1600 20.00% 19%
Submission 1437 1444
18.00% Oral
1400 16%
1174 16.00%
1200
14.00%
1000 900 12.00%
871
800 10.00%
600 555 8.00% 8% 7%
600
6.00% 4% 5%
400
223 266 4.00% 3% 3% 3%
200 2.00%
0 0.00%
98 00 02 04 06 08 10 12 14 98 00 02 04 06 08 10 12 14
60.00%
50.22% Overall
50.00%
43.61%
40.00% 37.67%
34.23%
10.00%
0.00%
98 00 02 04 06 08 10 12 14
Top 100 Publications - English
• For what it is worth (h5 index by Google
Scholar)
1. Nature
2. The New England Journal of Medicine
3. Science
…
55. IEEE Conference on Computer Vision and
Pattern Recognition (CVPR)
…
Top Publications - E&CS
1. Nano Letters
…
8. IEEE Conference on Computer Vision and
Pattern Recognition (CVPR)
...
16. IEEE Transactions on Pattern Analysis and
Machine Intelligence
…
Reactions
• Top journal papers
• Workshops vs conferences
• Waiting for the review or final results
• Acceptance
• Reject
• Mixed feeling
• Finding an error
• Resubmit?
• This time, it will go through
• Paper finally accepted
• Registration
• Oral presentation
• Poster presentation
Database Community
• Jeffrey Naughton’s ICDE 2010 keynote
• What’s wrong with the reviewing process?
• How to fix that?
Journals
• PAMI – IEEE Transactions on Pattern
Analysis and Machine Intelligence, since 1979
(impact factor: 5.96, #1 in all engineering and AI,
top-ranked IEEE and CS journal)
• IJCV – International Journal on Computer
Vision, since 1988 (impact factor: 5.36, #2 in all
engineering and AI)
• CVIU – Computer Vision and Image
Understanding, since 1972 (impact factor: 2.20)
Journals
• IVC – Image and Vision Computing
• TIP – IEEE Transactions on Image Processing
• TMI- IEEE Transactions on Medical Imaging
• MVA – Machine Vision and Applications
• PR – Pattern Recognition
• TMM – IEEE Transactions on Multimedia
• …
PAMI Reviewing Process
• Associate editor-in-chief (AEIC) assigns
papers to associate editors (AE)
• AE assigns reviewers
• First-round review: 2-4 months
– Accept as is
– Accept with minor revision
– Major revision
– Resubmit as new
– Reject
PAMI Reviewing Process
• Second-round review: 2-4 months
– Accept as is
– Accept with minor revision
– Major revision (rare cases)
– Reject
• EIC makes final decision
• Overall turn-around time: 6 to 12 months
• Rule of thumb: 30% additional work beyond a
CVPR/ICCV/ECCV paper
IJCV/CVIU Reviewing Process
• Similar formats
• Slightly longer turn-around time
Journal Acceptance Rate
• PAMI
– 2013: 151/959: 15.7%
– 2014: 160/1018: 15.7%
• IJCV: ~ 20% (my guess, no stats)
• CVIU: ~ 25% (my guess, no stats)
From Conferences to Journals
• How much additional work?
– 30% additional more work for PAMI?
– As long as the journal version is significantly
different from the conference one
• Novelty of each work
– Some reviewers still argue against this
– Editors usually accept paper with the same ideas
How to Get Your CVPR Paper Rejected?
• One CVPR paper: BR, BR, DR Two ECCV papers: PA, PA, BR
• Two ECCV paper: PR, PR, BR One CVPR 15 paper: WA, BR, BR -> Poster, Poster, WR
• One CVPR 15 paper: BR, BR, WR -> poster, poster, poster One CVPR 16 paper: WR, WR, BR
• One CVPR 15 paper: DR, WA, BR -> Poster, Poster, WR
Never Know What will Happen
Masked Meta-Reviewer ID: Meta_Reviewer_1
Meta-Reviews:
Question
Consolidation Report
All reviewers agree that this paper has moderate novelty of using partial and
spatial information for sparse representation. However, they also concern about
- unclear presentation on technical details (eg. definitions, inference algorithm,
pooling methods, template updating schemes, experimental settings etc.),
- not extensive experimental comparison (needs tests on more challenging
videos),
- missing justification of the assumption (complementary nature of two kinds of
pooling features) and the efficacy of each term.
The authors rebuttal addresses most issues, but is not sufficient to ease the
main concerns of R1 and R2. So, the AC recommends the paper to be rejected
as it is.
Decision
Definitely Accept
Challenging Issues
• Large scale
– CVPR 2011 best paper: pose estimation
– CVPR 2013 best paper: object detection
• Unconstrained
• Real-time
– CVPR 2001: face detector
– CVPR 2006: scalable object recognition
• Robustness
• Recover from failure
Interesting Stats
• Best papers and top cited papers in computer s
cience
• Best papers = high impact?
• Oral papers are more influential?
• CVPR Longuet-Hggins prize
• ICCV Helmholtz award
Data Set Selection
• NIPS 02 by Doudou LaLoudouana and
Mambobo Bonouliqui Tarare, Lupano
Tecallonou Center, Selacie, Guana
• The secret to publish a paper in machine learni
ng conferences?
• Read the references therein carefully!
Data Set Selection
Data Set Selection
Data Set Selection
• Disclaimer:
– h index = significance?
– # of citation = significance?
Basic Rules
• Use LaTeX
• Read authors’ guideline
• Read reviewers’ guideline
• Print out your paper – what you see may NOT be
what you get
• Submit paper right before deadline
– Risky
– Exhausting
– Murphy’s law
• Do not count on extension
Lessons
• Several influential papers have been rejected
once or twice
• Some best papers make little impact
• Never give up in the process
Karma?
Your Advisor and You
• Suggesting a research topic
• When your advisor presents your work
• When you explain your work
• Demos
• Good results
Start Working Early!
• Write, write, write…
• Ask others for comments
Work Hard in the Summer
Quotes from Steve Jobs
• “ I'm convinced that about half of what separates
successful entrepreneurs from the non-successful
ones is pure perseverance. ”