Profile

Cover photo
Bill Byrne
Works at Clare College, Cambridge
Attended University of Maryland, College Park
Lived in Cambridge,UK
197 followers|4,509 views
AboutPosts

Stream

Bill Byrne

Shared publicly  - 
 
Congrats to Hynek !!
1
Add a comment...

Bill Byrne

Shared publicly  - 
1
jordan cohen's profile photoBill Byrne's profile photoFernando Pereira's profile photo
3 comments
 
X-country skis would have been just the thing.
Add a comment...

Bill Byrne

Shared publicly  - 
 
I really like this WMT2011 paper that analyses the human judgements from WMT 2010. Two of the recommendations are right on target:

" We recommend the reference be sampled at a lower rate than other systems, so as to play a smaller role in the evaluation. We also recommend better quality control over the production of the references.

" Pairwise comparisons derived from 5-fold rankings are sometimes unreliable. Even a targeted pairwise comparison of two systems can shed little light as to which is superior.

These are exactly the points i attempted to make in the discussion session at least year's workshop. The methodological problems are really obvious if you look through the data (for instance, if you're trying to figure out why a system with a good bleu score ended up doing so very badly under human judgements). In my view the authors have done an admirable job in describing the problems and suggesting corrections.

But I think the problem might be worse even than they describe - for example, i thought i saw combinations of problems, such as an interaction between the number of times a system was judged and the number of times the human references were included in the comparisons. The two can act together to lower a system's relative ranking.
5
3
Add a comment...
Have him in circles
197 people
Delip Rao's profile photo
Matt Stuttle's profile photo

Bill Byrne

Shared publicly  - 
2
jordan cohen's profile photo
 
Thanks - it's good to see that machine translation is well in hand, as always!
Add a comment...

Bill Byrne

Shared publicly  - 
 
I'm far more ambivalent about Christopher Hitchens than most people. His writing was usually interesting to read, but when it came to serious matters his enthusiasms caused real harm. I think he should have withdrawn from public life once it became clear how horribly wrong he was about the Iraq war. In particular, what Hitchens wrote about Mark Daily was truly disturbing. I thought i was the only person who thought this, until i saw the piece by David Runciman in the LRB.
1
Add a comment...

Bill Byrne

Shared publicly  - 
 
Anybody familiar with the paper mentioned here ?

"It's a new level of absurdity," said Mike Phillips, Co-founder and Chief Technology Officer, Vlingo. "Nuance actually used an academic research paper from Interspeech 2011, a well known research conference, to accuse Vlingo of running infringing experiments. I have been attending these conferences for decades and have never seen anything this ridiculous. "
1
Bill Byrne's profile photoDaniel Povey's profile photoMurat Saraclar's profile photo
5 comments
 
I couldn't find any such paper in the proceedings
Add a comment...

Bill Byrne

Shared publicly  - 
 
The FAUST project was featured on the BBC World Service Programme Click, including an interview with yours truly.
3
peng xu's profile photo
peng xu
 
Nice to hear your American voice within the British ones :)
Add a comment...
People
Have him in circles
197 people
Delip Rao's profile photo
Matt Stuttle's profile photo
Education
  • University of Maryland, College Park
    Electrical Engineering, 1993
  • Cornell University
    Electrical Engineering, 1982
Basic Information
Gender
Male
Work
Occupation
Speech and language processing research
Employment
  • Clare College, Cambridge
    Fellow, present
  • Department of Engineering, University of Cambridge
    Reader in Information Engineering, present
  • Center for Language and Speech Processing, Johns Hopkins University
    Associate Professor (Resarch), 2004
  • Voice Signal Technologies
    Senior Research Engineer
  • Entropic Research Labs
    Research Engineer
Places
Map of the places this user has livedMap of the places this user has livedMap of the places this user has lived
Previously
Cambridge,UK - Baltimore, MD - Ithaca, New York - Denver, CO - Washington, DC - East Lansing, MI - Pelham, NY - NY, NY - Bethesda, MD