Single critic opinions or panel tastings? Which is the best?

OLYMPUS DIGITAL CAMERA

Yesterday Tim Atkin released his South African wine report. It’s created quite a bit of discussion, and it’s also raised once again for me the question of single critics versus panel tastings. Which is the best?

Tim has worked very hard tasting a lot of wines, as do the competing critics from the big publications such as The Wine Advocate and The Wine Spectator. And then of course, there’s also Jancis Robinson (and team), and James Suckling (and team) and the new Gallioni/Tanzer grouping. There are critics everywhere, making a living selling access to scores and tasting notes. The competition is fierce, and they are all chasing the same consumers.

The critic model champions one person’s opinion. But the unspoken assumption behind many of these publications is that their critics are so skilled that they can effectively taste objectively, and reveal (or get very close to) the truth about a wine. This assumption is that if several critics are equally highly skilled, they will reach the same judgement about any particular wine. And each critic would probably like you to think that they are especially skilled – they have a gift – and so their judgments are worth paying $$$ for.

This is wrong. Tasting is personal. Judging wine is personal. However objective we try to be, we can’t be, fully. I have style preferences. I like certain wines. Whether or not you find my tasting notes and recommendations useful depends on whether or not you like my palate preferences. That’s my branding, if you will. The major critics would like you to think that their pronouncements are relevant to all drinkers. Well, they aren’t.

Look at the way that experts – all skilled and experienced – disagree when faced with interesting wines. The World of Fine Wine tastings (where the scores of each taster are published) illustrate this beautifully. It’s not that some of them are doing a bad job. It represents a genuine disagreement about what constitutes a great wine.

OLYMPUS DIGITAL CAMERA

So what about panel tastings? Are they of use? Yes, they’re really valuable. I take part in them regularly. The International Wine Challenge, the National Wine Awards of Canada, the South African Top 100 and the Standard Bank Top 10 Chenin Blanc competitions are all excellently run, with great judges, and produce results that are useful for producer and consumer alike. The averaging of several opinions provides robustness to the results. But it does have the side effect that it doesn’t serve edgy, distinctive and unusual wines very well – the varying opinions get averaged out and the wines will get lost in the middle.

So we really need both. I like to read reviews from critics whose palate I agree with. But when it comes to awards, trophies and classifications, I think the panel method is more robust. This is where I am slightly uncomfortable with Tim’s Cape Classification, because it’s attempting to produce something that is taken seriously by the industry, yet is based on one person’s opinion (albeit a very valuable opinion). We need to be a bit humble in the face of wine, and any attempt to produce an authoritative ranking is best done on the basis of several pooled expert opinions (as withe the annual Platter Guide’s five star wines).

3 comments to Single critic opinions or panel tastings? Which is the best?

  • Brave post Jamie but I tend to agree. Panels are better for golds and silvers and so on at the big shows – if loads of qualified tasters agree, then they all can’t be that far off the mark. But as you say, that weird hazy 11% Gamay that only you get is going to polarise critics and so get averaged down. For those kind of wines you need people such as yourself to unearth / champion them and then it’s up to us to decide whether we like them and your definition of exciting or not.

  • Sabrina Durand

    Really good opinion article, research has also shown woman taste differently as well and they are the new target market and personally found Tim Atkins article kind of arrogant!

  • Not a big problem :

    – or you trust one voice, essentially because it fits your own taste, the comments and points of a specific Master (i.e. Parker, Bettane, Payne, Galloni, Meadows) , and nobody can criticize that
    – or you are not happy with a single voice, and then, as I have done of 16 years with the panel of the Grand Jury Européen (GJE) for our numerous blind tasting, you consider that 10 tasters over 15 cannot make the same mistake at the same time, at the same day, on the same wine and so, that the result coming out has a value.

Leave a Reply

 

 

 

You can use these HTML tags

<a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>

*