Beer Syndicate Blog

Shamelessly Promoting Beer

Tag: BeerAdvocate Top 250 Beers

Data Chug: The Outlier Breweries in BeerAdvocate’s Top 250

Previously on Data Chug, we took a broad look at the Top 250 beers listed on the beer ranking website BeerAdvocate.  We highlighted the top 10 beers, identified popular beer styles, ABV trends, the countries and states with the most beers in the Top 250, and more.

There were charts, jokes, and a cliffhanger ending that revealed two breweries that appeared a rather curious amount of times in the Top 250.

Today, we pick up where we left off by taking a closer look at what we affectionately refer to as “the outlier breweries.”

Now on with the Q & A…

The Outlier Breweries

Q1. Last time you mentioned that there were 210,023 different beers listed on BeerAdvocate, so to have a brewery with even a single beer in the Top 250 was impressive.  But there were actually several breweries that had more than one beer in the Top 250. What can you tell me about those breweries?

A1. Right, so there were 86 breweries in total in the Top 250, and 45 of those breweries had more than one beer on the list.  In fact the average number of beers per brewery in the Top 250 was 2.91, so it wasn’t all that unusual for a brewery to have more than one beer in the Top 250.

However, what was unusual was that two breweries, namely Trillium Brewing Co. and Hill Farmstead Brewery, both had exactly 20 beers each in the Top 250. This means that nearly 1 out of every 6 beers in the Top 250 was either from Trillium or Hill Farmstead.  If having one beer in the Top 250 is impressive, what do you call having 20?

Q2. Really impressive? I don’t know— it seems a little bit more than unusual to me.  But Trillium and Hill Farmstead weren’t the only outlier breweries with a statistically high number of beers in the Top 250, so what were the other ones?

A2. We identified a total of 8 outlier breweries.  Basically any brewery with more than 6 beers in the Top 250 would be considered a statistical outlier as you can see in the box plot graph below:

Of the outlier breweries, there were four that had 7 beers each in the Top 250 which included Russian River, Toppling Goliath, 3 Fonteinen, and Prairie Artisan Ales.  Next, you had Brasserie Cantillon with 8, Tree House with 13, and as you know, both Hill Farmstead and Trillium both had 20 beers each in the Top 250.  By the way, 3 Fonteinen and Cantillon are both Belgian breweries, the rest are American.

Interestingly, even though there are only 8 outlier breweries out of a total of 86 breweries in the Top 250, those 8 breweries contributed a combined total of 89 beers to the Top 250, or 35.60%.

Q3. Okay, so there are 8 outlier breweries. But still, having 20 beers in the Top 250 like Hill Farmstead and Trillium did just seems crazy. So what’s going on with those breweries?

A3. Alright, so imagine that Hill Farmstead and Trillium only produced 20 beers per brewery, and also imagine that every single one of those beers were in the Top 250. Basically, we thought it would be pretty strange if 100% of the beers brewed by any given brewery were all in the Top 250.

Q4. So that’s what you found? Every beer brewed by Hill Farmstead and Trillium were in the Top 250?

A4. Not exactly. After we looked at the total number of beers currently brewed by each outlier brewery, we found there wasn’t anything necessarily unusual about either Hill Farmstead or Trillium when compared to most of the other outlier breweries.

For example, when we pulled the numbers in mid-February of 2018, Hill Farmstead was currently producing 124 different beers, and of those 124, 20 were in the Top 250. In other words, 16.1% of the beers currently produced by Hill Farmstead were in the Top 250.

Trillium was at 14.9%. As for the rest of the outliers, 3 Fonteinen was at 26.9%, Cantillon at 22.86%, Tree House was at 20.96%, Toppling Goliath at 14.28%, Russian River at 11.67%, and Prairie Artisan Ales was relatively low in comparison at 4.7%.  If you look at it this way, both Trillium and Hill Farmstead weren’t sticking out, but were right in the middle of the pack of the outliers.  The average percentage of beers contributed per brewery of the outliers was 16.54%.

Q5. So what you’re saying is that it’s just a numbers game?  Basically, the more variety of beers that a brewery produces, the more that the chances increase that one of those beers will make it into the Top 250?  If that’s true, then those percentages that the outlier breweries were putting up would be similar for every brewery, including the non-outliers in the Top 250.  So what do the percentages for the non-outlier breweries look like?

A6. Okay, so there were initially 8 outlier breweries identified out of a total of 86 breweries in the Top 250, which means there were 78 non-outlier breweries.

The Lost Abbey was one of the non-outliers, producing a total of 57 beers, 2 of which appeared in the Top 250.  In other words, 3.5% of the beers The Lost Abbey produced were in the Top 250.  Likewise, Avery was at 1.7%, Deschutes at 0.56%, Firestone at 3.2%, Other Half Brewing Co. was at 2.02%, etc.

After chugging the numbers, it turned out that an outlier brewery was now any brewery that had more than 9.79% of its beers it currently produced in the Top 250.

Q7. Wait, so where does that leave Prairie Artisan Ales?  It was originally an outlier brewery because it had 7 beers in the Top 250.  But because those 7 beers represented only 4.7% of the brewery’s total production, it’s not considered an outlier anymore?

A7.  That’s right.  However, looking at the numbers relative to the quantity of different beers produced per brewery just reinforced the fact that the other outlier breweries were unusual, and appearing in the Top 250 wasn’t just a numbers game.  In other words, greatness in the brewing world isn’t simply a matter of throwing enough stuff at the wall until something sticks, at least not according to an analysis of BeerAdvocate’s data.

What’s more, we identified 4 new outlier breweries that had more than 9.79% of the beers they currently produced appearing in the Top 250. Those breweries were Alpine Beer Company at 10.71%, Brouwerij Rodenbach N.V. at 12.5%, Brasserie de Rochefort at 33.33%, and Brouwerij Westvleteren at a staggering 66.66%. Of the now 11 outlier breweries, 5 were Belgian, and the other 6 were American.

Q8. Alright, these percentages just seem insane. I mean, is there some conspiracy type stuff going on? What does all this mean?

A8. Ah, now there’s a question. In statistical analysis, sometimes the juiciest information can be obtained by looking more closely at the outliers.

In this case, if you take the data from BeerAdvocate at face value, it could mean that the outlier breweries like Tree House, Toppling Goliath, Trillium, Hill Farmstead, etc. are simply out-preforming all other breweries in the world at a statistically significant level, with respect to specific beer styles.

There’s certainly a case to be made that a brewery like Cantillon, founded in 1900, simply specialized and excelled in a limited number of beer styles over many years, and became a world leader par excellence in those specific and relatively sparsely produced categories like Gueuze and Lambic, which are the only kind of beers Cantillon makes.  8 out of 35 beers from Cantillon appear in the Top 250.

This pattern is similar for the other Belgian outlier breweries such as Brouwerij Westvleteren, a brewery that at first glance seems remarkably unusual with 66.66% of its beers appearing in the Top 250. However, we should also consider that the brewery, founded in 1838, only currently produces 3 beers in total, 2 of which were in the Top 250. One of those beers, Westvleteren 12, was rated a perfect 100/100 by RateBeer, and is considered by some sources to be the best beer in the world.

You may include Rochefort (founded 1595), Rodenbach (1821), and 3 Fonteinen (1887) into that list of Belgian breweries that produce a relatively small variety of beers, but have perfected those beers over generations, and are consistently recognized as world-class breweries, often epitomizing the beers styles they produce.

Similar to the production range of Brouwerij Westvleteren, Rochefort only produces 3 beers, 1 of which (or 33%) was in the Top 250. Rodenbach essentially invented and mastered the Flanders Red style, the only style of beer it brews, so it wasn’t surprising to see 1 of the 8 beers it produces (Caractère Rouge) in the Top 250.  Likewise, 3 Fonteinen specializes predominately in Lambic and Gueuze, and contributed 7 of its 26 beers to the Top 250.

Q9. Okay, maybe that explains the Belgian breweries somewhat, but what about the American outliers?

A9. Unlike the Belgian outlier breweries that typically only brew a small variety of beer styles, most of the American outliers brew a wider range, but they tend to specialize or excel at one particular beer style.

For example, the majority of beers contributed by Alpine (founded 1999), Tree House (2012), and Trillium (2013) in the Top 250 are hop-forward beer styles.

Russian River, founded in 1997, is widely known for its Pliny the Elder and Pliny the Younger double and triple IPAs, both of which appear in the Top 250 and were also rated 100/100 by RateBeer.  In addition to mastering the double IPA, a beer style the brewery is credited with inventing, Russian River was one of the first American breweries to specialize in sour and barrel-aged beers, and led in the American Wild Ale category with 5 beers in the Top 250.

Toppling Goliath (founded in 2009) is a bit of a mixed bag with 3 examples of imperial stout in the Top 250, along with 4 examples of hop-forward styles. Likewise, Hill Farmstead (founded 2010) has 12 hop-forward styles in the Top 250, and the rest are a mix of saisons, stouts and a single porter.

But even though Hill Farmstead produces a variety of beers compared to most of the other outliers, it was awarded the title of “Best New Brewery in the World” by RateBeer in 2011, and “Best Brewery in the World” every year from 2013-2017.

Q10.  Interesting, but when I looked at BeerAdvocate’s list of all American IPAs and there were literally beers there with PERFECT scores.  None of those perfect scoring beers appeared in the Top 250, so what gives?

A10. You’re correct, you might find several beers with perfect scores listed under many different beer style categories, but many of those perfect scores came from only one reviewer.   The fact is that BeerAdvocate’s ranking algorithm weights a beer’s score based on the number of reviews the beer has had, which is why those higher rated beers don’t appear in the Top 250.

What this means is that there very well could be and probably are better commercial examples of certain beer styles out there than those that appear in the Top 250, but it may take a little while until more of the BeerAdvocate user base has a chance to weigh in on those beers.  What this suggests is that the many of the current outlier breweries will not be there forever.

Nonetheless, we should probably expect to see some of the Belgian outlier breweries in the Top 250 for a while, particularly those breweries producing time-intensive beers styles like Lambic, Gueuze and Flanders Red.  These beer styles often take upwards of three years to produce, not to mention the perhaps generations of knowledge needed to perfect those styles.  All of this makes it cost-prohibitive for other breweries to attempt, which limits the respective competition.

For now, what we can say with certainty is that there are a relatively small number of breweries on BeerAdvocate’s Top 250 that are contributing a statistically significant number of beers to that list.

And outliers typically demand attention especially in situations where it’s clear that the outliers were not due to simple data collection errors.  By the way, the data we used is open to the public to independently verify.  We’ve even made it easy to sort the data by state, country, brewery, score, etc.  In other words, feel free to chug the numbers yourself.  Here’s the link: BeerAdvocate’s Top 250.

Q11. You know, we spent all this time talking about the “Top 250 beers,” but did you ever consider the source of that data?  What I mean is that if the user base is predominately English-speaking Americans, doesn’t that skew the data in favor of American breweries?

A11. You’re not wrong.  I wonder, is that the same as saying “you’re not not not wrong?”  Anyways, what I mean is that you’re right, or not not right.

Basically, it’s more likely that the results of the beers in the BeerAdvocate’s Top 250 had less to do with a conspiracy, and more to do with the demographics of the website’s user base and how the algorithm functions.  Even so, outliers still exist within this particular data set, and statistically speaking, those outlier breweries deserve a spotlight.

Of course, interpretation of that data can be tricky.

Q12. Okay, so you’re admitting that BeerAdvocate’s Top 250 is just one data set and it may be limited by certain factors including its user base which you speculate is dominated by American English-speakers.  Rarity and hype might also be factors.  Come to think of it, if you’re trying to independently verify if there is anything special about those outlier breweries you mentioned, don’t you think you should look more thoroughly at other data sets?

Like, did you even think to analyze Untappd’s list of Top Rated beers to see how it compares to BeerAdvocate’s list?

A12. “Untappd” you say?  You mean the geosocial networking service and mobile phone application that allows its users to rate beers and earn digital badges to increase the users average time spent on the app?  That Untappd?  Why, yes, we did think to analyze that data.

In fact, we did more than just think about it.  We pulled the data, chopped it up, ran a statistically analysis, and put it all together just for you.

Q13. Alright, let’s have it.  Anything juicy?

A13. Oh, it’s juicy alright— juicy like a big hazy NE IPA.  Let me see, I know I put that article somewhere for you…

Ah, there it is:

Next on Tap… Data Chug: Analysis of Untappd’s Top Rated Beers

Hi, I’m Dan: Beer Editor for Beer Syndicate, Beer and Drinking Blogger, Beer Judge, Gold Medal-Winning Homebrewer, Beer Reviewer, American Homebrewers Association Member, Shameless Beer Promoter, and Beer Traveler.

Daniel J. Leonard and Jean-Pierre van Roy of Cantillon Brewery

Dan with Owner and Brewer Jean-Pierre van Roy of Brasserie Cantillon Seen Sporting a Hill Farmstead T-Shirt.

Data Chug: Analysis of BeerAdvocate’s Top 250 Beers

Today, we attempt to answer exactly 16 questions based on BeerAdvocate’s Top 250 rated beers.

Intro complete, now on with the Q & A…

Q1. When we talk about “the Top 250 beers,” exactly how much competition was there? In other words, how many beers did the Top 250 beat out? Like 1,000 other beers? 2,000 other beers?

A1. Close. There were 210,023 beers listed on BeerAdvocate as of February 2018, so the Top 250 beat out 209,773 other beers. This means that the Top 250 represent the top 0.12% of all beers listed on BeerAdvocate. Not too shabby.

Q2. Talk about cream of the crop. Here’s an easy question: Which beer was # 1?

A2. That is an easy question. The highest rated beer in the Top 250 was Kentucky Brunch Brand Stout, which is a 12% ABV American Imperial Stout from Toppling Goliath Brewing Company.

In case you’re interested, here are the rest of the beers just in the Top 10 based on score:

Tied for 2nd place were:

Hunahpu’s Imperial Stout – Double Barrel Aged – Cigar City Brewing
Barrel-Aged Abraxas- Perennial Artisan Ales
King Julius – Tree House Brewing Company

Tied for 3rd were:

Marshmallow Handjee (Bourbon Barrel Aged Vanilla Bean Dark Lord) – 3 Floyds Brewing Co.
Drie Fonteinen Zenne Y Frontera – Brouwerij 3 Fonteinen
Barrel Aged Imperial German Chocolate Cupcake Stout- Angry Chair Brewing
Heady Topper – The Alchemist Brewery and Visitors Center

Tied for 4th were:

Very Hazy – Tree House Brewing Company
Fundamental Observation – Bottle Logic Brewing

BeerAdvocate recently adjusted its ranking algorithm to adjust for how many reviews of a given beer there were.  Based on that update, the Top 10 list was as follows:

1. Kentucky Brunch Brand Stout – Toppling Goliath Brewing Company
2. Heady Topper – The Alchemist Brewery and Visitors Center
3. Hunahpu’s Imperial Stout – Double Barrel Aged – Cigar City Brewing
4. Barrel-Aged Abraxas – Perennial Artisan Ales
5. Marshmallow Handjee (Bourbon Barrel Aged Vanilla Bean Dark Lord) – 3 Floyds Brewing Co.
6. King Julius – Tree House Brewing Company
7. Pliny The Younger – Russian River Brewing Company
8. Bourbon County Brand Coffee Stout – Goose Island Beer Co.
9. Fundamental Observation – Bottle Logic Brewing
10. Mornin’ Delight – Toppling Goliath Brewing Company

You can see the entire list here.

Q3. Huh, seems like big boozy stouts and Double IPAs dominate the Top 10. Can’t say I’m surprised. Speaking of which, what are the most popular beer styles in the Top 250?

A3. Keen observation… and get ready to be not surprised again. As you can see in the handy chart below, it turns out that the two most represented beer styles in the Top 250 were American Double IPA at 26% and American Imperial Stout at 23.6%. Together, those two beer styles make up nearly half of all beer styles in the Top 250.

[Click on any chart to magnify.]

The eight next most popular beer styles in the Top 250 after Double IPA and Imperial Stout were American Wild Ale (7.6%), American IPA (6.8%), Russian Imperial Stout (4.8%), American Porter (4.8%), American Pale Ale (4%), Fruit Lambic (3.6%), Saison (3.2%), Gueuze (2.8%), Sweet Stout (2%) and English Barleywine (2%).

In a six-way tie for the least represented beer style in the Top 250 with only one example from each category, you have Flanders Red Ale, Belgian Dubbel, German Hefeweizen, American Stout, Winter Warmer and Unblended Lambic.

Q4. Got it. So if you want to be in the Top 250, then it helps if you’re brewing big boozy stouts and Double IPAs. Sounds like a plan. Speaking of beer styles, I’m curious, how many beer styles are there in total?

A4. Well, BeerAdvocate lists a total of 104 different beer styles, and of those 104, only 25 were represented in the Top 250, which were largely dominated by… you got itDouble IPAs and Imperials stouts. There are definitely more beer styles out there than those that appear on BeerAdvocate’s list, but as the greatest comedian of all time, Larry the Cable Guy, once said: it is what it is.

Q5. Obviously Kathy Griffin is the greatest comedian of all time, but back to beer. It seems like the most popular beer styles (American Double IPA & American Imperial Stout) just so happen to be a bit on the boozy side. Do you have any data that shows how alcoholic the beers in the Top 250 are?

A5. Fancy that you ask. We actually did take a look at the ABV distribution of the Top 250 beers, and you are correct in your suspicion that they tend to be a bit alcohol-friendly as you can see in the chart below:

ABV Distribution of BeerAdvocate's Top 250 Beers

Turns out that the average ABV of all the beers in the Top 250 is 9.6%. In the spirit of thoroughness, two of the beers in the Top 250 didn’t have an ABV listed, but seeing as how one of those beers was an Imperial stout and the other an English Barleywine, it’s probably safe to say they didn’t bring the average ABV down.

Q6. Booze sells I guess. I noticed that the top two beer styles (American Double IPA & American Imperial Stout) are, as their names suggest, American styles of beer. Can you tell me how many beers in the Top 250 are from American breweries?

A6. Another good question. Of course, brewing a certain beer style isn’t country-specific, meaning that basically any country can brew any beer style it wants— Well, with the questionable exceptions of the quasi-protected appellations of Old Gueuze and Kölsch which allegedly can only be brewed in Belgium and Cologne respectively, but who’s counting.

Anyways, the point was that just because the top two beer styles happen to be American styles, doesn’t necessarily mean they came from American breweries. But that fact had minimal impact in this case. Only 5 out of the 124 American Double IPAs and Imperial Stouts in the Top 250 were brewed by non-American breweries (2 from Canada and 3 from Denmark to be specific).

Q7. Fair point, but you didn’t exactly answer the question about how many American-brewed beers there were in the Top 250. How about you just tell me how many beers in the Top 250 came from whichever countries.

A7. We’ll do better than tell you, we’ll show you! And also tell you. As the country-coded 3-D chart below shows, 224 of the Top 250 came from the U.S. After that, Belgium came in second with 20, followed by Denmark with 3, Canada at 2, and Germany with a grand total of 1. In other words, American-brewed beers represented 89.6% of all beers in the top 250.

# of Beers Contributed by Only Those Countries Appearing in BeerAdvocate's Top_250 Beers

On a side note, 55.87% of all beer styles in the top 250 were American styles. So if 89.6% of beers in the top 250 came from the U.S., this seems to suggest that American breweries are beating other countries at their own game.

Q8. Geez, it looks like the U.S. is really crushing it when it comes to beer. I wonder if the number of breweries in each country has something to do with it. I mean if there are more breweries in the U.S., that might increase the chances of American-brewed beers appearing in the Top 250, right?

A8. You might be on to something. There are 6,731 breweries in the U.S., followed by Germany with 1,413, Canada at 863, Belgium with 346, and Denmark with 114.  Here’s a chart that show’s the percentage of beers contributed to the Top 250 relative to the number of breweries per country:

Q9. Okay, the U.S. isn’t # 1 anymore after looking at the numbers proportionate to the number of breweries there are per country. But I’m still interested to see how the individual states in the U.S. did comparatively. Got anything for me?

A9. How’s about a big fat color-coded pie chart breaking down the percentage of beers in the Top 250 from each state. And yes, we excluded non-American contributions from the chart… that’s what that little asterisk at the title of the chart is about.

% of Beers Contributed by The States States Appearing in BeerAdvocate's Top 250 Beers.

As you can see above, there are 27 states with beers in the Top 250. The states with the most beers in the top 250 were California with 45, Massachusetts with 34, Vermont at 28, Florida with 14, and Oregon with 11.

Q10. Yeah, of course there’s going to be more beers in the Top 250 from California because California has the most breweries in the U.S. So how would things look if you adjusted the numbers relative to the number of breweries per state?

A10. Below is a chart that shows the percentage of beers contributed by each state that appears in the Top 250 relative to how many breweries there are in those respective states:

% of Beers Contributed by the States Appearing in BeerAdvocate’s Top_250 Based on the Number of Breweries in Those States.

So, as you can see, once you account for the total number of breweries in each state per number of beers in the Top 250, it turns out that California is no longer number one. It’s not even in the top 5. The new picture looks like this: Vermont in first place with 25.06%, followed by Massachusetts at 13.22%, Oklahoma with 12.71%, Iowa at 5.58%, Missouri with 5.25%, and then California with 3.68%.

Q11. Ok, so you relativized the data according to the number of breweries in each state, but not all breweries produce the same number of beers. Can you relativize these numbers based on how many beers are produced by each state?

A11. Let’s see, so there’re 800 breweries in California alone, and 4,661 breweries in the other 26 states in the Top 250, so… uh, this is gonna take a while. We’ll get back to you on that one.

Q12. Alright, maybe I was getting a little greedy with that question. Just for fun though, how many beers were contributed by each region of the U.S., according to how the U.S. Census Bureau defines the regions, of course.

A12. Obviously we were going to use the U.S. Census Bureau method for defining regions of the U.S. That’s like the gold standard, or whatever standard the U.S. is pinning the value of its currency to nowadays. Anyways… here’s another chart. With colors. And shapes.

Total Number of Beers Contributed to BeerAdvocates's Top 250 by U.S. Region

Here’s that same information in a non-chart format:

U.S. Regions:

West: CA: 45, CO: 3, AK: 1, OR: 11, WA: 5 = 65
Midwest: IA: 7, IL: 7, IN: 5, OH: 6, MI: 9, MN: 5, MO: 9 = 48
South: AR: 1, FL: 14, LA: 1, NC: 1, OK: 7, TX: 4, SC: 1, VA: 3: = 32
Northeast: CT: 3, MA: 34, ME: 5, NJ: 2, NY: 6, PA: 1, VT: 28: = 79

Q13. You know, here I am asking all these questions about the different states and beer styles, I forgot to ask about the breweries themselves. Were there many breweries with more than one beer to make it into the Top 250?

A13. Yes. In fact, there were only 86 breweries contributing beers to the Top 250, which means there were several, or more specifically 45, breweries with more than one beer in the Top 250. The average number of beers contributed by only those breweries in the Top 250 was 2.91.

Q14. Okay, so 2.91 was the average. Were there any outlier breweries on the list? Like breweries with a statistically high number of beers in the Top 250?

A14. So this is where things are about to get a bit more interesting. To answer your question, yes, there were a few outlier breweries in the Top 250. To keep things in prospective, remember that there were 210,023 beers listed on BeerAdvocate when we ran the numbers mid-February of 2018, so for a single brewery to have multiple beers in the Top 250 is pretty impressive on its own.

But if you’re asking for extreme outliers, there were two breweries in particular that caught our eye.

Hold on to your hat because both Hill Farmstead Brewery and Trillium Brewing Company each had 20 beers in the top 250. Them’s what we call some significant outliers.

Q15. 20 beers each?!? Seems like a WTF is in order. Tell me you guys dug into those curious sounding numbers a little bit more, right?

A15. Yep. But to get that information, you’ll have to pay us money. Just kidding! As Bill Gates once said, information and all the time it takes to compile and analyze should be free! So in the spirit of the Freedom of Information Act, we’re going to share those juicy details with you free-of-charge.

But first, you see that big cliff right over there?

Q16. Which cliff?

A16. The cliff you’ll have to hang onto until next time.

Next on Tap: Data Chug: The Outlier Breweries in BeerAdvocate’s Top 250

Hi, I’m Dan: Beer Editor for, Beer and Drinking Writer, Award-Winning Brewer, BJCP Beer Judge, Beer Reviewer, American Homebrewers Association Member, Shameless Beer Promoter, and Beer Traveler.

Powered by WordPress & Theme by Anders Norén