<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>MMA Ranking Talk &#187; system</title>
	<atom:link href="http://www.mma-elo.com/rants/tag/system/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.mma-elo.com/rants</link>
	<description>Hide your redheads!!!</description>
	<lastBuildDate>Mon, 01 Aug 2011 00:40:28 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.0.5</generator>
		<item>
		<title>Eloquent Elo Examples</title>
		<link>http://www.mma-elo.com/rants/2010/eloquent-elo-examples/</link>
		<comments>http://www.mma-elo.com/rants/2010/eloquent-elo-examples/#comments</comments>
		<pubDate>Thu, 04 Mar 2010 03:22:45 +0000</pubDate>
		<dc:creator>evil pooh</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[system]]></category>

		<guid isPermaLink="false">http://www.mma-elo.com/rants/?p=60</guid>
		<description><![CDATA[Engulfing Expletives excluded Easy-mode Enabled Expert experience entailed Editing expressly eluded Exact equivalents&#8230;Empty Engrossing ensnaring entertainment Emotional enthrallment Effortless enjoyment ensured Enticingly enigmatic examples enclosed Embarrassing errors erased Emboldened empowerment effect expected Everyone Eager? Extremely Excited? Evade Exits&#8230; Enter Example 1) An MMA fighter&#8217;s worth Not talking about &#8220;Fabulous life of MMA fighters&#8221; or &#8220;celebrity [...]]]></description>
			<content:encoded><![CDATA[<p>Engulfing</p>
<p>Expletives excluded</p>
<p>Easy-mode Enabled</p>
<p>Expert experience entailed </p>
<p>Editing expressly eluded</p>
<p>Exact equivalents&#8230;Empty</p>
<p>Engrossing ensnaring entertainment</p>
<p>Emotional enthrallment</p>
<p>Effortless enjoyment ensured</p>
<p>Enticingly enigmatic examples enclosed</p>
<p>Embarrassing errors erased</p>
<p>Emboldened empowerment effect expected</p>
<p>Everyone Eager?</p>
<p>Extremely Excited?</p>
<p>Evade Exits&#8230;</p>
<p>Enter</p>
<p><span id="more-60"></span></p>
<h2>Example 1) An MMA fighter&#8217;s worth</h2>
<p>Not talking about &#8220;Fabulous life of MMA fighters&#8221; or &#8220;celebrity cribs&#8221; here.  What I&#8217;m talking about is the basic case of how much a win over a certain fighter earns another fighter.  This is a basic part of the system, but one that is often misunderstood.</p>
<p>See, Fighter A doesn&#8217;t have a set value.  Beating Fighter A isn&#8217;t worth 10 points or 74 points.  That&#8217;s because the ratings of *BOTH* fighters determines how much a win is worth.</p>
<h3>Theoretical Example</h3>
<p>Let&#8217;s assume we have three fighters:</p>
<p>Fighter A &#8211; 1700 rated<br />
Fighter B &#8211; 1600 rated<br />
Fighter C &#8211; 1500 rated</p>
<p>In a case like this, Fighter B doesn&#8217;t have a set value they are worth.  If Fighter A were to beat Fighter B they&#8217;d get 36 points.</p>
<p>However, if Fighter C were to beat Fighter B they would earn 64 points.</p>
<h3>Actual Example</h3>
<p>GSP &#8211; 2243<br />
Mike Swick &#8211; 1932<br />
Chris Lytle &#8211; 1887</p>
<p>In this case GSP would get only 14 points for beating Mike Swick.  Chris Lytle, on the other hand, could gain 56 points for a win over Mike Swick.</p>
<p>The reason for this is the fighters&#8217; ratings and where they currently stand.  Although Mike Swick is a solid fighter, they are definitely below GSP.  At the same time, Mike Swick is a bit higher than Chris Lytle is.  This leads to one fighter gaining significantly more for beating them.</p>
<p>As you browse the site (and finish reading this rant), always keep in mind that a certain fighter doesn&#8217;t have a set value.  No one fighter is worth 10 or 20 or 80 points.  The ratings of *BOTH* fighters are what determines how many points are won and lost.</p>
<p>Before moving onto the next example, anyone else really want to see Chris Lytle Vs Mike Swick?  </p>
<h2>Example 2) The Elo giveth and the Elo Taketh away</h2>
<p>The other side of victory&#8230;is defeat.  Let&#8217;s take a quick second to look at how points are lost in the system.  Much like how the rating of both fighters determines how many points are won, it also determines how many points are lost.</p>
<h3>Theoretical example</h3>
<p>Again, three fighters:</p>
<p>Fighter A &#8211; 1800<br />
Fighter B &#8211; 1900<br />
Fighter C &#8211; 2000</p>
<p>If Fighter B were to lose to fighter A they would lose 64 points.</p>
<p>A loss to Fighter C would only cost Fighter B 36 points.</p>
<h3>Actual Example</h3>
<p><a href="http://www.mma-elo.com/me_hist.php?fighter=443">Andrei Arlovski</a> had a rating of 2051 when he faced Fedor.  Fedor had a rating of 2268.  The loss to Fedor cost Andrei 22 points.</p>
<p>Following that loss Andrei had a rating of 2029 and he faced Brett Rogers (who had a rating of 1828 at the time).  The loss to Rogers cost Andrei 76 points.</p>
<p>That is over three times as many points lost.  Why?  Because the first loss was against a *MUCH* higher rated fighter.  Some people (and sites!) actually moved Andrei *UP* in their rankings despite the loss.  </p>
<p>Rogers though was a much lower ranked fighter.  Despite being an up and comer he hadn&#8217;t really beat many high ranked opponents and Andrei was clearly the favorite in the fight.  Since Andrei loss to a lower rated opponent, he lost even more points.</p>
<h2>Example 3) Risk Vs Reward</h2>
<p>Anyone who frequents this site (thank you!) has undoubtedly seen me discuss risk vs reward.  I mention it here as example three because Risk Vs Reward is really Example 1 + Example 2 (that&#8217;s a math joke, it&#8217;s OK to laugh).</p>
<h3>Theoretical Example</h3>
<p>Three fighters walk into an arena&#8230;</p>
<p>Fighter A &#8211; 1800<br />
Fighter B &#8211; 2200<br />
Fighter C &#8211; 1800</p>
<p>If we look at the possible matchups and incorporate Examples 1 and 2 we see:</p>
<p>Fighter A Vs Fighter B<br />
Fighter can *WIN* 91 points or *LOSE* 9 points<br />
That means Fighter B can *LOSE* 91 points or *WIN* 9 points</p>
<p>That is just terrible.  Basically Fighter B is risking *TEN TIMES* as many points as they can possible gain.</p>
<p>If we instead consider Fighter A Vs Fighter C&#8230;<br />
Fighter A can *WIN* 50 points or *LOSE* 50 points<br />
Fighter C can *WIN* 50 points or *LOSE* 50 points</p>
<p>That seems pretty balanced in terms of risk vs reward, right?</p>
<p>Now, obviously not every fighter can be matched up against fighters with identical ratings, but even a 40/60 split would be more reasonable than the 10/90 we saw in the case of Fighter A vs Fighter B.</p>
<h3>Actual Example</h3>
<p>Let&#8217;s look at Mike Swick again.</p>
<p>Two fights again Mike took on Dan Hardy.  At the time their ratings were:</p>
<p>Swick &#8211; 2035<br />
Hardy &#8211; 2048</p>
<p>That means Mike could win 52 points for a win, or (as wound up happening) lose 48 points.  This was a number one contender type of fight and as you can see both fighters had very high ratings.  This to me is an excellent example of a fight that makes &#8220;ranking sense&#8221; and has reasonable Risk Vs Reward for both fighters.</p>
<p>To contrast that fight, look at Mike Swick&#8217;s previous fight&#8230;</p>
<p>Swick &#8211; 2009<br />
Saunders &#8211; 1829</p>
<p>Now I have nothing against Ben (except maybe his nickname), but it&#8217;s very obvious who had more to gain and who had more to lose in this fight.  At the time of the fight Swick was becoming a consensus top 10 fighter and Saunders was a prospect with just a couple wins in the UFC after some time on the ultimate fighter.</p>
<p>For winning the fight Swick earned 26 points.  That&#8217;s a fair number of points, but considering the situation and the 74 points he was risking I think this fight was on the other side of reasonable.  Mike clearly had a *LOT* more to lose and very little to gain.  Even the announcers mentioned that Saunders really had nothing to lose in the fight.</p>
<p>Some like to talk about &#8220;year of the upset&#8221; and how &#8220;volatile&#8221; MMA is, but that&#8217;s only because the matches get made in the first place.  Just because Swick won doesn&#8217;t mean it was OK to make such a fight.  MMA is a sport and the fighters are athletes.  As such, both fighters should have reasonably balanced &#8220;risk&#8221; and reasonably balanced &#8220;reward&#8221;.</p>
<h2>Example 4)Bottom Feeding</h2>
<p>One of the false claims people often make about the system used on the site is along the lines of,</p>
<p>&#8220;It doesn&#8217;t matter who you beat, just beating 10 cans is better than beating 9 title holders&#8221;.</p>
<p>I&#8217;m going to piggyback a bit on Example 1 (I reference so you can scroll back up if needed) and show you how the system prevents such bottom feeding.</p>
<h3>Theoretical Example</h3>
<p>I&#8217;m going to give the fighter the benefit of the doubt here and say that they just started out and had a 1500 rating.  I&#8217;m then going to play horrible match maker and continue to match them up against 1500 rated opponents.</p>
<p>Fight 1 &#8211; 1500 rating to start<br />
Win earns +50 rating</p>
<p>Fight 2 &#8211; 1550 rating to start<br />
Win earns +43 rating</p>
<p>Fight 3 &#8211; 1593 rating to start<br />
Win earns +37 rating</p>
<p>Notice what is happening?  When our theoretical fighter had a 1500 rating, then facing a 1500 rated opponent was reasonable and earned them good points (+50).  As they win though their rating goes up, that means the rating of their opponent has to also go up in order for them to continue to accrue similar rating gains.</p>
<p>In this case our fighter is continuing to be matched up against 1500 rated fighters.  As they beat them, their rating will increase by less and less.</p>
<p>*Skip ahead*</p>
<p>Fight 10 &#8211; 1776 rating to start<br />
Win earns +17</p>
<p>See how the points have dwindled?  Our fighter is now getting about 1/3 of the points they previously got.  This situation will only get worse.</p>
<p>Since I&#8217;m not going to provide an actual example here, I&#8217;m going to say a bit more (lucky you).</p>
<p>When we consider this situation using Example 1 we see that the fighter is getting less and less for a victory.  Now let&#8217;s also consider how devastating a loss would be.</p>
<p>If in fight 10 our fight instead *LOST* instead of winning they&#8217;d have:</p>
<p>Fight 10 &#8211; 1776 rating to start<br />
Loss costs them -83 rating</p>
<p>That means with a single loss our fighter is now back down at 1693.  That single loss offset almost all of the points from this fighter&#8217;s previous *FOUR* wins combined.</p>
<p>By continuing to face weaker competition (potentially through no fault of their own) our fighter is earning less and less and risking more and more.  Even without losing the system creates a relative ceiling that they simply can&#8217;t surpass unless better matchmaking happens.</p>
<p>In theory you would hope a fighter that is 9-0 against 1500 rated opponents gets a bump in competition (I&#8217;d hope for it long before 9-0), but even if it doesn&#8217;t this is one way the system can pseudo correct for poor match making.</p>
<h2>Example 5) Strength of Schedule</h2>
<p>Strength of Schedule is a reasonably hot topic and though I&#8217;m glad to see it discussed, I can&#8217;t help but feel some don&#8217;t &#8220;quite&#8221; get it.  When we talk about a fighter&#8217;s strength of schedule we are talking about the level of opposition they have faced.  </p>
<p>I think strength of schedule is an intriguing stat, but many miss how big a factor it already plays in calculating a fighters base &#8220;rating&#8221;.</p>
<h3>Theoretical Example</h3>
<p>In example 4 we saw what happens when a fighter goes 10-0 against 10 1500 rated opponents.  Now let&#8217;s contrast that against a fighter going 10-0 against 1800 rated opponents.</p>
<p>Fighter A &#8211; 10 wins against 1500 rated opponents<br />
SoS &#8211; 1500<br />
Rating &#8211; 1793</p>
<p>Fighter B &#8211; 10 wins against 1800 rated opponents<br />
SoS &#8211; 1800<br />
Rating &#8211; 2012</p>
<p>That means Fighter B has a 219 rating point advantage.  That is a *TON*.  Not to mention, Fighter B actually got so high that taking on 1800 rated opponents was a bit weak for them.</p>
<p>How big an advantage is it?  Well, if Fighter B (instead of winning all 10) won their first 8 and then *LOST* their next two, they would have a rating of&#8230;1825.</p>
<p>That&#8217;s right, by taking on stronger fighters Fighter B is able to offset the losses and still come out ahead of Fighter A.</p>
<h2>Example 6) What have you done for me lately?</h2>
<p>Another common misconception about the site is that old fights matter the same (if not more) than more recent fights.  This is quite false and I&#8217;d like to provide a few examples to illustrate this.</p>
<h3>Theoretical Example</h3>
<p>In this example I want to re-use Fighter B from above.  Remember this fighter had 10 fights and always fought 1800 rated opponents.</p>
<p>Here are three scenarios&#8230;</p>
<p>All wins &#8211; Final rating 2012<br />
Lost *LAST* fight &#8211; Final rating 1912<br />
Lost *FIRST* fight &#8211; Final rating 1981</p>
<p>See that?</p>
<p>If we take &#8220;all wins&#8221; as a baseline (2012) we see that losing their last fight results in Fighter B being a full 100 points lower than they could be.  By losing their *FIRST* fight though Fighter B winds up at 1981 rating which is only 31 points lower than they could be.</p>
<p>Why is that? </p>
<p>It&#8217;s because the value of a fight is based upon the ratings of *BOTH* fighters.  By losing their first fight that means Fighter B had a lower rating going into their second fight.  That means they *WON* more points for it.</p>
<p>When a fighter loses their last fight though, they haven&#8217;t had time to regain any points.  This means the most recent fight has the biggest impact on a fight.  Not an over-the-top&#8211;all-or-nothing-screw-sport level of impact, but still the strongest impact.</p>
<h3>Actual Example</h3>
<p>Now that we see how important recent fights are, let&#8217;s take a look at how important older fights are.</p>
<p>One of the most discussed fighters in MMA is Fedor.  On this site Fedor currently has the highest all time rating (2300).  Many feel this is because of his old fights and that fights from 10(ish) years ago are what makes his rating so high.</p>
<p>For my first example I want you to follow me back to May of 2000 as I give Fedor an even *HIGHER* rating.  That&#8217;s right, a *HIGHER* rating.  Instead of saying that Fedor had a 1500 rating in May and just started his career I want you to assume he&#8217;d been fighting for YEARS previous to that.</p>
<p>For this example let&#8217;s say that in May of 2000 (when Fedor really had his first fight) we&#8217;ll say that he was already 2000 rated.  That is a 500 points rating jump that we are giving him.  So now, with years of past wins having gotten Fedor to 2000 rating, we now step through his exact career.</p>
<p>The result?</p>
<p>On 2009-11-07<br />
Rating &#8211; 2316</p>
<p>Yup, 16 points.  We gave Fedor *YEARS* more wins, gave him over 500 more rating points and he still wound up almost exactly where he was.  Why?  Look back at the previous examples (all of them, you didn&#8217;t laugh enough yet and the jokes are there if you look for them).</p>
<p>I chose Fedor in part because he is so highly discussed, but also because his rating is the most extreme.  If we use a fighter like Big Nog and do the same (give them an extra 500 rating to start) we see that their rating would only be 8 points different today if the &#8220;rest&#8221; of their career played out the exact same.</p>
<p>To take it from the other side, if we said Anderson lost a *TON* before his career started and that he had a 1000 rating instead of a 1500 rating at the time of his &#8220;first&#8221; fight, we&#8217;d see that his rating would only be about 18 points different today.  </p>
<p>Since we now know that having a super high (or low) rating doesn&#8217;t carry over indefinitely, let&#8217;s look at some interesting (and potentially inflammatory) examples.</p>
<p>Staying with Fedor let&#8217;s say instead of starting his career in May of 2000 that he instead started it in January of 2005.  Why that date?  Because it&#8217;s *AFTER* his second Nog win.  So let&#8217;s set Fedor to 1500 rating, and roll through his career from 2005 till now.</p>
<p>Result?</p>
<p>Rating &#8211; 2071</p>
<p>Not quite his current 2300, but he lost 5 years of fights, including not one, but TWO Nog wins.</p>
<p>I picked the 2005-01-01 date mostly at random, but let&#8217;s consider a more specific date in history&#8230;.</p>
<p>Fedor starting at 1500 rating on 2007-06-02 (date ring a bell?)<br />
Fedor&#8217;s &#8220;current&#8221; rating would be&#8230;1814</p>
<p>For those that get the date, they can handle the comparison themselves.  Just keep in mind that if Fedor had &#8220;started&#8221; on that date, then his first win was legit (it was Brock&#8217;s intended first opponent) he then beat back to back former UFC champions, and then beat a 10-0 contender.  If those are your first four fights, that&#8217;s pretty impressive.  Fedor&#8217;s activity during this time range was definitely low though.  </p>
<p>Now, Fedor&#8217;s rating during this time isn&#8217;t the highest of all fighters (GSP&#8217;s is higher and Anderson&#8217;s is insane).  It does help illustrate his recent accomplishments though.  I don&#8217;t want to get off on a sub-rant, but many like to bash Fedor and say all of his &#8220;good&#8221; wins are in the past.  There&#8217;s no doubt that prime crocop, some wins over nog and other fights are great.  However, in his last three fights Fedor has beaten two former UFC champions (both top 5ish at the time of the fight) and a 10-0 contender (top 10ish at the time).</p>
<p>If you don&#8217;t consider Fedor #1 due to activity, brain damage or American arrogance, that&#8217;s OK and I can logically understand it.  The people that say he isn&#8217;t &#8220;top 10&#8243; or that Carwin has done more literally cause brain bleeds and god to smite kittens though.</p>
<h2>Pencils down&#8230;</h2>
<p>So, we&#8217;ve looked at &#8220;wins&#8221;, we&#8217;ve looked at &#8220;losses&#8221;.  We&#8217;ve looked activity (though no specifically covered it&#8217;s there if you look for it).  We&#8217;ve discussed bottom feeding, strength of schedule and all kinds of other fun things.</p>
<p>The system on this site is very powerful, very clean and, oh yeah, fair.  Perfect? No, but also not as bad as some try to claim.  </p>
<p>If there are any cases you&#8217;d like to see covered in more detail (other readers hope not), then let me know.</p>
<p>Til next time,<br />
- Evil Envoy Extraordinary</p>
]]></content:encoded>
			<wfw:commentRss>http://www.mma-elo.com/rants/2010/eloquent-elo-examples/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>MMA Ranking System &#8211; For Beginners</title>
		<link>http://www.mma-elo.com/rants/2009/mma-ranking-system-for-beginners/</link>
		<comments>http://www.mma-elo.com/rants/2009/mma-ranking-system-for-beginners/#comments</comments>
		<pubDate>Wed, 23 Sep 2009 23:52:32 +0000</pubDate>
		<dc:creator>evil pooh</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[mma rankings]]></category>
		<category><![CDATA[nfl]]></category>
		<category><![CDATA[site]]></category>
		<category><![CDATA[system]]></category>

		<guid isPermaLink="false">http://www.mma-elo.com/rants/?p=43</guid>
		<description><![CDATA[It never ceases to amaze me how little accurate information some people need to start opening their mouths. The amount of wrong information I see regarding the MMA rankings on this site and the ranking system used are insane. How about we wipe the slate clean and start from the very beginning&#8230; Requirements for our [...]]]></description>
			<content:encoded><![CDATA[<p>It never ceases to amaze me how little accurate information some people need to start opening their mouths.  The amount of wrong information I see regarding the MMA rankings on this site and the ranking system used are insane.  How about we wipe the slate clean and start from the very beginning&#8230;</p>
<p><span id="more-43"></span></p>
<h2>Requirements for our new MMA Ranking System</h2>
<p>In order to build something we should generally have an idea of the purpose.  In terms of an MMA Ranking system, the purpose should seem obvious&#8230;to rank MMA fighters.  Where this gets interesting is that there are several ways to <strong>rank MMA fighters</strong>.</p>
<p>Many sites seem to factor popularity into it heavily.  Some sites like to focus on the very last fight someone ever had.  For this &#8220;new&#8221; mma ranking system here is the base criteria.</p>
<p>1)  Respect the fighters (they <strong>are</strong> professional athletes) and reflect on MMA as the sport that it truly is.<br />
2)  Be unbiased, consistent, predictable and accurate</p>
<p>That shall be the basis.  To get away from the hype, from the subjective, from the inconsistent and in the process shift some power away from the matchmakers and over to the fighters.</p>
<h3>Any ranking problems thus far?</h3>
<p>Any problems thus far?  Any glaring issue with either of those points?  Anyone have more to add or think one of those points should be omitted from this ranking system?</p>
<h2>Implementation of our new MMA ranking system</h2>
<p>Since we know what we are aiming for we now set about implementing our new ranking system.  Here is how the system works:</p>
<h3>All MMA fighters start on equal footing</h3>
<p>What this does is remove hype, popularity.  Yes some MMA fighters might gain an advantage from being a BJJ Black belt or from K-1 Striking experience, but history shows that MMA is a different ballgame.  As such, all mma fighters start at the same place.</p>
<h3>Outcome determines rating changes</h3>
<p>No getting signed to a new org and jumping 5 places, no getting into a title fight and climbing the ranks.  What you <strong>actually do</strong> will determine how your mma rating and ultimately how your mma ranking changes.</p>
<h3>Quality opponents are worth more</h3>
<p>The better the person you beat, the more you gain, the more outmatched, the less you lose.  We aren&#8217;t looking at pure mma fight records where someone 100-2 is automatically superior to someone who is 99-2.</p>
<h3>That&#8217;s it!</h3>
<p>Now take a seat, pull out some scrap paper, throw on the old thinking cap and let&#8217;s go through that one more time.  The system we just built ignores hype, it rewards success and it factors in quality of opposition faced.</p>
<p>Yet again I pause and yield to questions from the audience.  Who sees a glaring flaw with the above?  Which of the three points mentioned above should be gone?  Is there another point missing that should be included?</p>
<h2>How the MMA Ranking system performs</h2>
<p>We thought up the system, we adhered to our requirements and lets see what we got.  Looking at the actual numbers we see our system is basically as unbiased as possible.  The only cases where &#8220;human&#8221; interaction plays any part is on selection of values and those were deliberately chosen for accuracy.  </p>
<p>The system is perfectly consistent and predictable.  No more #1 losing to #5 and #5 moving to #1 while elsewhere #2 beats #1 and still sits at #2.</p>
<p>In terms of accuracy the MMA ranking system we&#8217;ve created above is quite strong.  Overall prediction numbers are significantly better than a &#8220;fair coin toss&#8221; (roughly 33% better) and system integrity scores higher than some got in high school gym class.</p>
<h2>Problems with our new MMA Ranking system</h2>
<p>Pretty much nothing is perfect and obviously we can see some flaws with our results.  This begs the question&#8230;are the flaws because of the system we built or some other factor?  Looking back at the ground rules for our ranking system we see very few stipulations and almost nothing anyone has a problem with.</p>
<p>When we take a look at the actual ranking system basics and the design we see more sound thought and few issues.  Turning to the results we see numbers that show high accuracy and remain true to our unbiased and consistent requirements previously set forth.</p>
<p>Puzzling&#8230;if the system is built on sound philosophies, and the numbers prove accurate, why is it we see some &#8220;glaring&#8221; issues in the results?</p>
<h3>A possible answer</h3>
<p><a href="http://www.youtube.com/watch?v=xIraCchPDhk">Someone</a> much funnier than me and dearly missed once said, &#8220;Garbage in, Garbage out!&#8221;.  They were talking about politics, but the theory can be applied in many places.  In this case I&#8217;m talking about matchmaking.  Let&#8217;s consider this situation&#8230;</p>
<h4>An MMA Fighter is ranked too high/too low</h4>
<p>Let&#8217;s build this from the ground up&#8230;</p>
<p>We <strong>know</strong> all MMA fighters in this ranking system start at the same ranking.  That means there is no chance the fighter started off higher than someone that should be ranked below them.</p>
<p>We <strong>know</strong> fighters only get points when they win.  This means the fighter had to have won some fights.  Additionally we know fighters lose points when they lose matches, so that means in order for a fighter to be higher in rank they had to have gained more points than they lost.</p>
<p>We also <strong>know</strong> that quality of opponent matters.  To the extreme that in some cases an MMA fighter will literally get <strong>zero</strong> points for beating an opponent.  As above, we also know the system will take significantly more points from a fighter that loses to a much weaker fighter.</p>
<p>We also <strong>know</strong> the system has no idea who a fighter actually is.  Our system is as unbiased as possible and pays no attention to name, or popularity.</p>
<p>What this leaves us with is a situation where the root cause of our problem is matchmaking.  The good news is we can identify it, the bad news is that the solution is better matchmaking.  </p>
<p>Think about a case where one Fighter is &#8220;too high&#8221; and another fighter is &#8220;too low&#8221;.  If the matchmaker paired them against each other and the &#8220;proper&#8221; fighter won, then the MMA rating for the &#8220;too high&#8221; fighter would drop significantly and the MMA rating for the &#8220;too low&#8221; fighter would raise significantly.</p>
<p>This is just a simple case of the ranking system being able to self-correct itself.  Now obviously we might not get the perfect matchup, and we might not get it right away, but whenever and however it happens, the adjustment will still happen.  Eventually that &#8220;too high&#8221; fighter will lose and when they do they&#8217;ll drop even more rating for it.  At the same time, the &#8220;too low&#8221; fighter is bound to turn it around and when they do, they&#8217;ll gain even more rating for it.</p>
<h2>The honest truth</h2>
<p>Here&#8217;s the deal.  The MMA Ranking System on this site is very good.  I don&#8217;t say it because I built it.  As a matter of fact, if I hadn&#8217;t built it I&#8217;d probably be more positive towards the site and the ranking system.  I say it because it&#8217;s true.  The system has very sincere and respectful goals in mind and despite the few &#8220;eyesoars&#8221; that some like to focus on it does a fantastic job.  </p>
<p>I&#8217;m someone who is incapable of being happy, so you can rest assured I&#8217;ll keep trying to make it better.  What would be great though is if people could focus on what exactly the system sets out to do and how well it actually performs.  </p>
<p>I&#8217;m really not one to point fingers, but re-read the above points.  That is all the system sets out to do and that is all it does.  When you realize how accurate the system actually is it becomes clear the problems many have actually lie elsewhere.</p>
<p>If you hate the site, you hate the site.  That&#8217;s fine, stay away and if readership goes to 0 I can go back to building boats in bottles.  I&#8217;m ok with that.  All I&#8217;d really like though is some honest discussion.  If there is really a problem with the few very specific points above then lets hear it.  The above MMA ranking system is <strong>not</strong> perfect, but it&#8217;s also not as flawed as some insist on saying.  Just stop and think about the points mentioned above and consider these situations:</p>
<p>-  The Seahawks get to play the Raiders 12 times this year.  The Seahawks go 12-4 and make it into the playoffs over the 49ers who go 11-5 (with 8 games each against the Steelers and Giants).  Do we blame the NFL Playoff system because it said the 12-4 team goes or do we maybe look at the matchmaker that setup the schedules?</p>
<p>-  The commissioner of baseball declares that NY is a major market and as such at least one NY team will *ALWAYS* get a playoff berth.  The Mets do slightly less horrible than the Yankees (not this year, grats yanks on the birth) and get a playoff berth where they actually manage to win a few games past August 1st and take out their first round opponent.  </p>
<p>If the ranking system in place had said the other team did better than the Mets up to that point, do we blame it?  Should we really be flaming the ranking system in this case?  Instead, maybe we focus on the fact that the series shouldn&#8217;t have happened at all.</p>
<p>Those are just two examples, but many more could be made.  Players can get suspended, MMA fighters can linger on the undercard, MME can prevail over MMA at times, etc.</p>
<p>See the thing about me is I don&#8217;t mind being blamed for what I actually do.  Look at the situation below and understand that if I were the older brother I&#8217;d be ok with whatever punishment I got.  As the younger brother&#8230;not so much.</p>
<p>Consider an older brother hitting their younger brother in the head with a baseball bat and the younger brother getting yelled at because they bought the bat in the first place.  *shrugs*</p>
]]></content:encoded>
			<wfw:commentRss>http://www.mma-elo.com/rants/2009/mma-ranking-system-for-beginners/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
		</item>
		<item>
		<title>Inside the rankings 090920</title>
		<link>http://www.mma-elo.com/rants/2009/inside-the-rankings-090920/</link>
		<comments>http://www.mma-elo.com/rants/2009/inside-the-rankings-090920/#comments</comments>
		<pubDate>Sun, 20 Sep 2009 19:53:15 +0000</pubDate>
		<dc:creator>evil pooh</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[cro cop]]></category>
		<category><![CDATA[site]]></category>
		<category><![CDATA[system]]></category>

		<guid isPermaLink="false">http://www.mma-elo.com/rants/?p=42</guid>
		<description><![CDATA[The site is now updated with several recent events. In looking over the rankings I noticed a few things that stood out to me and thought I might explore them in a bit more detail. Usually if something jumps out at me then I figure others have questions as well. Do keep in mind that [...]]]></description>
			<content:encoded><![CDATA[<p>The site is now updated with several recent events.  In looking over the rankings I noticed a few things that stood out to me and thought I might explore them in a bit more detail.  Usually if something jumps out at me then I figure others have questions as well.</p>
<p>Do keep in mind that everything on this site is there for a reason, so if I don&#8217;t address a specific question you have, please feel free to ask.</p>
<p><span id="more-42"></span></p>
<h3><a href="http://www.mma-elo.com/me_hist.php?fighter=11">Mirko &#8220;Cro Cop&#8221;</a></h3>
<p>I&#8217;m sure this one jumped out at a few people.  Somehow Mirko is still ranked &#8220;top 10&#8243;.  This seems insane to some, and I have to confess that even I was a bit shocked by it.  As usual though, I looked into it a bit more and here&#8217;s what I found&#8230;</p>
<p>-  The first thing I noted was his relative rating to those around him.  There are only about 13 rating points currently separating #9 and #13.  Basically there are lots of fighters bunched up very closely around #10.  If Mirko&#8217;s rating were just a couple points lower his &#8220;ranking&#8221; wouldn&#8217;t seem so far off.</p>
<p>-  He didn&#8217;t lose to Alistair.  I know that might sound silly, but on a personal level that fight resolves as a loss in my head.  Much like how some still see Diaz as having a win over Gomi (or Gomi a loss to Diaz lol).  In truth though, Cro Cop did *NOT* &#8220;lose&#8221; that fight.  Had Alistair kept his knee out of Cro Cop&#8217;s groin and won the fight then the rankings would look at lot more &#8220;expected&#8221;.  ie Cro Cop outside &#8220;top 10&#8243; and Alistair moving up a bit.</p>
<p>-  The rankings for heavyweights is pretty weak.  This is probably the biggest point and can&#8217;t be stressed enough.  When we look at Mirko&#8217;s all-time high rating we see it sat at 2126.  Now his current rating sits at 1914.  That is a drop of over 200 points.  That is just an insane shift in rating.  </p>
<p>At his peak Mirko was #2-3 in the world, yet even with the huge point drop he&#8217;s still sitting at #10.  Why is that?  It is because other heavyweights aren&#8217;t putting together wins.  There are basically two ways to &#8220;drop&#8221; in rankings.  You go down, or your opponents go up.</p>
<p>What makes Mirko&#8217;s case so interesting is that although he&#8217;s personally dropped an absolutely incredibly amount of rating, other fighters simply haven&#8217;t stepped up.  There are a few reasons for this.  Some fighters like Tim Sylvia and Randy Couture have had rating drops as well during this period.  Additionally, some of the other fighters that could have passed him haven&#8217;t been given the proper match ups for it.</p>
<p>To get a better perspective on this, consider where Mirko&#8217;s current rating would place him in some of the other weight classes.</p>
<p>LHW &#8211; At Light Heavyweight a rating of 1914 would barely be good enough for 15th.  Well outside of the top 10.</p>
<p>MW &#8211; At Middleweight a 1914 rating wouldn&#8217;t even crack the top 20.</p>
<p>WW &#8211; At Welterweight right now you need almost 2k to even be top 10, 1914 isn&#8217;t even good enough for Top 20.</p>
<p>LW &#8211; 1914 is the exact same rating <a href="http://www.mma-elo.com/me_hist.php?fighter=1971">Joe Stevenson</a> currently has.  That rating has him at 23rd.</p>
<p>When we look at this it becomes clear that Mirko&#8217;s rating really isn&#8217;t that far off.  Looking at other fighters with similar ratings Mirko fits in (sadly for some I know, but look at his recent performances).  Where it becomes an &#8220;issue&#8221; for some is that despite his rating having significantly dropped his overall ranking hasn&#8217;t shifted a lot due to how others have performed recently as well.</p>
<p>-  The loss just happened.  Before Mirko&#8217;s next fight it&#8217;s very likely at least one fighter will pass him.  That is simply a function of how spread out MMA fights are.  Much like how looking at the standings saturday after one team plays and before another team plays monday can show a different picture.  Although Mirko is &#8220;top 10&#8243; today, odds are quite good that won&#8217;t last for very long.</p>
<p>- &#8220;top 10&#8243; doesn&#8217;t really matter.  Another important point, but one that gets overlooked.  You&#8217;d think with how much I rail against &#8220;top 10&#8243; I&#8217;d be immune to such flawed thinking, but no.  What it really comes down to is his rating and performance and the truth is Mirko&#8217;s currently rating is quite reflective of his performance.</p>
<h3><a href="http://www.mma-elo.com/me_hist.php?fighter=181">Yushin Okami</a></h3>
<p>Another fighter that helps illustrate the difference in rating vs ranking is Yushin Okami.  He sat at #2 on the MW list for awhile.  He was rumored to be getting a title shot.  He is 7-1 in the UFC.  His only 2 losses in the last five years both came against former title holders.  However, he&#8217;s been inactive all year (last fight 2008-12-27), and now some other fighters are closing the gap and passing him.</p>
<p>In this case Yushin&#8217;s rating hasn&#8217;t gone down.  Like we talked about above though, other fighters&#8217; ratings are going up.  As a poor analogy imagine a hitter in baseball that continues to hit .325 and sits in first, but eventually some other hitters get hot and raise their batting averages higher.  It&#8217;s not that Yushin has gone &#8220;down&#8221; so much as the other fighters have gone &#8220;up&#8221;.  </p>
<p>This situation is interesting because it&#8217;s almost the exact opposite of what happened to Cro Cop.  In Yushin&#8217;s case they haven&#8217;t lost and their rating has gone down at all, but they&#8217;ve slipped several places in the rankings.  On the other hand, Mirko has done almost everything he could to tank his personal rating, but still sits moderately high in the rankings.</p>
<h3><a href="http://www.mma-elo.com/fighter_compare/1405/1372/">&#8216;kos&#8217; Vs Twinkle Toes</a></h3>
<p>This is another case where I had things wrong in my head.  When I first heard the match up I assumed Kos was much higher rated than Trigg.  Looking at the numbers though Trigg was actually a bit higher.  Immediately I looked a bit deeper.  </p>
<p>Kos &#8211; Lost 2 of his last 3.  Only 3-3 in his last 6<br />
TT  &#8211; Won 4 in a row.  5-1 in last 6.</p>
<p>The truth is historically these two fighters are close enough that one of them getting into a bit of a slump (1-2 in last 3) at the same time one of them gets hot (4 in a row) is enough to shift their overall position.</p>
<p>Looking at the head-to-head fighter comparison I linked above you can see just how similar these two fighter&#8217;s careers have been.  </p>
<p>-  Win/loss percentage very close<br />
-  Edge to Trigg in (t)KO%<br />
-  Edge to Kos in Sub%<br />
-  Both lost to GSP</p>
<p>In the head to head Kos has the win, has the more recent win, and is rated/ranked higher.</p>
<p>Where these two fighters will go from here will be interesting to see.  Both have gotten close, but never broken 2k rating.  Both have had WW title shots, but never won.  Either way, both have had solid careers and will hopefully continue to be healthy and give us fights we enjoy watching.</p>
<h2>Moral of the story</h2>
<p>Don&#8217;t just look at the rankings.  This site provides us with far more useful and far more powerful information than &#8220;1)A 2)B 3)C&#8221;, it&#8217;s silly to ignore that.  Yes, even I mess up sometimes and fall back into the old way of looking at things.</p>
<p>If something looks &#8220;off&#8221; then dig a little deeper and you will almost always find an answer.  No, you might not always agree with it, but it&#8217;s an answer none the less (much like asking out a hot chick).  If you see something that looks completely off, then please feel free to ask.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.mma-elo.com/rants/2009/inside-the-rankings-090920/feed/</wfw:commentRss>
		<slash:comments>4</slash:comments>
		</item>
		<item>
		<title>The Great Weight Debate</title>
		<link>http://www.mma-elo.com/rants/2009/the-great-weight-debate/</link>
		<comments>http://www.mma-elo.com/rants/2009/the-great-weight-debate/#comments</comments>
		<pubDate>Sat, 22 Aug 2009 16:52:21 +0000</pubDate>
		<dc:creator>evil pooh</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[roy nelson]]></category>
		<category><![CDATA[site]]></category>
		<category><![CDATA[system]]></category>
		<category><![CDATA[weight]]></category>

		<guid isPermaLink="false">http://www.mma-elo.com/rants/?p=37</guid>
		<description><![CDATA[Sorry it&#8217;s *late* I didn&#8217;t mean to make you *wait* You see&#8230;*mate* I&#8217;ve had a lot on my *plate* There was this *quaint* cutey named *Kate*. She took the *bait*, so we went out and *ate*. What a *date*! As I got her back to her front *gate*; it was starting to feel like&#8230;*fate*. Then [...]]]></description>
			<content:encoded><![CDATA[<p>Sorry it&#8217;s *late*</p>
<p>I didn&#8217;t mean to make you *wait*</p>
<p>You see&#8230;*mate*</p>
<p>I&#8217;ve had a lot on my *plate*</p>
<p>There was this *quaint*</p>
<p>cutey named *Kate*.</p>
<p>She took the *bait*,</p>
<p>so we went out and *ate*.</p>
<p><strong>What a *date*!</strong></p>
<p>As I got her back to her front *gate*;</p>
<p>it was starting to feel like&#8230;*fate*.</p>
<p>Then she told me about her *RATE*!</p>
<p>Now let&#8217;s get one thing *straight*,</p>
<p>this whole thing I blame on *Nate*.</p>
<p>Please, forgive me as I&#8217;m still a bit *irate*.</p>
<p>&#8230;Oh well, enough *hate*</p>
<p>Let&#8217;s just get on with&#8230;</p>
<h4>The *GREAT* *WEIGHT* *DEBATE*</h4>
<p><span id="more-37"></span><br />
A lot of people ask about how the site handles weight classes.  Currently the site allows a fighter to carry their rating with them between weight classes.  Some think this is a major flaw with the system.  I personally think weight classes in general are flawed.  8P  </p>
<p>What I&#8217;m going to attempt to do is you give you look at things from inside the mind of Evil Pooh.  Please don&#8217;t get lost or break anything.</p>
<h3>1) Information Not Available</h3>
<p>The first point is probably the most important.  Understand that the information in question does *NOT* actually exist.  When I receive updates from promoters and commissions there is no weight class information provided.  If I see Fighter A Vs Fighter B, I can guess which weight the fight was contested at, but I simply cannot be sure.</p>
<p>Some people act as though I&#8217;m ignoring information that is readily available, but that simply isn&#8217;t true.  The information as people expect it simply doesn&#8217;t exist.  When discussing this topic further, please keep in mind that what some people are requesting simply does not currently exist.</p>
<p>Obviously for some of the more mainstream events weight class information is available, but even that has flaws&#8230;</p>
<h3>2) The information isn&#8217;t accurate</h3>
<p>The way &#8220;weight&#8221; works in MMA right now is that you have weight classes, and people use the &#8220;weight class&#8221; to say what &#8220;weight&#8221; a fighter fights at.  For example, if I weigh 180lbs and I weigh-in at 170lbs, then weigh 180lbs the day of the fight&#8230;I&#8217;m considered 170lbs.  </p>
<p>Here are just a couple amusing situations that result from such a practice.</p>
<h4>2a)Up or down?</h4>
<p>Let&#8217;s say we have these three fighters&#8230;</p>
<p>Fighter A &#8211; 172lbs</p>
<p>Fighter B &#8211; 169lbs<br />
Fighter C &#8211; 185lbs</p>
<p>Let&#8217;s ignore weight classes for a second and ponder which fighter (B or C) Fighter A should be matched up against.  If it&#8217;s Fighter B they have a 3lb advantage, if it&#8217;s Fighter C, then Fighter C has a 13lb advantage.</p>
<p>Hrmmm&#8230;So &#8220;competition&#8221; and &#8220;fair&#8221; and &#8220;balanced&#8221; and all that should dictate that Fighter A and Fighter B compete, right?  Oh wait, look there are the weight class brackets&#8230;they say that Fighter A (a &#8216;middleweight&#8217;) is being a bully if they fight Fighter B (a &#8216;welterweight&#8217;) and that instead Fighter A should pick on someone their own size!!!&#8230;Ya know, the guy their own size that is 13lbs heavier than them.</p>
<h4>2b) Fight Day Weight</h4>
<p>One of the silliest situations I&#8217;ve witnessed, and I&#8217;m sure it&#8217;s happened other times, was this:</p>
<p>Fighter A &#8211; 175lbs<br />
Fighter B &#8211; 180lbs</p>
<p>They are scheduled to fight at 170lbs.</p>
<p>Fighter B cuts to 170 and &#8220;makes weight&#8221;.  Fighter A oversleeps or something and only gets down to 172.5.  Fighter A then had to give up part of their purse and the &#8220;official&#8221; results show that Fighter A had a weight advantage over Fighter B.  Of course, during the actual fight (ya know, when it actually mattered!) Fighter A was clearly out weighed.  </p>
<p>In a case like this the &#8220;offical&#8221; results would show A as being heavier, they&#8217;d show the fight as not at &#8220;170&#8243; and a host of other flaws.</p>
<p>At this point it&#8217;s clear that even when the information does exist, it can be quite flawed.</p>
<h3>3)How much of a weight difference is needed to make a difference?</h3>
<p>One of the most confusing things to me (I&#8217;m not very smart) about weight classes is how they are currently divided up.</p>
<p>Going from 135lbs to 145lbs is a 10lb difference, this gives a new weight class</p>
<p>Going from 145lbs to 155lbs is a 10lb difference, Ok so 10lbs matters&#8230;</p>
<p>Going from 155lbs to 170lbs is a 15lb difference, ok so the first 10 don&#8217;t matter here, but the next 5 do</p>
<p>Going from 170lbs to 185lbs is a 15lb difference, 10lbs again doesn&#8217;t matter, so 15 is our lucky number now it seems</p>
<p>Going from 185lbs to 205lbs is a 20lb difference, Uhhh ok so more than double 10lbs to make a difference, ok the guys are a bit heavier, I guess?  Maybe??</p>
<p>Going from 205lbs to 265lbs is a 60lb difference, ok now I&#8217;m just lost~!!!</p>
<p>So it&#8217;s &#8220;ok&#8221; for someone who&#8217;s 210lbs to fight someone who&#8217;s 265lbs, but *NOT* ok for them to fight someone who&#8217;s 205 lbs?  </p>
<p>Isn&#8217;t 210 minus 205 just FIVE POUNDS~!?!?!  (checks on his claws) yeah, five pounds.  Going from 140 to 145 is 5 pounds and it doesn&#8217;t matter way down there when 5lbs is over 3% of someone&#8217;s total body weight.  Yet somehow, up at 210 just over 2% of a body weight difference is completely unacceptable.</p>
<p>In a head to head sport, shouldn&#8217;t the *ACTUAL* weight of the fighters *AT THE TIME OF THE FIGHT* be the comparison that really matters?  Sadly, we don&#8217;t get the actual weight of the fighters, and we have some fights that are viewed as &#8220;wrong&#8221; simply because of predetermined brackets.  </p>
<h4>Evil interlude</h4>
<p>Over my lifetime I&#8217;ve fluxuated between a few weight classes:  Heavyweight, super heavyweight, super-duper heavyweight, &#8216;get-two-scales this one only goes up to 300lbs&#8217;-weight, etc.  Despite all that weight gain I&#8217;ve never experienced any major performance gains from a few pounds either way.  Going from 205 to 207 didn&#8217;t increase my bench by 40lbs and my vertical jump by 8inches.  When I went from 185 to 187 it wasn&#8217;t because my arms grew an inch longer.</p>
<p>What makes these brackets so magical and significant?  Why is it that adherence to these brackets is more important than the *ACTUAL WEIGHT* of the competitors?!  How can it be OK for someone to weigh 170 and fight someone who weights 185 and &#8220;cut&#8221; the day before, but not OK for the 170lb person to fight someone who is 172?  Why are people ok with a 50 plus pound weight difference in some cases, but not ok with a 5 or 10 pound difference in others?</p>
<h3>4)Weight, the Whole Weight, and nothing but the Weight~!!!</h3>
<p>Almost as confusing to me as the &#8220;that 5lbs matters, that 3lbs doesn&#8217;t, that 10lbs does, those 10lbs don&#8217;t&#8221; is this almost automatic belief that weight is the be-all-end-all stat by which to determine a competitive advantage.</p>
<p>Make no mistake about it, if two fighters have equal:</p>
<p>-  Height<br />
-  Reach<br />
-  Uhh..I don&#8217;t know&#8230;~S~K~I~L~L~~!!</p>
<p>Then weight can definitely come into play.  Sadly, what I often see are many other competitive advantages completely overlooked because of &#8220;weight&#8221;.</p>
<p>If I&#8217;m going into a match against a known striker and my game plan is to strike I can assure you I&#8217;d give up 5lbs of weight for an extra inch reach advantage.  I&#8217;d probably do that up to about 20lbs, or 4 inches of reach advantage&#8230;after that I&#8217;d look silly standing with my arms at my side.  *shrugs*</p>
<p>The exercise here is to think about how big a factor weight is across a wide range of MMA fights&#8230;you know MMA a sport with a wide range of backgrounds/skill sets/fight outcomes.  Just consider these situations&#8230;</p>
<h4>4a)Striking matchup</h4>
<p>Fighter A &#8211; 200lbs  84inch reach<br />
Fighter B &#8211; 205lbs  80inches reach</p>
<p>These two fighters are about to engage in a pure striking match.  Assume most other things are reasonably even do you believe that the possible 5lbs more strength is a bigger advantage to fighter B than the 4inches of reach is to Fighter A?</p>
<h4>4b)Body Mass</h4>
<p>Fighter A &#8211; Roy Nelson (Sorry Roy)<br />
Fighter B &#8211; Sok</p>
<p>Somehow people talk as though every fighter has the exact same body mass.  If Fighter A is 200lbs and Fighter B is 200lbs, they have the exact same weight, so they have the same body mass, the same body fat%, the same lean muscle, the same muscle distribution, the same bone density, etc.</p>
<p>Anyone that&#8217;s every seen more than 2 people of the same weight in their lives knows that isn&#8217;t the case.  Some have higher body fat (Sorry again Roy), some are Taller, some have bigger legs, some have a lot of hair (Clay could make 145 if he was bald!!), etc.</p>
<p>Again, the point here isn&#8217;t to talk in absolutes, but to understand what a huge variance already exists within the current framework.  What it comes down to is aren&#8217;t there times when even at the same weight one fighter still has an advantage.  Miguel Torres has a lot of height for his weight class.  Anderson has quite the reach for 185.  Fedor&#8230;sorry gotta chalk that one up to the third category from above.</p>
<h3>5) Working hard for an asskicking</h3>
<p>How many fighters do you see change weights so they can lose?  I&#8217;m being serious here, how many fighters do you see change weight with the sole intent of performing worse?  How many times have you seen interviews where a fighter goes:</p>
<p>&#8220;I was feeling great at 185, but going up to 205 enables me to get taken down more because my sprawl is worse.  Besides, chicks dig the love handles!&#8221;?  </p>
<p>or</p>
<p>&#8220;I figured since I got knocked out a lot at 205 I&#8217;d move up to heavyweight so I could get knocked out just a bit faster!&#8221; John &#8220;zulu&#8217;d&#8221; Doe</p>
<p>Ever?  </p>
<p>Here&#8217;s what I usually see,</p>
<p>&#8220;Man, those guys at 185 were *HUGE* 170 is a better fit for me&#8221;.</p>
<p>&#8220;Getting down to 205 was too much of a cut, I was too tired and just working against my body, heavyweight is a much better place for me&#8221;.</p>
<p>&#8220;155 is where I should be&#8221;</p>
<p>The point here is that almost never does a fighter cut or gain weight in order to do worse.  In fact, I think it&#8217;s fairly safe to say that the decision to change weight classes is often dictated by a desire to perform even better.</p>
<p>This leads to the question of&#8230;if a Fighter is 1800 rated at one weight class, what are the odds they change weights just to drop to being 1700 rated?  Doesn&#8217;t it seem more likely that a fighter changes weights because they believe they will perform *BETTER* overall?</p>
<h3>6) Everything changed?</h3>
<p>This ties in a bit with point 4, but some people act as though the difference between 185 and 170 is night and day.  When a fighter moves from 185 to 170 do they completely forget takedown defense and have to relearn it?  When someone goes from 185 to 205 do they have to completely relearn their entire ground game?  Are sprawls at 155 categorically different than they are at 145?</p>
<p>Think about the MLB playoffs.  How many times do you see a &#8220;starting&#8221; pitcher come out of the bullpen during crucial series?  Obviously there is a difference between &#8220;starting&#8221; and &#8220;closing&#8221;.  However, there&#8217;s also a lot in common.</p>
<p>Think about if you&#8217;ve been scounting a great right fielder, but your farm system needs left fielders.  It&#8217;s *NOT* the same, but doesn&#8217;t a *LOT* of it transition?  Speed, reaction, dedication, drive, heart, etc?</p>
<p>What I&#8217;m getting at here is that although there are differences between 155 and 170 or 205 and 185, it isn&#8217;t a whole new ballgame.  Many of the fighter&#8217;s skills transition with them.</p>
<h3>7) Past more important than recent</h3>
<p>At some point in the future I&#8217;ll address the &#8220;current vs alltime&#8221; issue, but what it comes down to is some people think too much emphasis is placed on older fights and not enough emphasis is placed on more recent fights.  Where this gets interesting is when looking at weight classes.</p>
<p>Some people think looking at Fighter A&#8217;s fights at 205 from years ago is more relevant to his 205 standing than his recent fights at 185.  Some people want to focus on Fighter B&#8217;s wins at lightweight years ago, and ignore his more recent losses at welterweight.</p>
<p>Lets go back to baseball for a minute.  Lets say you now need a right fielder.  You&#8217;ve got Baller A that has been a DH for 4 years, and a first baseman for a year before that, but five years ago was a solid right fielder.  </p>
<p>Baller B won a gold glove in left field last year and only has two errors so far this year.  </p>
<p>Who do you throw into right field?</p>
<p>Another sport, lets take a look at the NFL.  Every year you see defensive linemen drafted to play in a scheme they&#8217;ve never played under.  There are big differences between a 4-3 and a 3-4.  Especially depending on the offensive formation and the team you are going against.  Why on earth would someone draft a &#8220;great&#8221; nosetackle they don&#8217;t need instead of a &#8220;solid&#8221; defensive tackle?</p>
<p>One possibility is that they see how many of the skills transition.  Maybe see the drive, the determination, the willingness to learn, etc.</p>
<p>Remember, we are *NOT* talking perfect here.  We are talking about reasonable.  Some people seem to be of the opinion that going from 170 to 185 resets everything, all I&#8217;m saying is that *SOME* of it transitions.</p>
<h3>8) Have to start somewhere</h3>
<p>All fighters start off at 1500.  Then they fight some and land wherever they land.  Always keep in mind that the system is very self-correcting.  If a fighter is &#8220;too high&#8221; they will drop, and drop quickly.  If a fighter is too low, they will rise quickly.  Both assuming proper matchmaking.  8)</p>
<p>Let&#8217;s actually take a look at a few big name fighters that have hoped weight.  Basically I&#8217;m just thinking of examples and then opening up their fighter page&#8230;let&#8217;s see what we find&#8230;</p>
<h4><a href="http://www.mma-elo.com/me_hist.php?fighter=41">Randy Couture</a></h4>
<p>One of the most well known weight hoppers.  Following 2 losses at heavyweight (both against higher rated fighters) Randy moved down to Light heavyweight.  Instead of setting him to 1500, we kept his ranking and he fought Chuck.  He was still an underdog (as he was everywhere), but this way it didn&#8217;t appear as though Chuck was fighting a basically 0-0 fighter.  Randy won and then fought Tito.  He was slightly lower ranked than Tito, but it was a reasonable matchup and Randy won.  </p>
<p>The two Vitor fights are skewed because of the cut.  (another case where I can&#8217;t change it on the site, but I do wonder about the decision *shrugs*)</p>
<p>Following the Vitor fights Randy then lost to Chuck, Beat Mike and Lost to Chuck.  All three of which fit from a &#8220;rating&#8221; perspective.  </p>
<p>Randy then moved back up to heavyweight where he was an underdog against Tim (again, not just on the site), and he won.  Following that win, he beat Gonzaga, whom he was higher rated then at the time.  He then got matched up against Brock. (Business > sport)</p>
<p>Overall though, not bad at all.  Chuck lost, but it wasn&#8217;t against a 1500 rated guy.  When Timmy fought Randy it was 2007, that&#8217;s 5(ish) years after Randy&#8217;s last fight at heavyweight.  Just like the example above.  Do people honestly think 5+ year old information is more accurate than 5+ years of recent competition and performance?  Simply because of a few pounds?</p>
<h4><a href="http://www.mma-elo.com/me_hist.php?fighter=1450">Mike Swick</a></h4>
<p>Mike was tearing up the middleweight division and then ran into Yushin Okami (a fighter higher rated than him).  Following the loss Swick dropped to welterweight and his first fight was against Josh Burkman.  Transferring his rating directly from middleweight he had a 3rating point advantage&#8230;and he won (by majority decision).</p>
<p>In his fights since he has beaten: Marcus Davis, Jonathan Goulet, and Ben Saunders.  All of which are fighters he was higher rated than.</p>
<h4><a href="http://www.mma-elo.com/me_hist.php?fighter=2356">Michael Bisping</a></h4>
<p>Following a loss to Rashad Evans&#8230;who was higher rated than him at the time.  (Notice all the fighters that change weight after a loss&#8230;must be because they want to lose more *shrugs*).</p>
<p>Anyway, following the loss Bisping beat &#8220;chainsaw&#8221; (whom he was higher rated than), Jason Day (who he was 3 whole rating points lower than), Chris Leben (who he was higher rated than), and then loss to Hendo (who he was lower rated than).</p>
<h4>Enough examples</h4>
<p>I could literally do this all day.  Some fighters will have done well, some will have continued to flounder, but the truth is the majority of fighters fit the pattern outlined above.  That pattern is that their current rating at the time of the weight class swap is more accurate than restarting them back at 1500.</p>
<h4>Other options?</h4>
<p>Some might say that instead of starting them back at 1500, why not just deduct a small percentage.  The obvious questions then become, &#8220;how much&#8221;, and &#8220;why&#8221;?  Remember, most fighters change weight classes to perform better, the thought of taking even 10% of their rating &#8220;just in case&#8221; doesn&#8217;t make much sense.</p>
<p>Additionally, why penalize/reward a fighter for what might happen, when you will be penalizing/rewarding based upon what actually does happen.  Think about it like this:</p>
<p>If a fighter changes weights and loses their next fight their rating will go down.  If we had forced their rating lower to start with, they&#8217;d lose less for the fight, but still be lower.</p>
<p>If a fighter changes weights and wins their next fight their rating will go up.  If we&#8217;d lower their rating already, then they&#8217;ll gain even more because they were &#8220;lower&#8221; rated going into the fight.</p>
<p>The system will self correct quite well, so the question becomes, &#8220;Why guess at how to adjust someone&#8217;s rating when simply having them fight will properly adjust it for us&#8221;?</p>
<p>Basically what we need are two things:</p>
<p>-  A logical and compelling reason to adjust ratings outside the standard flow of the system<br />
-  A fair and mathematically sound way to make such an adjustment.</p>
<p>Much like the weight information itself neither of these things seem to exist.  Lots will speculate that a fighter is &#8220;worse&#8221; when they change weight classes, but that is both counter intuitive and unsupported by data.  At the same time, naturally boosting Roy Nelson (honestly, last time man) just because he loses some weight also seems a silly thing to do.</p>
<p>Since we have a system in place that already accurately adjusts fighters based upon outcome, why would we want to try tinkering with it based upon non-outcome based factors?</p>
<h3>And that&#8217;s how we got here</h3>
<p>Basically a combination of the above and a few other things I edited out are why we stand where we stand.  If I needed to try to condense the above rant down it&#8217;d be very hard, but probably along the lines of:</p>
<p>- I like to *rhyme*&#8230;it&#8217;s just something I enjoy doing in my spare *time*&#8230;even when I don&#8217;t get paid a *dime*&#8230;<br />
-  Weight classes are highly flawed structures<br />
-  Accurate weight information does not exist<br />
-  Roy Nelson is fat (Guess I was wrong)<br />
-  Attempts to artificially adjust a system that has built in self correction seems foolish and wastrel</p>
<p>As always I&#8217;m not opposed to changing anything, but at this point it would require:</p>
<p>-  Accurate weight information<br />
-  Compelling reason(s) to make the change<br />
-  A mathematically sound change to make</p>
<p>Currently, I have none of the three.  What I do have is a plan for how to handle weight classes in the event I found myself in charge of sanctioning MMA in a post apocalyptic world I had been forced to repopulate after a &#8220;smart&#8221; bomb left only me and the hot redheads alive.  It will probably never come to that though. 8(</p>
]]></content:encoded>
			<wfw:commentRss>http://www.mma-elo.com/rants/2009/the-great-weight-debate/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Strike Force Carano Vs Cyborg Update</title>
		<link>http://www.mma-elo.com/rants/2009/strike-force-carano-vs-cyborg-update/</link>
		<comments>http://www.mma-elo.com/rants/2009/strike-force-carano-vs-cyborg-update/#comments</comments>
		<pubDate>Wed, 19 Aug 2009 00:51:35 +0000</pubDate>
		<dc:creator>evil pooh</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[fedor]]></category>
		<category><![CDATA[strikeforce]]></category>
		<category><![CDATA[system]]></category>
		<category><![CDATA[ufc]]></category>

		<guid isPermaLink="false">http://www.mma-elo.com/rants/?p=35</guid>
		<description><![CDATA[The Strikeforce card is in the books, and the site is finally updated(a few days late, sorry I&#8217;m so slow!). I&#8217;m going to discuss a few things from the card and respond to random things from around the web. Strikeforce &#8211; Carano Vs Cyborg Fight outcomes Some people are obsessed with fight outcomes as a [...]]]></description>
			<content:encoded><![CDATA[<p>The Strikeforce card is in the books, and the site is finally updated(a few days late, sorry I&#8217;m so slow!).  I&#8217;m going to discuss a few things from the card and respond to random things from around the web.</p>
<p><span id="more-35"></span></p>
<h3><a href="http://www.mma-elo.com/me_events.php?id=7956">Strikeforce &#8211; Carano Vs Cyborg</a></h3>
<h4>Fight outcomes</h4>
<p>Some people are obsessed with fight outcomes as a means of measuring the validity of the system.  As I&#8217;ve said in the past that is an often flawed approach because the system (and the sport) is much deeper than that.</p>
<p>For those that focus only on direct prediction percentage though, the higher ranked fighter won 8 of the 9 fights on Saturday.  In the one fight where the lower ranked fighter won, they are now ranked higher.  Doesn&#8217;t seem too bad, does it?</p>
<p>I don&#8217;t really look at things in those terms though.  I see that the case of one fighter &#8220;leapfrogging&#8221; the other wasn&#8217;t because of enforced leapfrogging within the system, but because the fighters were genuinely very evenly matched.  That to me speaks to good matchmaking, and to an overall meaningful fight.  </p>
<p>Another thing I note is the fight between Melendez and Ishida.  It wasn&#8217;t that long ago that Ishida beat Melendez and since that win the fighters have both had modest records (2-1 and 3-2).  The reason the fight stands out to me is that despite the head-to-head loss previously Melendez was still the higher rated fighter.  This makes sense from a logical point of view, from a system point of view, and obviously now from a results point of view.  </p>
<p>For some people the sight of a fighter being ranked above someone they&#8217;ve directly lost to immediately signals that the site&#8217;s system is flawed.  These people will complain about Sherk being 11 whole rating points higher than Edgar, yet some of them didn&#8217;t mind that Jardine was ranked lower than Forrest.  People need to understand that although a direct head-to-head victory has a tremendous impact on where two fighters stand, it does *NOT* immediately invalidate everything else that has happened up to that moment in time.</p>
<h4>Note to the <a href="http://www.mma-elo.com/me_hist.php?fighter=491">Gegard Mousasi</a> bandwagon&#8230;YOU&#8217;RE LATE!</h4>
<p>As with all fighters I&#8217;ll say there is no way to know what happens next.  Gegard could have peaked and his rating may never go higher.  He might get bored, change sports, retire, or continue winning for the next three years.  There is really no way to know what will happen in the future.</p>
<p>What we can be relatively sure of though is the past.  The fact of the matter is that Gegard has been doing very well for a long time now and most were unwilling to look/listen/think.  To hear some people claim Gegard &#8220;arrived&#8221; by winning a single fight after he won 12 fights in a row, a MW tourney, and jumped weight classes to fight Mark Hunt, just seems silly.  There&#8217;s no doubt the win over Renato was impressive, but some people obviously should have been paying attention sooner.</p>
<h4>Random Answers</h4>
<p>As evidenced by the two day late site update, I don&#8217;t have a lot of time.  I try very hard to answer questions on this site, and even some I get directed to elsewhere.  However, your best chance to get a response to an honest question is to post in the forums here or e-mail me.  If you genuinely have a question, then I&#8217;ll do my best to answer it.</p>
<p><strong>Genuine(ish) Questions</strong><br />
The question of weight classes on the site has come up&#8230;again.  I&#8217;ve responded to this several times in several places, but perhaps it&#8217;s time I throw it all together into one big answer.  Look for a rant later this week to address why weight classes are handled how they are on this site.</p>
<p>Another question I see raised is that of how unbiased the site is.  Let me be clear, the site is only biased towards accuracy.  The site is completely unbiased in terms of the fighters themselves and the organizations they fight for.  There is nothing that gives Fighter A an inherent advantage over Fighter B.  The system evaluates GSP the same way it evaluates Fedor.  If you see one fighter with an 1870 rating and another fighter with a 1270 rating you can be certain that if you swapped their fight histories exactly, their ratings would swap as well.</p>
<p>This is very different from some sites where wins mean different things.  Sometimes fighters leapfrog, sometimes they don&#8217;t, sometimes people move up without ever fighting, sometimes people move down without ever fighting.</p>
<p>I know some like to claim that the site is &#8220;biased&#8221; based upon the initially selected criteria, but that is simply wrong.  To claim it was biased would suggest that I wanted a certain outcome (say, Fighter A ranked highly, or Organization B to have more of the top ranked fighters), I&#8217;d then have to re-tune the system variables after almost every fight to ensure that the status quo I wanted was still maintained.  Given that the core system variables haven&#8217;t changed in quite some time I think it&#8217;s safe to say that isn&#8217;t the case.</p>
<p>As I said at the top, the system is biased towards accuracy.  A rant about system accuracy is on the list (along with a dozen other things), but understand that the values used on the site were chosen because they were the most accurate.  By accurate I mean that when the system expects a 60% win%, there is very close to a 60% win percentage.  Not that my all-time favorite fighters are cemented at #1 in every weight class and will never move regardless.</p>
<p>In a likely to fail attempt at clarifying the situation lets talk about painting a house.  If I were a huge fan of red walls in a house (I had a bias toward the red walls), and was painting the walls of a house and made them red due to my own personal tastes, that would be bias in the sense most understand it.  It is a personal bias that is determining how something is done.  </p>
<p>The situation here on the site would be akin to me liking red walls, but doing research and knowing that statistically white walls make a house more likely to be sold.  Given the intent on selling the house, my &#8220;personal bias&#8221; is set aside and a decision is made purely based upon supporting evidence.</p>
<p>If people want to get hung up on perceived &#8220;bias&#8221; they can all they want, but understand that most rational people understand what the term &#8220;unbiased&#8221; is representing in regards to this site.  It means no *PERSONAL* (Evil Pooh) bias, it means no *ORGANIZATION* bias, it means no *FIGHTER* bias, etc.  If you want to get hung up on &#8220;statistically accurate bias&#8221; be my guest, but I pray you have better things to do with your time.</p>
<p><strong>Not so genuine &#8220;questions&#8221;</strong><br />
Here are a couple comments I&#8217;ve seen around the web that were a waste of my time and sadly others I&#8217;m sure.</p>
<p>&#8220;Elo is basically using MMAth&#8230;&#8221;</p>
<p>Wow it only took this &#8220;author&#8221; five words to show they either have no clue what Elo is, or what MMAth is (maybe both *shrugs*).  Thank god they are making a comment about&#8230;Elo *AND* MMAth!</p>
<p>I&#8217;d go into more detail on how wrong this is, but it&#8217;s the kind of thing that if I have to explain what&#8217;s wrong it&#8217;s even worse.  </p>
<p><strong>Why I&#8217;m Evil Pooh and not Tolerant To Morons Pooh</strong><br />
Another little gem I saw was this &#8220;tongue-in-cheek, stick-it-to-the-man, omfg I&#8217;m so clever I&#8217;m going to jump out of my chair and slam the &#8216;submit&#8217; button as I post this ownage of a response&#8221; that said,</p>
<p>&#8220;i just like the elo system because it still has jon fitch ranked high, and he never dipped. AND as it stands now fedor is the only top 10 HW that is outside the UFC and signed with SF. so much for more competition outside the UFC&#8221;</p>
<p>Let&#8217;s step through this pile of shit turd by turd, shall we?</p>
<p>&#8220;Jon Fitch ranked high&#8221;  &#8211; is this a problem?  What places don&#8217;t have Fitch ranked high?</p>
<p>&#8220;and he never dipped&#8221; &#8211;  Simply wrong.  It takes clicking one link (shockingly titled &#8220;Jon Fitch&#8221;) to see that he, in fact, did dip.  He lost personal rating when he lost to GSP, he also got &#8220;passed&#8221; in the sense that other fighters&#8217; ratings improved.  </p>
<p>It&#8217;s important to keep in mind that a fighter&#8217;s rating shows where they stand on a personal level, but a fighter&#8217;s &#8220;ranking&#8221; is determined based upon their rating in relation to other people.  As I&#8217;ve said before, hitting 50 home runs in a year might sound awesome, but it loses a bit of its shine if the league average is 72 home runs.</p>
<p>&#8220;as it stands now fedor is the only top 10 HW that is outside the UFC and signed with SF&#8221;</p>
<p>I love the effort put in to tailor the response&#8230;&#8221;outside the UFC *AND* signed with SF&#8221;.  Yeah because SF is completely against co-promotion and unless someone is signed to SF this very second there&#8217;s no chance they could be one of Fedor&#8217;s next three opponents.  </p>
<p>&#8220;so much for more competition outside the UFC&#8221;</p>
<p>This is great because it acts as though the previous skewed comment actually proved something.  Note that the previous line used &#8220;*AND* signed with SF&#8221; and this line says &#8220;outside the UFC&#8221;.  Little known fact, those are actually two different things.</p>
<p>Let&#8217;s take a quick look at the current MMA-ELO top 10 heavy weights:</p>
<p>1) Fedor  &#8211; Ok so out of the top 10, we are down to 9 because he won&#8217;t fight himself!<br />
2) Josh Barnett &#8211; not in the UFC, was scheduled to fight, could still happen<br />
3) Big Nog &#8211; In the UFC, but uhhhh no one is asking for this fight. (Nog even turned a 4th fight down at one point previously)<br />
4) Jeff Monson &#8211; Available, and can&#8217;t leave the US lol<br />
5) Cro Cop &#8211;  See Nog<br />
6) Antonio Silva &#8211; Not UFC, Has fought in EliteXC<br />
7) Aleks &#8211;  Brother, won&#8217;t happen (still not UFC)<br />
8) Arlovski &#8211; Not UFC<br />
9) Ben Rothwell &#8211; Now UFC, wasn&#8217;t UFC before, somehow went from no chance against Fedor to now being mentioned as part of the UFC&#8217;s uber HW stable that Fedor has to come prove himself against.<br />
10) Randy Couture &#8211; If he wins this might actually get talked about a bit more</p>
<p>So of the &#8220;top 10&#8243; HWs, that&#8217;s really 9 because of Fedor himself, the UFC has&#8230;4.  Of those 4 Fedor has already beaten Two.  That means *TWO* of the top 10 HW&#8217;s are available in the UFC for Fedor that he hasn&#8217;t already beaten.  Additionally, one of those two hasn&#8217;t even fought in the UFC yet and until signing was bashed as being no competition.  Amazing how the original statement basically bashed SF for only having 1 of the &#8220;top 10&#8243;, but for the intent of the message, the UFC is sitting at 2.  (It&#8217;s ok, my head hurts too)</p>
<p>What is really interesting is the names people do talk about fighting Fedor are Brock, Carwin and Cain.  They have ratings of: 1916, 1864, 1797.  Compare those against fighters like Werdum (1903), Overeem(1912), Rogers(1903) and suddenly it does look like Fedor actually has some competition outside the UFC.  Note the word &#8220;some&#8221;, not &#8220;more&#8221;, not &#8220;better&#8221;, just a very reasonable, a very logical, a very factual, &#8220;some&#8221;.</p>
<p>Also note that Fedor is signed for three fights in Strikeforce.  Lots can change.  Carwin and Cain are about to fight each other that means one is likely to gain rating and one likely to go down.  Randy and Nog are about to fight.  If Randy wins his stock will go up, if he loses then people probably won&#8217;t mention him again.  Dos Santos has a fight with Cro Cop (Offical?) that could impact things.</p>
<p>Lots can and will happen in the next year or so.  In the next year Brock could win three more fights (and almost double his career total!) and that&#8217;d move him up the list a lot.  Carwin (or Cain) could remain unbeaten and climb the list.</p>
<p>Maybe in a year or so the UFC will have all of the top 5 or 10 fighters, then this person could actually post an honest, straight forward comment to support their personal opinion instead of the previous pile of crap.</p>
<p><strong>Quick Note</strong><br />
It should really be it&#8217;s own rant, but your personal opinion should not dictate how &#8220;good&#8221; the site is.  If your favorite fighter moves up to #1 that doesn&#8217;t make the site better.  If they lose and drop from #1 that doesn&#8217;t make the site worse.  If the site is wrong, then it needs to be adjusted, and that is true whether you like how the Top 10 currently looks or not.</p>
<p>If BJ beats Sanchez and moves into #1 don&#8217;t suddenly flaunt how BJ is #1 on mma-elo if you&#8217;ve been bashing the system because he wasn&#8217;t #1 before.  If the system was flawed to not have him #1 before, then it&#8217;s likely still flawed even if he&#8217;s now sitting at #1.  On the other hand, if you&#8217;ve been following the site and understand that Brock is on the rise, and he continues to win.  By all means, cheer his career and note his accomplishments.  </p>
<p>One of the real strengths of the site is how consistent it is and whether you like the site, love the site or hate the site, I don&#8217;t think it&#8217;s asking too much that you show a bit of consistency back to it.</p>
<p>Thanks,<br />
-Evil Pooh</p>
]]></content:encoded>
			<wfw:commentRss>http://www.mma-elo.com/rants/2009/strike-force-carano-vs-cyborg-update/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
		</item>
		<item>
		<title>BTN: System Accuracy</title>
		<link>http://www.mma-elo.com/rants/2008/btn-system-accuracy/</link>
		<comments>http://www.mma-elo.com/rants/2008/btn-system-accuracy/#comments</comments>
		<pubDate>Wed, 24 Dec 2008 16:36:35 +0000</pubDate>
		<dc:creator>evil pooh</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[btn]]></category>
		<category><![CDATA[site]]></category>
		<category><![CDATA[system]]></category>

		<guid isPermaLink="false">http://www.mma-elo.com/rants/?p=15</guid>
		<description><![CDATA[A comparative look at different ways to gauge the accuracy of a ranking system.]]></description>
			<content:encoded><![CDATA[<p>Unlike my last few relationship I&#8217;m going to start this rant by being painfully honest.  This rant contains math.  There I said it, but now that we know, lets try to work through this together.</p>
<p>I&#8217;ve tried to provide examples and keep the math simple.  If you have any questions please feel free to ask and I&#8217;ll attempt to explain further.  Even for those that hate math I&#8217;d suggest trying to read through it a time or two.  </p>
<p>With the disclaimer out of the way, lets move on.  The point of this rant is to examine how best to measure and represent system accuracy.  I&#8217;m going to go over three methods that have been suggested and show how the current system model on the site measures up.  There will also be a brief(ish) discussion of what I perceive the pros and cons to be with each approach.  Feedback here is much appreciated as I&#8217;d like this metric to be something people could quickly use to weigh one system against another.</p>
<h3>Method 1: Heads I win, Tails you lose</h3>
<p>The first approach is the most basic.  It looks at every fight and measures how many fights the higher rated fighter won.  It then divides that number by the total number of fights.</p>
<h4>Example</h4>
<p>Assume there were only 10 fights, and the higher rated fighter won 4 of them, then the result would be 40%.  That is to say that the system was correct 40% of the time.  </p>
<h4><a href="http://www.imdb.com/title/tt0060196/" target="_blank">The good, the bad, and the ugly</a></h4>
<p>PROS:  One of the upsides of this approach is that the number is very easy to understand.  It&#8217;s very easy for someone to look at past picks and understand they got 2 out 5 right.  Another benefit is that this number is easily compared to other systems.</p>
<p>CONS:  The biggest downside to this metric is that it deviates from the entire basis of the site.  When talking about sports almost nothing is ever 100%.  One of the major benefits of the site is that it is able to recognize that even though one fighter is rated higher that doesn&#8217;t guarantee victory or even proclaim vast superiority(such proclamations should be left to the fans and the fighter&#8217;s mom).</p>
<p>Another potential drawback is that every single fight is counted.</p>
<p>Thoughts:  Although I like the simplicity of the number and how portable it is, I don&#8217;t like how it fails to utilize the site&#8217;s expected win percentage model.  Additionally, I think if an approach like this were to be used it might make sense to specify additional parameters(ex. minimum number of fights).</p>
<p><b>Site result: 65%</b></p>
<h3>Method 2: Fighter history</h3>
<p>The way this approach works is by going fighter by fighter looking at every fight they had past their sixth fight where their opponent also had at least six fights previously.  For each of those fights I calculate their expected number of wins, and total their actual number of wins.</p>
<p>The absolute value of the difference between expected wins and actual wins is then accumulated across all fighters and this number is ultimately divided by the total number of fights.  </p>
<h4>Example</h4>
<p>Lets look at a two fighter example to get a better idea of how this works:</p>
<p>Fighter A<br />
Total fights = 2<br />
Expected wins = 1<br />
Actual wins = 1<br />
Absolute difference = 0</p>
<p>Fighter B<br />
Total fights = 4<br />
Expected wins = 3<br />
Actual wins = 2<br />
Absolute difference = 1</p>
<p>In this case our total absolute difference is 1 and our total number of fights is 6.  From here we can divide the total absolute difference by the total number fights to get a percentage of incorrect outcomes across all fights.</p>
<p>1 / 6 ~ 0.167</p>
<p>We can then subtract that number from 1 to get a percentage correct for the system:</p>
<p>1 &#8211; 0.167 = 0.833 ~ 83%</p>
<h4><a href="http://www.larrymillerhumor.com/home/" target="_blank">The Good, The Bad, and The Ugly: The Quickening</a></h4>
<p>PROS:  Unlike the previous approach this method factors in the expected win percentage.  Which is good because there is a lot of value in the expected win percentage and not just for looking at &#8220;pot odds&#8221; when placing a bet on a given fight.</p>
<p>CONS:  The approach used in this method is definitely more complicated than the first.  There is also the possibility that this number doesn&#8217;t represent a useful metric for people.</p>
<p>Thoughts:  Overall I like this approach better than the first method.  It factors in the expected win percentage and is an overall deeper number.  There&#8217;s no doubt that it would be misinterpreted at a glance by some, but I&#8217;m willing to put in the time so that anyone truly interested would be able to understand it.</p>
<p>Basically this number helps give us an idea of the average fighter&#8217;s actual performance compared to their expected performance.  I&#8217;m not sure how useful a measure that is though, so feedback is definitely welcomed on this method.</p>
<p><b>Site result: 86%.</b></p>
<h3><a href="http://www.sho.com/site/dexter/home.do" target="_blank">Method 3: Slice of Life</a></h3>
<p>The final suggested method is an extension of the rant I did a little while ago.  How it works is by slicing all fights up into smaller pools of fights based upon the difference in rating between the two fighters.  From there it looks at the actual percentage of fights won by the favorite versus the expected percentage of fights that would be won.  </p>
<p>In order to get an overall picture of the system on a per fight basis we multiply the number of fights in a given slice, by the absolute difference, accumulate that value across all slices and then divide by the total number of fights from all slices.  </p>
<p>I know that might sound complicated, but if I wrote it as a formula with sigmas and stuff you&#8217;d hate me even more.  Even if the math sounds like gibberish please try to picture what it represents in real world terms.  What this method boils down to is showing how close to the expected win percentage various rating slices actually come.</p>
<h4>Example</h4>
<p>Consider two very broad slices:</p>
<p>1-300 Rating difference:<br />
Total fights = 10<br />
Expected win percentage 65%<br />
Actual Win Percentage 70%<br />
Absolute Difference = 5%</p>
<p>301-600 Rating difference:<br />
Total Fights = 5<br />
Expected win percentage = 85%<br />
Actual win percentage = 70%<br />
Absolute difference = 15%</p>
<p>We then take ((5 * 10) + (15 * 5)) / (5 + 10) ~ 8.33%</p>
<p>That&#8217;s means that on average the above system would be off by about 8.33% or put another way it&#8217;s about 91.67% accurate in terms of expected win percentage based upon rating versus the actual win percentage.</p>
<h4><a href="http://www.imdb.com/title/tt0367882/" target="_blank">The Good, The Bad, The Ugly, and The Crystal Skull</a></h4>
<p>PROS:  The stat focuses in on the expected win percentage approach.  It allows one to quickly see how real life results are measuring up against predicted outcomes.  This number helps give an idea of the overall accuracy of the system when it says Fighter A is expected to win 65% of the time versus Fighter B.</p>
<p>CONS + Thoughts:  At first I was going to say that it&#8217;s more of a system stat than a user stat, but that&#8217;s pretty much what we are looking for here. What we want is a way for a user to gauge how accurate the other numbers they are seeing are.  It&#8217;s great to claim that Fighter A will win 45% of the time, but if in actuality the expected win percentages are off by 40% then the value of the original expected win percentage number is greatly deflated.</p>
<p><b>Site result: 97%</b></p>
<h3>some words Just random</h3>
<p>Whenever you deal with stats it&#8217;s important to know exactly what the number you are looking at represents and whether that number is remotely relevant to what you are doing.</p>
<p>For a lot of people all they will care about is method 1.  Sadly, that wastes a lot of the systems value.  There is a world of difference between a 1601 rated fighter taking on a 1600 rated fighter and a 1950 rated fighter taking on a 1700 rated fighter.  To simply say A > B (even if by the slimtest of margins) portents guranteed victory is a mistake.</p>
<p>Being the numbers geek that I am, method 3 is the most interesting to me.  It&#8217;s a number that helps clarify the validity of other numbers.  It&#8217;s interesting to see how close (on average) to expected results the system is actually coming.  This also provides a degree of cushion when weighing expected win percentage between two fighters of various ratings.</p>
<p>If there are any methods I missed or any additional parameters you would like to see applied to any of the methods, please let me know.  I&#8217;d really like to reach a bit of a consensus on this in the near future as it will prove useful with a couple future features/rants.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.mma-elo.com/rants/2008/btn-system-accuracy/feed/</wfw:commentRss>
		<slash:comments>5</slash:comments>
		</item>
	</channel>
</rss>

