Open vs. Closed Primaries: It Makes No Difference (Updated and To Be Updated Again)

As some of you might know, I've been crunching numbers and by chance saw some interesting things in the tendencies of voting electorate - not surprisingly, most people either found this uninteresting or simply don't like math.  Frankly, me either, but I was friends with a Director of Institutional Research awhile back who convinced me you can enjoy it if the results mean something to you.  That inspired me to continue working with this data.

A question I see raised a lot is that of Obamacans: Republicans and independents registering as Democrats to vote for Obama.  Is there any significance?  Well, being a fan of statistics, I'm going to search for a statistical significance.  My null hypothesis (for those other nerds out there) is that there is no significance in the 2008 Democratic primaries that can be attributed to party crossover.

But how can we know?  Simple, we need to look at open verses closed primaries (I can't work with caucus data because they're inherently skewed and fail to provide numbers verses percentages) in which Clinton and Obama are in direct competition (to try to avoid any significant Edwards, Biden, Dodd or Richardson data mixing in).  That leaves us with Super Tuesday, the Potomac Primary and the others that have come since Edwards dropped out.  The Null Hypothesis in this case is that there will be no significant difference between open and closed primaries in which Clinton and Obama go head to head as evidenced by mean Clinton vote percentages.

OK, so here are our states arranged by open and closed primaries with open primaries listed first (Clinton percentage is given afterward in brackets):

Open Primaries (Super Tuesday Forward):

  • Alabama [47.1%]
  • Arkansas [69.7%]
  • California (independents vote for whoever) [51.9%]
  • Georgia [31.3%]
  • Illinois (is weird but effectively open) [32.9%]
  • Massachusetts [56.2%]
  • Missouri [48%]
  • New Jersey (primaries are closed to opposite parties; independent free for all) [53.8%]
  • Tennessee [53.85%]
  • Utah (independent free for all) [39.2%]
  • Virginia [36.7%]
  • Wisconsin [40.7%]

Closed Primaries:

  • Arizona [50.5%]
  • Connecticut [46.6%]
  • Delaware [42.3%]
  • DC [24.0%]
  • Louisiana [35.6%]
  • Maryland [36.7%]
  • New York [57.4%]
  • Oklahoma [54.8%]

Ok, now to calculate the means and SDs of each group.

Open:
No. of observations: 12
Minimum: 31.3
Maximum: 69.7
Range: 38.4
Mean: 46.779
Std. deviation: 11.158 (Skewed toward Arkansas)

Closed:
No. of observations: 8
Minimum: 24
Maximum: 57.4
Range: 33.4
Mean: 43.488
Std. deviation: 11.147 (Skewed toward DC)

Ok, they're not nearly normal (they're actually skewed in opposite directions), but it's fairly obvious that there isn't a huge difference.  If we were to pretend that these represented nearly normal distributions and ran an analysis of variance (ANOVA) we would get as a final score: .7685.  (Findings are generally considered significant when the score is lower than .05).

There is not enough evidence to reject the null hypothesis. Now, as dbrown points out below, there is an omitted variable bias which I will get at tomorrow (and include this entry with the updated one). Basically, the problem is that I'm comparing states with no control. I probably won't be able to fix that, but I'm going to think through how to get at it tonight. Suggestions would be appreciated.

Sorry fellow Clinton supporters, it looks like it makes no difference and that she's doing better in open primaries.  Caucuses might still be a valid battle to fight, but unfortunately, this is not the line of argument we want anymore.  I'll do an analysis of Obama's momentum tomorrow to see if we can find anything there.



Display:


Re: Open vs. Closed Primaries: It Makes No Differe (none / 0)

Nice analysis.  I'd say these results pretty effectively confirm the null, though it would be nice if there were more observations.  Have you looked into the effects of (stab in the dark, but a reasonable one) DC and Arkansas as overly influential outliers?

So few primaries carry past Super Tuesday (with any importance, that is) that this might be difficult to apply more generally.


No way. No how. No McCain.
by freedom78 on Fri Feb 22, 2008 at 03:58:58 PM EST

Re: Open vs. Closed Primaries: It Makes No Differe (none / 0)

When I box plot both sets, there's no real reason to discount either.  In reality, DC could be discounted (probably) but, honestly, I'm hurting for data in the first place.  March 4 will give me some more to work with.


by ejintx on Fri Feb 22, 2008 at 04:03:31 PM EST
[ Parent ]

Good analysis (none / 0)

On a general level, I think it's good to have some mix of open and closed primaries, and perhaps even caucuses, though they have larger problems. Though your analysis didn't come to a hard conclusion, I think each form has the ability to test something different:

Closed primaries seem to measure support within the party.

Open primaries offer the chance to test appeal beyond the party, and get independents to commit to our candidate early. (Having voted for someone gives you a real reason to want to see them win.)

Caucuses are problems, but if you believe that the ability to organize on the ground is important, caucuses may be the best test of that.

by PhilFR on Fri Feb 22, 2008 at 04:07:16 PM EST

Re: Good analysis (none / 0)

My problem with caucuses in this data is the threshold of viability.  I'd also feel more comfortable if they provided voter turnout numbers as well, but I recognize that's not going to happen.

I agree with, closed tend to reflect party while open are general population.  If that's the case, Clinton supporters have a little reason to be happy with this data: Clinton seems to do better with the population at large.


by ejintx on Fri Feb 22, 2008 at 04:11:36 PM EST
[ Parent ]

Omitted variable bias (none / 0)

You only have one explanatory variable in your analysis.  Surely there are other variables that determine candidate choice.  By omitting them from your analysis, you could easily be biasing the coefficient on primary openness either up or down.


by dbrown04 on Fri Feb 22, 2008 at 04:09:13 PM EST

Re: Omitted variable bias (none / 0)

Absolutely; I recognize that.  But, since these aren't perfect conditions, I recognized that later on.  I let primaries that aren't necessarily completely open slide as open but acknowledged that in my data.  Take it for what it's worth; I'm only presenting what I can see at a glance.


by ejintx on Fri Feb 22, 2008 at 04:15:32 PM EST
[ Parent ]

Texas: perfect conditions (none / 0)

Its going to take multivariate regression analysis to get at the difference between open and closed primaries.

However, on March 4 we have a perfect natural experiment to study the difference between closed primaries and caucuses.  Texas will hold a primary in the day and a caucus at night.

Its going  to be extremely interesting to contrast the outcome of these two events in terms of candidate choice.  We'll also be able to compare the demographic characteristics of primary voters relative to caucus participants.

In light of the fact that the back-to-back delegate selection events control for candidates, issues and day, the simple difference between the sample averages can reasonably be attributed to the voting mechanism.


by dbrown04 on Fri Feb 22, 2008 at 05:23:35 PM EST
[ Parent ]

Re: Texas: perfect conditions (none / 0)

I just wonder how that would work out, because what is the likelihood of someone participating in both the primary and the caucus?  I plan to, but I don't know how common is it.


by ejintx on Fri Feb 22, 2008 at 05:30:12 PM EST
[ Parent ]

Re: Texas: perfect conditions (none / 0)

In order to participate in the caucus you have to have voted in the primary.  So the two systems are not exactly sampling from the same electorate.  But given the turnout for primaries is 17 times the turnout for caucuses, I don't think that the limits on caucus participation will bias the result much.  Its seems unlikely to me that there are very many people who would choose to participate in the caucus but won't vote in the primary.


by dbrown04 on Fri Feb 22, 2008 at 06:17:19 PM EST
[ Parent ]

Re: Texas: perfect conditions (none / 0)

So our problem is trying to capture states with extremely similar demographics, voting with about the same turnout at the same time with the only difference being their chosen methods of candidate selection.  I'm leaning toward Arkansas verses Oklahoma, but I'm going to do some more research.


by ejintx on Fri Feb 22, 2008 at 05:39:03 PM EST
[ Parent ]

Re: Omitted variable bias (none / 0)

I'll also admit that the data could be skewed by Obama's "momentum" in later states; I'll investigate if that's real tomorrow though.


by ejintx on Fri Feb 22, 2008 at 04:17:54 PM EST
[ Parent ]

Re: Omitted variable bias (none / 0)

dbrown, what do you think of this?  If I went back to individual states and their exit polls and determined if the state naturally leaned toward one candidate based on previous information and worked that in to try and get rid of the omitted variable?


by ejintx on Fri Feb 22, 2008 at 04:36:04 PM EST
[ Parent ]

Re: Omitted variable bias (none / 0)

Well it depends on what question you want to ask.  You want to control for anything that might be determining candidate selction other than the type of primary.  I would start with variables like per capita income, union density, etc.  Once you have settled on the variables you think ought to determine the outcome, then add a binary variable with primary type.  You may want to construct some kind of momentum variable.  But you may also want to construct a panel.  Collect data on a couple of years of presidential primaries.

Its a great problem.  Have fun!


by dbrown04 on Fri Feb 22, 2008 at 05:29:25 PM EST
[ Parent ]

Re: Open vs. Closed Primaries: It Makes No Differe (none / 0)

I would say that if you are choosing the DEMOCRATIC nominee, then DEMOCRATS should make the choice (which is the argument for superdelegates - people who actually work in and for the party all the time should have more of a say as to who the nominee as opposed to just showing up every 4 years to make a choice and they can act as a buffer against a fringe outsider from getting the nomination).  Independents and Republicans are free to change their affiliation to become Democrats to vote in the primary if they feel so passionately about a candidate, but they should have to change affiliation before election day.

This also does not account for many of the Republicans who showed up (and who are being encouraged to show up in future primaries) to not necessarily vote FOR Obama, but rather to vote AGAINST Clinton to make sure she doesn't get the nomination.


by cmugirl90 on Fri Feb 22, 2008 at 04:21:13 PM EST

Re: Open vs. Closed Primaries: It Makes No Differe (none / 0)

CMUGirl, the problem is that his data leads to the opposite conclusion, that is that Obama does better in closed primaries.


by Socraticsilence on Fri Feb 22, 2008 at 04:24:08 PM EST
[ Parent ]

Re: Open vs. Closed Primaries: It Makes No Differe (none / 0)

So now, it's not the open primaries, it's Republicans and Independents changing over to the democratic party specifically to vote against Hillary.  And what percentage of Democrats would you guess are Republican and Independent double agents?


by shalca on Fri Feb 22, 2008 at 04:30:29 PM EST
[ Parent ]

Re: Open vs. Closed Primaries: It Makes No Differe (none / 0)

I guess I don't understand the math (never did well in statistics), especially as across the board, she is way ahead in the number of Democrats that voted for her, as opposed to indies and R's.


by cmugirl90 on Fri Feb 22, 2008 at 04:25:55 PM EST

Re: Open vs. Closed Primaries: It Makes No Differe (none / 0)

That's very likely so, and I hope she is.  If you look at percentages though, it's a different story.


by ejintx on Fri Feb 22, 2008 at 04:29:01 PM EST
[ Parent ]

Re: Open vs. Closed Primaries: It Makes No Differe (none / 0)

I'd guess that a lot of first time voters (which there appear to be in this election) aren't affiliated with either party, unless they're required to register as such.  


No way. No how. No McCain.
by freedom78 on Fri Feb 22, 2008 at 04:48:08 PM EST
[ Parent ]

no matter how you look at it (none / 0)

Ind and Rep's are choosing the dem nominee.

In most cases, they don't even pledge to be in the party afterwards.  For instance, they can vote in this dem primary, and then next year vote in the rep. primary again.

If you are going to allow new voters, they should have to stay in that primary for 4 years. That would stop these people from playing games.

Also, why would you want a person who went from
Clinton -clinton - bush -bush - Obama voting in the dem primary.

They are ind. (confused) swing voters.

Why should they pick our nominee. If a scandal or something else comes out against our nominee, they will switch to the republicans.

People who pick the dem nominee should be dare I say,

yellow dog dems.


by yellowdem1129 on Fri Feb 22, 2008 at 04:41:19 PM EST

Cal and FL (none / 0)

Interesting.  I would make 2 observations whatever they are worth:

1.  Florida was a closed primary and although it doesn't count technically, it could be indicative of HRC's strengths among Dems (Obama did run TV ads here)

2.  In Calif. Decline to States did not have the option to vote Republican.


by inFlorida on Fri Feb 22, 2008 at 06:44:22 PM EST


You are not logged in.

In order to post a comment, you must be logged in. If you have a member account, please log in to comment.

If not, you can make an account right here. It's quick and free.