Need a hand with some statistics math. Can a lovely stats nerd please help?

[KmartSqrl]

I'm working on a website optimization system (as in conversion rate to signups/goals, not website speed) and I want to be able to know when the data I am collecting is statistically significant and how significant it is (95%, 99%, etc). The problem is that I know almost nothing about statistics, so I have no idea where to even start calculating this.

Here is a breakdown of the data I have and how it's being used:

We have a number of different optimization tests running. As an example, we'll use the headline on the home page.
An optimization test has any number of different test options, so to continue the example, the headline on the home page can either be "Headline 1", "Headline 2", or "Headline 3"
When a user first visits the site we pick one of the test options for them and make sure they only see that the rest of the time they are on the site (via cookies). This also increments a number that tracks how many times the given option has been selected (the selection count).
There is also a goal tied to each optimization test that is taking place. We'll use signup as an example.
When a user successfully completes a goal, we see which test option was assigned to them and increment a number that tracks the total conversions for that option (the conversion count).
We use the conversion count divided by the selection count to determine the conversion rate for a given test option, and then compare the conversion rates to determine which option is the best option for a given test/goal pair. [B]This is the part that I want to determine the statistical significance of.[/B] Is this possible with the data I have? If so, how? If not, what other data do I need?

Thanks a bunch if you can help!

[asciid]

[url]http://visualwebsiteoptimizer.com/ab-split-significance-calculator/[/url]

[KmartSqrl]

[QUOTE=asciid;41950155][url]http://visualwebsiteoptimizer.com/ab-split-significance-calculator/[/url][/QUOTE]

That doesn't exactly work for what I'm doing because that's assuming only two options and we can have any number of them. I also want to be able to actually implement this on the page where test results are displayed, so just putting some numbers in a calculator on a different site won't work.

Thanks though!

[editline]24th August 2013[/editline]

Did a little more digging and found a library that looks like it'll work for what I need to do :)

[url]https://github.com/livingsocial/abanalyzer[/url]