Profile

Cover photo
Aaron Levy
Works at Elite SEM
Attended Villanova University
Lives in Philadelphia, PA.
596 followers|26,657 views
AboutPostsPhotosVideos

Stream

Aaron Levy

Shared publicly  - 
 
aaron@castirondigital.com
Aaron Levy originally shared:
 
This Hangout On Air is hosted by Aaron Levy. The live video broadcast will begin soon.
Q&A
Preview
Live
test hangout
Mon, June 22, 8:45 PM
Hangouts On Air - Broadcast for free

1
Add a comment...

Aaron Levy

Shared publicly  - 
 
Really like this idea! 
 
Simulating different split test methodologies:

Suppose you are trying to maximise the number of clicks. You start off with two versions and evenly split impressions between them until each has 1000 impressions.

Next you perform some kind of maths to determine what to do next. Depending on what the maths tells you, you either continue to run the test or you pause one variation and introduce another one. Then you wait 1000 impressions and repeat...

After 10,000 impressions how many clicks will you have? 

Obviously, the answer depends a bit on what maths you do. The chart below shows the result of simulating 100 runs of the above game with six different strategies:

1: If 99% confident then pause the worst ad and add a new one
2. Same as 1. but with 95% confidence
3. 90% confidence
4. 80% confidence
5. Just pick the advert that is performing the best when you look (best observed CTR)
6. Cheat (because this is a simulation we know which version is actually better - so pick that one)

The results of the simulation show that, as long as you can keep up by producing enough new variations, waiting for statistical significance does not improve outcomes.

This result is very surprising to me. I'm sure it is at least partly because my simulation is overly simplistic; if you can precisely define what aspects of real life I'm missing here then I will have a go at coding it up.

Want more stuff like this? I'm starting a mailing list/newsletter http://www.eanalytica.com/subscribe/
1
Add a comment...

Aaron Levy

Shared publicly  - 
 
We're bringing SEER Q & A back to life tomorrow. From noon to 1 EST, SEER's team of brilliant search marketers will answer your every question on our G+ page
1
Add a comment...

Aaron Levy

Shared publicly  - 
 
Great guide from +Russell Savage to help you learn the bare bones basics of scripting. 
I've heard from a few readers that the posts on this blog have inspired them to learn to code. That's awesome! But I've also heard from a few that say they have run into trouble getting through many of the Javascript tutorial...
1
Add a comment...

Aaron Levy

Shared publicly  - 
 
+Katy Pitkin shares some pretty nifty tricks for finding social advertising audiences.
1
Add a comment...
Have him in circles
596 people
Mary Ann Geier's profile photo
Oliver Ewbank's profile photo
accord ad value's profile photo
Matt Haskell's profile photo
David Falise's profile photo
Rob Hoyt's profile photo
Jay Donahue's profile photo
Larry Waddell's profile photo
Adam Nason's profile photo

Aaron Levy

Shared publicly  - 
 
Does anyone know of a senior level digital marketer who's looking for an amazing role in DC? Trying to help a friend at a major research foundation hire someone in house. Looking for roughly 10 years cross channel experience.

Hit me up!
2
Add a comment...

Aaron Levy

Shared publicly  - 
 
Great wealth of tips from smart folks across the industry. Really consistent focus on landing pages and CRO, as well as following the leads AFTER they become leads. 
1
Add a comment...

Aaron Levy

Shared publicly  - 
 
Does anyone have insight on the ROE (return on effort) for getting a Google Trusted Stores badge? Thinking specifically for PLA's. Would love if anyone has a before-after and if the juice is worth the squeeze. 
1
Add a comment...

Aaron Levy

Shared publicly  - 
 
Let's break PPC out of the box and use our mountains and mountains of data for other fun stuff. Phase 1: stalk your audience!
1
Add a comment...

Aaron Levy

Shared publicly  - 
 
Good ROI from PPC, kinda table stakes no? What ELSE do you get from that data??

My audience was a lil too small at eMetrics to truly evangelize, but I'll keep fighting the good fight. Take your PPC team out of the black box. Ask them questions. Have them test things. Buy them beers. Lots and lots of beers. 
small tests BIG INSIGHTS aaron levy director of ppc
1
Add a comment...

Aaron Levy

Shared publicly  - 
 
Interesting - dunno if I love AdWords-only modeling (seems like it only looks at one piece of the pie) but interesting none the less.
 
Today, we’re excited to announce the Search Funnels Attribution Modeling Tool. This tool helps you identify keywords, ad groups or campaigns which play a critical role in driving conversions, but may be undervalued using a last-click attribution model.

Consumers now interact with many different ads before converting.  Most advertisers, however, still measure the success of their online advertising on a last-click basis: giving all credit to the single ad that was clicked right before the conversion. 

We've been working to help advertisers better understand this path to purchase, with products like Search Funnels and Attribution Modeling in GA. 

Use this tool to examine five different attribution models in AdWords to better understand how different bids for undervalued keywords can help you reach customers earlier in the purchase journey, driving even more conversions. 

Learn more from this article in our Help Center: http://goo.gl/3Vba7L 

We’re working hard on attribution-related features to help you better measure the value of your AdWords advertising. Stay tuned!

#adwords
2
Brian Swanick's profile photoAaron Levy's profile photoSteven Jones's profile photo
4 comments
 
You make a good point +Brian Swanick, if they just included assisted impressions in Analytics with other traffic sources that we be a better attribution report. And as you say +Aaron Levy channel attribution doesn't make a lot of sense if you're only looking at Adwords campaigns. I think it is a step in the right direction though as assisted impressions were available before but were buried as extra columns you had to add in the main adwords report screen. If anything it will make more advertisers aware of assisted impressions and generate more requests to Google to integrate this into the Analytics multi-channel funnels attribution modeling.
Add a comment...

Aaron Levy

Shared publicly  - 
 
ICYMI, here's a link to my presentation from SES San Francisco from Wednesday. Explores psychological drivers in social and how you can use them to target better and write more poignant ads. 

A link to notes is included in the preso so you can see what the hell I was talking about! 
San Francisco • September 10–13, 2013 • #SESSF @SESConf improving lives via social ads spot liars, prod pain points, touch aspirations aaron levy seer int
1
1
Andrew Lolk's profile photo
Add a comment...
People
Have him in circles
596 people
Mary Ann Geier's profile photo
Oliver Ewbank's profile photo
accord ad value's profile photo
Matt Haskell's profile photo
David Falise's profile photo
Rob Hoyt's profile photo
Jay Donahue's profile photo
Larry Waddell's profile photo
Adam Nason's profile photo
Work
Occupation
PPC King
Skills
PPC, SEM, Display Media, Video Advertising, Social Advertising, Agency branding & management
Employment
  • Elite SEM
    Account Executive, 2014 - present
  • SEER Interactive
    SEM Consultant, 2010 - 2014
  • True Action
    Interactive Marketing Specialist, 2008 - 2010
Places
Map of the places this user has livedMap of the places this user has livedMap of the places this user has lived
Currently
Philadelphia, PA.
Previously
Ithaca, NY.
Links
Contributor to
Story
Introduction
PPC/SEM consultant at my company, Cast Iron Digital. I'll help businesses small and large from those who are just dipping their toe in the digital water to someone who needs a full scale opportunity analysis. 

I like playing outside in the cold. And sometimes the warm too. 

Definitely more active on the twitterz, but will check here from time to time! 
Bragging rights
Arm wrestled a bear once. Didn't win, but I did it.
Education
  • Villanova University
    Marketing & IS, 2004 - 2008
Basic Information
Gender
Male
Apps with Google+ Sign-in
  • The Tower
  • Cut the Rope 2
  • Crossy Road