Television Advertising and Online Search - MISRC | Homemisrc.umn.edu/Papers/Research Papers/YiZhu...

18
MANAGEMENT SCIENCE Articles in Advance, pp. 1–18 ISSN 0025-1909 (print) ISSN 1526-5501 (online) http://dx.doi.org/10.1287/mnsc.2013.1741 © 2013 INFORMS Television Advertising and Online Search Mingyu Joo Fisher College of Business, The Ohio State University, Columbus, Ohio 43210, [email protected] Kenneth C. Wilbur Rady School of Management, University of California, San Diego, La Jolla, California 92093, [email protected] Bo Cowgill Haas School of Business, University of California, Berkeley, Berkeley, California 94720, [email protected] Yi Zhu Carlson School of Management, University of Minnesota, Minneapolis, Minnesota 55455, [email protected] D espite a 20-year trend toward integrated marketing communications, advertisers seldom coordinate tele- vision and search advertising campaigns. We find that television advertising for financial services brands increases both the number of related Google searches and searchers’ tendency to use branded keywords in place of generic keywords. The elasticity of a brand’s total searches with respect to its TV advertising is 0.17, an effect that peaks in the morning. These results suggest that practitioners should account for cross-media effects when planning, executing, and evaluating both television and search advertising campaigns. Key words : advertising; information search; media; search engine marketing; television History : Received February 17, 2012; accepted February 23, 2013, by Pradeep Chintagunta, marketing. Published online in Articles in Advance. 1. Introduction It is difficult to overstate the importance of television. The average American household contains 2.6 peo- ple and 2.5 televisions (Nielsen 2011, U.S. Census Bureau 2011). Television remains the most trusted source of news and information by a wide margin (Danaher and Rossiter 2011, eMarketer 2012). The average American watches 5.1 hours of television per day, more than the 4.6 self-reported daily hours spent on all work-related, educational, and house- work activities (Nielsen 2011, Bureau of Labor Statis- tics 2011). The typical consumer is exposed to about 29 minutes of paid television advertising per day. 1 Also remarkable is the growth of online search. Americans used core search engines like Google and Bing 17.7 billion times in July 2012, or about 1.8 times per person per day (comScore 2012). In other words, the average consumer now practices, about twice per day, an activity that barely existed 15 years ago. Per- haps the best evidence that search converts prospects to customers is provided by changes in advertis- ing budgets. Marketers spent $14.8 billion on search advertising in 2011, a substantial amount relative to the $69.6 billion spent on television advertising in the 1 This inference assumes 11.3 minutes of advertising per hour, as is typical in prime time, and an advertising avoidance rate of 50%. United States (Internet Advertising Bureau 2012, Tele- vision Bureau of Advertising 2012). Two decades of research and practice on integrated marketing communications have shown that deliver- ing a consistent message through multiple consumer touch points is more effective than managing dis- parate, medium-specific campaigns. One might expect that advertisers would coordinate their television advertising and search advertising campaigns. After all, synchronizing “push” and “pull” tactics is an old topic in marketing. Despite these apparent incentives, a review of Advertising Age’s top traditional and online adver- tising agencies (AdAge 2011) showed that coordina- tion of advertising campaigns across television and search media remains unusual. Client-facing agency websites were examined to determine each agency’s services and areas of expertise. Table 1 presents some surprising results from this survey. Twenty-four of the top 25 online advertising agencies do not offer television advertising services in-house. Twenty-four of the top 25 traditional adver- tising agencies do not offer search advertising services in-house. Only three of these 50 agencies coordinate online/offline advertising campaigns, and they define coordination as media budget planning or show- ing Web addresses in TV ads. The scarcity of coor- dinated television/search campaigns is further con- 1 Copyright: INFORMS holds copyright to this Articles in Advance version, which is made available to subscribers. The file may not be posted on any other website, including the author’s site. Please send any questions regarding this policy to [email protected]. Published online ahead of print May 23, 2013

Transcript of Television Advertising and Online Search - MISRC | Homemisrc.umn.edu/Papers/Research Papers/YiZhu...

MANAGEMENT SCIENCEArticles in Advance, pp. 1–18ISSN 0025-1909 (print) � ISSN 1526-5501 (online) http://dx.doi.org/10.1287/mnsc.2013.1741

© 2013 INFORMS

Television Advertising and Online Search

Mingyu JooFisher College of Business, The Ohio State University, Columbus, Ohio 43210, [email protected]

Kenneth C. WilburRady School of Management, University of California, San Diego, La Jolla, California 92093, [email protected]

Bo CowgillHaas School of Business, University of California, Berkeley, Berkeley, California 94720,

[email protected]

Yi ZhuCarlson School of Management, University of Minnesota, Minneapolis, Minnesota 55455, [email protected]

Despite a 20-year trend toward integrated marketing communications, advertisers seldom coordinate tele-vision and search advertising campaigns. We find that television advertising for financial services brands

increases both the number of related Google searches and searchers’ tendency to use branded keywords in placeof generic keywords. The elasticity of a brand’s total searches with respect to its TV advertising is 0.17, an effectthat peaks in the morning. These results suggest that practitioners should account for cross-media effects whenplanning, executing, and evaluating both television and search advertising campaigns.

Key words : advertising; information search; media; search engine marketing; televisionHistory : Received February 17, 2012; accepted February 23, 2013, by Pradeep Chintagunta, marketing.

Published online in Articles in Advance.

1. IntroductionIt is difficult to overstate the importance of television.The average American household contains 2.6 peo-ple and 2.5 televisions (Nielsen 2011, U.S. CensusBureau 2011). Television remains the most trustedsource of news and information by a wide margin(Danaher and Rossiter 2011, eMarketer 2012). Theaverage American watches 5.1 hours of televisionper day, more than the 4.6 self-reported daily hoursspent on all work-related, educational, and house-work activities (Nielsen 2011, Bureau of Labor Statis-tics 2011). The typical consumer is exposed to about29 minutes of paid television advertising per day.1

Also remarkable is the growth of online search.Americans used core search engines like Google andBing 17.7 billion times in July 2012, or about 1.8 timesper person per day (comScore 2012). In other words,the average consumer now practices, about twice perday, an activity that barely existed 15 years ago. Per-haps the best evidence that search converts prospectsto customers is provided by changes in advertis-ing budgets. Marketers spent $14.8 billion on searchadvertising in 2011, a substantial amount relative tothe $69.6 billion spent on television advertising in the

1 This inference assumes 11.3 minutes of advertising per hour, as istypical in prime time, and an advertising avoidance rate of 50%.

United States (Internet Advertising Bureau 2012, Tele-vision Bureau of Advertising 2012).

Two decades of research and practice on integratedmarketing communications have shown that deliver-ing a consistent message through multiple consumertouch points is more effective than managing dis-parate, medium-specific campaigns. One might expectthat advertisers would coordinate their televisionadvertising and search advertising campaigns. Afterall, synchronizing “push” and “pull” tactics is an oldtopic in marketing.

Despite these apparent incentives, a review ofAdvertising Age’s top traditional and online adver-tising agencies (AdAge 2011) showed that coordina-tion of advertising campaigns across television andsearch media remains unusual. Client-facing agencywebsites were examined to determine each agency’sservices and areas of expertise. Table 1 presents somesurprising results from this survey.

Twenty-four of the top 25 online advertisingagencies do not offer television advertising servicesin-house. Twenty-four of the top 25 traditional adver-tising agencies do not offer search advertising servicesin-house. Only three of these 50 agencies coordinateonline/offline advertising campaigns, and they definecoordination as media budget planning or show-ing Web addresses in TV ads. The scarcity of coor-dinated television/search campaigns is further con-

1

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.

Published online ahead of print May 23, 2013

Joo et al.: Television Advertising and Online Search2 Management Science, Articles in Advance, pp. 1–18, © 2013 INFORMS

Table 1 Top Advertising Agencies’ Service Offerings

No. of top 25 No. of top 25search traditional

advertising advertisingagencies agencies

In-house services for bothTV/search advertising

No 24 24Yes 1 (PlattForm) 1 (Ogilvy & Mather)

Online/offline coordinationNo coordination 23 24Provide Web address in offline 1 (iProspect) 0

creativeProvide media budget planning 1 (Covario) 0

across mediaCoordination offered but no 0 1 (Leo Burnett)

details providedOnline/offline integrated

performance metricsNone offered 21 21Media budget allocation only 2 (Acronym, 2 (Doner, Martin)

Rosetta)ROI across all media 1 (Covario) 2 (Campbell Ewald,

Leo Burnett)Metrics for effects of TV to 1 (iProspect) 0

online

firmed by the topic’s absence in leading advertisingtextbooks and academic literature and by personalconversations with dozens of researchers and man-agers at Amazon, Google, Yahoo! and other firms. AsEnge (2012) explained, “there is a big gap betweentraditional marketing thinking and the way searchmarketers typically think. For [the search marketing]industry to reach full maturity, that gap needs toclose, and there needs to be movement on both sides.”

The purpose of this paper is to investigate whetherand how television advertising expenditures influ-ence online search behavior. The empirical analysiscombines two comprehensive databases of televisionadvertising and consumer search in the financial ser-vices product category. The Internet search data areprovided by Google and include well over one billionsearches for financial services keywords. The advertis-ing data record the exact times and estimated expen-diture on 58,226 television advertisements aired by15 financial services brands at a total cost of about$200 million. The effects of television advertisingon online search are identified by changes in thehourly time series of search behavior correspondingto brands’ placements of television advertisements.The effects of primary interest are highly robust andcan be reproduced through several different estima-tion techniques.

Although the academic literature has not exploredthe effects of television advertising on online search,a few practitioner studies have considered it.iProspect (2007) surveyed consumers and found that

37% of Internet users reported that a television ad hadprompted them to conduct an Internet search. How-ever, work of this kind is typically based on searchers’self-reports, includes limited controls for competingexplanations and often focuses on a single brand.The one extant study based on passively measuredsearch data is that by Zigmond and Stipp (2010). Theypresented several case studies that showed peaksin Google searches corresponding to several TV adsthat aired during the Vancouver Winter Olympics.We extend this research by examining a mature prod-uct category over a three-month period, estimatingboth short- and longer-run effects of advertising, andby separately considering how TV advertising mayaffect both the volume of category search and theprobability of choosing a branded keyword.

The analysis indicates that TV advertising increasesthe number of product category-relevant searches andincreases consumers’ tendency to use branded key-words. The elasticity of a financial services brand’sonline searches with respect to its advertising is 0.17,an effect that is largest in the morning and smallest inthe late afternoon. These findings suggest that brandsmight profit from coordinating their television andsearch advertising campaigns.

1.1. Relationship to Prior LiteratureA burgeoning literature is finding that advertising inone medium may influence the results of advertisingin another medium (Assael 2011). Naik and Raman(2003) and Vakratsas and Ma (2005) gave evidence ofadvertising synergies among multiple offline media,and Naik and Peters (2009) found synergies betweenspending in online and offline media. Lewis andReiley (2011) found via a large-scale controlled exper-iment that 93% of the effects of online display adver-tising were found in offline retailer sales. Goldfarb andTucker (2011) found a substitution pattern betweenonline advertising and offline advertising: advertiserspay more for online search keywords when offlineadvertising is prohibited. Lewis and Nguyen (2012)and Papadimitriou et al. (2011) ran field experi-ments and found that display advertising increasedsearches for both the advertised brand and its com-petitors. Rutz and Bucklin (2012) found a similareffect: users exposed to a display advertisement on aproduct search engine were subsequently more likelyto browse pages related to the advertised brand. Thecurrent paper buttresses the existing media syner-gies literature by showing specifically how advertis-ing in one medium can change consumer behavior inanother.

A small number of recent papers have predictedways in which cross-media advertising effects mightinfluence market competition. Kim and Balachander(2010) showed how an advertiser’s cost per con-sumer in traditional media influences its optimal bid

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.

Joo et al.: Television Advertising and Online SearchManagement Science, Articles in Advance, pp. 1–18, © 2013 INFORMS 3

on search results. They found that advertisers haveincentive to coordinate search advertising with tra-ditional advertising, even when doing so is costly.Bergemann and Bonatti (2011) investigated the roleof targeting in the competition between offline andonline media. They predicted that the entry of highlytargeted media (online) will increase the price of lesstargeted media (offline) and reduce their revenues.The possibility that advertisers may free ride on com-petitors’ offline advertising was explored by Sayediet al. (2011). They showed that symmetric firms maydevelop asymmetric strategies, with one firm invest-ing in offline advertising to build category demandwhile the other firm uses targeted search advertisingto free ride on competitors’ investments. Our findingshelp to explain how online and offline media interactwith each other to generate such effects in a market.

These effects are particularly relevant to the liter-ature on search engine marketing (Jerath and Sayedi2011, Jerath et al. 2011, Katona and Sarvary 2010, Rutzand Bucklin 2011, Rutz and Trusov 2011, Wilbur andZhu 2009, Yang and Ghose 2010, Yao and Mela 2011,Zhu and Wilbur 2010). As competition in the searchengine setting becomes better understood, a naturalway to extend this literature is to consider how searchmarketers may use traditional “push” media such astelevision to compete before consumers even arrive atthe search engine.

2. Data and MeasuresThis section explains why we chose to study thefinancial services category, introduces the measuresand data, and describes how their characteristicsinfluence the modeling choices presented below.

2.1. Research Context: Product Category ChoiceA product category suitable for determining howoffline advertising influences online search shouldexhibit four characteristics. The first criterion relatesto whether effects of advertising on search exist,whereas the other three relate to an analyst’s abilityto detect those effects in market data.

1. Consumers must search category brand names online.High-involvement categories may be most appropri-ate since consumers are likely to actively gather infor-mation related to brands and products within thosecategories. Categories with infrequent choices or highprices might be most appropriate, since consumerscannot gather information easily through producttrial.

2. Category brands’ offline advertising must be mea-sured with high frequency. Television advertising expen-ditures may be observed by day and precise time,as are online search data. Advertising expendituredata for other offline media such as radio, magazines,and billboards are typically only observed to vary

monthly. Variation in advertising expenditure overtime is critical to identify the effect of advertising onsearch behavior.

3. Category brand names should not overlap too muchwith commonly searched keywords. Otherwise, categorysearches cannot be separated from unrelated searches.For example, it would not be clear whether a searchfor “Apple” is for a fruit or a computer. Many well-known brands—like Miller, Target, and Visa—presentthis problem.

4. The category should not be subject to obvious simul-taneity concerns. For example, advertising and con-sumer search for a movie both peak around the datethe movie is released in theaters. It would be diffi-cult to tease apart the effect of advertising from theeffect of the movie release date or other contempo-raneous promotions without good instrumental vari-ables. Ideally, the researcher should be able to getdata on exogenous time-varying factors that may shiftsearchers’ tendency to search for brands in the cat-egory to separately identify the effect of televisionadvertising from other factors that vary over time.

The financial services product category scores wellon all four criteria. It is a high-involvement cate-gory with infrequent choice, as consumers tend tostay with investment brokerages for long periods oftime. It is the seventhmost advertised product cat-egory on television. Most major financial servicesbrand names, such as Schwab and Ameritrade, gen-erally do not overlap with commonly searched key-words, as shown in Table 2. The data do not suggestsimultaneity, as §4 below explores in depth.2

2.2. Dependent Variables: ConsumerSearch Behavior

Marketing academics have studied consumer searchextensively since the 1970s. The literature impliesthree primary reasons that television advertising islikely to influence online search: objective knowledge,perceived knowledge, and incidental exposure.

First, television advertising may increase con-sumers’ objective knowledge of product or categoryfeatures and benefits, and this may influence con-sumer search. For example, Brucks (1985) found thatsome objective knowledge increases consumers’ abil-ity to acquire additional knowledge and makes searchmore efficient. Several studies have related theseeffects directly to objective knowledge provided by

2 Several other product categories were considered. The automotivecategory scores well on all criteria except the third. The pharmaceu-tical category scores well on all criteria except the first, since mostconsumers (but certainly not all) get information about most drugsfrom their doctors rather than from search engines. For example,the keyword “fidelity” is searched about 60 times as frequently asthe keyword “Vioxx.” Movies and video games score well on allcriteria except the fourth.

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.

Joo et al.: Television Advertising and Online Search4 Management Science, Articles in Advance, pp. 1–18, © 2013 INFORMS

Table 2 Most Common Financial Services-Related Keywords

Most common generic keywords Most common branded keywords

SEP INVESTORS AGEDWARDS ML401 K IRA AMERITRADE MORGANSTANLEYANNUITY LIABILITY AMERIVEST NETBENEFITSBALANCE LIQUIDITY CITI NUVEENBENEFITS LOAN CITIBANK OPPENHEIMERBONDS LOANS CITIFINANCIAL OPPENHEIMERFUNDSBROKER MUTUAL CITIGROUP OPTIONSXPRESSBROKERS OPTIONS CITIMORTGAGE RAYMONDJAMESCHECKING PAY CLEARSTATION SCHWABCONTRIBUTION PAYMENT CYBERTRADER SCOTTRADECREDIT PREPAID EBTACCOUNT SHAREBUILDERDEBIT PROFIT EDWARDJONES SOUTHTRUSTDIVIDEND RETIREMENT ETRADE TDDIVIDENDS SECURED EWORKPLACE TDWATERHOUSEEBT SECURITIES FIDELITY TROWEEQUITY SHARES FIDELITYINVESTMENTS VANGUARDETF SHARING FOREX VANKAMPENFIXED STATEMENT FXCM WACHOVIAFUND STOCK LEGGMASON WATERHOUSEFUNDS STOCKSINCOME TRADEINVEST TRADINGINVESTING TRUSTSINVESTMENT UGMAINVESTMENTS YIELD

advertising. Newman and Staelin (1973) showed thatadvertising may enlarge the set of brands a consumercan recall easily. Bettman and Park (1980) found thatconsumers with moderate amounts of prior productinformation are more likely to search for a brand thanthose with little prior information. Therefore, televi-sion advertising might stimulate online search if itincreases consumers’ stock of objective knowledge.

Second, advertising may alter how much a con-sumer thinks she knows (“perceived knowledge”),which may influence how the consumer searches.Numerous studies have shown perceived knowledgeto differ from objective knowledge with correlationsranging from 0.05 (Radecki and Jaccard 1995) to 0.65(Park et al. 1994). Moorman et al. (2004) experi-mentally manipulated perceived knowledge by firsttesting subjects’ knowledge in a particular domain,then randomly giving artificially low test results tosome knowledgeable subjects and artificially high testresults to some unknowledgeable subjects. Inflatedtest scores (high perceived knowledge) led to searchstrategies that were less likely to uncover discon-firming information. Therefore, if branded televisionadvertising increases consumers’ perceived knowl-edge, it may increase the chance the consumer entersbranded keywords into a search engine.

Third, incidental exposure to advertising has beenfound to influence consumers outside their consciousawareness. Incidental exposure refers to advertisingthat is perceived but not processed. It commonlyoccurs when consumers redirect their attention dur-ing television commercial breaks. Janiszewski (1993)

found that incidental exposure enhances brand lik-ing. Shapiro et al. (1997) found that incidental expo-sure to advertising influenced the products thatenter consumers’ consideration sets, even when theconsumers are not consciously aware that they sawthe ads. Shapiro (1999) took this a step further, show-ing that incidental ad exposure led to considerationset inclusion, even when subjects were explicitlyinstructed to avoid choosing products depicted in ads.Therefore it is possible that incidental exposure totelevision advertising changes the keywords a con-sumer would use to search.

This literature indicates that information can affectboth the likelihood of search and the means of search.We therefore distinguish between category search andkeyword choice. Category search is defined as the num-ber of searches in a period that contained genericor branded financial services-related keywords. Key-word choice is defined as the fraction of all key-words entered that are related to a particular brandin the category. In earlier research, a data miningtechnique was developed to identify a set of genericand branded keywords and determine which searcheswere relevant to the financial services product cate-gory; for full details, see Joo et al. (2013). This proce-dure identified several previously unknown brandedkeywords and a large set of generic keywords thatwere frequently used in searches that led to clicks onfinancial services brands’ websites. Table 2 providesthe common branded and generic keywords in thedata set.

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.

Joo et al.: Television Advertising and Online SearchManagement Science, Articles in Advance, pp. 1–18, © 2013 INFORMS 5

This distinction between category search andkeyword choice has important implications forconsumers as well as marketers. People who searcha branded keyword receive less information aboutcompetitors than those who search generic keywords.Paid advertising clicks also tend to cost less whenconsumers search branded keywords, because thesekeywords’ auctions typically enroll fewer biddersthan generic keyword auctions. It also may be the casethat a consumer who searches a branded keyword hasrevealed a greater willingness to purchase than onewho has used a generic keyword.

2.3. Data SourcesThe analysis combines a large online search data setwith a comprehensive television advertising database.The online data count all searches containing prod-uct category-relevant keywords received by Googlefrom U.S. users in the eastern time zone betweenOctober 1 and December 31, 2011.3 The search countswere aggregated hourly at the state level; informationabout individual users, their characteristics, or searchhistory was not included. Company disclosure poli-cies prevent us from revealing the specific number ofsearches for this set of keywords, but we are able toreport that it was substantially more than one billion.

Television advertising expenditure data were gath-ered from Kantar Media’s “Stradegy” database.Kantar computers monitor all paid advertisements innational broadcast and cable networks and all localbroadcast stations in the United States. Each uniquenew advertising creative is flagged and watched bya Kantar employee, who then records the advertisedbrand, product, and product category. Kantar supple-ments the ad occurrence data with program-specificaverage advertising prices reported by the networks.4

For each ad in the sample period, the data reportthe brand advertised (e.g., Fidelity), the network, starttime, duration, and the estimated cost.

These two time series are linked at the hour level.The choice of the hour as the unit of analysis bal-ances the competing concerns of data sparseness andpossible aggregation biases. It also requires fewer lagsto be estimated than if the data were combined at amore disaggregate level (e.g., minute or second). Thesample period includes 2,208 hours in 92 days. Thereare 22 brands in the data, so the sample size in thekeyword choice analysis is 48,576.

3 Only searches in the eastern time zone were considered to matchthe data on TV ads’ times of airing.4 Advertising ratings and demographics would be preferable toexpenditures, but these additional data were cost prohibitive.In their absence, it is necessary to presume that ad prices corre-late with program audiences. This presumption is common in theliterature and has substantial empirical support (e.g., Wilbur 2008).

2.4. Control Variables: Time Effects andStock Market Indices

The empirical model relies on brand dummies, timefixed effects, and movements in a stock market indexto estimate baseline consumer tendencies to search.Advertising effects on search behavior are then iden-tified by deviations from this baseline correspondingto brands’ TV advertising expenditures.

The time controls consist of fixed effects for eachweek in the sample, to allow baseline category searchtendency to vary across weeks, and two sets of hourlyfixed effects: one for weekdays and another for week-ends.5 This allows baseline tendencies to vary accord-ing to times when white-collar workers are in theoffice or not.

A stock performance index, the Dow Jones Indus-trial Average (DJIA), is used as an exogenous variableto control for unobserved time-varying determinantsof searchers’ online actions. DJIA levels are widelyreported in the media; recent movements in the stockindex may lead consumers to check their account bal-ances by searching their financial service providers’brand names. Two variables based on DJIA areincluded: (1) the absolute positive percentage changesince the most recent trading day’s opening value and(2) the absolute negative percentage change since themost recent trading day’s opening value. These vari-ables allow the effect to be asymmetric around zeroand proved to fit the data better than several alternatespecifications.

2.5. Descriptive StatisticsTable 3 describes the advertising and search data.To comply with company disclosure policies, thesearch data are normalized so that the weekdayaverage totals 100. Keyword search and advertisingexpenditures varied considerably across brands. Fourbrands (Charles Schwab, CitiGroup, E-Trade, andTD Ameritrade) spent more than $100,000 per dayon TV advertising, whereas nine other brands spentless than $1,000 per day. Generic financial serviceskeywords are searched three times as frequently asbranded keywords. Category search fell by 29% fromweekdays to weekend days, whereas brand advertis-ing expenditures were 85% higher on weekend daysthan on weekdays.

Figure 1 shows the variation in the advertisingexpenditures of the three highest-spending brandsacross days in the sample. Whereas CitiGroup spentabout equally on weekdays and weekends, E-Trade

5 Specification tests preferred these two sets of day/hour dummiesto a simpler alternative (24 hourly dummies that did not varyacross weekdays) and a more complex alternative (a different setof 24 hourly dummies for each of the seven weekdays). The adver-tising response parameter estimates were robust to the alternateday/hour specifications.

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.

Joo et al.: Television Advertising and Online Search6 Management Science, Articles in Advance, pp. 1–18, © 2013 INFORMS

Table 3 Descriptive Statistics

Monday–Friday Saturday–Sundaydaily averages averages

Normalized Normalizedquery Adv. exp. query Adv. exp.

Brands volumea ($000) volumea ($000)

AG Edwards 0000 0 0000 0Charles Schwab 0027 130 0011 298CitiGroup 5018 11075 3041 11153E-Trade 0019 151 0009 635Edward Jones 0001 38 0000 89Fidelity 0066 96 0031 365Forex 0038 4 0034 8FXCM 0001 2 0001 3Legg Mason 0000 0 0000 0Merrill Lynch 9065 3 7052 2Morgan Stanley 0003 0 0002 0Nuveen 0001 0 0000 0Oppenheimer 0005 0 0002 0OptionsXpress 0001 5 0000 0Raymond James 0000 14 0000 31Scottrade 0019 22 0005 64ShareBuilder 0003 0 0001 0T. Rowe Price 0009 32 0006 255TD Ameritrade 6067 166 5015 311Vanguard 0034 0 0021 0Van Kampen 0000 0 0000 0Wachovia 0026 0 0016 0All brand 24000 11738 17048 31214

keywordsAll generic 76000 — 54017 —

keywordsTotal (brand+ 100000 71065

generic)

aNormalized query volume standardizes query totals so that the daily aver-age of total searches (branded plus generic) on weekdays is 100.

and TD Ameritrade spent two to four times moreon weekend days. Figure 2 shows the distribution ofthese brands’ expenditures across hours on weekdaysand weekend days. The correlations are much higherhere, as television viewing peaks at prime time. How-ever, Citi’s media strategy relies on prime time to aproportionally greater extent, whereas E-Trade andTD Ameritrade tend to spend more money on week-end afternoons.

3. Empirical ModelThis section derives estimating equations to relatecategory search and keyword choice to televisionadvertising.

3.1. ModelsEquation (1) relates category search in each day/hourperiod t to advertising and control variables:

yt =T∑

�=0

at−��� +Xt�+ �t1 (1)

where yt = ln4Yt5 is the log of the total number of cate-gory searches Yt (including both generic and brandedkeywords) in period t, at = ln41 + At5 is the log ofone plus category television advertising expenditureAt in period t,6 �� is the effect of TV advertisingdone in period t − � on the number of categorysearches performed in period t, and T = 96 is thenumber of hourly lags of advertising included in themodel. The vector Xt contains control variables—anintercept, day/hour fixed effects, week fixed effects,and the two DJIA index variables—described in §2.4;� is a vector of parameters that represent the effectsof the exogenous variables on category search, and�t is an error term that accounts for any unobserveddeterminants of the number of category searches inperiod t.

Given a volume of category searches, Equation (2)relates the keyword choice share for each brandk = 11 0 0 0 1K in each period t to advertising andcovariates:

skt =exp4

∑T�=0 ak1 t−��� +Xkt�+ �kt5

1 +∑K

k′=1 exp4∑T

�=0 ak′1 t−��� +Xk′t�+ �k′t51 (2)

where skt is the share of keywords entered in period tthat are directly related to brand k (as defined in §2.2);akt = ln41 + Akt5 is the log of one plus the televisionadvertising expenditure Akt of brand k in period t;�� is the effect of TV advertising done by brand k inperiod t − � on its keyword choice share in period t;Xkt is a vector of exogenous control variables thatincludes an intercept, fixed effects for brand, day-hour, and week, and the two DJIA index variables;and �kt is an error term that represents all unobserveddeterminants of brand k’s keyword choice share inperiod t.

Equation (2) can be transformed into a linear modelby taking logs and subtracting the log of generic key-words’ share from both sides (Berry 1994):

zkt =T∑

�=0

ak1 t−��� +Xkt�+ �kt1 (3)

where zkt = ln4skt5 − ln4s0t5 and s0t is the fraction oftotal category searches in period t for purely generickeywords (i.e., the share of searches that do not con-tain any branded keywords).

3.2. Almon Parameterization ofAdvertising Effects

The primary drawback of direct estimation ofdistributed-lag models such as (1) and (3) is that, for

6 The empirical findings are qualitatively robust to replacing thismeasure of advertising with raw expenditure or share of voice.We use logs of search volume and advertising expenditures becausevisual inspection of the data showed the relationship between thesetwo variables to be approximately log-linear.

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.

Joo et al.: Television Advertising and Online SearchManagement Science, Articles in Advance, pp. 1–18, © 2013 INFORMS 7

Figure 1 Major Brands’ Ad Spending by Date

0

500

1,000

1,500

2,000

2,500

Adv

ertis

ing

expe

nditu

re (

$000

)

10/1/

2011

10/8/

2011

10/15

/2011

10/22

/2011

10/29

/2011

11/5/

2011

11/12

/2011

11/19

/2011

11/26

/2011

12/3/

2011

12/10

/2011

12/17

/2011

12/24

/2011

12/31

/2011

Citi

E-trade

TD Ameritrade

large T , the number of �� and �� parameters to beestimated is large. Almon (1965) proposed a simplerparameterization of distributed-lag models to addressthis issue. The fully specified distributed-lag functionis replaced with an assumption that the effects oflagged television advertising on search behavior canbe approximated by a p–degree polynomial functionof the time lag; that is, we assume

�� =

p1∑

�=0

���� and (4)

�� =

p2∑

�=0

����1 (5)

where the �� and �� terms are parameters to beestimated. In other words, the Almon (1965) model

Figure 2 Major Brands’ Ad Spending by Day/Hour

0

2,000

4,000

6,000

8,000

10,000

12,000

14,000

16,000

18,000

20,000

Adv

ertis

ing

expe

nditu

re($

000)

CitiE-tradeTD Ameritrade

Wee

kday

midnigh

t

Wee

kday

2 A.M.

Wee

kday

4 A.M.

Wee

kday

6 A.M.

Wee

kday

8 A.M.

Wee

kday

10A.M

.

Wee

kend

2 A.M.

Wee

kend

4 A.M.

Wee

kend

6 A.M.

Wee

kend

8 A.M.

Wee

kend

10A.M

.

Wee

kday

noon

Wee

kend

noon

Wee

kday

2 P.M.

Wee

kday

4 P.M.

Wee

kday

6 P.M.

Wee

kday

8 P.M.

Wee

kday

10P.M

.

Wee

kend

2 P.M.

Wee

kend

4 P.M.

Wee

kday

6 P.M.

Wee

kend

8 P.M.

Wee

kend

10P.M

.

Wee

kend

midnigh

t

assumes that the effect of the �th lag on current searchbehavior is given by a p-order polynomial in � . Forlarge p, this can provide a very flexible representationof the effects of lagged advertising on search behavior.This transforms Equations (1) and (3) into

yt =p1∑

�=0

��v�t +Xt�+ �t and (6)

zkt =p2∑

�=0

��wk�t +Xkt�+ �kt1 (7)

where v�t =∑T

�=0 ��at−� and wk�t =

∑T�=0 �

�ak1 t−� arefunctions of past advertising that may be constructed

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.

Joo et al.: Television Advertising and Online Search8 Management Science, Articles in Advance, pp. 1–18, © 2013 INFORMS

directly from the data (Gujarati 2003 provides adetailed explanation). The number of advertisingeffectiveness parameters to be estimated has fallenfrom 2T to p1 + p2, and the original effects of the lagscan be recovered by plugging the estimates of �� and�� into Equations (4) and (5).7

Davidson and MacKinnon (1993) and Gujarati(2003) give prescriptive advice on how to choosethe number of lags (T ) and degree of polynomials(p1 and p2).8 The number of lags is settled first byincluding a relatively large number of lags and thendropping some to check whether including fewer lagsappreciably reduces the fit of the model. Second, thedegree of the polynomial is specified for each modelby starting from the lowest-order polynomial andincrementing p until either the last parameter addedcontains zero within its 95% confidence interval oruntil the covariance matrix of the parameter estimatesbecomes noninvertible because of multicollinearity.

3.3. Serial Correlation in Search BehaviorThe measures of online search behavior are seriallycorrelated. A common remedy for this is to estimatethe model by taking the first differences of Equa-tions (6) and (7),

yt − yt−1

=

�∑

p=0

�p4vpt − vp1 t−15+ 4Xt −Xt−15�+ �t − �t−11 (8)

zkt − zk1 t−1

=

�∑

p=0

�p4wkpt −wkp1 t−15+ 4Xkt −Xk1 t−15�

+ �kt − �k1 t−10 (9)

Analytically, Equations (8) and (9) estimate thesame parameters as direct estimation of Equa-tions (6) and (7), but the first differences estimator ismore efficient than fixed effects estimator when theerrors are serially correlated (Wooldridge 2010). Theappendix provides further information about estima-tion, including modeling choices, serial correlationtests, and standard errors.

7 A popular alternative to the Almon (1965) parameterization isthe Koyck model, which would assume that an infinite number oflags enters Equations (1) and (2) and that the effects of those lagsdecrease monotonically and exponentially. Clarke (1976) discussesthe application of the Koyck model to advertising response, andGujarati (2003) compares the Koyck and Almon models. The Almonmodel is more flexible and can replicate a Koyck decay patternwhen the number of lags is large and the degree of the polynomialis two or larger.8 For further discussion, see Thomas (1977).

3.4. Measure of Advertising ElasticitiesA standard approach to presenting the size of anadvertising effect is to calculate it as an elasticity(e.g., Ataman et al. 2010, Lodish et al. 1995). We mea-sure the percentage change in total future searches forbrand k (defined as qkt =

∑T�=0 Yt+�sk1 t+� , the number

of branded searches between points t and t+T , inclu-sive) given a change in brand k’s television advertis-ing expenditure (Akt5 at time t. From Equations (1)and (2), this elasticity is

¡qkt¡Akt

Akt

qkt

=Akt

qkt41 +∑

kAkt5

T∑

�=0

Yt+���sk1 t+�

+Akt

qkt41 +Akt5

T∑

�=0

Yt+���sk1 t+�41 − sk1 t+�50 (10)

The first term on the right-hand side of Equation (10)represents the increase in searches for brand k’s key-words due to the expansion in the number of cat-egory searches, holding brand k’s share of categorysearches constant. The second term is the increasein searches for brand k’s keywords accruing to itsincrease in keyword choice share, holding total cate-gory searches constant. The first term is analogous toa “category expansion” effect, measuring the increasein brand searches accruing to an increase in cate-gory search total, holding the brand’s keyword choiceshare constant. The second term is similar to a “busi-ness stealing” effect, showing the increase in thebrand’s searches due to its change in keyword choiceshare, holding total category search constant. The rel-ative size of each effect will influence the managerialimplications of the results.

4. Identifying AssumptionsIn the present application, the temporal orderingthat advertisements must be purchased prior to air-ing rules out the possibility that consumer searchdata (y) directly cause TV advertising placements (x).However, there are two ways in which televisionadvertising (x) may depend indirectly on onlinesearch behavior (y).

One possible source of endogeneity is that brandsanticipate when consumers will search and pur-chase television advertising at times that will max-imally influence that search. To investigate this, weheld a series of several dozen informal conversationswith managers and researchers working in market-ing and advertising at three leading Internet compa-nies (Google, Yahoo!, and Amazon) and two leadingfinancial services brands in the sample. We beganeach conversation by asking whether brands typically

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.

Joo et al.: Television Advertising and Online SearchManagement Science, Articles in Advance, pp. 1–18, © 2013 INFORMS 9

Figure 3 Category Search and Ad Spending by Date

0

1,000

2,000

3,000

4,000

5,000

6,000

7,000

8,000

Adv

ertis

ing

expe

nditu

re (

$000

)

200

100

0

Nor

mal

ized

num

ber

of c

ateg

ory

sear

ches

(ave

rage

dai

ly s

earc

hes

=10

0)

Category advertising expenditures

Daily aggregate category searches

10/1/

2011

10/8/

2011

10/15

/2011

10/22

/2011

10/29

/2011

11/5/

2011

11/12

/2011

11/19

/2011

11/26

/2011

12/3/

2011

12/10

/2011

12/17

/2011

12/24

/2011

12/31

/2011

coordinate their television advertising and searchengine marketing campaigns. Our conversation part-ners were unanimous that they did not know of anyfirms who were using any online search data to plantheir television advertising campaigns.

We also investigated the available data to checkfor evidence that brands were anticipating spikes inonline search activity. If television advertising expen-ditures were planned on the basis of expected searchvolume, one would expect advertising expendituresto increase immediately before or during periodsof intense category search. Figures 3 and 4 presentdata showing that such covariation is not obvious.Although category search and television advertisingshow extensive variation across days within the week,

Figure 4 Category Search and Ad Spending by Day/Hour

0

5,000

10,000

15,000

20,000

25,000

Adv

ertis

ing

expe

nditu

re (

$000

)

Category advertising expenditures

Hourly aggregate category searches

500

400

300

200

100

0

Nor

mal

ized

num

ber

of c

ateg

ory

sear

ches

(ave

rage

hou

rly

sear

ches

= 1

00)

Wee

kday

midnigh

t

Wee

kday

2 A.M.

Wee

kday

4 A.M.

Wee

kday

6 A.M.

Wee

kday

8 A.M.

Wee

kday

10A.M

.

Wee

kend

2 A.M.

Wee

kend

4 A.M.

Wee

kend

6 A.M.

Wee

kend

8 A.M.

Wee

kend

10A.M

.

Wee

kday

noon

Wee

kend

noon

Wee

kday

2 P.M.

Wee

kday

4 P.M.

Wee

kday

6 P.M.

Wee

kday

8 P.M.

Wee

kday

10P.M

.

Wee

kend

2 P.M.

Wee

kend

4 P.M.

Wee

kend

6 P.M.

Wee

kend

8 P.M.

Wee

kend

10P.M

.

Wee

kend

midnigh

t

search varies reasonably little over weeks in the sam-ple. In addition, the two variables do not seem tocorrespond in their extremes. Advertising peaked onNovember 20, but there was no apparent movementin search volume, at least in the daily aggregates.Search activity peaked on December 5, but advertisingexpenditures lay below their sample average on thisdate. Search volume stayed high in the several weeksfollowing December 5, whereas advertising expendi-tures remained fairly low. The correlation betweendaily advertising and daily search volume was −0028.

Figure 4 corroborates this pattern among hourswithin weekdays and weekend days. The majorityof advertising expenditures occur during prime timeand weekend afternoons when category search is

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.

Joo et al.: Television Advertising and Online Search10 Management Science, Articles in Advance, pp. 1–18, © 2013 INFORMS

significantly lower than its peak during standardbusiness hours. The available data do not allow us tofalsify the hypothesis that brands planned advertis-ing expenditures based on expectations of search data;there is no clear evidence to support that hypothesis.

The other possible source of endogeneity is thattelevision advertising expenditures may be correlatedwith unobserved variables that also influence onlinesearch behavior. For example, if a financial servicesbrand pulses its television advertising with advertis-ing expenditures in other media (such as Internet dis-play advertising), and those other media influenceonline search behavior, then one would expect theestimates reported in §5 to be inflated.

Under the identifying assumptions that (1) in-tertemporal variation in category television advertis-ing is exogenous with respect to category searchesand (2) intertemporal variation in brand televisionadvertising is exogenous with respect to brands’ key-word choice shares, the estimates may be interpretedas causal. We believe these assumptions to be credi-ble based on our understanding of the industry andour inspection of the data. However, the possibil-ity remains that unobserved variables may lead toinflated estimates of the effects. This alternate hypoth-esis is not falsifiable using the available data.

5. FindingsThis section presents results of first-difference regres-sions of Equations (8) and (9).

5.1. Effects of Television Advertising on CategorySearch and Keyword Choice

Figure 5 displays the 95% confidence intervals forthe effects of lagged category advertising expendi-

Figure 5 Effects of Television Advertising on Category Search

–0.004

–0.002

0.000

0.002

0.004

0.006

0.008

0.010

0.012

Cur

rent

adv

.2-

hour

lag

4-ho

ur la

g6-

hour

lag

8-ho

ur la

g10

-hou

r la

g12

-hou

r la

g14

-hou

r la

g16

-hou

r la

g18

-hou

r la

g20

-hou

r la

g22

-hou

r la

g24

-hou

r la

g26

-hou

r la

g28

-hou

r la

g30

-hou

r la

g32

-hou

r la

g34

-hou

r la

g36

-hou

r la

g38

-hou

r la

g40

-hou

r la

g42

-hou

r la

g44

-hou

r la

g46

-hou

r la

g48

-hou

r la

g50

-hou

r la

g52

-hou

r la

g54

-hou

r la

g56

-hou

r la

g58

-hou

r la

g60

-hou

r la

g62

-hou

r la

g64

-hou

r la

g66

-hou

r la

g68

-hou

r la

g70

-hou

r la

g72

-hou

r la

g74

-hou

r la

g76

-hou

r la

g78

-hou

r la

g80

-hou

r la

g82

-hou

r la

g84

-hou

r la

g86

-hou

r la

g88

-hou

r la

g90

-hou

r la

g92

-hou

r la

g94

-hou

r la

g

“s-hour lag” indicates the effect of TV advertising expenditure in period t-s on category searches in period t (�s)

Est.

95%confidenceinterval

tures on category search. TV advertising has a smallbut positive effect on category search. Of the 96 lageffects, 76 are positive and statistically significantlydifferent from zero. None may be proven to be lessthan zero at a regular confidence level. However theeffects are quite small. A unit increase in log cate-gory advertising expenditures will lift the number ofqueries for category-related keywords by about 0.5%per hour over a period of about three days. Thisnonimmediate, sustained, subtle effect may indicatethat category advertising acts as a “reminder” thatincreases the likelihood that a consumer will thinkabout and search category-relevant keywords. Over-all, the results indicate that category search rises afterfinancial services advertising, showing that TV adver-tising has category expansion effects.

Figure 6 shows the 95% confidence intervals forthe effects of lagged brand advertising expenditureson searchers’ tendency to choose branded keywordsinstead of generic keywords. TV advertising increasesbranded keyword choice. Sixteen of the first 18 laggedeffects are positive and statistically significantly dif-ferent from zero, indicating elevated levels of brandedkeyword choice corresponding to the placement ofthat brand’s commercials on television. The esti-mates indicate an inverted-“U” pattern peaking inthe 6–11 hour range after TV advertising goes onthe air. All of the confidence intervals after the 17thlag include zero. Along with the category expansioneffects of advertising, brand advertising also increasesthe tendency to use branded keywords, but this effectis much shorter lived.

How big are these effects? The elasticity of abrand’s total searches with respect to television adver-tising may be calculated according to Equation (10).

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.

Joo et al.: Television Advertising and Online SearchManagement Science, Articles in Advance, pp. 1–18, © 2013 INFORMS 11

Figure 6 Effects of Television Advertising on Keyword Choice

–0.8

–0.6

–0.4

–0.2

0.0

0.2

0.4

0.6

0.8

1.0

1.2C

urre

nt a

dv.

2-ho

ur la

g4-

hour

lag

6-ho

ur la

g8-

hour

lag

10-h

our

lag

12-h

our

lag

14-h

our

lag

16-h

our

lag

18-h

our

lag

20-h

our

lag

22-h

our

lag

24-h

our

lag

26-h

our

lag

28-h

our

lag

30-h

our

lag

32-h

our

lag

34-h

our

lag

36-h

our

lag

38-h

our

lag

40-h

our

lag

42-h

our

lag

44-h

our

lag

46-h

our

lag

48-h

our

lag

50-h

our

lag

52-h

our

lag

54-h

our

lag

56-h

our

lag

58-h

our

lag

60-h

our

lag

62-h

our

lag

64-h

our

lag

66-h

our

lag

68-h

our

lag

70-h

our

lag

72-h

our

lag

74-h

our

lag

76-h

our

lag

78-h

our

lag

80-h

our

lag

82-h

our

lag

84-h

our

lag

86-h

our

lag

88-h

our

lag

90-h

our

lag

92-h

our

lag

94-h

our

lag

“s-hour lag” indicates the effect of TV advertising expenditure in period t-s on keyword choice in period t (�s)

Est.

95%confidenceinterval

Given a 10% increase in a brand’s television advertis-ing expenditures, the model predicts a 1.7% increasein its number of branded searches over the follow-ing 96 hours. This elasticity is statistically significantlydifferent from zero at the 99% confidence level, with astandard error of 0.2%. This effect magnitude is largerthan both the short-term market share elasticity ofadvertising (0.05) and the long-term market share elas-ticity of advertising (0.10) reported by Lodish et al.(1995). Similarly, it exceeds both the short-run (0.01)

Figure 7 Elasticities by Day/Hour

0.12

0.13

0.14

0.15

0.16

0.17

0.18

0.19

0.20

0.21

0.22

Wee

kday

5 A

.M.

Wee

kday

6 A

.M.

Wee

kday

7 A

.M.

Wee

kday

8 A

.M.

Wee

kday

9 A

.M.

Wee

kday

10

A.M

.

Wee

kday

11

A.M

.

Wee

kday

noo

nW

eekd

ay 1

P.M

.

Wee

kday

2 P

.M.

Wee

kday

3 P

.M.

Wee

kday

4 P

.M.

Wee

kday

5 P

.M.

Wee

kday

6 P

.M.

Wee

kday

7 P

.M.

Wee

kday

8 P

.M.

Wee

kday

9 P

.M.

Wee

kday

10

P.M

.

Wee

kday

11

P.M

.

Wee

kday

mid

nigh

t

Wee

kend

5 A

.M.

Wee

kend

6 A

.M.

Wee

kend

7 A

.M.

Wee

kend

8 A

.M.

Wee

kend

9 A

.M.

Wee

kend

10

A.M

.

Wee

kend

11

A.M

.

Wee

kend

noo

nW

eeke

nd 1

P.M

.

Wee

kend

2 P

.M.

Wee

kend

3 P

.M.

Wee

kend

4 P

.M.

Wee

kend

5 P

.M.

Wee

kend

6 P

.M.

Wee

kend

7 P

.M.

Wee

kend

8 P

.M.

Wee

kend

9 P

.M.

Wee

kend

10

P.M

.

Wee

kend

11

P.M

.

Wee

kend

mid

nigh

t

“Business stealing” effect

“Category expansion” effect

and long-run (0.12) advertising elasticities found byAtaman et al. (2010). Perhaps its magnitude can beexplained by the fact that consumer search is an actionthat takes place at the top of the funnel, where adver-tising is thought to be relatively more effective; pre-vious studies more frequently measured advertising’seffect on sales, which requires consumers to go deeperinto the purchase funnel and convert.

Figure 7 shows how the elasticity estimate breaksdown across sources of brand searches (the “category

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.

Joo et al.: Television Advertising and Online Search12 Management Science, Articles in Advance, pp. 1–18, © 2013 INFORMS

expansion” and “business stealing” effects discussedin §3.4) and by hours on weekdays and weekenddays. The effects of TV advertising on online searchare greatest in the morning and decrease throughoutthe day, before rising again after 5 p.m. and through-out the evening. This pattern seems to be consistentwith exposure to advertising during prime time and agradual wearout prior to the next day’s evening tele-vision. The effects are slightly higher on weekdaysthan on weekends.

The dark area of the figure represents contribu-tion of category search expansion to the percent-age increase in searches for the brand’s keywords.On average, business stealing effects are about twoorders of magnitude larger than category expansioneffects. The graph shows that television advertisingdoes not generate large positive spillovers, suggestingthat brands will not benefit much by free riding oncompetitors’ advertising expenditures.

Analyses of secondary data are typically unable todiscern precise behavioral mechanisms, but we canspeculate on the causes. There are two overlappingexplanations for the pattern in Figure 7 in which elas-ticities peak in the morning and fall throughout busi-ness hours. First, it is possible that the part of theaudience whose search for financial services brandsis influenced by television advertising is more likelyto search in the morning. For example, it might bethat working professionals are both more likely to beexposed to television advertising for financial servicesbrands, and more likely to enter Google searches inthe morning, than the average person. Another pos-sible explanation is that these effects could be duesolely to consumers’ memories and the duration ofthe effect of advertising on search. It may be that most

Figure 8 Day/Hour Fixed Effect Estimates in Category Search Model

1.5

1.0

0.5

0.0

–0.5 Est.

95%confidenceinterval

–1.0

Wee

kday

1 A

.M.

Wee

kday

1 P

.M.

Wee

kday

2 P

.M.

Wee

kday

3 P

.M.

Wee

kday

4 P

.M.

Wee

kday

5 P

.M.

Wee

kday

6 P

.M.

Wee

kday

7 P

.M.

Wee

kday

8 P

.M.

Wee

kday

9 P

.M.

Wee

kday

10

P.M

.

Wee

kday

11

P.M

.

Wee

kend

1 A

.M.

Wee

kend

2 A

.M.

Wee

kend

3 A

.M.

Wee

kend

4 A

.M.

Wee

kend

5 A

.M.

Wee

kend

6 A

.M.

Wee

kend

7 A

.M.

Wee

kend

8 A

.M.

Wee

kend

9 A

.M.

Wee

kend

10

A.M

.

Wee

kend

11

A.M

.

Wee

kend

1 P

.M.

Wee

kend

2 P

.M.

Wee

kend

3 P

.M.

Wee

kend

4 P

.M.

Wee

kend

5 P

.M.

Wee

kend

6 P

.M.

Wee

kend

7 P

.M.

Wee

kend

8 P

.M.

Wee

kend

9 P

.M.

Wee

kend

10

P.M

.

Wee

kend

11

P.M

.

Wee

kend

noo

n

Wee

kend

mid

nigh

t

Wee

kday

2 A

.M.

Wee

kday

3 A

.M.

Wee

kday

4 A

.M.

Wee

kday

5 A

.M.

Wee

kday

6 A

.M.

Wee

kday

7 A

.M.

Wee

kday

8 A

.M.

Wee

kday

9 A

.M.

Wee

kday

11

A.M

.

Wee

kday

noo

n

Wee

kday

10

A.M

.

–1.5

advertising exposure occurs during prime time andthat its effects have mostly dissipated within the fol-lowing 16 hours or so (as shown by Figure 6). Bothexplanations probably help to explain the pattern ofelasticity effects in Figure 7.

5.2. Effects of Control VariablesHere we present some of the effects of control vari-ables on category search and keyword choice. Fig-ures 8 and 9 display the 95% confidence intervals ofthe effects of day/hour dummies on category searchand keyword choice, respectively. Category searchrose rapidly between 6 a.m. and 10 a.m. on weekdaysand then laid approximately flat until about 10 p.m.Its pattern on weekend days was similar. Keywordchoice increased quickly from 5 a.m. until 10 a.m., butstarted to fall after 5 p.m. On weekend days it laidmostly flat between 10 a.m. and 10 p.m.

Stock market index parameter estimates (in Table 4)cannot be distinguished from zero.

5.3. Polynomial Parameters andAlternative Specifications

The procedure described in §3.2 led us to set T = 96,p1 = 2, and p2 = 6. We found that estimating higher-order polynomials did not change the statistical sig-nificance of the lower-order polynomial parameters.Table 5 reports the parameter estimates (�p and �p)underlying the effects of lagged TV advertising inFigures 5 and 6. Individual polynomial parametersdo not correspond to marginal effects, but they areincluded for completeness.

We previously estimated distributed-lag modelswithout the Almon parameterization. The unre-stricted distributed-lag models found qualitativelysimilar effects (positive effects of TV advertising on

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.

Joo et al.: Television Advertising and Online SearchManagement Science, Articles in Advance, pp. 1–18, © 2013 INFORMS 13

Figure 9 Day/Hour Fixed Effect Estimates in Keyword Choice Model

60

50

40

30

20

10

0

–10

–20

–30

–40

Wee

kday

1 A

.M.

Wee

kday

1 P

.M.

Wee

kday

2 P

.M.

Wee

kday

3 P

.M.

Wee

kday

4 P

.M.

Wee

kday

5 P

.M.

Wee

kday

6 P

.M.

Wee

kday

7 P

.M.

Wee

kday

8 P

.M.

Wee

kday

9 P

.M.

Wee

kday

10

P.M

.

Wee

kday

11

P.M

.

Wee

kend

1 A

.M.

Wee

kend

2 A

.M.

Wee

kend

3 A

.M.

Wee

kend

4 A

.M.

Wee

kend

5 A

.M.

Wee

kend

6 A

.M.

Wee

kend

7 A

.M.

Wee

kend

8 A

.M.

Wee

kend

9 A

.M.

Wee

kend

10

A.M

.

Wee

kend

11

A.M

.

Wee

kend

1 P

.M.

Wee

kend

2 P

.M.

Wee

kend

3 P

.M.

Wee

kend

4 P

.M.

Wee

kend

5 P

.M.

Wee

kend

6 P

.M.

Wee

kend

7 P

.M.

Wee

kend

8 P

.M.

Wee

kend

9 P

.M.

Wee

kend

10

P.M

.

Wee

kend

11

P.M

.

Wee

kend

noo

n

Wee

kend

mid

nigh

t

Wee

kday

2 A

.M.

Wee

kday

3 A

.M.

Wee

kday

4 A

.M.

Wee

kday

5 A

.M.

Wee

kday

6 A

.M.

Wee

kday

7 A

.M.

Wee

kday

8 A

.M.

Wee

kday

9 A

.M.

Wee

kday

11

A.M

.

Wee

kday

noo

n

Wee

kday

10

A.M

.

Est.

95%confidenceinterval

both category search and use of branded keywords),but the lagged advertising parameters showed acyclical pattern with a 24-hour frequency and littleapparent decay over time. The fluctuations seemed tomatch the pattern of autocorrelation in the advertis-ing expenditure data, so the Almon parameterizationwas thought to be a reasonable way to simplify themodel specification.

Table 4 Stock Index Effects

Parameter Newey–Westestimate std. err.

Category searchAbsolute positive % DJIA change −00012 00008Absolute negative % DJIA change 00006 00007Adjusted R2 00944

Keyword choiceAbsolute positive % DJIA change 1057 6032Absolute negative % DJIA change −5008 6040Adjusted R2 00005

Table 5 Advertising Polynomial Parameter Estimates

Parameter Newey–Westestimate std. err.

Category search�0 −2.0E−04 1.5E−03�1 2.4E−04 1.1E−04∗∗

�2 −2.4E−06 1.1E−06∗∗

Keyword choice�0 −1.1E−01 1.0E−01�1 2.8E−01 3.7E−02∗∗

�2 −2.8E−02 4.2E−03∗∗

�3 1.0E−03 1.8E−04∗∗

�4 −1.8E−05 3.6E−06∗∗

�5 1.4E−07 3.3E−08∗∗

�6 −4.5E−10 1.1E−10∗∗

∗∗Significant at the 99% confidence level.

6. DiscussionThis paper has investigated two large data sets toinvestigate how television advertising expendituresare related to online search. It found that televisionadvertising increases the number of product category-relevant searches and increases the advertised brand’sshare of keywords searched. For financial services, thislatter effect dominates; the primary effect of a brand’sadvertising expenditure is to “steal” query share fromrivals more so than to increase the number of searchesin the product category. The elasticity of a brand’ssearches with respect to its advertising is 0.17.

The most important implication of these results isthe need for advertisers to consider how televisionadvertising may impact their search advertising cam-paigns. Search engine marketing is typically run as astandalone activity that seeks to maximize its incre-mental profits. The importance of cross-channel strat-egy in marketing has been documented previously,but managers are still relying on experience and gutintuition to decide how to divide advertising budgetsacross media (Pfeiffer and Zinnbauer 2010).

The effects of television advertising on onlinesearch may differ across product categories, con-sumers, or time. The easiest way for a brand toinvestigate these effects is to use A/B tests to mea-sure changes in online behavior corresponding to theoccurrence of television advertisement. It would alsobe possible to use the number of people exposed to aTV advertisement within a local market to explainmarket-specific measures of online activity. Lewis andReiley (2013) explore these issues in greater depth.

Knowledge of these effects may lead a mar-keter to alter its pulsing, creatives, budgets, andreturn-on-investment metrics for both television andsearch advertising. It is likely advisable to facilitateor require coordination between the two agencies

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.

Joo et al.: Television Advertising and Online Search14 Management Science, Articles in Advance, pp. 1–18, © 2013 INFORMS

executing the advertising campaigns in each medium.For example, Web search metrics could be used as aninput into the TV advertising campaign dashboard tohelp guide realtime creative decisions.9 When televi-sion advertising increases branded keyword choice,it will reduce the number of expensive clicks ongeneric keyword searches and increase the number ofclicks paid for on cheaper branded keywords. (Costsper click are typically higher for generic category key-words because of greater competition in the keywordauction.) It also might increase the conversion rate ofboth branded and generic search keywords. The mar-keter who remains ignorant of these effects may riskunderspending on television advertising and over-spending on search advertising.10

This study has a number of limitations. It consid-ered only one product category. Television advertis-ing for new brands or for evolving categories wouldlikely show stronger category expansion and lowerbusiness stealing effects than the ones found here. Theavailable data excluded direct website traffic, addi-tional search engines, social networks, paid searchadvertisements, and click-through and conversioninformation. The effects were based on time seriesidentification and did not come from a single-sourcepanel in which advertising exposures and searchbehavior are observed within a single household.

We hope that some of the issues raised in thispaper will stimulate field experiments. Though it iswell known that exposure to online advertising affectsonline purchase behavior (e.g., Manchanda et al.2006), more information is needed about how adver-tising creative elements interact with consumers’stages in the purchase funnel to determine productchoices. Although Internet commerce enables mar-keters to observe many aspects of the consumerchoice process, further research is needed to deter-mine how to optimize all types of advertising to max-imize advertising effectiveness.

AcknowledgmentsThe authors thank Pradeep Chintagunta, the associate edi-tor, and three anonymous reviewers for their valuableand insightful comments. They also thank Randall Lewis,Preston McAfee, Hal Varian, and numerous seminar audi-ences for helpful comments. Bo Cowgill thanks Google for

9 With DVRs found in nearly 45% of U.S. households (Televi-sion Bureau of Advertising 2012) and live audiences falling by asmuch as 30% during commercial breaks (Schweidel and Kent 2010),search data may offer an important means to test television adver-tising effectiveness. As Swasy and Rethans (1986, p. 33) suggested,“advertisers should begin to incorporate a measure of curiositygeneration and question solicitation in their new-product ad con-cept and ad-testing procedures.”10 As Wiesel et al. (2011, p. 609) noted, “it is unwise to credit amarketing activity only for orders in ‘its’ channel, a practice typicalin companies with different managers for different channels.”

research support. Kenneth Wilbur was employed by theDuke University Fuqua School of Business and Yi Zhu wasa doctoral student at University of Southern California Mar-shall School of Business while much of this research wasconducted. Both members of the first and second pairsof authors contributed equally and are listed in alpha-betical order. The authors gratefully acknowledge finan-cial support from Marketing Science Institute/WhartonInteractive Media Initiative multichannel research award[Award 4-1645].

Appendix. Further Empirical DetailsThis appendix gives further details about the estimation andresults.

Functional FormsSeveral functional forms were considered for use in Equa-tion (1). Figure A.1 plots the log of category search against

Figure A.1 Log Category Search vs. Category Advertising Expenditure

0 500

Log

of

cate

gory

sea

rch

volu

me

(hid

den)

1,000 1,500

Advertising expenditure ($000)

Figure A.2 Log Category Search vs. Log Category AdvertisingExpenditure

4 6 8

Log

of

cate

gory

sea

rch

volu

me

(hid

den)

10 1412

Log advertising expenditure

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.

Joo et al.: Television Advertising and Online SearchManagement Science, Articles in Advance, pp. 1–18, © 2013 INFORMS 15

Table A.1 Week Fixed Effects to Control for Seasonality

Category search Keyword choice

Parameter Newey–West Parameter Newey–Westestimate std. err. estimate std. err.

Week 3 (Oct.) −00005 00019 −404 2204Week 4 (Oct.) 00003 00039 −4909 4302Week 5 (Oct.) 00015 00058 −7407 5507Week 6 (Oct./Nov.) 00049 00077 −5805 6107Week 7 (Nov.) 00040 00097 −8303 7308Week 8 (Nov.) 00080 00116 −12804 9104Week 9 (Nov.) 00134 00134 −11201 10200Week 10 (Nov./Dec.) 00132 00154 −7505 11401Week 11 (Dec.) 00187 00173 −10003 12401Week 12 (Dec.) 00220 00193 −8309 13403Week 13 (Dec.) 00309 00212 −4707 14300Week 14 (Dec.) 00387 00232 −7203 15300

the level of category advertising expenditures. It is difficultto discern the shape of the relationship because there aremany time periods with zero category advertising dollars.Figure A.2 shows a log–log plot. Based on this, a log-linearspecification represents the data better.

Serial Correlation TestsThe standard Arellano and Bond (1991) test for serial cor-relation was applied to Equation (1) and rejected the null

Table A.2 Lagged Advertising Parameter Estimates

Category search Keyword choice Category search Keyword choice

Newey–West Newey–West Newey–West Newey–WestEst. std. err. Est. std. err. Est. std. err. Est. std. err.

Current advertising −000002 000015 −00113 00101 Lagged advertising (48 hrs) 000059 000021∗∗ 00163 00178Lagged advertising (1 hr) 000000 000014 00140 00093 Lagged advertising (49 hrs) 000059 000021∗∗ 00187 00178Lagged advertising (2 hrs) 000003 000014 00343 00094∗∗ Lagged advertising (50 hrs) 000059 000021∗∗ 00210 00177Lagged advertising (3 hrs) 000005 000013 00502 00100∗∗ Lagged advertising (51 hrs) 000059 000021∗∗ 00231 00177Lagged advertising (4 hrs) 000007 000013 00622 00107∗∗ Lagged advertising (52 hrs) 000059 000021∗∗ 00249 00176Lagged advertising (5 hrs) 000010 000012 00708 00113∗∗ Lagged advertising (53 hrs) 000059 000021∗∗ 00265 00175Lagged advertising (6 hrs) 000012 000012 00764 00119∗∗ Lagged advertising (54 hrs) 000059 000021∗∗ 00279 00173Lagged advertising (7 hrs) 000014 000012 00794 00123∗∗ Lagged advertising (55 hrs) 000059 000021∗∗ 00290 00172Lagged advertising (8 hrs) 000016 000012 00803 00127∗∗ Lagged advertising (56 hrs) 000059 000021∗∗ 00299 00171Lagged advertising (9 hrs) 000018 000012 00792 00130∗∗ Lagged advertising (57 hrs) 000058 000020∗∗ 00305 00169Lagged advertising (10 hrs) 000020 000012 00767 00133∗∗ Lagged advertising (58 hrs) 000058 000020∗∗ 00309 00168Lagged advertising (11 hrs) 000022 000012 00728 00136∗∗ Lagged advertising (59 hrs) 000058 000020∗∗ 00311 00166Lagged advertising (12 hrs) 000024 000012 00680 00139∗∗ Lagged advertising (60 hrs) 000057 000020∗∗ 00310 00165Lagged advertising (13 hrs) 000026 000013∗∗ 00624 00143∗∗ Lagged advertising (61 hrs) 000057 000020∗∗ 00307 00164Lagged advertising (14 hrs) 000027 000013∗∗ 00563 00146∗∗ Lagged advertising (62 hrs) 000056 000019∗∗ 00301 00163Lagged advertising (15 hrs) 000029 000013∗∗ 00498 00150∗∗ Lagged advertising (63 hrs) 000055 000019∗∗ 00294 00163Lagged advertising (16 hrs) 000031 000013∗∗ 00431 00153∗∗ Lagged advertising (64 hrs) 000055 000019∗∗ 00286 00162Lagged advertising (17 hrs) 000032 000014∗∗ 00364 00157∗∗ Lagged advertising (65 hrs) 000054 000018∗∗ 00276 00162Lagged advertising (18 hrs) 000034 000014∗∗ 00297 00160 Lagged advertising (66 hrs) 000053 000018∗∗ 00265 00162Lagged advertising (19 hrs) 000036 000015∗∗ 00233 00164 Lagged advertising (67 hrs) 000053 000018∗∗ 00253 00161Lagged advertising (20 hrs) 000037 000015∗∗ 00171 00167 Lagged advertising (68 hrs) 000052 000017∗∗ 00240 00161Lagged advertising (21 hrs) 000039 000015∗∗ 00112 00169 Lagged advertising (69 hrs) 000051 000017∗∗ 00227 00161Lagged advertising (22 hrs) 000040 000016∗∗ 00058 00171 Lagged advertising (70 hrs) 000050 000017∗∗ 00213 00161Lagged advertising (23 hrs) 000041 000016∗∗ 00009 00173 Lagged advertising (71 hrs) 000049 000016∗∗ 00200 00161Lagged advertising (24 hrs) 000043 000016∗∗ −00035 00174 Lagged advertising (72 hrs) 000048 000016∗∗ 00188 00160Lagged advertising (25 hrs) 000044 000017∗∗ −00074 00175 Lagged advertising (73 hrs) 000047 000016∗∗ 00176 00159Lagged advertising (26 hrs) 000045 000017∗∗ −00107 00175 Lagged advertising (74 hrs) 000046 000015∗∗ 00164 00158Lagged advertising (27 hrs) 000046 000017∗∗ −00134 00175 Lagged advertising (75 hrs) 000044 000015∗∗ 00154 00157Lagged advertising (28 hrs) 000047 000018∗∗ −00156 00175 Lagged advertising (76 hrs) 000043 000014∗∗ 00145 00156

hypothesis of no serial correlation with a z-statistic of 41.84(p < 0005). When first differences are taken and Equation (8)is estimated instead, the z-statistic is −1045 (p > 0005), whichfails to reject the null of no serial correlation. Therefore,estimation results based on first differences are preferred(Wooldridge 2010).

Standard ErrorsThe first-difference estimator controls completely for time-invariant unobserved heterogeneity, but it remains possi-ble that the standard errors are biased by serial correlation(Bertrand et al. 2004). Therefore all estimates are reportedusing the standard errors suggested by Newey and West(1987), which are robust to heteroskedasticity and serial cor-relation of unknown form. Clustered standard errors andnonparametric “bootstrap” standard errors were similar inmagnitude to the Newey–West standard errors and did notchange the qualitative conclusions. Wooldridge (2010) pro-vides a complete discussion.

Week Fixed EffectsWeek fixed effects are presented in Table A.1 as controlsfor seasonality in category search tendency and keywordchoice. Category search was lowest in the third week ofthe sample, 0.5% lower than in the baseline second week.It peaked in the fourteenth week of the sample, 38.7%higher than the baseline week. The baseline tendency tochoose branded keywords also varied over time.

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.

Joo et al.: Television Advertising and Online Search16 Management Science, Articles in Advance, pp. 1–18, © 2013 INFORMS

Table A.2 (Continued)

Category search Keyword choice Category search Keyword choice

Newey–West Newey–West Newey–West Newey–WestEst. std. err. Est. std. err. Est. std. err. Est. std. err.

Lagged advertising (29 hrs) 000048 000018∗∗ −00172 00175 Lagged advertising (77 hrs) 000042 000014∗∗ 00138 00154Lagged advertising (30 hrs) 000049 000018∗∗ −00183 00174 Lagged advertising (78 hrs) 000041 000014∗∗ 00131 00152Lagged advertising (31 hrs) 000050 000019∗∗ −00188 00174 Lagged advertising (79 hrs) 000039 000013∗∗ 00126 00150Lagged advertising (32 hrs) 000051 000019∗∗ −00189 00173 Lagged advertising (80 hrs) 000038 000013∗∗ 00123 00147Lagged advertising (33 hrs) 000052 000019∗∗ −00185 00173 Lagged advertising (81 hrs) 000036 000013∗∗ 00121 00145Lagged advertising (34 hrs) 000053 000020∗∗ −00177 00173 Lagged advertising (82 hrs) 000035 000012∗∗ 00119 00143Lagged advertising (35 hrs) 000054 000020∗∗ −00164 00173 Lagged advertising (83 hrs) 000033 000012∗∗ 00119 00140Lagged advertising (36 hrs) 000054 000020∗∗ −00149 00173 Lagged advertising (84 hrs) 000032 000012∗∗ 00118 00137Lagged advertising (37 hrs) 000055 000020∗∗ −00130 00173 Lagged advertising (85 hrs) 000030 000012∗∗ 00118 00135Lagged advertising (38 hrs) 000056 000020∗∗ −00108 00173 Lagged advertising (86 hrs) 000028 000012∗∗ 00116 00131Lagged advertising (39 hrs) 000056 000021∗∗ −00084 00174 Lagged advertising (87 hrs) 000027 000012∗∗ 00113 00128Lagged advertising (40 hrs) 000057 000021∗∗ −00059 00174 Lagged advertising (88 hrs) 000025 000012∗∗ 00108 001233Lagged advertising (41 hrs) 000057 000021∗∗ −00031 00175 Lagged advertising (89 hrs) 000023 000012 00099 00118Lagged advertising (42 hrs) 000058 000021∗∗ −00003 00176 Lagged advertising (90 hrs) 000021 000012 00086 00112Lagged advertising (43 hrs) 000058 000021∗∗ 00025 00176 Lagged advertising (91 hrs) 000019 000012 00066 00105Lagged advertising (44 hrs) 000058 000021∗∗ 00054 00177 Lagged advertising (92 hrs) 000017 000013 00039 00097Lagged advertising (45 hrs) 000059 000021∗∗ 00082 00178 Lagged advertising (93 hrs) 000015 000013 00002 00090Lagged advertising (46 hrs) 000059 000021∗∗ 00110 00178 Lagged advertising (94 hrs) 000013 000014 −00046 00087Lagged advertising (47 hrs) 000059 000021∗∗ 00137 00178 Lagged advertising (95 hrs) 000011 000014 −00107 00093

∗∗Significant at the 99% confidence level.

Table A.3 Day/Hour Fixed Effect Parameter Estimates

Category search Keyword choice

Newey–West Newey–WestEst. std. err. Est. std. err.

Weekday 1 a.m. −00371 00005∗∗ −90094 30514∗∗

Weekday 2 a.m. −00650 00009∗∗ −190643 30582∗∗

Weekday 3 a.m. −00851 00011∗∗ −170311 30634∗∗

Weekday 4 a.m. −00901 00013∗∗ −190306 30799∗∗

Weekday 5 a.m. −00812 00014∗∗ −20742 30690Weekday 6 a.m. −00485 00016∗∗ 40160 30629Weekday 7 a.m. −00055 00017∗∗ 240220 40010∗∗

Weekday 8 a.m. 00461 00018∗∗ 320410 30950∗∗

Weekday 9 a.m. 00804 00019∗∗ 440488 40011∗∗

Weekday 10 a.m. 00937 00018∗∗ 440481 30966∗∗

Weekday 11 a.m. 00962 00018∗∗ 430821 30967∗∗

Weekday noon 00913 00019∗∗ 440880 30954∗∗

Weekday 1 p.m. 00939 00020∗∗ 430972 30924∗∗

Weekday 2 p.m. 00955 00022∗∗ 430811 30971∗∗

Weekday 3 p.m. 00950 00022∗∗ 440021 30962∗∗

Weekday 4 p.m. 00912 00022∗∗ 430842 30974∗∗

Weekday 5 p.m. 00752 00020∗∗ 380060 40040∗∗

Weekday 6 p.m. 00669 00018∗∗ 260419 30945∗∗

Weekday 7 p.m. 00698 00017∗∗ 260860 40021∗∗

Weekday 8 p.m. 00740 00016∗∗ 290770 30886∗∗

Weekday 9 p.m. 00724 00014∗∗ 210931 30751∗∗

Weekday 10 p.m. 00595 00010∗∗ 220363 30874∗∗

Weekday 11 p.m. 00338 00007∗∗ 120034 30338∗∗

Weekend midnight 00067 00012∗∗ 20379 70567Weekend 1 a.m. −00233 00026∗∗ −60906 80147Weekend 2 a.m. −00531 00028∗∗ −150228 70772Weekend 3 a.m. −00757 00027∗∗ −180421 70679∗∗

Weekend 4 a.m. −00847 00032∗∗ −140926 70733Weekend 5 a.m. −00880 00028∗∗ −130538 70693Weekend 6 a.m. −00681 00030∗∗ −10379 70450Weekend 7 a.m. −00298 00033∗∗ 200490 70245∗∗

Weekend 8 a.m. 00109 00032∗∗ 160891 70203∗∗

Weekend 9 a.m. 00369 00029∗∗ 270072 70354∗∗

Weekend 10 a.m. 00493 00028∗∗ 280180 70300∗∗

Weekend 11 a.m. 00553 00026∗∗ 260779 70244∗∗

Table A.3 (Continued)

Category search Keyword choice

Newey–West Newey–WestEst. std. err. Est. std. err.

Weekend noon 00560 00025∗∗ 310015 70330∗∗

Weekend 1 p.m. 00572 00025∗∗ 270231 70337∗∗

Weekend 2 p.m. 00595 00026∗∗ 360510 70385∗∗

Weekend 3 p.m. 00592 00027∗∗ 320692 70288∗∗

Weekend 4 p.m. 00596 00030∗∗ 280062 70417∗∗

Weekend 5 p.m. 00591 00031∗∗ 290132 70360∗∗

Weekend 6 p.m. 00582 00032∗∗ 270634 70413∗∗

Weekend 7 p.m. 00632 00035∗∗ 350117 70854∗∗

Weekend 8 p.m. 00689 00039∗∗ 300201 80052∗∗

Weekend 9 p.m. 00691 00032∗∗ 330279 80306∗∗

Weekend 10 p.m. 00567 00025∗∗ 250718 70813∗∗

Weekend 11 p.m. 00348 00017∗∗ 180908 70940∗∗

∗∗Significant at the 99% confidence level.

For completeness, Tables A.2 and A.3 present the param-eter estimates and standard errors used to construct Fig-ures 5, 6, 8, and 9.

ReferencesAdAge (2011) Agency report 2011 index. Accessed April 24, 2013,

http://adage.com/article/datacenter-agencies/agency-report-2011-index/226900/.

Almon S (1965) The distributed lag between capital appropriationsand expenditures. Econometrica 41(4):775–788.

Arellano M, Bond S (1991) Some tests of specification for paneldata: Monte carlo evidence and an application to employmentequations. Rev. Econom. Stud. 58(2):277–297.

Assael H (2011) From silos to synergy: A fifty-year review of cross-media research shows synergy has yet to achieve its full poten-tial. J. Advertising Res. 51(1):42–48.

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.

Joo et al.: Television Advertising and Online SearchManagement Science, Articles in Advance, pp. 1–18, © 2013 INFORMS 17

Ataman MB, van Heerde HJ, Mela CF (2010) The long-term effectof marketing strategy on brand performance. J. Marketing Res.47(5):866–882.

Bergemann D, Bonatti A (2011) Targeting in advertising markets:Implications for offline vs. online media. RAND J. Econom.42(3):417–443.

Berry ST (1994) Estimating discrete choice models of product dif-ferentiation. RAND J. Econom. 25(2):242–262.

Bertrand M, Duflo E, Mullainathan S (2004) How much shouldwe trust differences-in-differences estimates? Quart. J. Econom.119(1):249–275.

Bettman J, Park CW (1980) Effects of prior knowledge and expe-rience and phase of the choice process on consumer decisionprocesses: A protocol analysis. J. Consumer Res. 7(3):234–248.

Brucks M (1985) The effects of product class knowledge on infor-mation search behavior. J. Consumer Res. 12(1):1–16.

Bureau of Labor Statistics (2011) American time use survey, Table 1.Accessed April 24, 2013, http://www.bls.gov/news.release/atus.t01.htm.

Clarke DG (1976) Econometric measurement of the duration ofadvertising effect on sales. J. Marketing Res. 13(4):345–357.

comScore (2012) comScore releases July 2012 U.S. search enginerankings. Accessed April 24, 2013, http://www.comscore.com/Press_Events/Press_Releases/2012/8/comScore_Releases_July_2012_U.S._Search_ Engine_Rankings.

Danaher PJ, Rossiter JR (2011) Comparing perceptions of marketingchannels. Eur. J. Marketing 45(1/2):6–42.

Davidson R, MacKinnon JG (1993) Estimation and Inference in Econo-metrics (Oxford University Press, New York).

eMarketer (2012) Traditional media still most trusted sources ofinfo. Accessed April 24, 2013, http://www.emarketer.com/Article.aspx?R=1009182.

Enge E (2012) Integrated marketing: Why search needs a largeseat at the table. Search Engine Watch (April 8), http://searchenginewatch.com/article/2166526/Integrated-Marketing-Why-Search-Needs-a-Large-Seat-at-the-Table.

Goldfarb A, Tucker CE (2011) Search engine advertising: Chan-nel substitution when pricing ads to context. Management Sci.57(3):458–470.

Gujarati DN (2003) Basic Econometrics, 4th ed. (McGraw-Hill/Irwin).

Internet Advertising Bureau (2012) IAB Internet advertising rev-enue report. Accessed April 24, 2013, http://www.iab.net/AdRevenueReport.

iProspect (2007) Offline channel influence on online search behav-ior study. Accessed March 1, 2011, http://www.iprospect.com/premiumPDFs/researchstudy_2007_offlinechannelinfluence.pdf.

Janiszewski C (1993) Preattentive mere exposure effects. J. ConsumerRes. 20(3):376–392.

Jerath K, Sayedi A (2011) Exclusive display in sponsoredsearch advertising. Unpublished manuscript, Carnegie MellonUniversity, Pittsburgh.

Jerath K, Ma L, Park YH, Srinivasan K (2011) A “position paradox”in sponsored search auctions. Marketing Sci. 30(4):612–627.

Joo M, Wilbur KC, Zhu Y (2013) Effects of television adver-tising on Internet search. Unpublished manuscript, OhioState University, Columbus. Accessed April 24, 2013, http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1720713.

Katona Z, Sarvary M (2010) The race for sponsored links: Biddingpatterns for search advertising. Marketing Sci. 29(2):199–215.

Kim A, Balachander S (2010) Coordinating traditional mediaadvertising and search advertising. Unpublished manuscript,Purdue University, West Lafayette, IN.

Lewis R, Nguyen D (2012) Display advertising’s impact ononline branded search. Unpublished manuscript, Yahoo!Accessed April 24, 2013, http://conference.nber.org/confer/2012/SI2012/PRIT/Lewis_Nguyen.pdf.

Lewis RA, Reiley DH (2011) Does retail advertising work?Measuring the effects of advertising on sales via a con-trolled experiment at Yahoo! Unpublished manuscript, Yahoo!Accessed April 24, 2013, http://www.davidreiley.com/papers/DoesRetailAdvertisingWork.pdf.

Lewis RA, Reiley DH (2013) Down-to-the-minute effects of SuperBowl advertising on online search behavior. 14th ACM Conf.Electronic Commerce 9(4):Article 61.

Lodish LM, Abraham M, Kalmenson S, Livelsberger J, Lubetkin B,Richardson B, Stevens ME (1995) How TV advertising works:A meta-analysis of 389 real world split cable TV advertisingexperiments. J. Marketing Res. 32(2):125–139.

Manchanda P, Dube JP, Goh KY, Chintagunta PK (2006) The effectof banner advertising on Internet purchasing. J. Marketing Res.43(1):98–108.

Moorman C, Diehl K, Brinberg D, Kidwell B (2004) Subjectiveknowledge, search locations, and consumer choice. J. ConsumerRes. 31(3):673–680.

Naik PA, Peters K (2009) A hierarchical marketing communicationsmodel of online and offline media synergies. J. Interactive Mar-keting 23(4):288–299.

Naik PA, Raman K (2003) Understanding the impact of synergy inmultimedia communications. J. Marketing Res. 13(4):375–388.

Newey WK, West KD (1987) A simple, positive semi-definite,heteroskedasticity and autocorrelation consistent covariancematrix. Econometrica 55(3):703–708.

Newman JW, Staelin R (1973) Information sources for durablegoods. J. Advertising Res. 13(2):19–29.

Nielsen (2011) State of the Media 2010: Audiences and devices.Accessed April 24, 2013, http://blog.nielsen.com/nielsenwire/wp-content/uploads/2011/01/nielsen-media-fact-sheet-jan-11.pdf.

Papadimitriou P, Garcia-Molina H, Krishnamurthy P, Lewis R,Reiley D (2011) Display advertising impact: Search lift andsocial influence. Proc. 17th ACM SIGKDD Internat. Conf. Knowl-edge Discovery and Data Mining (ACM, New York), 1019–1027.

Park CW, Mothersbaugh DL, Feick L (1994) Consumer knowledgeassessment. J. Consumer Res. 21(1):71–82.

Pfeiffer M, Zinnbauer M (2010) Can old media enhance new media?How traditional advertising pays off for an online social net-work. J. Advertising Res. 50(1):42–49.

Radecki CM, Jaccard J (1995) Perceptions of knowledge, actualknowledge and information search behavior. J. Experiment. Soc.Psych. 31(2):107–138.

Rutz OJ, Bucklin RE (2011) From generic to branded: A modelof spillover in paid search advertising. J. Marketing Res.48(1):87–102.

Rutz OJ, Bucklin RE (2012) Does banner advertising affect brows-ing for brands? Clickstream choice model says yes, for some.Quant. Marketing Econom. 10(2):231–257.

Rutz OJ, Trusov M (2011) Zooming in on paid search ads—Aconsumer-level model calibrated on aggregated data. Market-ing Sci. 30(5):789–800.

Sayedi A, Jerath K, Srinivasan K (2011) Competitive poaching insponsored search advertising and strategic impact on tradi-tional advertising. Unpublished manuscript, Carnegie MellonUniversity, Pittsburgh.

Schweidel DA, Kent RJ (2010) Predictors of the gap between pro-gram and commercial audiences: An investigation using livetuning data. J. Marketing 74(3):18–33.

Shapiro S (1999) When an ad’s influence is beyond our consciouscontrol: Perceptual and conceptual fluency effects caused byincidental ad exposure. J. Consumer Res. 26(1):16–36.

Shapiro S, MacInnis DJ, Heckler SE (1997) The effects of incidentalad exposure on the formation of consideration sets. J. ConsumerRes. 24(1):94–104.

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.

Joo et al.: Television Advertising and Online Search18 Management Science, Articles in Advance, pp. 1–18, © 2013 INFORMS

Swasy JL, Rethans AJ (1986) Knowledge effects on curiosity andnew product advertising. J. Advertising 15(4):28–34.

Television Bureau of Advertising (2012) TV basics. Accessed April24, 2013, http://www.tvb.org/media/file/TV_Basics.pdf.

Thomas JJ (1977) Some problems in the use of Almon’s tech-nique in the estimation of distributed lags. Empirical Econom.2(3):175–193.

U.S. Census Bureau (2011) U.S. QuickFacts. Accessed April 24, 2013,http://quickfacts.census.gov/qfd/states/00000.html.

Vakratsas D, Ma Z (2005) A look at the long-run effectiveness ofmultimedia advertising and its implications for budget alloca-tion decisions. J. Advertising Res. 45(2):241–254.

Wiesel T, Pauwels K, Arts J (2011) Marketing’s profit impact: Quan-tifying online and offline funnel progression. Marketing Sci.30(4):604–611.

Wilbur KC (2008) A two-sided, empirical model of television adver-tising and viewing markets. Marketing Sci. 27(3):356–378.

Wilbur KC, Zhu Y (2009) Click fraud. Marketing Sci. 28(2):293–308.

Wooldridge JM (2010) Econometric Analysis of Cross Section and PanelData, 2nd ed. (MIT Press, Cambridge, MA).

Yang S, Ghose A (2010) Analyzing the relationship between organicand sponsored search advertising: Positive, negative, or zerointerdependence? Marketing Sci. 29(4):602–623.

Yao S, Mela CF (2011) A dynamic model of sponsored search adver-tising. Marketing Sci. 30(5):447–468.

Zhu Y, Wilbur KC (2010) Hybrid advertising auctions. MarketingSci. 30(2):249–273.

Zigmond D, Stipp H (2010) Assessing a new advertising effect:Measurement of the impact of television commercials on Inter-net search queries. J. Advertising Res. 50(2):162–168.

Copyright:

INFORMS

holdsco

pyrig

htto

this

Articlesin

Adv

ance

version,

which

ismad

eav

ailableto

subs

cribers.

The

filemay

notbe

posted

onan

yothe

rweb

site,includ

ing

the

author’s

site.Pleas

ese

ndan

yqu

estio

nsrega

rding

this

policyto

perm

ission

s@inform

s.org.