||This article possibly contains original research. (September 2012)|
Ad filtering or ad blocking is removing or altering advertising content in a webpage. Advertising can exist in a variety of forms including pictures, animations, embedded audio and video, text, or pop-up windows and can employ autoplay of audio and video. It is a known problem with most web browsers, including Firefox, that restoring sessions often plays multiple embedded ads at once. All browsers offer some solution to the problem, either by targeting technologies (Flash/Shockwave, Window Media files, etc.) that are used to deliver ads, targeting URLs that are the source of ads, or targeting behavioural characteristic of ads (such as the use of HTML5 autoplay of both audio and video).
- 1 Benefits
- 2 Methods
- 3 Browser integration
- 4 External programs
- 5 Hosts file and DNS manipulation
- 6 By external parties and internet providers
- 7 Economic consequences for online business
- 8 Advertiser offensive countermeasures and justifications
- 9 See also
- 10 References
- 11 External links
To users, the benefits of ad blocking include quicker loading and cleaner looking Web pages free from advertisements, lower resource waste (bandwidth, CPU, memory, etc.), and privacy benefits gained through the exclusion of the tracking and profiling systems of ad delivery platforms. Blocking ads can also save substantial amounts of energy.
Another important aspect is improving security, according to some research online advertising subjects users to a higher risk of infecting their devices than surfing porn sites. In a high profile case malware was distributed through advertisements provided to YouTube by a malicious customer of Google's Doubleclick.
Users who pay for total transferred bandwidth ("capped" or pay-for-usage connections) including most mobile users worldwide, have a direct financial benefit from filtering an ad before it is loaded. Streaming audio and video, even if they are not presented to the user interface, can rapidly consume gigabytes of transfer especially on a faster 4G connection. In Canada, where users without a data plan often pay C$0.50/megabyte ($500/gigabyte) for at least the first 50-100MB exceeding their data allowance, the cost of tolerating ads can be intolerable. Even fixed connections are often subject to usage limits, especially the faster connections (100Mbit/s and up) which can quickly saturate a network if filled by streaming media. "The extent of unlimited bandwidth plans is often grossly over-estimated by US and European users and advertisers. This problem affects other countries, especially those with bandwidth limitations on their global Internet connections, or those that have poor regulatory or effective monopoly providers."[this quote needs a citation]
To advertisers, the benefits include not angering or annoying users into blocking, defaming or boycotting their products or websites. Few advertisers actually intend to anger end users. Very sophisticated filtering and anti-spam techniques can involve active defenses which can shut down an advertiser's domains or brokers, ban them from searches or target them for other countermeasures. Some countries have even considered banning the use of certain ports, e.g. South Korea's proposed ban on port 25 used by SMTP. Future countermeasures would be likely to include bans on ads South Koreans are unlikely to want or even ad brokering services. Ad substituting is also a legal and common practice already, for instance in Canadian cable TV where regulations permit showing a Canadian channel with Canadian ads instead of a US channel with US ads, where both are broadcasting the show simultaneously - this practice has spread to the web with some cable Internet providers uniformly substituting foreign ads for local ones, for which they receive a share of the revenue. Avoiding national, provider or technological interference with their ads is a priority for advertisers and especially brokers of advertising, to whom it could be fatal.
A very common method of filtering is simply to block (or prevent autoplay of) Flash animation or image loading or Windows audio and video files. This can be done in most browsers easily and also improves security and privacy. This crude technological method is refined by numerous browser extensions. Every internet browser handles this task differently, but, in general, one alters the options, preferences or application extensions to filter specific media types. An additional add-on is usually required to differentiate between ads and non-ads using the same technology, or between wanted and unwanted ads or behaviors.
The more advanced filters allow fine-grained control of advertisements through features such as blacklists, whitelists, and regular expression filters. Certain security features also have the effect of disabling some ads. Some antivirus software can act as an ad blocker.
Filtering by intermediaries such as providers or national governments is increasingly common. See below especially re provider ad substitution and national root DNS.
A number of external applications offer ad filtering as a primary or additional feature. A traditional solution is to customize an HTTP proxy (or web proxy) to filter content. These programs work by caching and filtering content before it is displayed in a user's browser. This provides an opportunity to remove not only ads but also content which may be offensive, inappropriate, or simply junk. Popular proxy software which blocks content effectively include AdGuard, Privoxy, Squid, Ad Muncher and Diladele Web Safety. The main advantage of the method is freedom from implementation limitations (browser, working techniques) and centralization of control (the proxy can be used by many users).
Proxies are very good at filtering but have several limitations compared to browser based solutions:
- difficulty to filter https/SSL traffic
- full webpage context is not available to the filter
Hosts file and DNS manipulation
These methods prevent the browser from accessing an ad server by manipulating the name resolution. While simple to implement these methods are also very easy to circumvent. One method to circumvent this form of ad filtering is to load ads from servers with hardcoded IP, thus skipping name resolution altogether. Another method to evade this form of filtering is to load the advertisements from a server which also serves the main content - blocking name resolution of this server would also block the useful content of the site.
- Further information: hosts file.
Manipulating the hosts file exploits the fact that most operating systems store a file with IP address, domain name pairs which is consulted by most browsers before using a DNS server to look up a domain name. By assigning the loopback address to each known ad server, the user directs traffic intended to reach each ad server to the local machine. Running a suitable web server locally the ad content can be replaced with anything the user wishes.
This method operates by filtering and changing records of a DNS cache. On most operating systems the domain name resolution always goes via DNS cache. By changing records within the cache or preventing records from entering the cache, programs are allowed or prevented from accessing domain names. The external programs like Portable DNS Cache and Firewall monitor internal DNS cache and import DNS records from a file. As a part of the domain name resolution process, a DNS cache lookup is performed before contacting a DNS server. Thus its records take precedence over DNS server queries. Unlike the method of modifying a Hosts file, this method is more flexible as it uses more comprehensive data available from DNS cache records.
Advertising can be blocked by using a DNS server which is configured to block access to domains or hostnames which are known to serve ads.
Manipulating DNS is a widely employed method to manipulate what the end user sees from the internet but can also be deployed locally for personal purposes.
China runs its own root DNS and the EU has considered the same. Google has required their Google Public DNS be used for some applications on its Android devices. Accordingly, DNS addresses / domains used for advertising may be extremely vulnerable to a broad form of ad substitution whereby a domain that serves ads is entirely swapped out with one serving more local ads to some subset of users. This is especially likely in countries, notably Russia, India and China, where advertisers often refuse to pay for clicks or page views. DNS-level blocking of domains for non-commercial reasons is already common in China.
By external parties and internet providers
Internet providers, especially mobile operators, frequently offer proxies designed to reduce network traffic. Even when not targeted specifically at ad-filtering, these proxy-based arrangements will block many types of advertisements that are too large or bandwidth-consuming, or that are otherwise deemed unsuited for the specific internet connection or target device.
Many internet operators block some form of advertisement and inject their own.
Economic consequences for online business
One consequence of widespread ad blocking is decreased revenue to a website sustained by advertisements, where this blocking can be detected.
A number of website operators, who use online advertisements to fund the hosting of their websites, argue that the use of ad-blocking software risks cutting off their revenue stream. While some websites have successfully implemented subscription and membership based systems for revenue, the majority of websites today rely on online advertising to function.
Advertiser offensive countermeasures and justifications
Some websites have taken counter-measures against ad-blocking software, such as attempting to detect the presence of ad blockers and informing users of their views, or outright preventing users from accessing the content unless they disable the ad-blocking software. There have been several arguments supporting and opposing the assertion that blocking ads is wrong.
- Commercial skipping
- Ad server
- Adversarial information retrieval
- Hosts file filtering
- Proxy server#Content filter
- Pop-up ads
- Plain text
- Ad banners
- Flash animations
- Keyword hyperlinks
- "Upon startup multiple audio sources begin playing. I can't find the tab to kill them! | Firefox Support Forum | Mozilla Support". Support.mozilla.org. Retrieved 2013-10-26.
- "Internet Security". SecTheory. 2008-10-24. Retrieved 2013-10-26.
- Danchev, Dancho (2011-11-15). "South Korea to block port 25 as anti-spam countermeasure". ZDNet. Retrieved 2013-10-26.
- Paul Thurrott. "IE8: Ad blocking with the InPrivate Filter". Retrieved 5 October 2009.
- "Verigio Communications - Portable DNS Cache and Firewall for Windows". Verigio.com. Retrieved 2013-10-26.
- "Block annoying ads, unblock US Netflix, and more". Ad-free time!. 2013-08-13. Retrieved 2013-10-26.
- "The Extent of DNS Services Being Blocked in China". Circleid.com. 2010-05-21. Retrieved 2013-10-26.
- Fisher, Ken (2010-03-06). "Why Ad Blocking is devastating to the sites you love". Ars Technica. Retrieved 2013-10-26.
- "Ad Blocking is Immoral | The Google Cache: Search Engine Marketing, SEO & PPC". The Google Cache. 2007-08-02. Retrieved 2011-11-04.
- "Adblock: Adapt, or die.Service Assurance Daily: Anything and everything that affects IT performance, from the mundane to the bizarre - Network Performance Blog". Networkperformancedaily.com. 2007-09-05. Retrieved 2011-11-04.
- Kirk, Jeremy (2007-08-23). "Firefox ad-blocker extension causes angst | Applications". InfoWorld. Retrieved 2011-11-04.
There is ongoing research with respect to AdBlock countermeasures