Not verified. Are you owner ?
sponsored links

List of User-Agents (Spiders, Robots, Browser)

A searchable database of interesting user-agents - Search engine spiders, crawler, robots

Main page screenshot of user-agents.org
Popularity
 
5.0 out of 5 by PressAboutUs
Icons
Reviewed on Jun 13st, 2015
  • Press about user-agents.org

  • user-agents.org writes about

  • Social about user-agents.org

Do you know new review about this site?
Suggest a new review!
  •  

    github.com Internet.userAgent() by aratak · Pull Request #16 · Marak/Faker.js · GitHub

    Json file has been converted from xml: http://www.user-agents.org/allagents.xml Internet.userAgent() Read article

    Relevance
     
    Find useful? Yes
  •  

    isaserver.it Blog di ISAserver.it - Luca Conte: User-Agent - un motore di ricerca

    Iscriviti alla newsletter ISAserver.it - No. 1 Unofficial European web site on Microsoft ISA Server / Forefront TMG Inserisci i termini di ricerca Invia modulo di ricerca User-Agent - un motore di ricerca Se siete alla ricerca delle stringhe User-Agent da inserire nei vostri HTTP Filter e non sap... Read article

    Relevance
     
    Find useful? Yes
  •  

    cogo.wordpress.com New proposal for the Zend Framework | Christer's blog o' fun

    Lets say we have a mvc based application and we would like to make different views for different clients (mobile phones, smart phones, browsers, rss readers and so on)… This could then be done by asking Zend_UserAgent what type of device we are dealing with and present the correct view for the cl... Read article

    Relevance
     
    Find useful? Yes
  •  

    dougboude.com Sneaking Spiders Past Security

    I found what appears to be a VERY comprehensive list of spider user agent values (and other metadata) at this url: http://www.user-agents.org/index.shtml . They also offer RSS and XML feeds if anybody wants to do something really cool with the data. Read article

    Relevance
     
    Find useful? Yes
  •  

    bruceclay.com SEO - Handling Multilingual Sites for Humans and Search Engines - Bruce Clay

    A couple of interesting things, the User Agent and the language of the browser: $_SERVER["HTTP_USER_AGENT"]; Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534.30 (KHTML, like Gecko) Chrome/12.0.742.91 Safari/534.30 Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0) Mozilla/5... Read article

    Relevance
     
    Find useful? Yes
  •  

    edin.no-ip.com Security | edin.no-ip.com

    Setting this up is very simple. In case of Debian, install Fail2ban with: apt-get install fail2ban Then check /etc/fail2ban/filter.d/apache-badbots.conf and you will find a well pre-defined blocking list, which fetched from http://www.user-agents.org . What you need to do is active this filtering... Read article

    Relevance
     
    Find useful? Yes
  •  

    inceptor.com Hiding Content from Search Engines | Inceptor Blog

    You can find a list of search engine crawler names at User-Agents.org . Disallow is page or directory you want to block. Disallow: / to block access to the entire website. Disallow: /private_page.html to block access to a page. Disallow: /private_directory/ to block access to a directory. Robots ... Read article

    Relevance
     
    Find useful? Yes
  •  

    lab.xceptance.de XLT - Release Notes

    This means, you will not be able to distinguish XLT requests from normal browser requests on the server side. Setting this property does not change the internal browser handling that can be configured using the known property com.xceptance.xlt.browser. Only the transfered agent name will change. ... Read article

    Relevance
     
    Find useful? Yes
  •  

    oddmuse.org Oddmuse: Comments on Small Screens

    First, you need to identify the user agents you want to redirect. This is how browsers identify themselves. See http://www.user-agents.org/ and http://webcab.de/wapua.htm for two lists I managed to find. My test setup just tested for a Mozilla browser. You probably need to replace ^Mozilla with ^... Read article

    Relevance
     
    Find useful? Yes
  •  

    stackoverflow.com Php - Tell bots apart from human visitors for stats? - Stack Overflow

    I am looking to roll my own simple web stats script. The only major obstacle on the road, as far as I can see, is telling human visitors apart from bots. I would like to have a solution for that which I don't need to maintain on a regular basis (i.e. I don't want to update text files with bot-rel... Read article

    Relevance
     
    Find useful? Yes
  •  

    markbeljaars.com MarkBeljaars.com - Spam

    Google has many different user-agents used to index your site, extract images and videos, find news feeds, find mobile phone content, check your site for Adsense quality and so on. This site details a complete list of known user-agents. The robots.txt file has been around for ages. It was actuall... Read article

    Relevance
     
    Find useful? Yes
  •  

    weba20.com User-Agents.org - Navegadores

    User-Agents.org es una enorme base de datos en línea, que recopila toda la información posible sobre la identificación de navegadores, bots, lectores RSS o Read article

    Relevance
     
    Find useful? Yes
  •  

    lightspeedretail.com Scraping Links With PHP | LightSpeed Cloud Blog

    Search Engine User Agents Browser User Agents Common User Agents Tip: Fake Your User Agent Scrape Links From Any Web Page Using PHP. This Tutorial Will Show You How: cURL, PHPDOM, and XPath explained. Read article

    Relevance
     
    Find useful? Yes
  •  

    outofcontrol.ca Out of Control

    Note that you really should look through all the User Agents and be sure you are not blocking someone or some software that you would like to keep. The list above is far from complete, but is a good start. For a fairly up-to-date list of User Agents you will find a useful User Agent database here... Read article

    Relevance
     
    Find useful? Yes
  •  

    swebdizajn.com Google index stranica, sitemap.xml mapa sajta - Pravljenje sitemapa

    10/09/2010 Kategorija: Internet Google indeks page Značaj datoteke Robots.txt Ukoliko bi ste želeli da zabranite indeksiranje sajta i pristup bootovima, upisaćete samo sledeći kod: User-agent: * Disallow: / Ukoliko želite da od pretraživača sakrijete neki folder na sajtu, iza kose crte upisaćete ... Read article

    Relevance
     
    Find useful? Yes

Twitter about user-agents.org

Facebook about user-agents.org

Get weekly email alerts

Follow user-agents.org

Get every new review delivered to your Inbox.