| LoneStarBot/1.06 is the parsing agent used to populate our building contractor search database. The signature UA (user agent) string in your log files is;
Mozilla/5.0 (compatible; LoneStarBot/1.06;+http://www.dareddconstruction.com/bot.htm) ... and it comes from the dedicated ip address of 67.20.109.179.
LoneStarBot obeys all internet protocols, including robots.txt and meta NoIndex/NoFollow tags.
LoneStarBot only collects page titles, descriptions, and urls (web addresses), and in turn lists these in our index according to keyword relevance.
LoneStarBot was built by, and is maintained by our web developer, Southeast Texas Web Development. If you have any questions regarding the LoneStarBot, feel free to contact us. |
