Semrush logo
  • Products

    Start Here

    • Semrush One
    • Enterprise
    • Features
    • Request a Demo
    • Talk to Sales

    Find the Right Tools

    • AI Visibility Toolkit
    • SEO Toolkit
    • Traffic & Market Toolkit
    • Content Toolkit
    • Local Toolkit
    • Social Toolkit
    • Advertising Toolkit
    • PR Toolkit

    Platform

    • Integrations
    • App Center
    • API
    • Data Sources

    Top Apps

    • AdClarity
    • Exploding Topics
    • Other apps
  • Pricing
  • Resources

    Grow with Semrush

    • Blog
    • Knowledge Base
    • Academy
    • Success Stories
    • AI Visibility Index
    • Webinars
    • News

    Explore Free Tools

    • AI Visibility Checker
    • SEO Checker
    • Website Traffic Checker
    • Keyword Tool
    • Backlink Checker
    • Top Websites by Traffic
    • Explore Other Free Tools

    About Semrush

    • About Us
    • Stats and Facts
    • Integrations
    • Affiliate Program
    • Contact us
  • Enterprise
Log InSign Up
  • News
  • Data & Insights
  • Company News
  • Product News
  • Press Kit
Search icon
Semrush logo
  • Products
  • Pricing
  • Resources
  • Enterprise
  • News
  • Data & Insights
  • Company News
  • Product News
  • Press Kit
Log InSign Up

Start Here

  • Semrush One
  • Enterprise
  • Features
  • Request a Demo
  • Talk to Sales

Find the Right Tools

  • AI Visibility Toolkit
  • SEO Toolkit
  • Traffic & Market Toolkit
  • Content Toolkit
  • Local Toolkit
  • Social Toolkit
  • Advertising Toolkit
  • PR Toolkit

Platform

  • Integrations
  • App Center
  • API
  • Data Sources

Top Apps

  • AdClarity
  • Exploding Topics

Grow with Semrush

  • Blog
  • Knowledge Base
  • Academy
  • Success Stories
  • AI Visibility Index
  • Webinars
  • News

Explore Free Tools

  • AI Visibility Checker
  • SEO Checker
  • Website Traffic Checker
  • Keyword Tool
  • Backlink Checker
  • Top Websites by Traffic
  • Explore Other Free Tools

About Semrush

  • About Us
  • Stats and Facts
  • Integrations
  • Affiliate Program
  • Contact us
Main page /Product News

Log File Analyzer – Open Beta

December 3, 2018
Log File Analyzer – Open Beta
What do ‘sea’ and ‘SEO’ have in common aside from their similar spelling? You’re going to need reliable equipment to dive deep into both. The solution for the first was invented a long time ago, and now it’s time to deal with the second.
Today we’re celebrating the beta launch of our new and very promising product. Please meet our innovative Log File Analyzer – a tool that will allow you to take a look at your site from the perspective of a Googlebot.

What is it for?

  • What errors were found during the crawl?
  • What are your most crawled pages?
  • Do you spend your crawl budget efficiently?
No questions unanswered and stones unturned now! With Log File Analyzer you will clearly understand what happens when a search engine crawls your website.
The tool will allow you to:
  • eliminate structural and navigational issues affecting the accessibility of your site’s pages
  • track the occurrence of technical problems (broken pages, incorrect redirects, etc.)
  • optimize consumption of your crawl budget
  • track and analyze the behavior of different bots on your site separately (mobile, desktop)
  • check if your website has successfully gone through migration
  • understand how Googlebot prioritizes content
  • make sure you spend resources on content production wisely

How does it work?

Find the Log File Analyzer in our left-hand menu in the On Page & Tech SEO block, or just select All Tools. Make sure that your log file is unarchived and in the proper access.log file format. We’ve described the proper file format in this PDF manual. Use the link in the description.
6.png
Then you simply drag and drop your file into the form on the Log File Analyzer page to upload your file to the tool.
After all of your files have been uploaded, click on Start Log File Analyzer and ... here you go: all the useful data, including how a Googlebot’s behavior changed over time, consistency of response statuses for tracking issues, the paths that received the most hits by the bot in the time frame, and much more.
7.png
8.png
You can use the All Google Bots filter to show only desktop or mobile bot activity, and also adjust the time period. The charts on the right will tell you how many of each status code and file type the bots interacted with.
9.png
That's all for today. There’s no need to analyze log files manually, no matter how skilled you are. The formula is simple: take Site Audit, add our new Log File Analyzer and find answers to any questions related to technical SEO!
Enough with the theory, let’s get to the practice! Give our new tool a try and let us know what you think by hitting us up with an email at log-analysis@semrush.com.
Want to learn more about crawlability and indexability of a website? Check out this article.
Become a technical SEO guru. Try out the tool.

Download as

PDF
DOCX

Share

Relevant news

YouTube Gap Analyzer Now Available in the Semrush App Center

Semrush has introduced YouTube Gap Analyzer to its App Center, expanding the range of tools available to marketers and creators working with video.
Product News
April 22, 2026

Semrush Introduces LLM Gap Analyzer to the App Center

The LLM Gap Analyzer app helps marketers understand how and why their content appears in large language models, and just as importantly, why it does not.
Product News
April 21, 2026

Voice Assist Added to the Semrush App Center

Semrush has expanded the App Center offering with Voice Assist, an AI voice assistant developed by CallRail.
Product News
April 20, 2026

Get started with Semrush today

Try Semrush free for seven days. Cancel anytime.

Start free trial
  • Semrush One
  • Features
  • Pricing
  • Free Trial
  • Compare Semrush
  • Success Stories
  • Stats and Facts
  • Affiliate Program
  • Enterprise SEO
  • Enterprise AIO
  • Enterprise SI
  • Insights24
  • Mfour
  • App Center
  • Top Websites
  • Free Tools
  • Sensor
  • About Us
  • News
  • Careers
  • Partners
  • For Investors
  • Semrush Select
  • Global Issues Index
  • Contact us
  • Knowledge Base
  • Academy
  • API
Community
  • Semrush Blog
  • Webinars
  • Ambassador Program
LinkedInInstagramTikTokYouTubeFacebookX
© 2008 - 2026 Semrush. All rights reserved.
Privacy PolicyTerms of ServiceCookies Settings
Semrush