1.4.0 Major Release – Google Pagespeed Scores!

  • Facebook
  • Twitter
  • Reddit

This is an old version

New version is here

Need Support?

Reply to a comment with your real email address and real URL in this post and I’ll get back to you.

Whats in the update?

New Feature – Google Pagespeed Check

You can now check Google Pagespeed score for free and bulk on all your links! Just follow this easy tutorial to get an API key and then you are good to go! Then on the app just right click the link you want:

 

Bug Fixes

  • Able to search websites with ports example.com:8000
  • Fixed robots.txt missing breaking crawl

Add comment

69 comments

  1. Ralf
    04 . Feb . 2025

    I’ve downloaded the jar-Version, but when running it, I get “A Java Execption has occurred” from Java-VM Launcher.

    Java 1.8.0_441-b07 is installed and it’s a Win11Pro machine

    • G
      04 . Feb . 2025

      Hey Ralf, can you try installing the Windows version instead? Let me know if it works.

      Thanks.

  2. Braulio
    06 . Feb . 2025

    I’ve found around 300 not found (404) pages. I want to quickly export all the “incoming links” for all of these, so I can edit the source, as sometimes the URLs are “hardcoded” in the content rather than being called dynamically. Is there any way to do this?

    • G
      07 . Apr . 2025

      No but good idea. Thanks

  3. Gene
    06 . Feb . 2025

    Thank you for this brilliant resource! One question: is there something in the settings that would lessen the load on my server? I noticed while crawling or even while loading a previous crawl my server CPU, RAM, and I/O all peak at 100.

    • G
      07 . Apr . 2025

      If you’re website can’t take it there is problem with your site, which I would check. But its a good idea and i’ll implement it in the future. Thanks

  4. John A
    08 . Feb . 2025

    Awesome tool, thanks for doing this!

    Small issue. It seems to be parsing .svg files, which are text but not html so it complains about missing components.
    Does not fail, but it is a little distracting.

    Property Value
    Url Address https://10.0.0.10/img/pycro-nano-arduino.svg
    Filters Matched Title Is Missing, Meta Description Missing, No H1 Header

  5. John A
    14 . Feb . 2025

    Running v1.4.0. Worked fine several runs across a local server and a remote one. Got an exception today for some reason:
    Exception in thread “AWT-EventQueue-0” java.lang.ArrayIndexOutOfBoundsException: Index 24 out of bounds for length 24
    at java.desktop/javax.swing.DefaultRowSorter.setModelToViewFromViewToModel(DefaultRowSorter.java:745)
    at java.desktop/javax.swing.DefaultRowSorter.rowsInserted0(DefaultRowSorter.java:1078)
    at java.desktop/javax.swing.DefaultRowSorter.rowsInserted(DefaultRowSorter.java:879)
    at org.jdesktop.swingx.sort.DefaultSortController.rowsInserted(DefaultSortController.java:403)
    at java.desktop/javax.swing.JTable.notifySorter(JTable.java:4338)
    at java.desktop/javax.swing.JTable.sortedTableChanged(JTable.java:4186)
    at java.desktop/javax.swing.JTable.tableChanged(JTable.java:4463)
    at org.jdesktop.swingx.JXTable.tableChanged(JXTable.java:1529)
    at java.desktop/javax.swing.table.AbstractTableModel.fireTableChanged(AbstractTableModel.java:302)
    at java.desktop/javax.swing.table.AbstractTableModel.fireTableRowsInserted(AbstractTableModel.java:237)
    at com.beamusup.webcrawler.swing.model.ResultTableModel.onModelChange(ResultTableModel.java:68)
    at com.beamusup.webcrawler.swing.model.ResultTableModel.onModelChange(ResultTableModel.java:47)
    at com.beamusup.webcrawler.swing.MainFrame$ModelListener.lambda$crawlTaskCompleted$4(MainFrame.java:294)
    at java.desktop/java.awt.event.InvocationEvent.dispatch(InvocationEvent.java:318)
    at java.desktop/java.awt.EventQueue.dispatchEventImpl(EventQueue.java:773)
    at java.desktop/java.awt.EventQueue$4.run(EventQueue.java:720)
    at java.desktop/java.awt.EventQueue$4.run(EventQueue.java:714)
    at java.base/java.security.AccessController.doPrivileged(AccessController.java:400)
    at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:87)
    at java.desktop/java.awt.EventQueue.dispatchEvent(EventQueue.java:742)
    at java.desktop/java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:203)
    at java.desktop/java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:124)
    at java.desktop/java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:113)
    at java.desktop/java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:109)
    at java.desktop/java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:101)
    at java.desktop/java.awt.EventDispatchThread.run(EventDispatchThread.java:90)

    (try on arrizza.com)

  6. Cecelia
    20 . Feb . 2025

    Thanks for the great tool!

    One thing I’m experiencing is that when I tell Google Pagespeed to check all URLs, the queue window pops up over and over again. I’m not clicking on the “Google Pagespeed” filter. Any way to prevent this or am I doing something wrong?

    • G
      07 . Apr . 2025

      It is a bug. Thanks

  7. Flavia Donadio
    21 . Feb . 2025

    I’ve been using BUU for some time and it works really well. One feature I really need, but that BUU doesn’t support (yet), is finding tags missing the “alt” parameter. That expensive alternative supports this, but it’s hard to beat free, right? 😉

    If you can implement that, I’ll be happy to pay you a beer (or a 6-pack).

    • G
      07 . Apr . 2025

      We’ll see 🙂

  8. AK
    21 . Feb . 2025

    I’m trying to download the Windows version and it wants to open this webpage (https://beamusup.com/downloads/buu.msi) but it just keeps spinning no matter the browser I use. I’ll try back in a few days but wanted to give you a heads up.

    • G
      07 . Apr . 2025

      Wasn’t aware but guess its working for most people. Thanks

  9. Lukas
    24 . Feb . 2025

    Hi, is there any way to export Page Speed data to Excel?

    • G
      07 . Apr . 2025

      Yes just export on the top right of the app.

  10. Ivan
    27 . Feb . 2025

    Love this awesome tool, thank you so much for building this!

    Was wondering if it’s possible to extract images/videos links from the site as well or not. It would be great if that’s possible too!

    • G
      07 . Apr . 2025

      Thanks appreciated no that isn’t possible

  11. Brodey
    18 . Mar . 2025

    The column “Total Internal Links” is being treated as a string, not an intiger. So it’ll take you from 80s, 70s, 60s then suddenly 5000. Despite 5,000 is clearly more than 80. Because a string is treating the first character, an integer would be treated as all numbers.

    Simple fix. Other columns that should be integers might be strings as well, I’m not sure.

    • G
      07 . Apr . 2025

      Thanks!

  12. Dirk
    20 . Mar . 2025

    Very cool! Works for me!

    I run it on a Macbook which I’m not very familiar with, so as a noob I found out how to do it. If you would like to receive all the steps needed, let me know! I’ve let GPT type it out.

  13. Tore
    24 . Mar . 2025

    I can’t seem to get it started on my MacBook. I have allowed in the Settings, however, it won’t open the program.

  14. Tahir
    27 . Mar . 2025

    Would it be possible to add a wait time between URL checks due to a Cloudflare server block?

    • G
      07 . Apr . 2025

      Whitelist your IP on cloudflare 😀

  15. Ward
    01 . Apr . 2025

    Nice tool! Any chance basic authentication is supported?

    • G
      07 . Apr . 2025

      No not yet.

  16. Monica
    03 . Apr . 2025

    Hello
    I am trying to analyze the web with more than 100K links but once the crawl is almost finished, the app freezes and does not let me do anything. If I export to excel, it appears empty.

    I have let it work without touching anything so that it can process the whole web but it reaches a point that does not let me do anything.

    I have a part of the web that has allowed me to export but I need it to be complete.

    any idea?

    • G
      07 . Apr . 2025

      This is likely due to limitations of your computer. However, you should consider splitting your crawls to target specific sections of the website. In most cases, once you’ve reached around 50,000 links, you’ve already captured the main site architecture and key pages. At that point, it’s usually better to stop crawling and start analyzing the data.

      ——————–

      Esto probablemente se deba a las limitaciones de tu computadora. Sin embargo, deberías considerar dividir tus rastreos para enfocarte en secciones específicas del sitio web. En la mayoría de los casos, cuando alcanzas unas 50,000 enlaces, ya has capturado la arquitectura principal del sitio y las páginas clave. En ese punto, lo mejor suele ser detener el rastreo y comenzar a analizar los datos.

  17. Andrea Scarpetta
    06 . Apr . 2025

    hey there! I’ve made a short guide to install BUU on osx.
    https://github.com/garethjax/beamusup-osx-installer

    • G
      07 . Apr . 2025

      Thanks!

  18. Monica
    09 . Apr . 2025

    Gracias G!

    Finalmente rastree la web 118K de links. Lo he parado para poder exportarlo a XSL. Por saber un poco, cuánto tiempo tarda en procesar todo ?

    GRaciasª

  19. Anna
    06 . Oct . 2025

    This software is an incredible free Screaming Frog alternative for websites that contain over 500 pages. Fantastic work, I’m actually blown away by how good it is, especially for free software! I’ll be honest, what sold me on it is the About Me page. Huge respect for what you are doing!

    Just wanted to make a feature request (or maybe I just did not find how to do that) to also indicate internal links TO the page in the main scan result table and allow sorting by it. This would be extremely helpful to track if the most important pages are getting the most juice. Many thanks!

  20. Ludo
    10 . Dec . 2025

    Hi Ralf, thank you for a great sw. I was not able to figure out how to make this:
    External Link Review – Analyzes all external links and checks their status.

    Is there a way I can see/export list of all outgoing links (not only for a specific page but for whole website) with their status and URLs where the link is placed?

    • G
      28 . Sep . 2026

      Who’s Ralf hehe.

      Thats a good idea. In the meantime check the latest version with MCP you could ask an AI to do that for you.

  21. Henrik
    15 . Dec . 2025

    Excellent! love to se more updates and new features

    • G
      28 . Sep . 2026

      New version has craaaaaaaaaaaaaaaazy new updates!

  22. Naomi
    16 . Dec . 2025

    I’m trying to crawl my demo website to make sure there are no errors, but there’s a basic http authentication on it (to prevent indexation), is there a way to input the user/password in the application for the crawling to work? I tried putting it in the url (http://user:[email protected]) but I’m still getting 401s.

    • G
      28 . Sep . 2026

      New version now allows this. Go check it out.

  23. Andy
    02 . Jan . 2026

    i used BUU software and it developed several crawling scans.
    i made changes in the configuration. it did not work anymore.
    I removed the check mark from the first 4 items in the configuration, and it had not worked since. i uninstalled the software an reinstalled it. It kept all the old scanning files.
    I deleted the previous crawling files, but it does not delete. when I reopen the software, it still had them.
    when i tried to start a new scan… it does not respond. As soon as I started, It said finished, but I do not see any results of the scan. It offers the main website address. When i press on incoming links, it showed nothing.
    Basically, the software is NOT working. Have you heard this before?
    Thank you.

    • G
      28 . Sep . 2026

      Won’t happen in new version. Thanks

  24. User
    16 . Jan . 2026

    I’m crawling a large site and my server is getting overloaded. Is there a way to throttle the crawl rate to reduce CPU and I/O usage?

    • G
      28 . Sep . 2026

      Try the new verison however honestly if your server is getting overloaded then I would suggest fixing it as it shouldnt.

  25. jonathan
    07 . Feb . 2026

    Please would you make the data this tool generates accessible to AI? This way you could just ask AI a question and it would summarize the data/data set you are interested in. I think this the logical step for the evolution for data tools. You could mane your resident AI (just like Jarvis from Iron Man) Jonathan. Its a stellar idea!

    • G
      28 . Sep . 2026

      Yep new version does that with MCP

  26. michal
    12 . Feb . 2026

    Thanks for the great tool!

    • G
      28 . Sep . 2026

      Thanks!

  27. Nataliya
    03 . Mar . 2026

    thank you

    • G
      28 . Sep . 2026

      Thank you too!

  28. Brian
    06 . May . 2026

    Is there a list mode available where I can paste or upload a list of urls?

    • G
      28 . Sep . 2026

      Not yet but maybe in the next version. But you should check the latest one its a different world!

  29. Randal J Watkins
    06 . May . 2026

    This is really a great tool that you are offering for free. However, I was wondering is there a way to find the location of where the 404 links are actually located on the site?

    • G
      28 . Sep . 2026

      Sure check the new version its way easier now.

  30. Jerry
    23 . Jun . 2026

    Is there an option to export all outgoing links for every sub-page after a crawl?

    • G
      28 . Sep . 2026

      Nope but you could do that connecting with MCP. On new version.

  31. Christian
    28 . Jun . 2026

    Still getting errors installing de Mac version. Can you help? -jar error

    • G
      28 . Sep . 2026

      Mac install now is easy on the new version go and get it 😀

  32. Simon
    06 . Jul . 2026

    Hi,

    Thanks for creating such a great tool!

    Today, when I launched BeamUsUp Crawler on Windows 11 25H2, Windows Smart App Control blocked it because it couldn’t verify the publisher.

    It looks like the executable isn’t digitally signed.

    If it’s something you’ve considered, digitally signing future releases would help Windows 11 users avoid Smart App Control blocking the application without having to disable this security feature.

    Thanks again for all your work!

    • G
      28 . Sep . 2026

      Thats Simon, I appreciate it. It’s signed now on the new version. 😀

  33. Mercenario
    20 . Jul . 2026

    Hey dude. Just wanna say hi. I keep coming back to your tool here. I’ve known this since 2019. Hope you’re doing fine.

    • G
      28 . Sep . 2026

      Thanks I appreciate that!

  34. Anders Bagnegaard Kristensen
    22 . Jul . 2026

    Thanks for a great piece of software.

    Can I make a request?
    Can we get a crawler time limit? Like max X crawls per minute? I have the crawler threads set to 1 already, but I get blocked on every page I use the software on. Both by Cloudflare, Shopify, and others.

    • G
      28 . Sep . 2026

      They’ll block you because of the type of crawling it does anyway you need to whitelist your own IP the new version out today, automatically detects when this is happening.

  35. Stuart Clark
    12 . Aug . 2026

    I’ve been looking at integrating a crawler into my Claude workflow so I can use Claude to run a BUU crawl and import data from GA4 and GSC via local MCP servers.

    I know that BUU doesn’t have an MCP server, but according to Google AI I may be able to make a generic MCP server myself and then get Claude to run BUU crawls via the command line.

    However, Claude says that BUU doesn’t support command line input.

    Just wondering if there are any plans to enable either CLI or MCP servers?

    Absolutely love your work by the way and I’ve been recommending BUU to people for years 🙂

    • G
      28 . Sep . 2026

      Its done on the new version 🙂

    • G
      29 . Sep . 2026

      New version has this 😀

  36. Harald Hutter (he/him)
    20 . Aug . 2026

    Dear G,

    First of all: Thank you so much!!!!
    Great tool.

    Very best regards, Harald (he/him)

    PS:
    Maybe I did something wrong?

    harald@haralds-rechner:~/Downloads$ java -jar buu.jar
    Aug. 20, 2026 11:39:15 PM com.brsanthu.googleanalytics.GoogleAnalytics
    INFORMATION: Initializing Google Analytics with config=GoogleAnalyticsConfig [threadNameFormat=googleanalytics-thread-{0}, enabled=true, maxThreads=1, useHttps=true, validate=true, httpUrl=http://www.google-analytics.com/collect, httpsUrl=https://ssl.google-analytics.com/collect, userAgent=java/21.0.11+10-1-24.04.2-Ubuntu/Oracle Corporation/OpenJDK 64-Bit Server VM/Linux/6.8.0-138-generic/amd64, proxyPort=80, deriveSystemParameters=true, gatherStats=true] and defaultRequest=Request [parms={HIT_TYPE=pageview, APPLICATION_VERSION=1.4.0, DOCUMENT_ENCODING=UTF-8, TRACKING_ID=UA-66948531-1, USER_LANGUAGE=de-DE, PROTOCOL_VERSION=1, CLIENT_ID=b0cba97b-ad4e-4182-97d7-1b2b9e372743, APPLICATION_NAME=BeamUsUp}, customDimensions={}, customMetrics={}]
    Aug. 20, 2026 11:39:15 PM com.beamusup.webcrawler.google.analytics.AnalyticsTracker
    INFORMATION: Version: 1.4.0
    Exception in thread “AWT-EventQueue-0” java.lang.NullPointerException: Cannot read the array length because “” is null
    at com.beamusup.webcrawler.Model.getCrawlInfo(Model.java:1654)
    at com.beamusup.webcrawler.Model.getAllCrawlingInfo(Model.java:972)
    at com.beamusup.webcrawler.swing.dialog.RecentCrawlsDialog.(RecentCrawlsDialog.java:119)
    at com.beamusup.webcrawler.swing.MainFrame.onRecentCrawls(MainFrame.java:1281)
    at com.beamusup.webcrawler.swing.MainFrame$1.windowOpened(MainFrame.java:448)
    at java.desktop/java.awt.Window.processWindowEvent(Window.java:2082)
    at java.desktop/javax.swing.JFrame.processWindowEvent(JFrame.java:298)
    at java.desktop/java.awt.Window.processEvent(Window.java:2044)
    at java.desktop/java.awt.Component.dispatchEventImpl(Component.java:4996)
    at java.desktop/java.awt.Container.dispatchEventImpl(Container.java:2324)
    at java.desktop/java.awt.Window.dispatchEventImpl(Window.java:2780)
    at java.desktop/java.awt.Component.dispatchEvent(Component.java:4828)
    at java.desktop/java.awt.EventQueue.dispatchEventImpl(EventQueue.java:775)
    at java.desktop/java.awt.EventQueue$4.run(EventQueue.java:720)
    at java.desktop/java.awt.EventQueue$4.run(EventQueue.java:714)
    at java.base/java.security.AccessController.doPrivileged(AccessController.java:400)
    at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:87)
    at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:98)
    at java.desktop/java.awt.EventQueue$5.run(EventQueue.java:747)
    at java.desktop/java.awt.EventQueue$5.run(EventQueue.java:745)
    at java.base/java.security.AccessController.doPrivileged(AccessController.java:400)
    at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:87)
    at java.desktop/java.awt.EventQueue.dispatchEvent(EventQueue.java:744)
    at java.desktop/java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:203)
    at java.desktop/java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:124)
    at java.desktop/java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:113)
    at java.desktop/java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:109)
    at java.desktop/java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:101)
    at java.desktop/java.awt.EventDispatchThread.run(EventDispatchThread.java:90)
    Wird in einer aktuellen Browsersitzung geöffnet.

Related

2.0.0 Biggest Release Ever – AI Crawling, MCP, 100+ extra checks, CLI, crawl comparison, auto updating and more and more!
1 week ago

BeamUsUp SEO Crawler 2.0 is out, and it’s the biggest update the crawler has ever ...

Get a Google Pagespeed API Key
2 years ago

To enable bulk google pagespeed collection in BeamUsUp you’ll need an API key so here ...

Beam Us Up Crawler Updated v1.3.0 – New features & Fixes
2 years ago

Download Windows, Mac or Linux Remember you need Java installed for Mac & Linux. As well as to ...

Beam Us Up Crawler Updated v1.2.1 – Big Feature Update
3 years ago

Download Windows, Mac or Linux Remember you need Java installed for Mac (how to run on mac guide) ...