Beam Us Up Crawler Updated 2024 v1.1.1

  • Facebook
  • Twitter
  • Reddit

After many attempts of finding someone to help me updated the crawler, I have finally got someone and the new updated working version is here.

Download WindowsMac or Linux

Remember you need Java installed for Mac (how to run on mac guide) & Linux

Whats in the new update?

The last real update was 10 years ago, and since then the web and technology has changed quite a bit. So what has been updated is mostly the core technology behind the crawler to make it work. Some features which I think are pointless now like Google Drive upload have been removed. And some other features which broke with new websites have been removed but will come back in a future update.

The only new feature is the ability to see recently crawled websites and that it’ll now it will use 1GB of memory instead of only 250mb (computers have gotten much more powerful in 10 years).

Want to help?

There will be errors and must have features based on new SEO issues/rules of the last 10 years. So let me know in the comments of this post.

Also feel free to post a review or like us on Alternative.to here

Why did it take so long?

I first discontinued Beam Us Up because I was starting my own company in a unrelated field and didn’t have time to maintain and run it (especially since its free and makes no money). Then when I wanted to update it due to conflicts around the world I was no longer able to work with the person I originally made it with.

Although I own a software company we do not program in Java which is what Beam Us Up crawler is made with. I tried to get several people but none were suitable until recently where I found some one suitable and also have decided to make something more of Beam Us Up. The desktop crawler will remain free and have no paid version.

When is the next update?

Wow aren’t you excited! The next update will be within the next few months and what is planned is proper support for sitemaps and robots.txt. As well as a fundamental change in the architecture of the software it’ll look prettier. Plus I am guessing bugs found by you and us until then.

Support?

For now will be provided in the comments section of the appropriate release.

Add comment

10 comments

  1. Ralf
    26 . Feb . 2024

    Hey William,
    has been a while but great news. Thanks a lot for the update!
    Will test it as soon as possible for feedback.

    All the best for your other endeavors! 🙂
    Ralf

    • G
      26 . Feb . 2024

      Thanks Ralf I appreciate it 🙂

  2. Mers
    26 . Feb . 2024

    It’s been such a long time I can’t recall how this app works 😀 I’ve gone through it again and realized it’s a Screaming Frog killer. Nice job bringing it back to life after such a long time.

    • G
      26 . Feb . 2024

      Thanks for saying that although I am pretty sure screaming frog is better 😉 But it isn’t free soo. Also since then I’ve noticed screaming frog and most other tools have taken our idea of having pre made filters with errors so that’s nice to see 🙂

  3. Derluck
    05 . Mar . 2024

    Awesome have liked on Alternative.to

  4. Rich B
    05 . Mar . 2024

    Support Request: Thanks for bringing this back! I do think 1GB of memory is a bit much, however, this pinned my CPU to 99% and froze the application. I think some memory, buffering, or CPU throttling needs to be adjusted. I do have a large website, after scanning 10,000 items, it froze. Windows Server 2016, Intel Xeon 2.4GHz 6GB RAM.

    • G
      07 . Mar . 2024

      Hey Rich,

      We’ll look into it. I’ve been managing to get to around 80k. Perhaps easiest solution is we allow users to set how many pages they want crawled.

      Thanks.

  5. Waldo
    25 . Mar . 2024

    Fantastic piece of software! Just 22 MB vs 576 MB for ‘seo spider’!
    I run it today and got the impression that it treats links to the same page as links to different pages if both versions the relative – ../folder/page.html and the absolute – https://website.com/folder/page.html are present on the website.
    I noticed that cause it gave me too many errors on my website. Once I removed the 2 dots in front of the slash in the relative links (edited ../folder and made it /folder) the errors disappeared.
    Thank you!

    • G
      27 . Mar . 2024

      Thanks Waldo, that issue has been fixed for the new version which has HUGEEEE updates and will be out next month.

Related

Beam Us Up Crawler Updated v1.2.1 – Big Feature Update
3 months ago

Download Windows, Mac or Linux Remember you need Java installed for Mac (how to run on mac guide) ...

Web Based Crawler
2 years ago

Update: Unforuntately due to personal reasons the developer I was working on this with (who ...

Back in active development
4 years ago

Hello, So after around 5 years out of active development, I have decided to restart ...

Mac/Linux Version Support Discontinued
7 years ago

So currently we do not really support any of the software as it is largely ...