Published August 11, 2025

More on: Improved Website Scraping + URL-Based Topics

Untitled design (30)

By Robyn Cameron
Head of Sales & Marketing, Tufa    

7 minute read

Let’s take an in depth look at one of our platforms newest updates: improved website scraping. This means better first drafts, more specific topics, links to specific pages of your website, and automatically uploaded photos for post generations. Here’s what’s new:

  • Rescrape Your Website Anytime 
  • Scrape Individual Webpages
  • Auto-Upload Images to Photo Bank
  • Smarter Topic Management by URL
Table of Contents
    Add a header to begin generating the table of contents

    Rescrape Your Website

    Refresh your topics and links with a single click. The platform will scan your site for new URLs and pull in any new content we can turn into post ideas. As your website grows and evolves, with new blog posts, landing pages, service offerings, your content generation tools should keep up. That’s exactly what our Rescrape Your Website feature is built for.

    When you trigger a rescrape, our system re-scans your website to:

    • Pull in new or updated content

    • Generate fresh topics and captions

    • Collect any relevant internal links

    • Identify and upload images from those pages to your Photo Bank

    This ensures your posts and topics stay aligned with your latest web content, and makes it easier to generate posts. We won’t re-scrape pages that have already have a topic associated with them, so if you’ve updated an existing page, be sure to remove your old topic and rescrape that page individually.

    Scrape Individual URL's

    Don’t need a full site refresh? You can also scrape specific URLs to generate new topics. Just paste the link into the “Add from URL” within your Topics and we’ll do the rest. This tool is great if you’ve updated an existing page, since we won’t scrape topics that already have a corresponding URL attached. Here’s what Tufa will do:

    • Generate a new topic based on that page
    • Pull in relevant images and upload them to your Photo Bank

    This will help you:

    • Stay aligned with your most current messaging
    • Avoid manually adding topics or searching for links
    • Speed up your content workflow with auto-categorized media
    • Ensure your Photo Bank reflects your website’s latest visuals

     

    Pro Tip: Set a reminder to rescrape your website regularly, especially after publishing new content or launching a new campaign. That way, Tufa stays in sync with your evolving brand and content strategy.

    Auto Upload Images to Your Photo Bank

    During any scraping process, we’ll now also collect relevant images from your pages and store them directly in your Photo Bank and within your Topics. They’ll be ready to be used in post generations or within the Editor.

    This saves you the time and effort of manually downloading, organizing, and uploading visuals, and ensures your content library stays current and aligned with your brand.

    How It Works

    1. When you rescrape your site or paste in a specific URL, the platform scans the page for:

      • Header images

      • Inline content visuals

      • Product images

      • Blog post thumbnails or featured images

      • Embedded graphics, charts, or branded visuals

    2. Relevant images are selected based on:

      • Image file type and size (we skip icons, buttons, logos, etc.)

      • Placement on the page (e.g. we prioritize content-driven visuals over UI elements)

      • Association with text sections or topics

    3. Images are then automatically uploaded to your Photo Bank, and:

      • Tagged with the topic and page they came from

      • Instantly available in post creation and the Editor

    How to manage images, description and URL from Manage Topics page

    Smarter Topic Management by URL

    Creating great content starts with having the right topics, and now, we’ve made topic generation and management even more intelligent and transparent with URL-based topic management.

    Each topic generated from a webpage is now linked to its original source so that you can use the URL in generated posts to drive your users back to your website. This is great for linking people to product pages, or blog posts. A clickable URL will now be shown in your posts!

    Ready to scrape your website to start generating on-brand content? Sign up for an account to get started today.

    Simply enter your business website to generate on-brand posts in seconds

    Here’s some more information about Tufa’s core features:

    • AI-Powered Post Generation: Let our AI craft visually appealing and engaging posts for your social media platforms.
    • Scheduling and Publishing Tool: Our all-in-one scheduling and automated publishing tool allows you schedule and cross post across your social media channels. 
    • Powerful Design Studio for Customization: Our in app design tool allows for easy customization of generated posts and allows you to create your own content. We offer ready to use templates and a vast stock image library. If you have your own images you’d like to use, you can upload them into your library.
    • Plan my Month: Allow our algorithm to generate and schedule 30+ days of posts for you with just the click of a button.

    Explore More Topics