Import Any Website into ChatGPT Fast (RAG Trick)

In this video I'm going to show you how I import entire websites with multiple pages into cat gbt and it's actually super easy for this example I have a large documentation site that I want to explore my goal is to download all documentation feed it into chat gbt and then interact with it

So here's how it works this process is powered by a Chrome extension I wrote and the only thing I need is an API key for fir crawl fire crawl as the name suggests crawls web pages and extracts data into well formatted markdown which is exactly what we need you can create a free

Fire craw account I've already done this and it allows you to scrape up to 500 pages per month which is plenty so once you have an API key you simply paste it into the extension next you just copy and paste the URL of the page you want to scrape when you press scrape

And download it automatically extracts the content and saves it as a formatted markdown file which is exactly what we need but wait there's more instead of manually copying and pasting links you can also select multiple links by drawing a rectangle around them the extension will automatically detect and extract all linked Pages inside

The selected area if I'm feeling super lazy and I want to just grab all the documentation at once I can simply press scrape all links and boom it scrapes every link page on the current page so once all pages are scraped I can download them in bulk there's also an option to merge

To downloaded files while keeping them within the 512 megabit limit which is important for CET gbt's file upload now if I go to chbt where I've already created a project I can drag and drop one of my markdown files and ask a question about the documentation for example if I ask why Auto

Jbt will not only Prov provide an answer but also site the correct Source from the extract documentation so I know it's using real data and that's already it so if there's interest I can maybe publish this Chrome extension and will be completely free since everything runs locally in your browser and you just

Need an API key so yeah if there's interest let me know in the comments below and leave a like leave a subscribe and then until next time have a great day and bye-bye