Read a page that blocks plain fetching
Fetches a page you name and, when the plain request is blocked or comes back empty, reads it through a reader service into a Google Doc.
Apps it connects
Authenticate each one once and the workflow is ready to run.
What it does
The integration steps this workflow runs, in the order it first runs them.
- 1Jina AIRead url
- 2Google DocsCreate document
- 3Google DocsAppend text
How it works
Everything the template sets up, and what to fill in before the first run.
Some pages will not hand their text to anything that is not a browser: the request comes back with a challenge screen, a 403, or a shell of a page with the article missing. Paste the address into 'pageUrl' and this fetches it the plain way first, and only if that does not produce the page does it read the address through a reader service that renders it properly. Either way the text lands in a new Google Doc with a line saying which route it came by.
Use it on pages you are entitled to read. A site that blocks automated requests may well have meant to, and this is for getting at an article you could open yourself in a browser - not for reaching anything you could not.
What counts as blocked: the request failed, or the page came back under 'minimumCharacters' long, or it carries the wording of a challenge screen rather than an article. Raise 'minimumCharacters' if short real pages are being sent to the reader unnecessarily.
One deliberate omission. The address recorded in the document is rebuilt from the scheme, the host and the path - the query string and anything before the host are left out, because that is where an access key travels and the document is somewhere you may share. For the same reason a failed request is reported by host and reason only: the underlying error text quotes the whole address, so it is never repeated as it arrived.
'maximumCharacters' caps how much of a very long page is written. Each run creates its own document, so nothing you already have is overwritten.
You May Also Be Interested In
Summarise the documents people email youReads every document that arrives by email, logs a short summary of each in a Google Doc and emails you what came in.
Save matching emails to a spreadsheetSaves each new Gmail message that matches your search as a row in your spreadsheet, and never saves the same message twice.
Smart email draft generatorWhen a new email arrives, Claude writes the reply you would have written and leaves it in your Gmail drafts for you to send.
Gmail alerts in SlackPosts the emails that match your subject, sender or label filters into a Slack channel as they arrive.
Start from a workflow that already works.
Add "Read a page that blocks plain fetching" to your workspace, connect its apps, and make it yours. No credit card required.
Free plan available · No credit card required