Turn a list of web pages into spreadsheet rows

Give it a list of web pages and the details you want off each one, and run it. Every page is fetched once, exactly as you listed it, and read as clean text, then an AI step pulls out the details you asked for and they are written across one row per page in your Google Sheet.

You end up with one appended row per page: the page address first, then your details in the order you listed them, with 'n/a' wherever the page does not say. Nothing crawls, follows links or wanders onto other pages. Values are written exactly as extracted, so nothing off a page can turn into a spreadsheet formula, and rows are only ever added, so running it again with a new list never disturbs what is already there. A page that will not load, or that comes back with no readable text, is named in the run log and the remaining pages carry on.

Before the first run you need a sheet whose header row reads 'Page' followed by your fields in the same order, since the workflow cannot name the columns for you.

Set pageUrls to blank.Set pageUrls to blank.

Set fieldsToExtract to blank.Set fieldsToExtract to blank.

Set spreadsheetUrl to blank.Set spreadsheetUrl to blank.

Set sheetName to Sheet1.Set sheetName to Sheet1.

Set maxPageCharacters to 12000.Set maxPageCharacters to 12000.

Set columnSeparator to |||.Set columnSeparator to |||.

Split pageUrls by , and save it as pages.Split pageUrls by , and save it as pages.

Set rowsWritten to 0.Set rowsWritten to 0.

Set pagesWithoutRows to an empty list.Set pagesWithoutRows to an empty list.

For each listedPage in pages:For each listedPage in pages:

Trim listedPage and save it as webPage.Trim listedPage and save it as webPage.

If webPage doesn't start with httpIf webPage doesn't start with http

Yes

Add webPage to the end of pagesWithoutRows and save it as pagesWithoutRows.Add webPage to the end of pagesWithoutRows and save it as pagesWithoutRows.

Show in the output: Skipped '@webPage' - each page in the 'pageUrls' step has to be a full web address starting with http.Show in the output: Skipped '@webPage' - each page in the 'pageUrls' step has to be a full web address starting with http.

Skip to the next item.Skip to the next item.

No

No steps

If a step below fails, save the error as pageErrorIf a step below fails, save the error as pageError

Try

Jina AIRead the page at webPage with Jina. Save it as page.Read the page at webPage with Jina. Save it as page.

Trim page.content and save it as pageText.Trim page.content and save it as pageText.

If pageText isn't emptyIf pageText isn't empty

Yes

Set prompt to You are reading one web page and filling in one row of a spreadsheet.Set prompt to You are reading one web page and filling in one row of a spreadsheet. Pull out these details, in this exact order: fieldsToExtract Reply with ONE line and nothing else. Separate the values with columnSeparator in the order listed above. Do not repeat the field names, do not add headings, bullets, numbering or any commentary, and do not wrap values in quotes. Write n/a for anything the page does not say. Page address: webPage Page content: pageText truncated to maxPageCharacters characters.

OpenAIAsk OpenAI: prompt. Save it as extraction.Ask OpenAI: prompt. Save it as extraction.

Trim extraction.response_text and save it as answerLine.Trim extraction.response_text and save it as answerLine.

Create a list of [webPage] and save it as row.Create a list of [webPage] and save it as row.

For each extractedValue in answerLine split by columnSeparator:For each extractedValue in answerLine split by columnSeparator:

Add extractedValue to the end of row and save it as row. Add extractedValue to the end of row and save it as row.

Google SheetsAdd a row to sheetName in spreadsheetUrl.Add a row to sheetName in spreadsheetUrl.

Add 1 to rowsWritten.Add 1 to rowsWritten.

No

Add webPage to the end of pagesWithoutRows and save it as pagesWithoutRows.Add webPage to the end of pagesWithoutRows and save it as pagesWithoutRows.

Show in the output: Read '@webPage' but it had no readable text, so no row was written for it.Show in the output: Read '@webPage' but it had no readable text, so no row was written for it.

On error

Add webPage to the end of pagesWithoutRows and save it as pagesWithoutRows.Add webPage to the end of pagesWithoutRows and save it as pagesWithoutRows.

Show in the output: Could not read '@webPage': pageError as text.Show in the output: Could not read '@webPage': pageError as text.

Show in the output: Finished. Wrote rowsWritten as text row(s) to '@sheetName'.Show in the output: Finished. Wrote rowsWritten as text row(s) to '@sheetName'.

If pagesWithoutRows isn't emptyIf pagesWithoutRows isn't empty

Yes

Show in the output: No row was written for: pagesWithoutRows joined by , .Show in the output: No row was written for: pagesWithoutRows joined by , .

No

No steps