UrlFetchApp.fetch will abort the script? - google-apps-script

Question

I create a spreadsheet with 3 sheets, "Links", "Valid Links" and "Invalid links", then use the following code to check each row in the "Links" sheet, as below:
function myFunction() {
var rows = SpreadsheetApp.getActiveSpreadsheet().getSheetByName("Links").getDataRange().getValues();
rows.forEach(function(row, index)
{
if (index !== 0)
{
var url = row[1];
var page = UrlFetchApp.fetch(url).getContentText();
var number = page.match("sample.com");
if (!number)
SpreadsheetApp.getActiveSpreadsheet().getSheetByName("Valid Links").appendRow(url);
else
SpreadsheetApp.getActiveSpreadsheet().getSheetByName("Invalid Links").appendRow(url);
}
});
}
However, when I debug to UrlFetchApp.fetch(url), the script suddenly aborts. No error or exception are shown. Why?
I have asked this question on Google Script Community, but no one answers. So I have to ask it here. I don't know how to get the specific URL for my question on Google Script Community, so I have to copy & paste the question. Sorry about that.
Update
With the help of Tanaike, I fix my bug:
I think row[1] refers to column A, but it actually to column B, which is an undefined value, so cause the bug.
!number should be changed to number, as if (number) means a match so the result is valid link.

Answer 1

I believe your goal as follows.
You want to put the value to Valid Links and Invalid Links sheets by checking the URL using UrlFetchApp.fetch.
The URLs for checking are put in the column "B" in Links sheet.
Modification points:
In this case, how about using muteHttpExceptions as the option of UrlFetchApp.fetch? By this, the response value can be retrieved even when the request is failed.
The default value of muteHttpExceptions is false. In this case, when the request occurs error, the script is stopped. It seems that this is the current specification. But when muteHttpExceptions is true, the script is not stopped even when the request occurs error.
In your script, appendRow(url) is used and var url = row[1]; is the value from the column "B". In this case, url is required to be [url].
In the case of var number = page.match("sample.com");, when sample.com is included in page, url is put in Invalid Links sheet. When sample.com is NOT included in page, url is put in Valid Links sheet. I'm not sure whether this might be the result you expect. But please be careful this.
I think that when var ss = SpreadsheetApp.getActiveSpreadsheet(); is used, the process cost will be able to be reduced a little.
When above points are reflected to your script, it becomes as follows.
Modified script:
function myFunction() {
var ss = SpreadsheetApp.getActiveSpreadsheet(); // Added
var rows = ss.getSheetByName("Links").getDataRange().getValues(); // Added
rows.forEach(function(row, index) {
if (index !== 0) {
var url = row[1];
var page = UrlFetchApp.fetch(url, {muteHttpExceptions: true}).getContentText(); // Modified
var number = page.match("sample.com");
if (!number) {
ss.getSheetByName("Valid Links").appendRow([url]); // Added
} else {
ss.getSheetByName("Invalid Links").appendRow([url]); // Added
}
}
});
}
Note:
When fetchAll is used, the process cost might be able to be reduced more. But I'm not sure about the number of URLs. So I modified your script like above without using fetchAll method.
References:
fetch(url, params)
appendRow(rowContents)
Added:
About the following new question,
One more question, when url is wisesoft.co.uk, I get error SSL Error wisesoft.co.uk (line 10, file "Code") and the script also abort. I use Chrome and find https has error but the site can be visited via http version, how to ignore such an error and continue fetch the contents?
in this case, how about using try...catch as follows?
Modified script:
function myFunction() {
var ss = SpreadsheetApp.getActiveSpreadsheet();
var rows = ss.getSheetByName("Links").getDataRange().getValues();
rows.forEach(function(row, index) {
if (index !== 0) {
var url = row[1];
try {
var page = UrlFetchApp.fetch(url, {muteHttpExceptions: true}).getContentText();
var number = page.match("sample.com");
if (!number) {
ss.getSheetByName("Valid Links").appendRow([url]);
} else {
ss.getSheetByName("Invalid Links").appendRow([url]);
}
} catch(e) {
ss.getSheetByName("Invalid Links").appendRow([url]);
}
}
});
}
try...catch