How to EXTRACT and save Url in CSV using IMACROS - csv

Question

Trying to get contents and saving them in a CSV, one per row
But when it has a WEBLINK, the URL gets messed up.
See the latest
Actually the glassdoor.com/Top-Companies-... part is a hyperlink to following weblink
http://t.co/tDbVGX48c6
which redirects to
http://www.glassdoor.com/Top-Companies-for-Culture-and-Values-LST_KQ0,36.htm
**ISSUE is if we use the following to save this **
TAG POS=1 TYPE=DIV ATTR=CLASS:dir-ltr EXTRACT=TXT
SAVEAS TYPE=EXTRACT FOLDER=* FILE=Save.csv
it is saved in CSV as following only (i.e TEXT) & the link is not saved properly.
Honored to be named #Glassdoor's top company for culture and values. #jointheflock glassdoor.com/Top-Companies-...
**How can we make sure we get ACTUAL link saved in CSV, for every one
I feel EVAL & thus Javascript command can be used but i am not sure how.
I am using WINDOWS XP 64 Bit with Latest Firefox Imacros Addon
Thanks

Answer 1

Take a look at the EXTRACT definition on the iMacros wiki. You can use HREF as the extract type to extract the link instead of the text for that anchor. The following example extracts the link and saved it to a file.
VERSION BUILD=8820413 RECORDER=FX
TAB T=1
TAB CLOSEALLOTHERS
URL GOTO=http://www.penny-arcade.com/
TAG POS=1 TYPE=A ATTR=TXT:Forum EXTRACT=HREF
SAVEAS TYPE=EXTRACT FOLDER=* FILE=FORUMS.CSV
Here is the macro code for the twitter page:
TAG POS=1 TYPE=A ATTR=CLASS:twitter-timeline-link EXTRACT=HREF
SAVEAS TYPE=EXTRACT FOLDER=* FILE=SaveTweets.csv
Here is a javascript version that pulls each tweet and a link it if exists.
var retcode, tagText, tweetCounter, startIndex, endIndex, macro, extractMacro;
extractMacro = "";
macro = "CODE:";
macro += "URL GOTO=https://twitter.com/twitter\n";
retcode = iimPlay(macro);
tweetCounter = 1;
do
{
extractMacro = "CODE:";
macro = "CODE:";
macro += "TAG POS=" + tweetCounter + " TYPE=P ATTR=CLASS:ProfileTweet-text<SP>js-tweet-text<SP>u-dir EXTRACT=TXT\n";
retcode = iimPlay(macro);
tagText = iimGetLastExtract();
// iMacros code requires <SP> for spaces
tagText = tagText.replace(/[ \s\t\n]/g, "<SP>");
// Add extracted value to another macro for extraction later
extractMacro += "ADD !EXTRACT " + tagText + "\n";
macro = "CODE:";
macro += "TAG POS=" + tweetCounter + " TYPE=DIV ATTR=CLASS:ProfileTweet-Contents EXTRACT=HTM\n";
retcode = iimPlay(macro);
tagHTML = iimGetLastExtract();
tweetCounter++;
startIndex = 0;
do
{
startIndex = tagHTML.indexOf("data-expanded-url=", startIndex + 1);
endIndex = tagHTML.indexOf(" ", startIndex);
if (startIndex > 0)
{
var linkText = tagHTML.substring(startIndex + 'data-expanded-url="'.length, endIndex - 1);
// iMacros code requires <SP> for spaces
linkText = linkText.replace(/[ \s\t\n]/g, "<SP>");
extractMacro += "ADD !EXTRACT " + linkText + "\n";
}
} while (startIndex > 0);
// Save extracted data
extractMacro += "SAVEAS TYPE=EXTRACT FOLDER=* FILE=SaveTweets.csv\n";
retcode = iimPlay(extractMacro);
}
while (tagText !== "#EANF#");