How to copy all text from website + pop up windows? - html

There's a web page with loads of contact info that I would like to copy to my clipboard and paste into an excel doc. The problem is that in order to display the info (phone, email, title, company, etc...) you have to click on the contact name and then a little blurb comes up (similar to a business card) that shows all info. Thus, I am unable to select all and copy and would have to do this one by one. There are thousands of contacts, so obviously this would be impractical. The hyperlink does not change when I click the blurb.
I'm wondering if there's a workaround to this - is there a program I can use that can extract the info from all of these small blurb-type pop ups that come from one page?
Any help is appreciated.

There is no systematic way to crawl web pages, as it depends on how it was developped.
But you can try this :
Click on one such pop-up.
With the "dev tools" of your browser, inspect it and find anything you can use to identify this pop-up (for instance it may have a certain class or name).
Then, look for this class (or name) in the source code : all the other pop-ups may be there.
If so, you can do some text parsing to get the info you want.
Finally, you can use something like "search and replace" in a text editor to display the result in an Excel-friendly way.

Related

Is it possible to discover that I used text expanders or I pasted text into a text box BEFORE sending my form?

I work writing messages on text boxes on a NON SECURE website interface of a company. I work from my pc and google chrome with no spy programs installed because i work from home on my own pc!
They do not want people to paste messages, but there are some words that I repeat a lot and I would like to use text expanders for those words or small expression.
My question is, is it possible that the company read and saves the keys that are digited on a text box BEFORE sending them the final message that I wrote?
Example, I could create a shortcut and use GDM to write Good Morning, is it possible that the company understand that I wrote GDM instead of good morning into the text box of that I pasted a word even if the final sent message will be Good Morning and not GDM? Will they be able to record my pressed keys like CTRL C and V or GDM instead of good morning?
Yes, It is possible to implement a javascript keylogger that logs every keystroke on that page. In your scenario the company would "benefint" from it, if they really want to detect pasting messages.
However this can be tricked by any application that calls the OS's native function that simulates the keystrokes and doesnt use keyboard shorcuts for the text expansion.

How should we use google analytic script in django?

Can we add google analytic script in tag and push it to the GitHub or we should keep it secret i.e. add it to the .env file and call in .
When I tried by the second one it appears in the source page as it is and also not working properly.
I would say there is no meaning of hiding it because it is also shown when 'view page source' is clicked. All you need is a simple filter. It will only include traffic on your domain, protecting yourself from any data corruption when people hijack your Google Analytics Property ID.
To find your filters:
Go to your Google Analytics standard reports
Click on the “Admin” button in the top right
Click on “Filters”
Click “+ New Filter
Then use these settings for your filter:
Select “Create New filter for Profile”
Name your filter with something snazzy like “Hacking Defense”
Select “Custom Filter”
Select “Include”
For the Filter Field, select “Hostname”
If your site is LarsLofgren.com, you would define the filter pattern
as “larslofgren.com” and make sure to include a “\” before any “.”
Pick “No” for case-sensitive
At the end of the day, your analytics id will be visible on your website. So, I don't think you should make an effort to hide it.
Just add it to your base template and you should be ready to go :)

Using VBScript in tandem with Chrome to fill out forms and download files

I need to download a series of credit reports using chrome, has to be chrome because my company uses last pass and I don't actually know the password. I also need to use VBScript with windows default libraries. The script needs to click (and I counted) 2 links -> then a radial button -> then input into 2 text boxes -> select the 6th item in a dropdown list -> click a download button -> then copy a string from the page and rename the downloaded file based on that. This last part I think I could do with windows.xmlhttp get then parse it, but if there's a better way I'm looking for suggestions.
My knowledge of VBscript is ad hock at best, I've had to learn it on the fly on an as needed basis, frankly its a miracle some of the scripts i wrote work at all.
The only solutions I could think of was to use WScript.SendKeys "{tab}" and WScript.SendKeys "{enter}" a few dozen times, this works most of the time, but has no reaction capability and can't copy text from the page and rename it for me. The page also doesn't always have the same number of buttons or links so my tab count will be off at times. My other idea was to use http post and http get but I'm more or less completely in the dark about how those work

click through several links on webpage and extract information from each?

I have access a webpage with a list of several hyperlinks, each of which are unique. This is it:
webpage I have access to that lists names from top to bottom. Each name is unique and is a hyperlink. I would like to click on these hyperlinks one by one and extract info from the resulting webpage.
Say I click the first name, say Adam, it then brings me to the following webpage:
alt:this is a page of the user's profile and includes info such as name, email status and more
My goal is to create a program that clicks the name at the top, and then takes the email address and puts it in an excel spreadsheet on my local machine. And then goes back to the original page, clicks on the name directly below the name that was previously clicked on, and then takes this names resulting email and throws it in the spreadsheet.
for those looking at the pictures, i would like to click on 'Adam' and then put his email into a spreadsheet, then go back, and then click on 'Adrian' and then put his email into a spreadsheet, and so on and so forth down the list.
What do I need to do/learn to create a tool that will do this for me?
I know a bit of Java and a tiny bit of html. I've been trying to look for a solution but the most I can get is excel vba to click on the first name, but not much more. Even if I got the vba to click on all the names, it seems I would have to type in an instruction for the vba to find each unique name, and I dont see much point in doing that since its probably faster to just do this manually then.
As i'm not a programmer (but would like to be soon :)) I have had some trouble asking this question since I don't know any technical terms.
Any thoughts/advice on how to do this?
With javascript and a little php you could make this happen. Since it appears this is something running in the browser it would probably be your best bet.
Make your program click links js has the ability to activate links. You could
click on body load
the first link on the page,
then have a counter that counts each time you click a link.
`Find out how many links there are in the document:`
var x = document.links.length;`
`Get the URL of the first link (index 0) in the document:`
`var x = document.links[0].href;`
Click the link you want to click
$(function(){
$('#myLink').trigger('click');
})
now that your on the next page you need to grab the email address that is on this page. If you know the css just grab the string that is in the element. at this point you can use javascript to go back to the previous page.
<button onclick="goBack()">Go Back</button>
Now you are on the original page. Your counter is one number higher. Use the counter to click the next link and your program will repeat the process pushing the new email to your array.
var fruits = ["Banana", "Orange", "Apple", "Mango"];
fruits.push("Kiwi");
once the program runs out of links to click or hits the limit of your counter you will need to create a txt file with javascript. write your array to the file with PHP. You can do this with an ajax call.
make an AJAX call to your php file passing the array. php can then write to the file.
Here is an example of making a text file and writing to it with javascript
Following this logic you can fairly easy make an application that activates the links in order of a page, pushes the email address to an array as a string. Goes back to the previous page and continues the process till you have all the links. At this point your program will write all the data in the array to a file.

hyperlink field in table doesnt work

I have an Access table that has a hyperlink field, with the records being a website link, to look up the UPS Worldship shipment tracking#. My problem is that even though the text has blue colored font, the link doesn’t launch and open the web browser when I click on the field.
originally the hyperlink did work, when I created the table and changed the field properties from “text” to “hyperlink”, but once I ran a delete query and an append query (in order to refresh the data), the link no longer functioned, even though the field has hyperlink properties.
Here is an example of my hyperlink record that I want the browser to launch: http://wwwapps.ups.com/WebTracking/processInputRequest?sort_by=status&tracknums_displayed=1&TypeOfInquiryNumber=T&loc=en_us&InquiryNumber1=1Z1467826772975386&track.x=0&track.y=0
Please advise what I need to do in order to make the hyperlink work, so the user doesn’t have to manually copy and paste the link into a web browser.
Thank you very much in advance
Nathaniel, Access 2003
I don't understand what you mean. I need to create an Access app that would be used throughout the day in order to track UPS packages. Ideally the table would provide a link, so that the user doesnt have to manually copy and paste the tracking number into the UPS website. Please advise if this is feasible without VBA.
I do not like hyperlink fields, they are difficult to edit and somewhat confusing for the user. I prefer to use a click event with FollowHyperlink. However, if you must use hyperlink fields, they have to have this format to work:
Descriptive text#link#
So
Stackoverflow#http://stackoverflow.com#
http://stackoverflow.com#http://stackoverflow.com#
Email#mailto:mail#example.com#
I imagine you have lost the link - that is, the bit between the hash signs.
Try going back to the table with the record and change the data type to short text. Close and reopen the table and switch the data type back to hyperlink. If the text is a valid webpage link it should work without any extra coding.
Good luck!