Search all the Edgar Data from http://xbrl.sec.gov/ - xbrl

I need to Fetch all the Edgar search data From xbrl site either in XML Format or in RSS Feed form.
This is the same Search on this Link http://www.sec.gov/edgar/searchedgar/cik.htm which i want to create on my Website but donot want to use all the Data, just want to use a bit of Information in My Website.
And this is all the List of Items http://www.sec.gov/divisions/corpfin/organization/cfia.shtml
but don't know how to reach on a single Point.

sec web site have lot of data, so have to first decide what information you want to get, mostly you would be interested in 10-Q and 10-K forms that contain financial statements.
Before 2010 information was submitted in html format and after words in html as well as XML (XBRL) files. This link http://www.sec.gov/divisions/corpfin/organization/cfia-c.htm gives all companies CIK's registered at sec, if you want information about a company you can use this URL :
http://www.sec.gov/cgi-bin/browse-edgar?action=getcompany&CIK=GOOG&type=&dateb=&owner=include&count=40
This will show all the filings from the company, you can change few parameters from this URL :
count : will return you number of files in a request
CIK : it can be CIK number or symbol for a company
type : this allow you to restrict the type of file you want, e.g type=10-Q will only return 10-Q documents for that company.
You can use any crawler to get html and xml files.
Also you can find all files from a company here :
http://www.sec.gov/Archives/edgar/data/companyCIK

Related

Extract JSON Data From ThingSpeak API

so i want to get the value from one oof my fields in my thingspeak, i'm able to extract data from my channels but i want to get only one specific field
i read the documentation and the api link that looks like this
https://api.thingspeak.com/channels/<channel_id>/feeds.json?results=1
and when i opened the link it showed this
{"channel":{"id":1688112,"name":"ESP8266 - Web Controlled LED","latitude":"0.0","longitude":"0.0","field1":"Command","field2":"Red LED","field3":"Green LED","field4":"Blue Led","created_at":"2022-03-29T00:36:06Z","updated_at":"2022-04-06T03:12:36Z","last_entry_id":443},"feeds":[{"created_at":"2022-04-10T07:06:01Z","entry_id":443,"field1":null,"field2":"0","field3":"0","field4":"0"}]}
so my question is how do i extract the data for example from my field2 data where "field2":"0"?
i want to use it for my project in my html where later it can do some functions in my content.
thanks!
It really depends on the program you use.
But usually you find a JSON library to be installed in your IDE.
With it you extract any field from the JSON file

Access Website & Download files from a Server

I am trying to write a VBA macro to download files from our companies server. In order to download the files, I look for their number of our my excel list. E.G. the number is "250". Then I need to search for "250" on the website and then get the objectID of the file.
So the links of the download document looks like this :
https://plm.corp.int:10090/enovia/tvc-action/downloadMultipleFiles?objectId=***4706.39075.61185.44166***&object=250
4706.39075.61185.44166 this number is what I need to find for every of my numbers from excel, in order to edit the download link and get the files.
in the image you can see how it looks in the source code of the website...
Now I have absolutely no idea how I can extract such data our of source code in VBA
#Zwenn
enter image description here
the E2**** is the number out of excel, that i am searching for on the platform.
The 4706 number form my original question, is the unique ID of every E2***number.

Multiple entries containing exact file paths or text file on server containing multiple file paths with a single entry in the database to that file?

Here's some background information to help understand my dilemma. I've got a system written in PHP where users can fill out a form, upload a few images and everything gets archived in a .zip, I then have an "Account Page" that echo's a simple table containing a list of all of that specific users uploaded .zip's, the reason I'd need separate filepaths for each and every .zip is because no matter the user, they all need to be in the same single folder on the server for the broader application to work (these .zips are used for a mobile based Package Manager; see Cydia).
Would the smarter choice be to have every name of each .zip stored in a table on the database with things like the username and user_id tying to each entry, which would result in a few entries being for one user, and a few more being for a different user (depending on upload time), and everything will be unorganized. If I need to enter the database and manually search for a specific user's uploaded .zip's, I'll have to sort them out by user_id.
OR
Would it be more cost effective (in terms of passing data and hardware limitations) to have an XML file or even a plain .txt file on the server with a list of the users uploaded .zip's, and an exact file path pointing to them, and in the database simply have one column tied to the rest of the users information that points to that file containing multiple lines of filepaths?
It's a mouth full I know, and I have no problem achieving either of them as it's well within my skillset and knowledge of PHP & MySQL, I'm just not too sure which is the most secure and the best practice in the industry for this type of system.

Best way to store this data in data store google app engine

I am trying to make a phone app for my university's notice board.
This is the notice board. And each notice is served as an HTML page. The URL structure of the notices are simple, with "docid" giving each notice's ID. As far as I guessed from the pattern its an auto incrementing key.
My strategy so far has been to get the HTML file from with a get request, by incrementing the docid value. Parse the html to get the desired values, e.g Title, Posted by, Attention, Date and body.
Initially to store the existing notices to the datastore, then a cron job can check for new notices.
These sets of values will be served as JSON to the phone app.
The body part of the notice is formatted using HTML tags. I would like to retain the formatting. I am simply storing the body as a string which contains all the html tags. Could this be a problem somehow? Is there a better way to preserve the formatting?
I have to do this because i have no way of knowing upfront what sort
of formatting is done

csv file upload

In my Grails app, I would like admin users to be able to upload a CSV file that contains data such as:
List of users to be added to system
List of groups to be added to system
Assignment of users to groups
I have no idea how the user will generate these CSV files - most likely from Excel, Access or similar, and therefore I've no way of knowing which column will contain which data. So I'm planning to allow the user to specify which column contains users, groups, etc.
I'm wondering if there's a JavaScript component that could help with this. Ideally I'd like to implement the following:
User uploads file
In browser, user is shown first N lines of uploaded file and prompted to select the column that contains the users, groups, etc.
Column information is uploaded to server
Is there a client/server side component that could help with this, or an entirely different approach which would be superior to that outlined above?
I should emphasise that the users of this system will not be technically gifted, so expecting them to provide an XML/JSON file instead is out of the question (and you can definitely forget about asking them to call a Web Service instead of uploading a file).
Thanks,
Don
I like your solution so far, given that the users are non-technical, and that you want to be able to accept this data as a file upload, rather than have the users enter it directly into your application.
I would simply suggest that when the user uploads the file, the server returns the first five (or so) lines back to the client as an HTML table. Then you can have <select> drop-downs as the headers for each column, with the pre-set options you're looking for. You can validate that the user has assigned all available options to each column (use JS to remove options from the select as they use them, but be sure to provide a method to undo and change selections), and allow some columns not to be labeled (which the server will just ignore when parsing the file.
If possible, also illustrate (perhaps in a graph format or just an example sentence, if applicable) how their label choices will apply to the relationships. For example, "New user ABC will be a member of new group XYZ." If ABC and XYZ are unexpectedly backwards, the user will recognize they made a mistake.
Also, some users will inevitably upload a file where they used rows as columns and columns as rows. Either provide a GUI function to reverse this ("rotate" the table), or let them choose which axis to label.
I would also suggest providing your users with a collection of example files in various formats (Excel, Access, etc), and give them explicit instructions for how to enter the data they want, and step by step instructions to export as CSV and upload.
I have no idea how the user will generate these CSV files - most likely from Excel, Access or similar, and therefore I've no way of knowing which column will contain which data.
I should emphasize that the users of this system will not be technically gifted
With these two things in mind, are you sure that CSV import is the best way to handle bulk user creation? It's a great technical solution, but the question is, will your users be able to take advantage of it?
It may be worth implementing an alternative bulk create option for those who don't get CSV or are scared off by Excel. Perhaps a JS grid that has the required fields where they could manually enter the data for each field and enter as many as they need at once, with a link to upload a CSV file as an option for those who would use it.
For the CSV option, since your users are not technically-minded, it would be better to give them instructions on how to create the csv files that specify the order fields should be in. Along with a screen shot and a sample file.
Another option is to require the field names be the first row of the document, and require that they use specific labels for the fields. If you do that, you could figure out from the first row what order the data is in. You could also put in a check that looks for the titles in the first row and if they're not found, tell the user they need to add the field names to the CSV and re-upload.