mitmproxy to export web traffic as JSON [closed] - json

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
This question does not appear to be about a specific programming problem, a software algorithm, or software tools primarily used by programmers. If you believe the question would be on-topic on another Stack Exchange site, you can leave a comment to explain where the question may be able to be answered.
Closed 1 year ago.
Improve this question
Trying to save the captured web traffic of the raw HTTP request/response while using mitmproxy:
Followed https://github.com/mitmproxy/mitmproxy/blob/main/examples/contrib/jsondump.py with
mitmproxy -s /pkg/mitmproxy/jsondump.py, and with
$ cat ~/.mitmproxy/config.yaml
dump_destination: "/tmp/mitmproxy.log.json"
But my "/tmp/mitmproxy.log.json" was never written to.
Then tried mitmproxy -w outfile as per Dump packets collected with mitmproxy, but the output is not in JSON format
Then tried mitmproxy -s /pkg/mitmproxy/jsondump.py -w outfile and the output is still not in JSON format.

Mitmproxy currently has no JSON export. We're tentatively planning to support HAR export soon though. There's a community-contributed example for this here, which I think is in better shape than the jsondump one: https://github.com/mitmproxy/mitmproxy/blob/main/examples/contrib/har_dump.py

Related

ipfs name publish does not publish to peerID [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
This question does not appear to be about a specific programming problem, a software algorithm, or software tools primarily used by programmers. If you believe the question would be on-topic on another Stack Exchange site, you can leave a comment to explain where the question may be able to be answered.
Closed 2 years ago.
Improve this question
I am trying to publish a file on my ipfs node. In order to do so I use the following commands:
ipfs add someFile.txt
// added <someHash> someFile.txt
ipfs name publish <someHash>
// Published to <notPeerID>: /ipfs/<someHash>
I get the weird behavior that ipfs name publish does not use the peerID to publish the file to. It is not the peerID ipfs id returns. Also does not look like a normal ipfs hash either, it does not start with 'Qm' but 'k'. Anyone have an idea what I could try to fix that?
As of go-ipfs 0.7, IPNS paths encode the key name as a base36 CIDv1 (k...) instead of base58 (Qm...).
You can read more about this here - there's a section on exactly this change: https://blog.ipfs.io/2020-09-24-go-ipfs-0-7-0/

Is there any tool for manupolation Json data? [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 1 year ago.
Improve this question
I have a large Json log file which contain result of a web service call. now I need to search inside it and find some element with multiple condition.
is there any tool for making query and administration On json log file?
First open the file in an editor to understand its structure. If the file is huge, as you write, browse it page-by-page with a command such as more or less.
Then use jq to obtain the data that interests you. Start by extracting some top-level elements to get the hang of the process and then gradually refine your invocation to what you actually want to obtain.
The jq tutorial has many invocation examples. You can also see a specific use case in a blog post I wrote on recovering Firefox session data from the browser's json session file.

Remove quotes from CSV output [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
This question does not appear to be about a specific programming problem, a software algorithm, or software tools primarily used by programmers. If you believe the question would be on-topic on another Stack Exchange site, you can leave a comment to explain where the question may be able to be answered.
Closed 2 years ago.
Improve this question
I'm using Trifacta Wrangler to rearrange some datasets, stored in CSV files. I have to produce a CSV file as output, but when I do that Trifacta Wrangler surrounds every value, even integers and floats, with quotes, even if the column type is correctly set. How can I avoid that?
This can be changed by looking under the "More Options" accordion on job run output: there's an option labeled "include quotes" that controls this.

searching 2GB sql.gz file for frequently used word [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
This question does not appear to be about a specific programming problem, a software algorithm, or software tools primarily used by programmers. If you believe the question would be on-topic on another Stack Exchange site, you can leave a comment to explain where the question may be able to be answered.
Closed 7 years ago.
Improve this question
I want to change slug x to slug y, it is so important and critical change.
There are ~ 150 tables with bunch of columns so Mysql search wouldn't be efficient. I tried to search from backup file. But I couldn't succeded with zgrep.
I would like to search 'x'|/x/ but not x-y or www.x.com it is actually simple regex but couldn't achieve with zgrep could you please give some advice how to use zgrep for this purpose ?
zgrep "'x'|/x/" daily_backup.sql.gz
any help would be appreciated.
Something like this?
zcat daily_backup.sql.gz| grep -E "'x'|/x/"
-E puts grep into 'extended regexp' so the alternation operator | works

Converting .264 to .avi (audio is out of sync) [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
This question does not appear to be about a specific programming problem, a software algorithm, or software tools primarily used by programmers. If you believe the question would be on-topic on another Stack Exchange site, you can leave a comment to explain where the question may be able to be answered.
Closed 7 years ago.
Improve this question
I am converting a .264 with its .wav file to .avi and the duration of the generated file is smaller than it should be. This is a problem for me because the video is not synchronized with the audio.
I've tested several parameters (-async,-vsync, sync_file_id) and did not notice any change in the file. For example:
avconv -r 15 -i input.264 -i input.wav -c:a copy -map 0:a -map 1:v output.avi
Anyone have any ideas?
ps: The .264 and .wav files were extracted from a pcap file using the program Videosnarf