Xpath to JSON - still needs tidying - json

Question

I am trying to get the table of data from this website. and serve it out as JSON.
I am taking my first steps with Yahoo Pipes/XPath, so apologies in advance for the noob Qs.
I have a pipe that just uses an XPath expression:
//table1/tbody/tr
Which gives me the following JSON output (snippet, 1 of about 30 items):
"items": [{
"td": [{
"a": {
"href": "http:\/\/www.hydro.com.au\/system\/files\/water-storage\/Web_Lakes_AUGUSTA.pdf",
"content": "Lake Augusta"
}
},
{
"p": "2.58"
},
{
"p": "Steady"
}],
"description": null,
"title": null
},
What I want to end up with is a flattened out version, something like this:
"items": [{
{
"href": "http:\/\/www.hydro.com.au\/system\/files\/water-storage\/Web_Lakes_AUGUSTA.pdf",
},
{
"content": "Lake Augusta"
},
{
"p": "2.58"
},
{
"p": "Steady"
}],
},
Can someone help me achieve this? Should I be doing more with the original XPath, or is there a particular processor within Pipes that will help me accomplish this?

Answer 1

It's not possible to select the data structure you want directly with XPath.
However, it's not difficult to manipulate selected data in Yahoo Pipes, for example by combining a "Loop" module with a "Item Builder" module.
The result is a feed that looks like this:
{
"count": 43,
"value": {
"title": "Hydro Tasmania Lake Levels",
"description": "Hydro Tasmania Lake Levels\n\nfrom StackOverflow Question http://stackoverflow.com/q/23248288/18771",
"link": "http://pipes.yahoo.com/pipes/pipe.info?_id=d2fe64963964bf6636b58fb7b9814ef0",
"pubDate": "Fri, 25 Apr 2014 06:12:35 +0000",
"generator": "http://pipes.yahoo.com/pipes/",
"callback": "",
"items": [
{
"title": "Lake Augusta",
"link": "http://www.hydro.com.au/system/files/water-storage/Web_Lakes_AUGUSTA.pdf",
"meters": "2.58",
"comment": "Steady",
"description": null
},
... more ...
]
}
}