How can I scrape a child span class using VBA? - html

Question

I would like to use the below code to scrape the ranking position in one of amazon's sub categories (Candy & Chocolate Bars). Please see attached picture for the html code. Referring to "a-list-item" gives me a lot of results, however, the "#204" is not part of it. Thus, my question is two-fold: (i) is there a way to get all the items labeled "a-list-item" and (ii) is there a way that just gives me back the ranking position without pulling all other items. Option (ii) would be superior for my purposes.
Thanks for your time and efforts.
html code with target value
Public Sub social()
'--------------------------------------------------------------------------
Dim WSactive As Worksheet
Dim IE As New InternetExplorer
Set WBactive = ActiveWorkbook
Set WSactive = WBactive.Sheets("Tabelle1")
'-----------------------------------------------------------------------------
On Error Resume Next
'-------------------------------------------------------------------------
With WSactive
Dim results(0 To 4) ', counter As Long, i As Long
With IE
.Visible = False
'If TBLurl.DataBodyRange.Cells(i, w).Value <> "" Then
url = "https://www.amazon.com/dp/B08X19ZCHS?ref=myi_title_dp"
.navigate url
'--------------------------------------------------------------------------
While .Busy Or .readyState < 4: DoEvents: Wend
Dim aNodeList As Object, ele As Object, t As Date
Const MAX_WAIT_SEC As Long = 5
t = Timer
Do
DoEvents
On Error Resume Next
Set ele = .document.querySelector(".rhpdm")
On Error GoTo 0
If Timer - t > MAX_WAIT_SEC Then Exit Do
Loop While ele Is Nothing
'--------------------------------------------------------------------------
Set aNodeList = .document.querySelectorAll(".a-list-item")
Dim j As Long
For j = 0 To aNodeList.Length - 1
Debug.Print aNodeList.Item(j).innerText
Next j
Set aNodeList = Nothing: Set ele = Nothing
.Quit 'close IE
End With
End With
'-------------------------------------------------------------------------
End Sub

Answer 1

There is only 1 Url shown and a css path to that node can be
Debug.Print .document.querySelector('#detailBulletsWrapper_feature_div #detailBullets_feature_div + ul .a-list-item .a-list-item').innerText
The + is an adjacent sibling combinator specifying ul that follows at same level an element with id detailBullets_feature_div. The spaces are descendant combinators, meaning elements on right are children of elements on left of space. The . are class selectors for the class names of elements.
The html in your image appears to be slightly different from the provided url however. Your mileage with the above solution may vary. I have gone for positional matching on assumption other pages will have similar layout.
Even if you were doing a loop over different pages, pages as per the provided url would have only that one ranking to pick up (if as shown in your image).
You don't need the overhead of the browser. The following shows you how to get both rankings on the page (not just the one you showed) using xhr:
Option Explicit
Public Sub PrintRankings()
'tools > references > Microsoft HTML Object Library
Dim html As MSHTML.HTMLDocument, xhr As Object
Set xhr = CreateObject("MSXML2.XMLHTTP")
Set html = New MSHTML.HTMLDocument
With xhr
.Open "GET", "https://www.amazon.com/dp/B07YG6MTD3?ref=myi_title_dp&th=1", False
.setRequestHeader "User-Agent", "Mozilla/5.0"
.send
html.body.innerHTML = .responseText
End With
Debug.Print html.querySelector("#detailBullets_feature_div + ul span > span").NextSibling.NodeValue
Debug.Print html.querySelector("#detailBulletsWrapper_feature_div #detailBullets_feature_div + ul .a-list-item .a-list-item").innerText
End Sub