VBA access drop downs properly in a website - html

Question

I'm having a bit of a problem. I'm hoping some VBA guru's can help me with. I have a website that has drop down options I'd like to be able to select. Right now my code is off and I'm not sure what I'm doing wrong. I looked over the website trying to find out what I was doing wrong but nothing I found that could answer my question directly. Any help would be greatly appreciated.
Here is what I have:
Private Sub CMReportExport()
Dim IEapp As Object
Dim WebUrl As String
Dim yearList As Object
Dim prefixList As Object
Dim versionList As Object
Set IEapp = CreateObject("InternetExplorerMedium.Application")
'Set IEapp = CreateObject("InternetExplorer.Application")
WebUrl = "http://reporthub/Enterprise/Pages/Report.aspx?ItemPath=%2fSupply+Chain%2fProduction%2fContribution+Margin%2fNonFood%2fNonFood+CM+RetailCat"
With IEapp
.Silent = True
.Visible = True
.navigate WebUrl
End With
While IEapp.Busy Or IEapp.readyState < 4: DoEvents: Wend '<== Ensure page loaded
Set yearList = IEapp.document.querySelectorAll("#ctl32_ctl04_ctl03_ddValue option") '<==apply CSS selector to get nodeList
Set prefixList = IEapp.document.querySelectorAll("#ctl32_ctl04_ctl05_ddValue option")
Set versionList = IEapp.document.querySelectorAll("#ctl32_ctl04_ctl07_ddValue option")
yearList.item(2).Selected = True 'Index into nodeList e.g. second item is at index 2 = year 2018
prefixList.item(2).Selected = True
versionList.item(1).Selected = True
'Set IEapp.getElementById("ctl32_ctl04_ctl03_ddValue").selectedvalue = 2 'Year
'Set IEapp.getElementById("ctl32_ctl04_ctl05_ddValue").selectedvalue = DA 'Prefix
'Set IEapp.getElementById("ctl32_ctl04_ctl07_ddValue").selectedvalue = 1 'Version
End Sub
The HTML elements (a chunk) are as follows:
<tr>
<td class="ParamLabelCell"><label for="ctl32_ctl04_ctl03_ddValue"><span>Year</span></label>
</td>
<td class="ParamEntryCell" style="padding-right:0px;"><div id="ctl32_ctl04_ctl03">
<select name="ctl32$ctl04$ctl03$ddValue" onchange="javascript:setTimeout('__doPostBack(\'ctl32$ctl04$ctl03$ddValue\',\'\')', 0)" id="ctl32_ctl04_ctl03_ddValue" disabled="disabled">
<option selected="selected" value="0"><Select a Value></option>
<option value="1">2019</option>
<option value="2">2018</option>
<option value="3">2017</option>
<option value="4">2016</option>
<option value="5">2015</option>
</select>
</div></td><td class="InterParamPadding"></td><td class="ParamLabelCell"><label for="ctl32_ctl04_ctl05_ddValue"><span disabled="disabled">Offer</span></label></td><td class="ParamEntryCell" style="padding-right:0px;"><div id="ctl32_ctl04_ctl05">
<select name="ctl32$ctl04$ctl05$ddValue" onchange="javascript:setTimeout('__doPostBack(\'ctl32$ctl04$ctl05$ddValue\',\'\')', 0)" id="ctl32_ctl04_ctl05_ddValue" disabled="disabled" class="EmptyDropDown">
</select>
</div>
</td>
</tr>
<tr IsParameterRow="true">
<td class="ParamLabelCell"><label for="ctl32_ctl04_ctl07_ddValue"><span disabled="disabled">Version</span></label></td>
<td class="ParamEntryCell" style="padding-right:0px;"><div id="ctl32_ctl04_ctl07">
<select name="ctl32$ctl04$ctl07$ddValue" id="ctl32_ctl04_ctl07_ddValue" disabled="disabled" class="EmptyDropDown">
</tr>

Answer 1

Caveat:
I can't test against that webpage and there is not enough HTML to know if there are forms/frames and the like to also negotiate. The following is based on the HTML snippet provided. Mileage may vary.
CSS selectors:
You can use CSS selectors to target elements. For example you can get all the year options with the following selector, and then index into the returned nodeList:
#ctl32_ctl04_ctl03_ddValue option
The above selector says all elements with option tag that have parent element with id ctl32_ctl04_ctl03_ddValue. "#" is the id selector.
There is not enough HTML to advise on the other elements you are targeting for sure but see my suggestions at the bottom. This illustrates the principle of using CSS selectors to target elements by page styling. More info on CSS selectors here and here.
CSS query results on HTML section provided:
Getting the nodeList and selected an option - VBA:
As more than one element is matched, querySelectorAll method is used to apply the selector and return the nodeList of matching elements.
For example:
While IEapp.Busy Or IEapp.readyState < 4: DoEvents: Wend '<== Ensure page loaded
Dim yearList As Object
Set yearList = IEapp.document.querySelectorAll("#ctl32_ctl04_ctl03_ddValue option") '<==apply CSS selector to get nodeList
yearList.item(1).Selected = True 'Index into nodeList e.g. second item is at index 1 = year 2019
Assuming similar pattern for your other two option lists:
Dim prefixList As Object, versionList As Object
Set prefixList = IEapp.document.querySelectorAll("#ctl32_ctl04_ctl05_ddValue option")
Set versionList = IEapp.document.querySelectorAll("#ctl32_ctl04_ctl07_ddValue option")
Then index into those.
If problems with While IEapp.Busy Or IEapp.readyState < 4: DoEvents: Wend then try the following instead:
While IEapp.readyState < 4: DoEvents: Wend
Dim waitUntil As Date
waitUntil = Now + TimeValue("00:00:11") '<==Adjust additional wait time in seconds here
Do
DoEvents
Loop Until Now >= waitUntil
XMLHttpRequest (XHR)
You are currently using IE browser which is a slow method for scraping. It may be possible for you to retrieve the required info by issuing an XHR POST request. I can't test against that page but you can find more info here and here.