Can Distill detect updates/changes in multi page websites?

[scsb]

Hi Surya,

I am trying to track the changes to the forms that are available on How to Apply for Dust Disease Care | icare through the href. However, the href option is not available in the drop down (refer attached screenshot). In this instance, what would be the best way for me to track the changes?

Also I am trying to track the changes to the land registry forms on Forms Library - NSW Land Registry Services
I noticed that in order to track the forms, I will need to expand the relevant row that bears the form heading and select the relevant forms and only one row can be expanded at a time. Will Distill be able to track the changes to the forms if I expand a certain row, then click Select Element at the bottom left and then select the relevant form (and select href), then pause Select Element, move on to expand another row, then click Select Element again to select another form?

Your assistance in this regard would be greatly appreciated.

Thank you.

[surya]

Hi @scsb

For the website: How to Apply for Dust Disease Care | icare
Please try expanding the selection, as shown in the screenshot below, you should get the anchor tag & the corresponding href element:

In the case of Forms Library - NSW Land Registry Services, I believe if you select the forms which you’d like to track & the corresponding href attributes, it should work. Please feel free to reach out, if you have any challenges & we’ll be happy to help you out.

Best regards,
Surya

[scsb]

Hi Surya,

Thank you for your assistance. After expanding the selection in the iCare page, I managed to view and select the href attribute, however when I expand the webpage in the watchlist, I could see a few huge pdf images (refer image). Is there a way for me to get rid of those pdf images?

Thank you Surya.

[scsb]

Meanwhile, I have also tried to select the forms in Forms Library - NSW Land Registry Services. When I landed in the website, I sorted the forms by form number and selected the forms that I wish to track within each page. However after I saved the webpage, I realised that the forms that appeared in the webpage dropdown is different from what I have selected (refer image below). Would you be able to advise how can I properly track the forms that I have selected?

[surya]

Hi @scsb

Can you please export the JSON for the corresponding monitor & share it with me?
Please feel free to take a look at this video, to export the JSON configuration.
I’d like to take a look at the configuration, to suggest you the best way to address this challenge.

Cheers,
Surya

[surya]

Hi @scsb

I believe that in this scenario you will have to use a macro, if you need to track the sorted list of forms.
If you notice, when you click the sort button, the URL doesn’t change & hence tracking on this page will have to be setup using a macro.

Best,
Surya

[scsb]

Hi Surya,

Thank you for your reply.

Here’s the JSON for the Dust Diseases Form Monitor:

{“client”:{“local”:1},“data”:[{“name”:“NSW Forms / Dust Diseases Forms (7/6)”,“uri”:“https://www.icare.nsw.gov.au/injured-or-ill-people/work-related-dust-disease/make-an-application",“config”:“{\“selections\”:[{\“frames\”:[{\“index\”:0,\“excludes\”:[],\“includes\”:[{\“type\”:\“xpath\”,\“expr\”:\”(//main[@id=‘main’]/section[contains(@class,‘cm’)]/ul//a[contains(@class,‘link-item’)])[1]\",\“fields\”:[{\“name\”:\“text\”,\“type\”:\“builtin\”},{\“type\”:\“attribute\”,\“name\”:\“href\”}]},{"type":"xpath","expr":"(//main[@id=‘main’]/section[contains(@class,‘cm’)]/ul//a[contains(@class,‘link-item’)])[2]","fields":[{"name":"text","type":"builtin"},{"type":"attribute","name":"href"}]},{"type":"xpath","expr":"(//main[@id=‘main’]/section[contains(@class,‘cm’)]/ul//a[contains(@class,‘link-item’)])[3]","fields":[{"name":"text","type":"builtin"},{"type":"attribute","name":"href"}]},{"type":"xpath","expr":"(//main[@id=‘main’]/section[contains(@class,‘cm’)]/ul//a[contains(@class,‘link-item’)])[4]","fields":[{"name":"text","type":"builtin"},{"type":"attribute","name":"href"}]},{"type":"xpath","expr":"(//main[@id=‘main’]/section[contains(@class,‘cm’)]/ul//a[contains(@class,‘link-item’)])[6]","fields":[{"name":"text","type":"builtin"},{"type":"attribute","name":"href"}]},{"type":"xpath","expr":"(//main[@id=‘main’]/section[contains(@class,‘cm’)]/ul//a[contains(@class,‘link-item’)])[7]","fields":[{"name":"text","type":"builtin"},{"type":"attribute","name":"href"}]},{"type":"xpath","expr":"(//main[@id=‘main’]/section[contains(@class,‘cm’)]/ul//a[contains(@class,‘link-item’)])[5]","fields":[{"name":"text","type":"builtin"},{"type":"attribute","name":"href"}]}]}],"dynamic":true,"delay":2}],"ignoreEmptyText":true,"includeStyle":false,"dataAttr":"text"}”,“tags”:null,“content_type”:2,“state”:40,“schedule”:“{"type":"INTERVAL","params":{"interval":84688}}”,“ts”:“2023-06-07T07:57:34.855Z”,“datasource_id”:null}]}

[scsb]

Hi Surya,

I’ve set up a monitor a few days ago to track the changes to a number of Local Court forms on https://www.localcourt.nsw.gov.au/forms-and-fees/forms.html#Criminal1. Earlier, I received an alert and noted that some of the forms that I’ve selected has changed to other forms, aren’t the trackers set to the specific documents selected? I would be grateful if you can clarify the reason behind the change.

Thank you.

[scsb]

Hi Surya,

I’ve also received another alert for the District Court Forms. As seen below, I’ve only selected 8 forms to track however it has now added another form (the one highlighted in green). I am not sure why is this the case.

[surya]

Hi @scsb

This can potentially arise because the order in which the forms are displayed on the page may have changed.
You may have to modify the selector configuration to ensure you always track those specific links of interest.

Cheers,
Surya

[scsb]

Hi Surya,

Thanks for your reply.

How should I modify the configuration to ensure that the specific links are tracked?

[scsb]

Hi Surya,

I hope you’ve been well.

As I have been working on other projects, I haven’t been able to update the webpage selection criteria for those websites in my watchlist so that specific links are tracked (so that the forms that I want to track won’t be untracked just because the arrangement in the source website has changed). I recall from my our previous conversation that you have suggested me to use the webapp for better tracking selectors. I have tried to do so today but I note that the selectors are similar to the ones done through the Google Chrome extension (refer screenshot). As such, can I trouble you to please share the steps on how I can improve the selection criteria once again? Thank you.

[surya]

Hi @scsb

The selectors are a configuration associated with the monitor.

In this case, the most likely scenario is that you originally created the monitor using the web app in the cloud and switched it to local monitoring (using the extension).

Is there a way to uniquely identify the rows that you’d like to track/monitor?
Assuming the form code number does not change, you can try using an XPath as follows:

//*[contains(text(),'form code')]//../td

The above XPath can be broken down as follows:
a. Select the element whose text contains form code
b. The ‘//..’ selects the parent
c. The ‘/td’ selects the first occurrence of td element among the children

Note that the above selector will select the first element in the table row. If you need the 2nd td element, you’ll have to modify the XPath as follows:

//*[contains(text(),'form code')]//../td[2]

Please ensure to replace the form code corresponding to each form you want to track.
Hope that helps.

Cheers,
Surya

[scsb]

Hi Surya,

Thank you for your reply.

I have tried to select the elements and changed the selector type to XPath and I note that it seems to be selecting everything in the table. I believe I am supposed to update the text ‘page-content’ to the actual form code but I wasn’t sure what is the form code in this instance. Are you able to clarify further please?

[surya]

Hi @scsb

In your screenshot, the form code will be ODA 076 I
Hope that helps.

Cheers,
Surya

[scsb]

Hi Surya,

Thanks for your prompt response.

I’ve tried to update the text ‘page-content’ to ‘ODA 076 I’ but it is indicated that it is not a valid selector. Can you kindly advise what is it that I am missing out here?

[surya]

Hi @scsb

The selector should be of the form:

//*[contains(text(),'ODA 076 I')]//../td

The above selector tries to target the element based on a certain text being present within the element & hence I suggested the same in your scenario.

Hope that helps clarify the suggestion.

Cheers,
Surya

[scsb]

Thanks Surya. I think I’ve managed to work it out for the above scenario.

However when I went to create another monitor for Forms and applied the same method, it doesn’t seem to work (refer screenshot). In this instance, how can I make sure that only the forms that I’ve selected are tracked even if their order/arragement is changed in the source website?

[surya]

Hi @scsb

There are 2 issues with your selector:

1. contains(text(),...) selectors are case-sensitive.
2. There is no number in the text in the page.

Try something as follows:

//*[contains(text(),'Subpoena')]/../a

Please note that the above selector uses the wild card search on text contains and checks for the immediate parent being an anchor tag. It will fail to detect, if this is not found in the page (or the structure changes).

I’d recommend you to look at an online tutorial on XPath to ensure you are able to understand better how it works.

Cheers,
Surya

[scsb]

Thank you for your assistance, Surya.