In one of our use cases, we’d like to retrieve the content via API on every scheduled Distill check (i.e., every time Distill queries the API/webpage we provide), not only when a change is detected.
We want to handle change detection on our side. That way, if our processing fails for any reason, we won’t have to wait for the next content change, we can simply receive the data again on the next scheduled run based on the configured interval.
getting the latest item in change history via is quite simple. the following api call will fetch the latest data:
https://api.distill.io/v1/sieves/:sieve_id/data?_opt[only][0]=data&_opt[limit]=1
you can omit _opt[only] query parameter to get all fields.
note that there is no need to store and fetch data for every run where data didn’t change, one can use the latest data already saved in the db. duplicated data doesn’t need to be stored.
feel free to reach out to our support team by sending an email to support@distill.io in case you you have any other technical questions. they also help you use the api to help sync data between distill and your app in case that is your main objective.
that way I have to manage it by myself, meaning I have to call the API while I would like to get it via webhook.