I’d like to be able to capture information multiple times during what I believe would be best served as a macro. I want to go to a jobs page, search a key word, then click through the paginated results and capture the HTML on the page each time (and ideally send the full list of those jobs to my webhook). I understand that the macro can do the keyword searching and clicking through the results, its the overall capture process on each step that’s eluding me. Any advice on if this is possible?
@akillough This is a great use case, and you’re absolutely right that a macro is the way to go for interacting with elements like search fields and pagination. While macros can perform keyword searches and click through results, Distill captures content only after the full macro finishes running — meaning it will monitor the final state of the page, not each intermediate step. If multi-step capturing becomes essential for your use case, it may require a more customized approach outside of Distill’s current capabilities.
@akillough Just to add — for use cases like yours, we also offer Managed Scrapers, which are ideal for more advanced workflows like paginated job listings and multi-step content extraction.
Unlike macros, Managed Scrapers can capture data across multiple pages, aggregate results, and share the results — exactly the kind of flow you’re looking for. We already support several popular websites, and we’re happy to explore adding support for others based on your needs.
If you’re interested, feel free to reach out to our support team — either via the live chat on our website at https://distill.io/ or by emailing us at support@distill.io. We’d be glad to walk you through the options!