Hi All, I used to be able to retrieve data recorded by Distill locally after finding it was stored at this path: C:\Users<user>\AppData\Local\Google\Chrome\User Data\Default\databases\chrome-extension_inlikjemeeknofckkjolnjbpehgadgge_0\24. The file ‘24’ was an sqlite database. However since some updates that happened in July '24 (I believe) this file is now dormant and not being updated. Please can you tell me where the data is now being stored and how I can export it? This used to be a really simple way to get any past data. The export function in the distill page will only export the latest report by the looks. I am using the free price plan. Thanks in advance for the advice.
@aaupetel chrome deprecated support for websql in extensions and enforced the requirement of using manifest version 3 for all updates since june 2024. data is no longer stored in the usual location. distill now uses opfs and sqlitewasm to store the data.
finding how browsers store the opfs’s data is delibrately not documented. this makes it tricky to find the actual file. check out the following answer on stackoverflow for more information: javascript - Where does OPFS with SQLite WASM store files for the chrome extension? - Stack Overflow
Thanks for the reply @ajitk. Is there another way I can export the data then? In effect I just want to export what it returns.
The pic shows the records the new method of data storage has for one of my URLs. At the moment I am having to consider to copy and paste it manually into a spreadsheet but it would be much easier if it was automated. I was looking at the email action but I feel that’s going to be too complicated.
And just one point on export. When I use the export feature (either csv or JSON) it doesn’t seem to include what I expect, ie I want all past records from all URLs currently active. It only shows either the very latest or just the setup for each one. You have to manually expand each URL and then export that specific one in order to see the history.
Any thoughts most welcome
Thanks.
change history can be automatically exported to a spreadsheet. please see How to save web page changes in Google Sheets? – Distill.
Hi @ajitk I think that webhook will only report when there is a change and won’t do the whole history. Also, it would be good to keep this local.
Any other ideas?
Thanks
once the webhooks are set, every change since then will be automatically exported. api (for enterprise) is another way to get data.