Use Open Data Files for Regular Full Data Downloads
If you require regular updates of entire local authority (LA) data, consider downloading the Open Data files and then processing the data from your local copy.
These files are updated nightly. The data source is the same as the ratings website, and the V1 & V2 APIs.
Open Data is the best option to get full daily updates. The files have an extractDate in them that signal when the data has changed (not all LAs change every night). By using these files and the extract date, you can minimise your processing, and get a full update as fast as possible.
You can get the list of the URLs for Open Data files by querying the local authority endpoint in the API. It is advised that the URLs are queried from this list: there is the possibility that the files will be moved (e.g. to a Content Delivery Network) in the future, at which point the URLs will change: if you are getting them from the API the change will be seamless.