Metro event scraper did not scrape new media links
reginafcompton opened this issue · comments
The Metro staff added media sources to the following events on December 11.
https://ocd.datamade.us/ocd-event/a4341b90-793d-4c17-9563-52018b89a7ba/
https://ocd.datamade.us/ocd-event/4e091b19-b407-4e4a-adc7-be6afb4e36bb/
However, the scraper did not update the events with the expected links, since none of the timestamps in the API were updated (i.e., 'EventLastModifiedUtc', 'EventAgendaLastPublishedUTC', 'EventMinutesLastPublishedUTC'):
http://webapi.legistar.com/v1/metro/events/1389
http://webapi.legistar.com/v1/metro/events/1419
Note: the Metro scraper runs with window=0.5. Running the full events scrape successfully imported the media data.
This issue seems to be in the same class as this one. @hancush - I'd appreciate any input you have on this one!
@reginafcompton i think you've done a great job capturing this issue and possible remedies here and in #239. did you ever get an answer to your question of whether metro has any control of last updated timestamps?
We've done a fair amount of testing for bills, but not events. This would certainly be something to consider with the Metro team.