Metro: _is_restricted() may be too greedy

Question

Metro: _is_restricted() may be too greedy

hancush opened this issue 4 years ago · comments

hannah cushman garland commented 4 years ago

Over the weekend, nearly 80 percent of Metro bills were coming back as restricted.

# On the Metro server
>>> from lametro.models import *
>>> Bill.objects.count()
3245
>>> LAMetroBill.objects.count()  # filters restricted bills, among other conditions
631
>>> Bill.objects.filter(extras__restrict_view=True).count()
2579

The only visible bills seem to be from 2014-2016. This seems not right. I've got a line out to Metro to see what happened. Will update this thread.

hannah cushman garland · Answer 1 · Tue Jul 21 2020 21:46:33 GMT+0800 (China Standard Time)

Per Metro, there was no mass archival, i.e., this is not expected behavior. In testing, I noticed that the Gateway link that we use to determine a bill's InSite URL does not seem to work consistently, e.g., we can't view the bill in the web interface even when it's set to publicly viewable, not a draft, etc.

The Gateway link still seems to work for some bills, for example:

But, it doesn't work for others that otherwise have no indication they should be private, e.g.,

(scrapers-us-municipal) call-me-hank:scrapers-us-municipal hannah$ pupa update --scrape lametro bills window=7 --rpm=0 --fastmode
lametro (scrape)
  bills: {'window': '7'}
...
08:37:31 INFO scrapelib: HEAD - https://metro.legistar.com/gateway.aspx?m=l&id=6922
08:37:32 WARNING legistar: Bill could not be found in web interface: https://webapi.legistar.com/v1/metro/matters/6922
6922 False Approval Review Executive Management Committee No Legistar URL
6922 False Approval Review Executive Management Committee No Legistar URL
6922 False Approval Review Executive Management Committee No Legistar URL
08:37:32 INFO pupa: save bill 2020-0480 in 2020 as bill_54022e62-cb57-11ea-8f00-acde48001122.json
...
08:37:33 INFO scrapelib: HEAD - https://metro.legistar.com/gateway.aspx?m=l&id=6923
08:37:33 WARNING legistar: Bill could not be found in web interface: https://webapi.legistar.com/v1/metro/matters/6923
6923 False Approval Review Executive Management Committee No Legistar URL
6923 False Approval Review Executive Management Committee No Legistar URL
6923 False Approval Review Executive Management Committee No Legistar URL
08:37:33 INFO pupa: save bill 2020-0481 in 2020 as bill_55197e40-cb57-11ea-8f00-acde48001122.json
...

(I pushed debugging print statement to this branch.)

Upon manual review, the bills are private in the API (i.e., you can't access them without a token) and the Gateway link does not work. Here are a bunch more, from a broader scrape:

08:40:13 INFO scrapelib: HEAD - https://metro.legistar.com/gateway.aspx?m=l&id=2418
08:40:13 WARNING legistar: Bill could not be found in web interface: https://webapi.legistar.com/v1/metro/matters/2418
2418 False Discussed Board of Directors - Regular Board Meeting No Legistar URL
08:40:13 INFO scrapelib: HEAD - https://metro.legistar.com/gateway.aspx?m=l&id=2416
08:40:13 WARNING legistar: Bill could not be found in web interface: https://webapi.legistar.com/v1/metro/matters/2416
08:40:13 INFO scrapelib: HEAD - https://metro.legistar.com/gateway.aspx?m=l&id=2419
08:40:13 WARNING legistar: Bill could not be found in web interface: https://webapi.legistar.com/v1/metro/matters/2419
2419 False Passed Board of Directors - Regular Board Meeting No Legistar URL
08:40:13 INFO scrapelib: HEAD - https://metro.legistar.com/gateway.aspx?m=l&id=2421
08:40:13 WARNING legistar: Bill could not be found in web interface: https://webapi.legistar.com/v1/metro/matters/2421
2421 False Passed Board of Directors - Regular Board Meeting No Legistar URL
08:40:13 INFO scrapelib: HEAD - https://metro.legistar.com/gateway.aspx?m=l&id=2417
08:40:13 WARNING legistar: Bill could not be found in web interface: https://webapi.legistar.com/v1/metro/matters/2417
08:40:13 INFO scrapelib: HEAD - https://metro.legistar.com/gateway.aspx?m=l&id=2422
08:40:13 WARNING legistar: Bill could not be found in web interface: https://webapi.legistar.com/v1/metro/matters/2422
2422 False Passed Board of Directors - Regular Board Meeting No Legistar URL
08:40:13 INFO scrapelib: HEAD - https://metro.legistar.com/gateway.aspx?m=l&id=2423
08:40:13 WARNING legistar: Bill could not be found in web interface: https://webapi.legistar.com/v1/metro/matters/2423
2423 False Passed Board of Directors - Regular Board Meeting No Legistar URL
08:40:13 INFO scrapelib: HEAD - https://metro.legistar.com/gateway.aspx?m=l&id=2425
08:40:13 WARNING legistar: Bill could not be found in web interface: https://webapi.legistar.com/v1/metro/matters/2425
2425 False Discussed Board of Directors - Regular Board Meeting No Legistar URL
08:40:13 INFO scrapelib: HEAD - https://metro.legistar.com/gateway.aspx?m=l&id=2424
08:40:13 WARNING legistar: Bill could not be found in web interface: https://webapi.legistar.com/v1/metro/matters/2424
2424 False Discussed Board of Directors - Regular Board Meeting No Legistar URL

I don't have time to run a broader scrape to get a sense of whether this could account for the scale of the missing bills. But it seems to me like something may have changed on Metro's side / in Legistar...

hannah cushman garland · Answer 2 · Tue Jul 21 2020 21:52:33 GMT+0800 (China Standard Time)

Annoyingly the Metro scrape logs on the OCD server is empty, and yesterday's daily scrape failed a few minutes into the full bill scrape in the dashboard, so I don't have logs for a full bill scrape since this issue started to occur. I just triggered a fast full bill scrape on the dashboard – will let it run today and see what we see this afternoon.

hannah cushman garland · Answer 3 · Wed Jul 22 2020 03:55:37 GMT+0800 (China Standard Time)

I downloaded the associated log from S3 and searched for bills that are not accessible via the web interface:

call-me-hank:~ hannah$ grep "could not be found in web interface" ~/Downloads/1.log | wc -l
    2306

That seems about in line with the magnitude of missing bills.

I created an extract of the log with links to the matter in the API, followed by the gateway URL that did not resolve.

grep -B 1 "could not be found in web interface" ~/Downloads/1.log > ~/Desktop/private_matters.log

I am going to share this with Metro for further investigation.

hannah cushman garland · Answer 4 · Wed Jul 22 2020 21:19:36 GMT+0800 (China Standard Time)

The private bills we shared were indeed private. I scraped one bill that Metro expected to be visible but wasn't, and observed that it was imported as public, so I ran a fast full scrape, and behold, public bills have been restored.

I will keep this issue open as I track down why so many bills were imported as private last last week / over the weekend. Will port to the DataMade fork or the Legistar scraper if scheduling or underlying code, respectively, is implicated.

hannah cushman garland · Answer 5 · Thu Jul 23 2020 22:07:51 GMT+0800 (China Standard Time)

This was not a problem with _is_restricted().

Rather, the gateway URLs for public bills were not accessible for some reason over the weekend. See: datamade/scrapers-us-municipal#55 (comment).

This smacks of a Legistar failure. I opened opencivicdata/python-legistar-scraper#110 to (hopefully) be able to discern between system failures and actual private bills.

@fgregg suggests we also interrogate why we don't trust MatterRestrictViewViaWeb. Are there some instances where this is false, but bills don't appear in the web interface?

Forest Gregg · Answer 6 · Thu Jul 23 2020 22:53:59 GMT+0800 (China Standard Time)

@fgregg suggests we also interrogate why we don't trust MatterRestrictViewViaWeb. Are there some instances where this is false, but bills don't appear in the web interface?

let's do full scrape where we track disagreements

bills where the MatterRestrictViewWeb is false but the bill does not appear in the web interface
bills where the MatterRestrictViewWeb is true but the bill does appear in the web interface

hannah cushman garland · Answer 7 · Tue Jul 28 2020 00:11:12 GMT+0800 (China Standard Time)

Added logging as suggested, @fgregg! My full scrape timed out, but we got some useful signal:

10:02:20 INFO pupa: Matter 1028: MatterRestrictViewViaWeb is False, legistar_url is None
10:02:20 INFO pupa: Matter 1027: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:25 INFO pupa: Matter 1868: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:37 INFO pupa: Matter 1917: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:38 INFO pupa: Matter 1918: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:38 INFO pupa: Matter 1919: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:38 INFO pupa: Matter 1920: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:38 INFO pupa: Matter 1921: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:38 INFO pupa: Matter 1922: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:38 INFO pupa: Matter 1923: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:38 INFO pupa: Matter 1924: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:38 INFO pupa: Matter 1926: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:38 INFO pupa: Matter 1927: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:38 INFO pupa: Matter 1928: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:38 INFO pupa: Matter 1929: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:38 INFO pupa: Matter 1930: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:40 INFO pupa: Matter 1936: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:40 INFO pupa: Matter 1937: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:40 INFO pupa: Matter 1938: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:40 INFO pupa: Matter 1939: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:40 INFO pupa: Matter 1940: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:40 INFO pupa: Matter 1941: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:40 INFO pupa: Matter 1942: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:40 INFO pupa: Matter 1943: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:40 INFO pupa: Matter 1944: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:41 INFO pupa: Matter 1945: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:51 INFO pupa: Matter 1965: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:53 INFO pupa: Matter 1970: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:54 INFO pupa: Matter 1971: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:54 INFO pupa: Matter 1972: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:54 INFO pupa: Matter 1973: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:54 INFO pupa: Matter 1985: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:54 INFO pupa: Matter 1986: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:54 INFO pupa: Matter 1987: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:54 INFO pupa: Matter 1888: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:55 INFO pupa: Matter 1990: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:56 INFO pupa: Matter 1991: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:56 INFO pupa: Matter 1992: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:56 INFO pupa: Matter 1994: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:56 INFO pupa: Matter 1993: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:56 INFO pupa: Matter 1996: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:56 INFO pupa: Matter 1995: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:56 INFO pupa: Matter 1997: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:56 INFO pupa: Matter 1998: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:56 INFO pupa: Matter 1999: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:56 INFO pupa: Matter 2000: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:56 INFO pupa: Matter 2001: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:57 INFO pupa: Matter 2002: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:57 INFO pupa: Matter 2003: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:57 INFO pupa: Matter 2004: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:57 INFO pupa: Matter 2005: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:57 INFO pupa: Matter 2006: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:57 INFO pupa: Matter 2007: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:57 INFO pupa: Matter 2009: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:57 INFO pupa: Matter 2008: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:57 INFO pupa: Matter 2011: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:57 INFO pupa: Matter 2010: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:57 INFO pupa: Matter 2012: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:57 INFO pupa: Matter 2013: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:57 INFO pupa: Matter 2014: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:57 INFO pupa: Matter 2015: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:57 INFO pupa: Matter 2016: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:57 INFO pupa: Matter 2017: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:57 INFO pupa: Matter 2018: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:58 INFO pupa: Matter 2019: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:58 INFO pupa: Matter 2020: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:58 INFO pupa: Matter 2021: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:58 INFO pupa: Matter 2023: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:58 INFO pupa: Matter 2022: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:58 INFO pupa: Matter 2025: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:58 INFO pupa: Matter 2024: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:58 INFO pupa: Matter 2026: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:58 INFO pupa: Matter 2027: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:59 INFO pupa: Matter 2028: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:59 INFO pupa: Matter 2029: MatterRestrictViewViaWeb is False, legistar_url is None
10:04:59 INFO pupa: Matter 2030: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:21 INFO pupa: Matter 2089: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:39 INFO pupa: Matter 2110: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:39 INFO pupa: Matter 2111: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:39 INFO pupa: Matter 2112: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:39 INFO pupa: Matter 2114: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:39 INFO pupa: Matter 2115: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:40 INFO pupa: Matter 2116: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:40 INFO pupa: Matter 2117: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:40 INFO pupa: Matter 2118: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:40 INFO pupa: Matter 2119: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:40 INFO pupa: Matter 2120: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:40 INFO pupa: Matter 2121: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:40 INFO pupa: Matter 2122: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:40 INFO pupa: Matter 2123: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:40 INFO pupa: Matter 2124: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:40 INFO pupa: Matter 2125: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:40 INFO pupa: Matter 2126: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:40 INFO pupa: Matter 2127: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:40 INFO pupa: Matter 2128: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:41 INFO pupa: Matter 2129: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:41 INFO pupa: Matter 2130: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:41 INFO pupa: Matter 2131: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:41 INFO pupa: Matter 2132: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:41 INFO pupa: Matter 2133: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:41 INFO pupa: Matter 2135: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:41 INFO pupa: Matter 2134: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:41 INFO pupa: Matter 2136: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:41 INFO pupa: Matter 2137: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:41 INFO pupa: Matter 2138: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:41 INFO pupa: Matter 2139: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:49 INFO pupa: Matter 2165: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:49 INFO pupa: Matter 2166: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:49 INFO pupa: Matter 2167: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:50 INFO pupa: Matter 2170: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:50 INFO pupa: Matter 2171: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:50 INFO pupa: Matter 2172: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:50 INFO pupa: Matter 2173: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:51 INFO pupa: Matter 2174: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:51 INFO pupa: Matter 2175: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:51 INFO pupa: Matter 2176: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:51 INFO pupa: Matter 2177: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:51 INFO pupa: Matter 2178: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:51 INFO pupa: Matter 2179: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:51 INFO pupa: Matter 2180: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:51 INFO pupa: Matter 2181: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:51 INFO pupa: Matter 2182: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:51 INFO pupa: Matter 2183: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:51 INFO pupa: Matter 2184: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:51 INFO pupa: Matter 2185: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:51 INFO pupa: Matter 2186: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:51 INFO pupa: Matter 2187: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:51 INFO pupa: Matter 2188: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:51 INFO pupa: Matter 2189: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:52 INFO pupa: Matter 2190: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:52 INFO pupa: Matter 2191: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:52 INFO pupa: Matter 2192: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:52 INFO pupa: Matter 2193: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:52 INFO pupa: Matter 2194: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:52 INFO pupa: Matter 2195: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:52 INFO pupa: Matter 2196: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:52 INFO pupa: Matter 2197: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:52 INFO pupa: Matter 2198: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:52 INFO pupa: Matter 2199: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:52 INFO pupa: Matter 2200: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:52 INFO pupa: Matter 2201: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:52 INFO pupa: Matter 2202: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:52 INFO pupa: Matter 2203: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:52 INFO pupa: Matter 2204: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:52 INFO pupa: Matter 2205: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:53 INFO pupa: Matter 2206: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:53 INFO pupa: Matter 2207: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:53 INFO pupa: Matter 2208: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:53 INFO pupa: Matter 2209: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:53 INFO pupa: Matter 2210: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:53 INFO pupa: Matter 2211: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:53 INFO pupa: Matter 2212: MatterRestrictViewViaWeb is False, legistar_url is None
10:05:53 INFO pupa: Matter 2213: MatterRestrictViewViaWeb is False, legistar_url is None
10:06:08 INFO pupa: Matter 2239: MatterRestrictViewViaWeb is False, legistar_url is None
10:06:15 INFO pupa: Matter 2263: MatterRestrictViewViaWeb is False, legistar_url is None
10:06:33 INFO pupa: Matter 2262: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:11 INFO pupa: Matter 2418: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:11 INFO pupa: Matter 2416: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:11 INFO pupa: Matter 2419: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:11 INFO pupa: Matter 2421: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:11 INFO pupa: Matter 2417: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:12 INFO pupa: Matter 2422: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:12 INFO pupa: Matter 2423: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:12 INFO pupa: Matter 2425: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:12 INFO pupa: Matter 2424: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:19 INFO pupa: Matter 2453: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:19 INFO pupa: Matter 2454: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:20 INFO pupa: Matter 2455: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:20 INFO pupa: Matter 2456: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:21 INFO pupa: Matter 2457: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:21 INFO pupa: Matter 2458: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:21 INFO pupa: Matter 2459: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:21 INFO pupa: Matter 2460: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:21 INFO pupa: Matter 2461: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:21 INFO pupa: Matter 2462: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:21 INFO pupa: Matter 2463: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:21 INFO pupa: Matter 2464: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:21 INFO pupa: Matter 2465: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:21 INFO pupa: Matter 2466: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:21 INFO pupa: Matter 2467: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:21 INFO pupa: Matter 2468: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:25 INFO pupa: Matter 2477: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:25 INFO pupa: Matter 2478: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:25 INFO pupa: Matter 2480: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:25 INFO pupa: Matter 2481: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:25 INFO pupa: Matter 2482: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:25 INFO pupa: Matter 2483: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:26 INFO pupa: Matter 2484: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:26 INFO pupa: Matter 2486: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:26 INFO pupa: Matter 2491: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:30 INFO pupa: Matter 2508: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:30 INFO pupa: Matter 2509: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:30 INFO pupa: Matter 2510: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:30 INFO pupa: Matter 2511: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:30 INFO pupa: Matter 2512: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:31 INFO pupa: Matter 2513: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:31 INFO pupa: Matter 2514: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:31 INFO pupa: Matter 2515: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:31 INFO pupa: Matter 2516: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:31 INFO pupa: Matter 2517: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:31 INFO pupa: Matter 2518: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:31 INFO pupa: Matter 2519: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:31 INFO pupa: Matter 2520: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:31 INFO pupa: Matter 2521: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:36 INFO pupa: Matter 2536: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:50 INFO pupa: Matter 2571: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:50 INFO pupa: Matter 2572: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:50 INFO pupa: Matter 2573: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:50 INFO pupa: Matter 2574: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:50 INFO pupa: Matter 2575: MatterRestrictViewViaWeb is False, legistar_url is None
10:07:51 INFO pupa: Matter 2576: MatterRestrictViewViaWeb is False, legistar_url is None
10:08:08 INFO pupa: Matter 2611: MatterRestrictViewViaWeb is False, legistar_url is None
10:08:08 INFO pupa: Matter 2612: MatterRestrictViewViaWeb is False, legistar_url is None
10:08:09 INFO pupa: Matter 2613: MatterRestrictViewViaWeb is False, legistar_url is None
10:08:10 INFO pupa: Matter 2614: MatterRestrictViewViaWeb is False, legistar_url is None
10:08:10 INFO pupa: Matter 2615: MatterRestrictViewViaWeb is False, legistar_url is None
10:08:10 INFO pupa: Matter 2616: MatterRestrictViewViaWeb is False, legistar_url is None
10:08:10 INFO pupa: Matter 2617: MatterRestrictViewViaWeb is False, legistar_url is None
10:08:15 INFO pupa: Matter 2630: MatterRestrictViewViaWeb is False, legistar_url is None
10:09:58 INFO pupa: Matter 2760: MatterRestrictViewViaWeb is False, legistar_url is None
10:09:58 INFO pupa: Matter 2761: MatterRestrictViewViaWeb is False, legistar_url is None
10:10:07 INFO pupa: Matter 2772: MatterRestrictViewViaWeb is False, legistar_url is None
10:10:22 INFO pupa: Matter 2802: MatterRestrictViewViaWeb is False, legistar_url is None
10:10:22 INFO pupa: Matter 2803: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:01 INFO pupa: Matter 2876: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:02 INFO pupa: Matter 2877: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:15 INFO pupa: Matter 2906: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:15 INFO pupa: Matter 2907: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:15 INFO pupa: Matter 2908: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:45 INFO pupa: Matter 2961: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:47 INFO pupa: Matter 2972: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:52 INFO pupa: Matter 2982: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:52 INFO pupa: Matter 2983: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:52 INFO pupa: Matter 2984: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:52 INFO pupa: Matter 2985: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:52 INFO pupa: Matter 2986: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:52 INFO pupa: Matter 2987: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:52 INFO pupa: Matter 2988: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:52 INFO pupa: Matter 2990: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:52 INFO pupa: Matter 2991: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:52 INFO pupa: Matter 2992: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:55 INFO pupa: Matter 2993: MatterRestrictViewViaWeb is False, legistar_url is None
10:11:59 INFO pupa: Matter 3000: MatterRestrictViewViaWeb is False, legistar_url is None
10:12:09 INFO pupa: Matter 3043: MatterRestrictViewViaWeb is False, legistar_url is None
10:12:30 INFO pupa: Matter 3082: MatterRestrictViewViaWeb is False, legistar_url is None
10:12:30 INFO pupa: Matter 3083: MatterRestrictViewViaWeb is False, legistar_url is None
10:12:30 INFO pupa: Matter 3084: MatterRestrictViewViaWeb is False, legistar_url is None
10:12:30 INFO pupa: Matter 3085: MatterRestrictViewViaWeb is False, legistar_url is None
10:12:50 INFO pupa: Matter 3119: MatterRestrictViewViaWeb is False, legistar_url is None
10:13:09 INFO pupa: Matter 3138: MatterRestrictViewViaWeb is False, legistar_url is None
10:13:15 INFO pupa: Matter 3159: MatterRestrictViewViaWeb is False, legistar_url is None
10:13:36 INFO pupa: Matter 3192: MatterRestrictViewViaWeb is False, legistar_url is None
10:13:36 INFO pupa: Matter 3193: MatterRestrictViewViaWeb is False, legistar_url is None
10:13:36 INFO pupa: Matter 3194: MatterRestrictViewViaWeb is False, legistar_url is None
10:13:36 INFO pupa: Matter 3195: MatterRestrictViewViaWeb is False, legistar_url is None
10:13:47 INFO pupa: Matter 3235: MatterRestrictViewViaWeb is False, legistar_url is None
10:13:54 INFO pupa: Matter 3254: MatterRestrictViewViaWeb is False, legistar_url is None
10:14:03 INFO pupa: Matter 3277: MatterRestrictViewViaWeb is False, legistar_url is None
10:14:04 INFO pupa: Matter 3279: MatterRestrictViewViaWeb is False, legistar_url is None
10:14:04 INFO pupa: Matter 3278: MatterRestrictViewViaWeb is False, legistar_url is None
10:14:04 INFO pupa: Matter 3280: MatterRestrictViewViaWeb is False, legistar_url is None
10:14:12 INFO pupa: Matter 3301: MatterRestrictViewViaWeb is False, legistar_url is None
10:14:14 INFO pupa: Matter 3308: MatterRestrictViewViaWeb is False, legistar_url is None
10:14:45 INFO pupa: Matter 3327: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:37 INFO pupa: Matter 3444: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:47 INFO pupa: Matter 3454: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:47 INFO pupa: Matter 3455: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:48 INFO pupa: Matter 3456: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:48 INFO pupa: Matter 3457: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:48 INFO pupa: Matter 3458: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:48 INFO pupa: Matter 3459: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:48 INFO pupa: Matter 3460: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:48 INFO pupa: Matter 3461: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:48 INFO pupa: Matter 3462: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:48 INFO pupa: Matter 3463: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:50 INFO pupa: Matter 3464: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:50 INFO pupa: Matter 3465: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:50 INFO pupa: Matter 3466: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:50 INFO pupa: Matter 3468: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:50 INFO pupa: Matter 3467: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:50 INFO pupa: Matter 3469: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:50 INFO pupa: Matter 3470: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:50 INFO pupa: Matter 3471: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:50 INFO pupa: Matter 3472: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:50 INFO pupa: Matter 3474: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:50 INFO pupa: Matter 3473: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:50 INFO pupa: Matter 3475: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:50 INFO pupa: Matter 3477: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:50 INFO pupa: Matter 3476: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:50 INFO pupa: Matter 3478: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:50 INFO pupa: Matter 3479: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:51 INFO pupa: Matter 3481: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:51 INFO pupa: Matter 3480: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:51 INFO pupa: Matter 3482: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:51 INFO pupa: Matter 3484: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:51 INFO pupa: Matter 3483: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:51 INFO pupa: Matter 3485: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:53 INFO pupa: Matter 3495: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:53 INFO pupa: Matter 3496: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:53 INFO pupa: Matter 3497: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:54 INFO pupa: Matter 3498: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:56 INFO pupa: Matter 3502: MatterRestrictViewViaWeb is False, legistar_url is None
10:15:56 INFO pupa: Matter 3503: MatterRestrictViewViaWeb is False, legistar_url is None
10:16:01 INFO pupa: Matter 3506: MatterRestrictViewViaWeb is False, legistar_url is None
10:16:23 INFO pupa: Matter 3557: MatterRestrictViewViaWeb is False, legistar_url is None
10:17:08 INFO pupa: Matter 3650: MatterRestrictViewViaWeb is False, legistar_url is None
10:17:40 INFO pupa: Matter 3703: MatterRestrictViewViaWeb is False, legistar_url is None
10:17:47 INFO pupa: Matter 3717: MatterRestrictViewViaWeb is False, legistar_url is None
10:17:48 INFO pupa: Matter 3718: MatterRestrictViewViaWeb is False, legistar_url is None
10:17:49 INFO pupa: Matter 3719: MatterRestrictViewViaWeb is False, legistar_url is None
10:17:49 INFO pupa: Matter 3720: MatterRestrictViewViaWeb is False, legistar_url is None
10:17:51 INFO pupa: Matter 3725: MatterRestrictViewViaWeb is False, legistar_url is None
10:18:09 INFO pupa: Matter 3747: MatterRestrictViewViaWeb is False, legistar_url is None
10:18:11 INFO pupa: Matter 3749: MatterRestrictViewViaWeb is False, legistar_url is None
10:18:12 INFO pupa: Matter 3750: MatterRestrictViewViaWeb is False, legistar_url is None
10:18:12 INFO pupa: Matter 3758: MatterRestrictViewViaWeb is False, legistar_url is None
10:19:18 INFO pupa: Matter 3856: MatterRestrictViewViaWeb is False, legistar_url is None
10:19:48 INFO pupa: Matter 3911: MatterRestrictViewViaWeb is False, legistar_url is None
10:19:50 INFO pupa: Matter 3921: MatterRestrictViewViaWeb is False, legistar_url is None
10:20:02 INFO pupa: Matter 3933: MatterRestrictViewViaWeb is False, legistar_url is None
10:20:02 INFO pupa: Matter 3932: MatterRestrictViewViaWeb is False, legistar_url is None
10:20:02 INFO pupa: Matter 3935: MatterRestrictViewViaWeb is False, legistar_url is None
10:20:02 INFO pupa: Matter 3934: MatterRestrictViewViaWeb is False, legistar_url is None
10:20:02 INFO pupa: Matter 3936: MatterRestrictViewViaWeb is False, legistar_url is None
10:20:02 INFO pupa: Matter 3937: MatterRestrictViewViaWeb is False, legistar_url is None
10:20:32 INFO pupa: Matter 4000: MatterRestrictViewViaWeb is False, legistar_url is None
10:20:39 INFO pupa: Matter 4007: MatterRestrictViewViaWeb is False, legistar_url is None
10:20:44 INFO pupa: Matter 4025: MatterRestrictViewViaWeb is False, legistar_url is None
10:20:44 INFO pupa: Matter 4024: MatterRestrictViewViaWeb is False, legistar_url is None
10:20:54 INFO pupa: Matter 4045: MatterRestrictViewViaWeb is False, legistar_url is None
10:20:54 INFO pupa: Matter 4052: MatterRestrictViewViaWeb is False, legistar_url is None
10:20:55 INFO pupa: Matter 4046: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:07 INFO pupa: Matter 4074: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:07 INFO pupa: Matter 4073: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:12 INFO pupa: Matter 4085: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:22 INFO pupa: Matter 4101: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:46 INFO pupa: Matter 4135: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:52 INFO pupa: Matter 4158: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:53 INFO pupa: Matter 4162: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:53 INFO pupa: Matter 4163: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:53 INFO pupa: Matter 4164: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:54 INFO pupa: Matter 4165: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:54 INFO pupa: Matter 4167: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:54 INFO pupa: Matter 4168: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:55 INFO pupa: Matter 4169: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:55 INFO pupa: Matter 4170: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:55 INFO pupa: Matter 4171: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:55 INFO pupa: Matter 4172: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:55 INFO pupa: Matter 4173: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:55 INFO pupa: Matter 4174: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:55 INFO pupa: Matter 4175: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:55 INFO pupa: Matter 4176: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:55 INFO pupa: Matter 4177: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:55 INFO pupa: Matter 4178: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:55 INFO pupa: Matter 4180: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:55 INFO pupa: Matter 4181: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:55 INFO pupa: Matter 4182: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:57 INFO pupa: Matter 4183: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:57 INFO pupa: Matter 4184: MatterRestrictViewViaWeb is False, legistar_url is None
10:21:58 INFO pupa: Matter 4189: MatterRestrictViewViaWeb is False, legistar_url is None
10:22:01 INFO pupa: Matter 4200: MatterRestrictViewViaWeb is False, legistar_url is None
10:22:02 INFO pupa: Matter 4201: MatterRestrictViewViaWeb is False, legistar_url is None
10:22:02 INFO pupa: Matter 4202: MatterRestrictViewViaWeb is False, legistar_url is None
10:22:03 INFO pupa: Matter 4204: MatterRestrictViewViaWeb is False, legistar_url is None
10:22:03 INFO pupa: Matter 4205: MatterRestrictViewViaWeb is False, legistar_url is None
10:22:03 INFO pupa: Matter 4206: MatterRestrictViewViaWeb is False, legistar_url is None
10:22:20 INFO pupa: Matter 4245: MatterRestrictViewViaWeb is False, legistar_url is None
10:22:20 INFO pupa: Matter 4246: MatterRestrictViewViaWeb is False, legistar_url is None
10:22:20 INFO pupa: Matter 4247: MatterRestrictViewViaWeb is False, legistar_url is None
10:22:23 INFO pupa: Matter 4254: MatterRestrictViewViaWeb is False, legistar_url is None
10:22:23 INFO pupa: Matter 4258: MatterRestrictViewViaWeb is False, legistar_url is None
10:22:23 INFO pupa: Matter 4257: MatterRestrictViewViaWeb is False, legistar_url is None
10:22:25 INFO pupa: Matter 4265: MatterRestrictViewViaWeb is False, legistar_url is None
10:22:33 INFO pupa: Matter 4279: MatterRestrictViewViaWeb is False, legistar_url is None
10:22:41 INFO pupa: Matter 4299: MatterRestrictViewViaWeb is False, legistar_url is None
10:23:01 INFO pupa: Matter 4329: MatterRestrictViewViaWeb is False, legistar_url is None
10:23:05 INFO pupa: Matter 4336: MatterRestrictViewViaWeb is False, legistar_url is None
10:23:05 INFO pupa: Matter 4337: MatterRestrictViewViaWeb is False, legistar_url is None
10:23:06 INFO pupa: Matter 4338: MatterRestrictViewViaWeb is False, legistar_url is None
10:23:06 INFO pupa: Matter 4339: MatterRestrictViewViaWeb is False, legistar_url is None
10:23:06 INFO pupa: Matter 4340: MatterRestrictViewViaWeb is False, legistar_url is None
10:23:39 INFO pupa: Matter 4400: MatterRestrictViewViaWeb is False, legistar_url is None
10:24:04 INFO pupa: Matter 4452: MatterRestrictViewViaWeb is False, legistar_url is None
10:24:04 INFO pupa: Matter 4453: MatterRestrictViewViaWeb is False, legistar_url is None
10:24:05 INFO pupa: Matter 4456: MatterRestrictViewViaWeb is False, legistar_url is None
10:24:05 INFO pupa: Matter 4457: MatterRestrictViewViaWeb is False, legistar_url is None

So it seems like it's reasonable to expect that some bills don't appear in the web interface, despite MatterRestrictViewViaWeb being False.

Did some issue spelunking, as well. This comment seems to indicate that there are some other indicators that a bill is private, so we're just using the Legistar URL as a catch all.

        Private bills have 'MatterRestrictViewViaWeb' set to True.
        However, the Metro system sometimes has discrepancies (e.g., a bill has
        'MatterRestrictViewViaWeb' set to False, but with a status as 'draft' and no agenda date).
        We thus also use the absence of a `legistar_web` link to determine if a bill is private.

(For reference, here's the PR that introduced _is_restricted(): #262)

hannah cushman garland · Answer 8 · Tue Jul 28 2020 00:21:22 GMT+0800 (China Standard Time)

FWIW, since that comment mentioned matter status and agenda date, I updated the logging and re-ran the scrape using the cache to see if either/some combination of both is a reliable indicator of a private bill.

tl;dr - It doesn't seem like they are reliable, either.

At this point, I don't see a way around using the Legistar URL, though I think it'd be a great idea to add a docstring with our rationale to the scraper.

11:15:45 INFO pupa: Matter 1028: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:15:45 INFO pupa: Matter 1027: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:03 INFO pupa: Matter 1868: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:04 INFO pupa: Matter 1917: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:04 INFO pupa: Matter 1918: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:04 INFO pupa: Matter 1919: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:04 INFO pupa: Matter 1920: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:04 INFO pupa: Matter 1921: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:04 INFO pupa: Matter 1922: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:04 INFO pupa: Matter 1923: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:04 INFO pupa: Matter 1924: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:05 INFO pupa: Matter 1926: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:05 INFO pupa: Matter 1927: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:05 INFO pupa: Matter 1928: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:05 INFO pupa: Matter 1929: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:05 INFO pupa: Matter 1930: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:05 INFO pupa: Matter 1936: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:05 INFO pupa: Matter 1937: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:05 INFO pupa: Matter 1938: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:05 INFO pupa: Matter 1939: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:05 INFO pupa: Matter 1940: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:05 INFO pupa: Matter 1941: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:05 INFO pupa: Matter 1942: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:05 INFO pupa: Matter 1943: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:05 INFO pupa: Matter 1944: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:06 INFO pupa: Matter 1945: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:07 INFO pupa: Matter 1965: MatterRestrictViewViaWeb is False, MatterStatusName is Passed, MatterAgendaDate is Passed, legistar_url is None
11:16:07 INFO pupa: Matter 1970: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:07 INFO pupa: Matter 1971: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:07 INFO pupa: Matter 1972: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:07 INFO pupa: Matter 1973: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:07 INFO pupa: Matter 1985: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:07 INFO pupa: Matter 1986: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:07 INFO pupa: Matter 1987: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:07 INFO pupa: Matter 1888: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:08 INFO pupa: Matter 1990: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:08 INFO pupa: Matter 1991: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:08 INFO pupa: Matter 1992: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:08 INFO pupa: Matter 1994: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:08 INFO pupa: Matter 1993: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:08 INFO pupa: Matter 1996: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:08 INFO pupa: Matter 1995: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:08 INFO pupa: Matter 1997: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:08 INFO pupa: Matter 1998: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:08 INFO pupa: Matter 1999: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:08 INFO pupa: Matter 2000: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:08 INFO pupa: Matter 2001: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:08 INFO pupa: Matter 2002: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:08 INFO pupa: Matter 2003: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:09 INFO pupa: Matter 2004: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:09 INFO pupa: Matter 2005: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:09 INFO pupa: Matter 2006: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:09 INFO pupa: Matter 2007: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:09 INFO pupa: Matter 2009: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:09 INFO pupa: Matter 2008: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:09 INFO pupa: Matter 2011: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:09 INFO pupa: Matter 2010: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:09 INFO pupa: Matter 2012: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:09 INFO pupa: Matter 2013: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:09 INFO pupa: Matter 2014: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:09 INFO pupa: Matter 2015: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:09 INFO pupa: Matter 2016: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:09 INFO pupa: Matter 2017: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:09 INFO pupa: Matter 2018: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:09 INFO pupa: Matter 2019: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:10 INFO pupa: Matter 2020: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:10 INFO pupa: Matter 2021: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:10 INFO pupa: Matter 2023: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:10 INFO pupa: Matter 2022: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:10 INFO pupa: Matter 2025: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:10 INFO pupa: Matter 2024: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:10 INFO pupa: Matter 2026: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:10 INFO pupa: Matter 2027: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:10 INFO pupa: Matter 2028: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:10 INFO pupa: Matter 2029: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:10 INFO pupa: Matter 2030: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:13 INFO pupa: Matter 2089: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:14 INFO pupa: Matter 2110: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:14 INFO pupa: Matter 2111: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:14 INFO pupa: Matter 2112: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:14 INFO pupa: Matter 2114: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:14 INFO pupa: Matter 2115: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:14 INFO pupa: Matter 2116: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:14 INFO pupa: Matter 2117: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:14 INFO pupa: Matter 2118: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:14 INFO pupa: Matter 2119: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:14 INFO pupa: Matter 2120: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:14 INFO pupa: Matter 2121: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:14 INFO pupa: Matter 2122: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:14 INFO pupa: Matter 2123: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:15 INFO pupa: Matter 2124: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:15 INFO pupa: Matter 2125: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:15 INFO pupa: Matter 2126: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:15 INFO pupa: Matter 2127: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:15 INFO pupa: Matter 2128: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:15 INFO pupa: Matter 2129: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:15 INFO pupa: Matter 2130: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:15 INFO pupa: Matter 2131: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:15 INFO pupa: Matter 2132: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:15 INFO pupa: Matter 2133: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:15 INFO pupa: Matter 2135: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:15 INFO pupa: Matter 2134: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:15 INFO pupa: Matter 2136: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:15 INFO pupa: Matter 2137: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:15 INFO pupa: Matter 2138: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:15 INFO pupa: Matter 2139: MatterRestrictViewViaWeb is False, MatterStatusName is Passed, MatterAgendaDate is Passed, legistar_url is None
11:16:16 INFO pupa: Matter 2165: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:17 INFO pupa: Matter 2166: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:17 INFO pupa: Matter 2167: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:17 INFO pupa: Matter 2170: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:17 INFO pupa: Matter 2171: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:17 INFO pupa: Matter 2172: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:17 INFO pupa: Matter 2173: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:17 INFO pupa: Matter 2174: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:17 INFO pupa: Matter 2175: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:17 INFO pupa: Matter 2176: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:17 INFO pupa: Matter 2177: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:17 INFO pupa: Matter 2178: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:17 INFO pupa: Matter 2179: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:17 INFO pupa: Matter 2180: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:17 INFO pupa: Matter 2181: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:17 INFO pupa: Matter 2182: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2183: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2184: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2185: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2186: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2187: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2188: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2189: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2190: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2191: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2192: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2193: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2194: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2195: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2196: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2197: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2198: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2199: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:18 INFO pupa: Matter 2200: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:19 INFO pupa: Matter 2201: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:19 INFO pupa: Matter 2202: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:19 INFO pupa: Matter 2203: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:19 INFO pupa: Matter 2204: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:19 INFO pupa: Matter 2205: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:19 INFO pupa: Matter 2206: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:19 INFO pupa: Matter 2207: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:19 INFO pupa: Matter 2208: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:19 INFO pupa: Matter 2209: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:19 INFO pupa: Matter 2210: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:19 INFO pupa: Matter 2211: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:19 INFO pupa: Matter 2212: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:19 INFO pupa: Matter 2213: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:21 INFO pupa: Matter 2239: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:21 INFO pupa: Matter 2263: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:23 INFO pupa: Matter 2262: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:28 INFO pupa: Matter 2418: MatterRestrictViewViaWeb is False, MatterStatusName is Discussed, MatterAgendaDate is Discussed, legistar_url is None
11:16:28 INFO pupa: Matter 2416: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:28 INFO pupa: Matter 2419: MatterRestrictViewViaWeb is False, MatterStatusName is Passed, MatterAgendaDate is Passed, legistar_url is None
11:16:28 INFO pupa: Matter 2421: MatterRestrictViewViaWeb is False, MatterStatusName is Passed, MatterAgendaDate is Passed, legistar_url is None
11:16:28 INFO pupa: Matter 2417: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:28 INFO pupa: Matter 2422: MatterRestrictViewViaWeb is False, MatterStatusName is Passed, MatterAgendaDate is Passed, legistar_url is None
11:16:28 INFO pupa: Matter 2423: MatterRestrictViewViaWeb is False, MatterStatusName is Passed, MatterAgendaDate is Passed, legistar_url is None
11:16:28 INFO pupa: Matter 2425: MatterRestrictViewViaWeb is False, MatterStatusName is Discussed, MatterAgendaDate is Discussed, legistar_url is None
11:16:28 INFO pupa: Matter 2424: MatterRestrictViewViaWeb is False, MatterStatusName is Discussed, MatterAgendaDate is Discussed, legistar_url is None
11:16:29 INFO pupa: Matter 2453: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:29 INFO pupa: Matter 2454: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:29 INFO pupa: Matter 2455: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:29 INFO pupa: Matter 2456: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:29 INFO pupa: Matter 2457: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:29 INFO pupa: Matter 2458: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:29 INFO pupa: Matter 2459: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:30 INFO pupa: Matter 2460: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:30 INFO pupa: Matter 2461: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:30 INFO pupa: Matter 2462: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:30 INFO pupa: Matter 2463: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:30 INFO pupa: Matter 2464: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:30 INFO pupa: Matter 2465: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:30 INFO pupa: Matter 2466: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:30 INFO pupa: Matter 2467: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:30 INFO pupa: Matter 2468: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:30 INFO pupa: Matter 2477: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:31 INFO pupa: Matter 2478: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:31 INFO pupa: Matter 2480: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:31 INFO pupa: Matter 2481: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:31 INFO pupa: Matter 2482: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:31 INFO pupa: Matter 2483: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:31 INFO pupa: Matter 2484: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:31 INFO pupa: Matter 2486: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:31 INFO pupa: Matter 2491: MatterRestrictViewViaWeb is False, MatterStatusName is Passed, MatterAgendaDate is Passed, legistar_url is None
11:16:31 INFO pupa: Matter 2508: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:31 INFO pupa: Matter 2509: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:32 INFO pupa: Matter 2510: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:32 INFO pupa: Matter 2511: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:32 INFO pupa: Matter 2512: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:32 INFO pupa: Matter 2513: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:32 INFO pupa: Matter 2514: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:32 INFO pupa: Matter 2515: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:32 INFO pupa: Matter 2516: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:32 INFO pupa: Matter 2517: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:32 INFO pupa: Matter 2518: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:32 INFO pupa: Matter 2519: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:32 INFO pupa: Matter 2520: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:32 INFO pupa: Matter 2521: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:33 INFO pupa: Matter 2536: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:35 INFO pupa: Matter 2571: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:35 INFO pupa: Matter 2572: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:35 INFO pupa: Matter 2573: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:35 INFO pupa: Matter 2574: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:35 INFO pupa: Matter 2575: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:35 INFO pupa: Matter 2576: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:37 INFO pupa: Matter 2611: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:37 INFO pupa: Matter 2612: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:37 INFO pupa: Matter 2613: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:37 INFO pupa: Matter 2614: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:37 INFO pupa: Matter 2615: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:37 INFO pupa: Matter 2616: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:37 INFO pupa: Matter 2617: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:38 INFO pupa: Matter 2630: MatterRestrictViewViaWeb is False, MatterStatusName is Passed, MatterAgendaDate is Passed, legistar_url is None
11:16:44 INFO pupa: Matter 2760: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:45 INFO pupa: Matter 2761: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:45 INFO pupa: Matter 2772: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:47 INFO pupa: Matter 2802: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:47 INFO pupa: Matter 2803: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:52 INFO pupa: Matter 2876: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:52 INFO pupa: Matter 2877: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:54 INFO pupa: Matter 2906: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:54 INFO pupa: Matter 2907: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:54 INFO pupa: Matter 2908: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:58 INFO pupa: Matter 2961: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:58 INFO pupa: Matter 2972: MatterRestrictViewViaWeb is False, MatterStatusName is Agenda Ready, MatterAgendaDate is Agenda Ready, legistar_url is None
11:16:59 INFO pupa: Matter 2982: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:59 INFO pupa: Matter 2983: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:59 INFO pupa: Matter 2984: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:59 INFO pupa: Matter 2985: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:59 INFO pupa: Matter 2986: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:59 INFO pupa: Matter 2987: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:59 INFO pupa: Matter 2988: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:59 INFO pupa: Matter 2990: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:59 INFO pupa: Matter 2991: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:59 INFO pupa: Matter 2992: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:16:59 INFO pupa: Matter 2993: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:00 INFO pupa: Matter 3000: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:02 INFO pupa: Matter 3043: MatterRestrictViewViaWeb is False, MatterStatusName is Passed, MatterAgendaDate is Passed, legistar_url is None
11:17:05 INFO pupa: Matter 3082: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:05 INFO pupa: Matter 3083: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:05 INFO pupa: Matter 3084: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:05 INFO pupa: Matter 3085: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:07 INFO pupa: Matter 3119: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:08 INFO pupa: Matter 3138: MatterRestrictViewViaWeb is False, MatterStatusName is Passed, MatterAgendaDate is Passed, legistar_url is None
11:17:09 INFO pupa: Matter 3159: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:11 INFO pupa: Matter 3192: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:11 INFO pupa: Matter 3193: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:11 INFO pupa: Matter 3194: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:12 INFO pupa: Matter 3195: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:14 INFO pupa: Matter 3235: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:15 INFO pupa: Matter 3254: MatterRestrictViewViaWeb is False, MatterStatusName is Agenda Ready, MatterAgendaDate is Agenda Ready, legistar_url is None
11:17:17 INFO pupa: Matter 3277: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:17 INFO pupa: Matter 3279: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:17 INFO pupa: Matter 3278: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:17 INFO pupa: Matter 3280: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:18 INFO pupa: Matter 3301: MatterRestrictViewViaWeb is False, MatterStatusName is Agenda Ready, MatterAgendaDate is Agenda Ready, legistar_url is None
11:17:19 INFO pupa: Matter 3308: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:24 INFO pupa: Matter 3327: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:31 INFO pupa: Matter 3444: MatterRestrictViewViaWeb is False, MatterStatusName is Agenda Ready, MatterAgendaDate is Agenda Ready, legistar_url is None
11:17:32 INFO pupa: Matter 3454: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:32 INFO pupa: Matter 3455: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:33 INFO pupa: Matter 3456: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:33 INFO pupa: Matter 3457: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:33 INFO pupa: Matter 3458: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:33 INFO pupa: Matter 3459: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:33 INFO pupa: Matter 3460: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:33 INFO pupa: Matter 3461: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:33 INFO pupa: Matter 3462: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:33 INFO pupa: Matter 3463: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:33 INFO pupa: Matter 3464: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:33 INFO pupa: Matter 3465: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:33 INFO pupa: Matter 3466: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:33 INFO pupa: Matter 3468: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:33 INFO pupa: Matter 3467: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:33 INFO pupa: Matter 3469: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:33 INFO pupa: Matter 3470: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:33 INFO pupa: Matter 3471: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:34 INFO pupa: Matter 3472: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:34 INFO pupa: Matter 3474: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:34 INFO pupa: Matter 3473: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:34 INFO pupa: Matter 3475: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:34 INFO pupa: Matter 3477: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:34 INFO pupa: Matter 3476: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:34 INFO pupa: Matter 3478: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:34 INFO pupa: Matter 3479: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:34 INFO pupa: Matter 3481: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:34 INFO pupa: Matter 3480: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:34 INFO pupa: Matter 3482: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:34 INFO pupa: Matter 3484: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:34 INFO pupa: Matter 3483: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:34 INFO pupa: Matter 3485: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:35 INFO pupa: Matter 3495: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:35 INFO pupa: Matter 3496: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:35 INFO pupa: Matter 3497: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:35 INFO pupa: Matter 3498: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:35 INFO pupa: Matter 3502: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:35 INFO pupa: Matter 3503: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:36 INFO pupa: Matter 3506: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:39 INFO pupa: Matter 3557: MatterRestrictViewViaWeb is False, MatterStatusName is Agenda Ready, MatterAgendaDate is Agenda Ready, legistar_url is None
11:17:48 INFO pupa: Matter 3650: MatterRestrictViewViaWeb is False, MatterStatusName is Agenda Ready, MatterAgendaDate is Agenda Ready, legistar_url is None
11:17:54 INFO pupa: Matter 3703: MatterRestrictViewViaWeb is False, MatterStatusName is Agenda Ready, MatterAgendaDate is Agenda Ready, legistar_url is None
11:17:55 INFO pupa: Matter 3717: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:55 INFO pupa: Matter 3718: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:55 INFO pupa: Matter 3719: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:55 INFO pupa: Matter 3720: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:55 INFO pupa: Matter 3725: MatterRestrictViewViaWeb is False, MatterStatusName is Agenda Ready, MatterAgendaDate is Agenda Ready, legistar_url is None
11:17:57 INFO pupa: Matter 3747: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:58 INFO pupa: Matter 3749: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:58 INFO pupa: Matter 3750: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:17:58 INFO pupa: Matter 3758: MatterRestrictViewViaWeb is False, MatterStatusName is Approval Paused, MatterAgendaDate is Approval Paused, legistar_url is None
11:18:05 INFO pupa: Matter 3856: MatterRestrictViewViaWeb is False, MatterStatusName is Agenda Ready, MatterAgendaDate is Agenda Ready, legistar_url is None
11:18:09 INFO pupa: Matter 3911: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:09 INFO pupa: Matter 3921: MatterRestrictViewViaWeb is False, MatterStatusName is Agenda Ready, MatterAgendaDate is Agenda Ready, legistar_url is None
11:18:10 INFO pupa: Matter 3933: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:10 INFO pupa: Matter 3932: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:11 INFO pupa: Matter 3932: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:11 INFO pupa: Matter 3935: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:11 INFO pupa: Matter 3934: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:11 INFO pupa: Matter 3936: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:11 INFO pupa: Matter 3937: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:15 INFO pupa: Matter 4000: MatterRestrictViewViaWeb is False, MatterStatusName is Agenda Ready, MatterAgendaDate is Agenda Ready, legistar_url is None
11:18:16 INFO pupa: Matter 4007: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:17 INFO pupa: Matter 4025: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:17 INFO pupa: Matter 4024: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:19 INFO pupa: Matter 4045: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:19 INFO pupa: Matter 4052: MatterRestrictViewViaWeb is False, MatterStatusName is Approval Paused, MatterAgendaDate is Approval Paused, legistar_url is None
11:18:19 INFO pupa: Matter 4046: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:21 INFO pupa: Matter 4074: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:21 INFO pupa: Matter 4073: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:22 INFO pupa: Matter 4085: MatterRestrictViewViaWeb is False, MatterStatusName is Agenda Ready, MatterAgendaDate is Agenda Ready, legistar_url is None
11:18:23 INFO pupa: Matter 4101: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:26 INFO pupa: Matter 4135: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:27 INFO pupa: Matter 4158: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:28 INFO pupa: Matter 4162: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:28 INFO pupa: Matter 4163: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:28 INFO pupa: Matter 4164: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:28 INFO pupa: Matter 4165: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:28 INFO pupa: Matter 4167: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:28 INFO pupa: Matter 4168: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:28 INFO pupa: Matter 4169: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:28 INFO pupa: Matter 4170: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:28 INFO pupa: Matter 4171: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:28 INFO pupa: Matter 4172: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:28 INFO pupa: Matter 4173: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:28 INFO pupa: Matter 4174: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:29 INFO pupa: Matter 4175: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:29 INFO pupa: Matter 4176: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:29 INFO pupa: Matter 4177: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:29 INFO pupa: Matter 4178: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:29 INFO pupa: Matter 4180: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:29 INFO pupa: Matter 4181: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:29 INFO pupa: Matter 4182: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:29 INFO pupa: Matter 4183: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:29 INFO pupa: Matter 4184: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:29 INFO pupa: Matter 4189: MatterRestrictViewViaWeb is False, MatterStatusName is Agenda Ready, MatterAgendaDate is Agenda Ready, legistar_url is None
11:18:30 INFO pupa: Matter 4200: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:30 INFO pupa: Matter 4201: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:30 INFO pupa: Matter 4202: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:30 INFO pupa: Matter 4204: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:31 INFO pupa: Matter 4205: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:31 INFO pupa: Matter 4206: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:33 INFO pupa: Matter 4245: MatterRestrictViewViaWeb is False, MatterStatusName is Discussed, MatterAgendaDate is Discussed, legistar_url is None
11:18:34 INFO pupa: Matter 4246: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:34 INFO pupa: Matter 4247: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:34 INFO pupa: Matter 4254: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:34 INFO pupa: Matter 4258: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:34 INFO pupa: Matter 4257: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:35 INFO pupa: Matter 4265: MatterRestrictViewViaWeb is False, MatterStatusName is Agenda Ready, MatterAgendaDate is Agenda Ready, legistar_url is None
11:18:36 INFO pupa: Matter 4279: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:37 INFO pupa: Matter 4299: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:40 INFO pupa: Matter 4329: MatterRestrictViewViaWeb is False, MatterStatusName is Agenda Ready, MatterAgendaDate is Agenda Ready, legistar_url is None
11:18:40 INFO pupa: Matter 4336: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:40 INFO pupa: Matter 4337: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:41 INFO pupa: Matter 4338: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:41 INFO pupa: Matter 4339: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:42 INFO pupa: Matter 4340: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:48 INFO pupa: Matter 4400: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:52 INFO pupa: Matter 4452: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:52 INFO pupa: Matter 4453: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:52 INFO pupa: Matter 4456: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None
11:18:52 INFO pupa: Matter 4457: MatterRestrictViewViaWeb is False, MatterStatusName is Draft, MatterAgendaDate is Draft, legistar_url is None

hannah cushman garland · Answer 9 · Thu Jul 30 2020 04:22:40 GMT+0800 (China Standard Time)

In summary, considering the Legistar URL seems like the right thing to do. I made a change upstream to interrupt scrapes if we see a response we don't expect so we can be more sure that no URL means private. opencivicdata/python-legistar-scraper#111

Going to go ahead and close this.