138 pointsby chaps7 days ago8 comments
  • jessriedel6 days ago
    This sort of experience shows how broken the FOIA law is. If it’s in the public interest to make data available, it’s in the public interest to make it available to a person with imperfect understanding of the extreme details of government’s crappy IT systems.

    Not sure exactly what the fix is, but one idea is to have a state-wide ombudsman-like office for facilitating FOIA requests. Currently each agency usually has its own small FOIA office, which naturally protects its own turf. A centralized office could 1. …be independent of the agencies from which info is being requested, avoiding conflicts of interest in denying/delaying requests 2. …have commitments to confidentiality so agencies couldn’t justify withholding contextual info (“what’s a better way to ask this question?”) from the ombudsman 3. …afford building up more technical and legal expertise than any single agency-specific office.

    • qingcharles6 days ago
      I don't think FOIA is broken, it just needs some tweaks. One of the tweaks OP is involved with is changing the FOIA law to allow for the type of request he made. This is the only way to fix the poorly-decided Ill. S. Ct. case now.

      There does need to be a better incentive for public bodies to do the right thing, though. I get a ton of weak, half-baked responses, and a ton of push-back. A lot of it feels like laziness. There is no decent punishment in Illinois for workers or bodies that don't make a reasonable effort to respond.

      This is basically how FOIA responses go:

      https://www.youtube.com/watch?v=BxWQo_vZgR8

      • jessriedel6 days ago
        Tweaks like you describe are exactly what I think are doomed. The problem isn’t some small wording in the law that we just need to adjust. The problem is that (1) info request of complicated systems by their nature require good-faith coordination by both inquirer and respondent but (2) the agency responding to the FAOI request is incentivized to obstruct. This is why legal discovery is such a nightmare and so inefficient.

        “Punish people for not being helpful enough” is a bad way to get them to be helpful.

        • potato37328426 days ago
          >“Punish people for not being helpful enough” is a bad way to get them to be helpful.

          That's the reality every vendor rep's job exists in and most of them are quite helpful.

          • jessriedel5 days ago
            I mean this is a long conversation but the major differences are: (1) agencies are mostly incentivized to do other stuff and (2) it's hard to objectively assess helpfulness per se rather than sales.
  • akudha7 days ago
    Why aren't all non-classified, non-sensitive public data actually public by default? The time, effort and money they spent fighting the FOIA lawsuit - wouldn't it just be easier and cheaper to just honor the request?
    • gleenn6 days ago
      Providing public APIs to such information sounds great and I think it should be done but is also probably realistically expensive and peone to security problems. The government seems to have a very difficult time in general running all sorts of web services, it's a nightmare in some jurisdictions to even pay the government money for e.g. tickets... I had a hell of a time paying a ticket in San Diego and had to visit the the courthouse multiple times and file a paper form because my paymentment became "late" when it never showed up in their online database weeks later. I was TRYING to pay them and even going to suffer through the "convenience" fees because they outsourced the website to some crappy company and they still couldn't get it right.
      • akudha6 days ago
        Expensive compared to what? Paying a bunch of lawyers and dragging a lawsuit for five years? Don’t lawyers, judges, court personnel’s time cost money?

        They even refused to provide the database schema - how is providing just the schema expensive? Or hard to do?

        • marsovo6 days ago
          As I understand it, the trial was about whether or not providing the database schema is a security risk.

          > Your request seeks a copy of tables or columns within each table of CANVAS. The dissemination of these pieces of network information could jeopardize the security of the systems of the City of Chicago.

          Related: https://news.ycombinator.com/item?id=43175628

      • k1t6 days ago
        Nobody said anything about providing a public API.

        Just provide a DB dump to this one guy.

    • remexre6 days ago
      The first reasonable concern that springs to mind is that correlating a few fields that are individually non-identifying in a dataset can lead to deanonymizing people; in principle, the FOIA process gives the organization being requested time to think about what needs to be masked to protect privacy.
      • JadeNB6 days ago
        > in principle, the FOIA process gives the organization being requested time to think about what needs to be masked to protect privacy.

        Although of course that's a lot more in principle than in practice! Like rolling your own crypto, I think experience shows that, against determined de-anonymizers, there is basically nothing you can do to preserve anonymity except to severely limit the information, and the only way definite feedback you get is if you don't succeed and someone discloses the de-anonymized information that they were able to reconstruct.

      • Schiendelman6 days ago
        If government has access to all those fields the data isn't private.

        Your argument makes me think we really SHOULD make all government data public. Then people would have an incentive to not let governments have so much of their private data.

        • remexre5 days ago
          I'm essentially comfortable with the government knowing what banks I've banked at, what homes I've lived in, and where and when I've been arrested. I'm much less comfortable with those being in a public database anyone can query.
          • Schiendelman5 days ago
            Why are you comfortable with the government knowing what banks you have banked at?

            Also, I hope you don't mean the federal government should know if you've been arrested. I don't think that should be available to them at all.

    • kube-system6 days ago
      Determining whether or not something is sensitive is not necessarily a trivial activity, especially if you’re asking it to be done for everything that every employee creates everyday.
      • vincnetas6 days ago
        Thats why you do design o DB and decide if this data is really needed to be stored, for how long, now sensitive it is etc. You don't just add data to DB as you go (well ideally).
        • kube-system6 days ago
          If only it were that easy. Only a small amount of government data is in a database, if even electronic at all. A lot of it is on paper, in Microsoft word, in emails, in a voicemail, etc.

          Nobody is going to write a DB schema or call a DBA before taking notes in a notebook… but that’s government data too.

          Example: https://home.nps.gov/katm/blogs/images/IMG_3229.jpg

          • vincnetas6 days ago
            True, but in this case we are talking about providing DB dumps to citizens.
            • kube-system6 days ago
              That is not how I interpreted “all non-classified, non-sensitive public data”
              • vincnetas6 days ago
                true. i scope of grand parent comment. i was still thinking about TFA when i commented.
    • potato37328426 days ago
      Because it would significantly de-legitimize the government (particularly state and local) if any and every youtube talking head and blogger could pour over it and find the objectionable things that is supported by few and only tolerated by many because of poor awareness. And that's before you get into the spurious correlations and conspiracy stuff.
      • idiotsecant6 days ago
        It's exhausting the number of conversations online that assume that everything in the government is nefarious, inefficient, and focused on steeling ur freedums. I have worked in private industry, I've worked in government, and I've worked in the murky world in between. By and large government employees and thoughtful, genuinely want to make things work, and are faithful stewards of the public good. They usually make less money than they could get in private industry, the job security is absolutely no longer there, and the benefits are getting worse and worse each year.

        They're just people doing their best. Try to be a little less breathless with your rhetoric.

        • potato37328425 days ago
          I tend to assume government employees are a cross section of the population. I don't care about the people, I care about the system.

          If you apply the assumption that government employees are better or more well intentioned than the population in general then it makes the government's actions look even worse.

      • Schiendelman6 days ago
        Or it would make us look for ways to have government do fewer things.
        • warmcompress6 days ago
          About as believable as DOGE "saving" the government $105 billion.
          • Schiendelman6 days ago
            I'm not really interested in any of that. But I am interested in us having privacy from government. The last thing I want is someone like Musk getting access to my personal information, and the only way to really prevent that is to not collect it in the first place.
  • dang6 days ago
    Recent and related:

    I Went to SQL Injection Court - https://news.ycombinator.com/item?id=43175628 - Feb 2025 (433 comments)

  • joshka6 days ago
    I wonder if starting with intentionally getting a parking fine in Chicago, followed by then submitting an FOIA about that fine and all related documents / data would have worked.

    Edit: seems like that was the part of the origin story of this according to https://sockpuppet.org/blog/2025/02/09/fixing-illinois-foia/

  • qingcharles6 days ago
    I reiterate my point from the comments of the companion post. OP lost even while being represented by some of the best civil rights lawyers in the country.

    A lot of FOIA requests die because they receive push-back and the requestor lacks the resources to litigate it. You can do it yourself. FOIA litigation is usually not like OP's struggle over data types -- it's usually just to get the court to smack the public body and tell them they are being lazy or overly strict and the court procedures are much simpler. (often the public body will fold as soon as you file)

    Also, I wonder if @chaps can give his reasoning on going directly for litigation? In Illinois there is an alternate avenue where you can ask the AG to intervene. (I hate this route myself because it has become slow and toothless)

    • chaps6 days ago
      Going to litigation made sense here because, tbh, I didn't want to deal with the PAC's office taking three years to complete the RFR while never actually understanding the underlying issue. They really stink at interpreting anything technical. Also, I've never done pro bono (I probably could though), but I don't trust myself on procedural matters!
      • qingcharles6 days ago
        You definitely have the skills to do it yourself if you had to. I totally understand sidestepping the PAC. I've had it work occasionally, especially in the days when they would get back to you in a couple of weeks. Now it's a shitshow.
    • JadeNB6 days ago
      > Also, I wonder if @chaps can give his reasoning on going directly for litigation? In Illinois there is an alternate avenue where you can ask the AG to intervene. (I hate this route myself because it has become slow and toothless)

      There is some discussion here, which you may already have seen:

      https://news.ycombinator.com/item?id=43176319

  • exabrial6 days ago
    So dumb that the default behavior of the governments (State and Fed) is to withhold information. This isn't classified information and shouldn't be treated as such.

    100% onboard with shrinking the government.

    • ryandrake6 days ago
      These things don't make sense together. Chances are, shrinking government will cause information to be withheld even more, since there will be fewer staff available to answer/process requests for data, or to create automated ways to retrieve it. A fully-transparent government needs to be staffed.
  • emorning36 days ago
    This government doesn't honor its commitments to friend, foes, or citizens
  • joering26 days ago
    > Please note that in late 2013, the City of Chicago launched a publically available Data

    did they really say "publically" in their response? :)