Helping file a co-op’s city registration, the AI stated a $13 fee was paid and invented a deadline rule
A user was filing a housing co-op’s HPD property registration with AI’s help. Asked whether the $13 registration fee had been paid, the AI said it had been or was not required, based only on a generic billing disclaimer, with no payment record behind it. Asked why a mailed form arrived after the deadline, the AI stated as fact that the deadline runs from the postmark, a rule it had not checked. Both claims were corrected only after he challenged them. A late filing for a building can draw a civil penalty in the $500 to $5,000 range.
This one went wrong. Read what happened so you don’t hit the same problem.
How it works
- Filing a co-op registration with AI’s help
- Asked if the $13 fee was paid
- The AI says paid or not required, from a generic disclaimer
- Asked about a late mailed form
- The AI states a postmark rule as fact with no source
- Both corrected only after he pushes back
Why it’s worth knowing
Nothing was filed wrong, because he caught both claims. The session shows how close a filing came to resting on invented facts.
Where it’s from
Summarized from a public post on github.com. See the original ↗