Keeping the Human in the Loop: Failure Points of Generative AI in Small-Business Accounting and Tax Compliance
DOI:
https://doi.org/10.37497/opsbrazil.51Keywords:
Generative AI, Large Language Models, Human-In-The-Loop, Accounting, Tax Compliance, Small Business, Taxpayer Data Protection, Irc §7216, Automation BiasResumo
Generative AI is becoming part of everyday accounting and tax work in small firms and small businesses, and its productivity gains are real. This paper argues that those gains hold only when a qualified person stays in the loop. Drawing on the author's practice as founder of a U.S. tax firm and IRS Certifying Acceptance Agent, and on the professional and legal literature, it identifies four failure points that appear when people are removed or bypassed. The first is classification error: fluent output that assigns transactions to the wrong account or tax category. The second is advisory over-reliance: owners treat an LLM's answer as authoritative and act on it without seeing its assumptions, sometimes triggering IRS notices and penalties. The third is taxpayer data exposure: returns and statements containing Social Security numbers uploaded to general-purpose tools. The fourth is a compliance and accountability gap under IRC §7216, the FTC Safeguards Rule, IRS Publication 4557 and Circular 230. Cases from the author's practice, the abrupt closure of an online bookkeeping provider and an exploratory run of 26 questions on three free chatbots illustrate each point. In that single run per tool, given the same 60 real bank transactions, the chatbots produced a refusal, a fourfold profit range and a cash-flow total presented as profit; the demonstration shows how the failures arise and does not estimate error rates or rank the tools. The paper closes with human-in-the-loop principles: where review is indispensable, how to minimize the data a tool sees, and how to document who checked what.
Downloads
Referências
AICPA. (n.d.). AICPA Code of Professional Conduct: Confidential client information rule (ET § 1.700.001) and use of a third-party service provider (ET § 1.700.040). https://pub.aicpa.org/codeofconduct
AICPA. (2025, October 27). Accounting firms report strong hiring outlook, AICPA report finds. https://www.aicpa-cima.com/news/article/accounting-firms-report-strong-hiring-outlook-aicpa-report-finds
Anthropic. (2025). Updates to our consumer terms. Retrieved October 30, 2026, from https://www.anthropic.com/news/updates-to-our-consumer-terms
California Department of Justice. (n.d.). California Consumer Privacy Act (CCPA). https://oag.ca.gov/privacy/ccpa
Committee for a Responsible Federal Budget. (2024, October 24). IRS estimates a $606 billion tax gap for 2022. https://www.crfb.org/blogs/irs-estimates-606-billion-tax-gap-2022
Covington & Burling LLP. (2023, November). FTC finalizes new notification requirement for GLBA Safeguards Rule. https://www.cov.com/en/news-and-insights/insights/2023/11/ftc-finalizes-new-notification-requirement-for-glba-safeguards-rule
CPA Practice Advisor. (2026, October 12). What to settle before client tax data touches AI. https://cpapracticeadvisor.com/2026/10/12/what-to-settle-before-client-tax-data-touches-ai/191491
Disclosure or use of information by preparers of returns, 26 U.S.C. § 6713. https://www.law.cornell.edu/uscode/text/26/6713
Disclosure or use of information by preparers of returns, 26 U.S.C. § 7216. https://www.law.cornell.edu/uscode/text/26/7216
Florida Department of Revenue. (n.d.). Employer's quarterly report (RT-6): Instructions. https://www.floridarevenue.com/Forms_library/current/rt6n.pdf
Fla. Stat. § 443.141 (2025). https://m.flsenate.gov/Statutes/443.141
Fla. Stat. § 501.171 (2025). Security of confidential personal information. https://www.flsenate.gov/Laws/Statutes/2025/501.171
Goddard, K., Roudsari, A., & Wyatt, J. C. (2012). Automation bias: A systematic review of frequency, effect mediators, and mitigators. Journal of the American Medical Informatics Association, 19(1), 121–127. https://doi.org/10.1136/amiajnl-2011-000089
Huang, L., et al. (2025). A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions. ACM Transactions on Information Systems. https://doi.org/10.1145/3703155
Internal Revenue Service. (2013a). Revenue Procedure 2013-14 (Internal Revenue Bulletin 2013-3). https://www.irs.gov/irb/2013-03_IRB
Internal Revenue Service. (2013b). Revenue Procedure 2013-30 (Internal Revenue Bulletin 2013-36). https://www.irs.gov/irb/2013-36_IRB
Internal Revenue Service. (2024a). Safeguarding taxpayer data: A guide for your business (Publication 4557, Rev. 5-2024). https://www.irs.gov/pub/irs-pdf/p4557.pdf
Internal Revenue Service. (2024b). Creating a written information security plan for your tax & accounting practice (Publication 5708, Rev. 8-2024). https://www.irs.gov/pub/irs-pdf/p5708.pdf
Internal Revenue Service. (n.d.-a). COLA increases for dollar limitations on benefits and contributions. https://www.irs.gov/retirement-plans/cola-increases-for-dollar-limitations-on-benefits-and-contributions
Internal Revenue Service. (n.d.-b). Information return penalties. https://www.irs.gov/payments/information-return-penalties
Mason, E. (2025, February 19). How a once-hot accounting fintech's bet on AI led to bankruptcy. Accounting Today. https://accountingtoday.com/articles/how-a-once-hot-accounting-fintechs-bet-on-ai-led-to-bankruptcy
Morris, Manning & Martin, LLP. (n.d.). When is consent enough? Tax return information in the uncharted AI landscape. https://www.mmmlaw.com/resources/When%20Is%20Consent%20Enough%20-%20Tax%20Return%20Information%20in%20the%20Uncharted%20AI%20Landscape_QzLqZ8E.pdf
National Institute of Standards and Technology. (2023). Artificial intelligence risk management framework (AI RMF 1.0) (NIST AI 100-1). https://doi.org/10.6028/NIST.AI.100-1
OpenAI. (n.d.). Data controls FAQ. Retrieved October 30, 2026, from https://help.openai.com/en/articles/7730893-data-controls-faq
Parasuraman, R., & Manzey, D. H. (2010). Complacency and bias in human use of automation: An attentional integration. Human Factors, 52(3), 381–410. https://doi.org/10.1177/0018720810376055
Permissible disclosures or uses without consent of the taxpayer, 26 C.F.R. § 301.7216-2. https://www.law.cornell.edu/cfr/text/26/301.7216-2
Rollet, C. (2024, December 27). Bench shuts down, leaving thousands of businesses without access to accounting and tax docs.
Rollet, C. (2025, January 3). Inside the wild fall and last-minute revival of Bench, the VC-backed accounting startup that imploded over the holidays. TechCrunch. https://techcrunch.com/2025/01/03/inside-the-wild-fall-and-last-minute-revival-of-bench-the-vc-backed-accounting-startup-that-imploded-over-the-holidays
Standards for Safeguarding Customer Information, 16 C.F.R. pt. 314. https://www.law.cornell.edu/cfr/text/16/part-314
Thomson Reuters. (2025, April 15). From incubation to integration: Generative AI adoption nearly doubles as professional services reach crossroads. https://thomsonreuters.com/en/press-releases/2025/april/from-incubation-to-integration-generative-ai-adoption-nearly-doubles-as-professional-services-reach-crossroads
Thomson Reuters Tax & Accounting. (2026). IRS announces midyear increase in standard mileage rates (Announcement 2026-11). https://tax.thomsonreuters.com/news/irs-announces-midyear-increase-in-standard-mileage-rates-for-business-medical-and-moving-expense-purposes/
U.S. Department of the Treasury. (2014). Regulations governing practice before the Internal Revenue Service (Circular No. 230, Rev. 6-2014; 31 C.F.R. pt. 10). https://www.irs.gov/pub/irs-pdf/pcir230.pdf
Wood, D. A., et al. (2023). The ChatGPT artificial intelligence chatbot: How well does it answer accounting assessment questions? Issues in Accounting Education, 38(4), 81–108. https://research.tilburguniversity.edu/en/publications/the-chatgpt-artificial-intelligence-chatbot-how-well-does-it-answ/
X Corp. (n.d.). About Grok. Retrieved October 30, 2026, from https://help.x.com/en/using-x/about-grok
Postado
Categorias
Licença
Copyright (c) 2026 Open Science Brazil

Este trabalho está licenciado sob uma licença Creative Commons Attribution 4.0 International License.






