Back to all work

Shipped at work, ResMed

Faxes read by a model

4.5M a year. The doubtful ones go to a person.

See it live Open the walkthrough

Illustration: a scanned fax beside what a model read, one field sent to a person

The problem

About 4.5 million faxes a year arrived at a healthcare equipment platform, and staff keyed every one in by hand to start a patient and bill an order. Each patient took about 30 minutes of admin time. In this setting a wrong billing field is not a typo. It is a denied claim.

What I owned

The data scientists built and trained the model. I owned everything that decided whether the model became a product.

  • What gets read. The document types and fields, starting with the ones that open a patient and bill an order.
  • Where a person steps in. A confidence threshold sends anything uncertain to a reviewer before it becomes a record.
  • What good enough means. The accuracy bar for launch, the automation rate and the time saved, tracked every release.
  • Compliance as a launch gate. Patient data protected and every access audited. I set the requirement; engineering built the controls.
  • The trade-off. Accuracy over automation. A missed automation costs a person a few minutes. A wrong field costs a customer their revenue.

Proof

  • Intake time per patient30 min to 5
  • Field-level extraction accuracy~95%
  • Claim denials from bad intake data10% to 1%

What I would flag

  • The figures are the ones measured at launch, and the savings estimate rests on stated assumptions about admin time and cost.
  • 95% at field level was not good enough to auto-submit billing fields blind. That is why the threshold and the reviewer exist.
  • Automation rate and error rate pull against each other. The error rate on auto-processed documents is the number that keeps the threshold honest.

Who acts at each stop

  1. Fax arrivesCode
  2. ClassifyModel
  3. Extract fieldsModel
  4. Check the doubtful onesPerson
  5. Create patient and orderCode
  6. RetrainModel

Hiring an AI product manager?

Sid's agent

scripted, person-approved

Scripted, no model behind it, and every answer went past a person first. Ask me something.