Skip to content

v0.1.0: Nemotron Parse receipt pilot

Status: draft. No experiment tag is published yet.

This experiment runs Nemotron-3.5-Parse through vLLM on a local RTX 4090. It preserves 24 CORD receipt inputs' provenance and 48 measured responses. All measured requests completed. One amount changed from 79,500 to 79,300. Diagnostic ROUGE-L F1 was 0.801; exact numeric-string recall was 212/241. The evaluation does not measure layout or table-structure accuracy.

Recalculate the saved experiment without a GPU:

uv sync --locked
uv run python scripts/score_receipts.py \
  --input evidence/cord-test-24 --output runs/tag-inspection/scores.json

Companion post: I ran Nemotron Parse on a 4090. Then I checked the numbers. The public post URL is pending. Do not publish this release before that post is ready. The post must link back to https://github.com/Alberto-Codes/inference-lab/releases/tag/v0.1.0.

Measured results ยท Reproduction

The draft-release workflow appends the exact validated public commit to the GitHub notes. Before publication, replace the pending post status with its verified public URL.