r/estimators
Open-source model for reading scanned engineering drawings? Generic VLMs struggle compared to CAD-exported PDFs
- upvotes
- 3
- comments
- 12
Post
I'm working on AI for construction/engineering drawing review and have noticed a big gap in how general-purpose multimodal LLMs handle two kinds of drawing PDFs: CAD-exported PDFs: These keep vector data (lines, arcs, text objects), so models pick up geometry, dimensions and annotations fairly well. Scanned PDFs: These are a single raster image per page. Understanding drops sharply, especially for thin lines, small dimension text, hatching and dense details. My guess at the root cause: models like Gemini and Claude Opus downsample large images to a fixed resolution before processing. A full-size drawing sheet (A1/A0) gets compressed so much that the model never sees pixel-level detail. A few questions for the community: Are there open-source models (VLMs, document-understanding or OCR-focused models) that handle high-resolution scanned drawings better than generic multimodal LLMs? Has anyone had success with tiling/ cropping strategies, like splitting a sheet into patches, processing each, and stitching results back together? Is raster-to-vector conversion before the LLM step worth it, and which tools work well for engineering drawings? Any benchmarks or datasets for technical/ engineering drawing understanding? Would love to hear what's worked (or failed) for you in production.
Extracted from these lines
[comment u/R87FX] Our company uses Glean, which I guess uses a number of AI models.
[comment u/R87FX] When I went down this rabbit hole I ended up having to create a prompt (skill) that does a “preflight check” on the drawings provided. I also add boxes around the data I want it to use like you suggested.