Watched a tiny model sort my mom's recipe box in 40 minutes, and now I get why small beats big for boring jobs | AI Innovations - The Design Community Hub
Watched a tiny model sort my mom's recipe box in 40 minutes, and now I get why small beats big for boring jobs
My mom has a wooden recipe box with about 300 index cards, half of them stained and handwritten, and I kept putting off typing them up. Two weeks ago I ran the photos through a small open model on my laptop, a 3 billion parameter one, and it pulled out ingredients and oven temps from 91 percent of the cards in under 40 minutes. A bigger cloud model did slightly better on accuracy but took way longer and cost me $6 in credits. The small model also ran fine with no internet, which mattered because my parents live out in the country. Anyone else using local small models for dumb household stuff instead of the big name APIs?