Having been a home builder most of my life, my biggest difficulty with metric system stems from the use of standard sizing of construction materials produced here in the US.
A US construction stud for instance is presently 1 1/2 inches X 3 1/2 inches X (for instance) 8 feet.
In metrics that comes out to 38.1mm X 88.9 mm X 2.4384 M. It doesn't really roll off the tongue for me at all, let alone register as a size.
Secondly, standard building practices here use, usually,16 inch or 24 inch center to center measurements for supporting structural members. The sheet materials, plywood, paneling, Oriented strand board, drywall, are all also produced based on those specifications. Using metric SIZED studs, joists, or beams would not be so difficult, but all the panel products, if produced in even metrics, would need to be recut to fit the standard spacings required in our building codes.
Lastly, nearly every building constructed here uses the standard spacings, making it much more difficult to use metric sized sheet goods for renovation and repair work. I still need to "shim out" stud and joist widths on the 1 1/2" X 3 1/2" current mill sizing to match the older 1 5/8" X 3 5/8" milled work produced up to about the 1970's, in order to maintain a flat wall or ceiling, or to fit a newer door or window frame to an older, thicker wall.
Best I can do in my brain is - "a meter is about 39". But then, I'm 80 years old too.
On machine work however, lathe or mill metal working, although I was trained imperial sizing, I find either system to work just as suitably. For me, having the ability to use my machines with either system just makes things easier, as having just one or the other always seems to require conversions, depending on the job at hand.
EJ