Can a weld look acceptable but still fail strength requirements?

Yes, a power source calibration fault can produce a weld that looks visually acceptable but doesn't meet the penetration or strength standard a pipeline joint is held to — this is why we verify calibration against a known reference rather than relying on visual inspection alone.