Our best limits here so far are from the WISE survey - an infrared telescope that mapped the whole sky three times. Since it observed in infrared, the visual albedo doesn’t matter. What matters is its temperature.

LIMITS FROM THE WISE SURVEY

The original paper for the WISE results implications for planets is here:

A SEARCH FOR A DISTANT COMPANION TO THE SUN WITH THE WIDE-FIELD INFRARED SURVEY EXPLORER

The survey is for gas giants, and stars rather than terrestrial planets shining only by reflected light. It was an automated computer search with any tricky borderline cases investigated by hand.

The scans overlapped at the ecliptic poles. Each spot of the sky was photographed twelve times in the ecliptic, but hundreds of times at the poles. So there is no way it can miss planets that are out of the ecliptic - it is more sensitive to those than planets in the ecliptic.

Artist's impression of the Wide Field Infrared Survey Explorer which has produced the tightest constraints to date on Planet X.

It gives strong constraints on a Jupiter or Saturn sized object. A Jupiter sized object must be at least 82,000 au from the sun (1.3 light years), and a Saturn sized object at least 28, 000 au (0.44 light years). But a brown dwarf can actually be similar in size to Jupiter and also very cold and as well as that, it can be much darker than Jupiter in appearance (though not invisible in reflected light, - our Moon is as dark as worn asphalt and of course, easy to see). More to the point, it can also be very cold.

Anyway, apparently it would be possible for a small, dark and very cold five billion year old brown dwarf to be in our solar system at a distance of 26,000 au (0.41 au), even closer than the limit for Saturn.

The survey could spot the more usual 150 K brown dwarf out to ten light years away.

So no, we’d have spotted a Jupiter sized object at a distance of 0.01 light years easily by now. Even out to 1.3 light years. A brown dwarf is the same size visually as Jupiter but much heavier. If it is an unusually cold brown dwarf then we would have spotted it out to 0.41 au.

That is still 41 times further away than your figure.