It is on the river side by Albert Docks and the Liver bird building, so while visiting the museum you can also look round the historic Albert docks area and shops etc.
They say the Albert dock area has more Grade 1 listed buildings than any area in the UK.