The fine is for failing to tell the FSA it was under investigation for fraud by the US financial watchdog this summer.
In July, Goldman settled the fraud charge with the Securities and Exchange Commission by paying $550m (£356m).
The £20m is one of the heaviest fines ever imposed by the FSA, said the BBC's business editor Robert Peston.
Both the FSA and Goldman Sachs declined to comment on the fine.
Goldman agreed to pay the US fine to settle civil fraud charges of misleading investors.
The charges concerned the bank's marketing of complex mortgage investments, just as the US housing market faltered.
The FSA said Goldman also did not tell them that Fabrice Tourre, the trader who helped to create these mortgage derivatives, was under investigation.
This it said was particularly relevant as Mr Tourre moved from the US to London, and therefore came under the auspices of the UK regulator.
Goldman has admitted that it made a mistake, our correspondent added.
