It comes after it emerged two senior lawyers rejected the opportunity to lead the inquiry into child sexual abuse before ministers appointed Mrs Woolf.
It has now emerged that Baroness Kennedy and Lady Justice Hallett were previously approached about the position before Mrs Woolf was appointed.
They had been on a 'long list' of candidates but said they were not interested, the Sunday Times reported.
The two women had been named as possible successors to Mrs Woolf over the weekend, which now appears unlikely.
A source told the newspaper that both women had indicated they did not want to take on the position earlier this year, and Mrs Woolf was not the first choice for the role.
Another official confirmed there had been 'a listing process which involved some preliminary conversations with different people.'
Lady Justice Hallett is vice president of the criminal division of the Court of Appeal - a position she took on in November 2013.
Baroness Kennedy is a British barrister and broadcaster.
Mrs Woolf, a solicitor and Lord Mayor of London, resigned on Friday after pressure from victims support groups. She had lost their trust over her connections to Brittan - a Tory peer who is accused of failing to act when he was presented with a dossier of evidence about an alleged sex ring.
Lord Brittan has strenuously denied accusations that he ignored a document – which later went missing – that detailed a paedophile ring involving high-profile figures.
However he is likely to be called to the inquiry.
Peter Saunders, of the National Association of People Abused in Childhood, last week said Mrs Woolf was 'someone would we would not be able to work with were she to remain in place' because of her connections to Brittan.
It was also claimed that Mrs Woolf had tried to downplay her connections to the former cabinet minister and his wife after a photograph emerged of her chatting to Lady Brittan last October. Mrs Woolf had claimed she had no social connections to Lady Brittan.
Mrs May now has the difficult task of finding someone to replace Ms Woolf to lead the inquiry.
The inquiry was launched after allegations that there had been an Establishment cover-up of child sexual abuse claims in the 1980s.
Esther Rantzen has already rebuffed any suggestion she could take on the role saying that because she heard rumours about Jimmy Savile as a junior researcher a number of people already felt she had let them down.
But Mrs May could have more luck with Michael Mansfield, a socialist lawyer, who told the BBC 'I am very prepared to consider it.'