He previously worked at Nvidia for seven years as general manager of its computing products. The company is valued at $3.6tn (£2.8tn).
Heidrick & Struggles, the recruiting firm hired by the board, has started contacting potential candidates, Bloomberg reported.
Bloomberg reported that Haas, who joined Arm in 2013 and became chief executive in 2022, is among those approached.
Arm is the biggest technology company headquartered in Britain, valued at $196bn.
It employs more than 7,000 staff, including more than 3,000 in the UK.
Nvidia is searching for a replacement for Huang, one of its founders, who resigned last week after admitting to an extramarital affair with a woman accused of spying for China.
Nvidia has sought to curb speculation that Huang could return to the role after he said on Tuesday that he would be willing to come back.
Jones said that"while this was an unexpected transition"and that"The board is proactively dealing with the consequences".
Colette Kress, Nvidia's chief financial officer, was named interim chief executive last week.
She presented the company's financial results on Tuesday. Quarterly revenue doubled from a year earlier to $115.84bn.
Haas told a technology conference in Austin on Wednesday that Huang was"a legend"."What he built at Nvidia is historic,"he said.