Nvidia's board met late on Wednesday to decide whether to remove CEO Jensen Huang, according to the source. The report says the company lost more than $600 billion in market value this week after reports that Huang had extramarital affairs with two women.

One of the women is Alice Huang, a former executive at Singapore-based Megaspeed. U.S. officials suspect her of working for Chinese intelligence, a claim China has denied. The New York Times reported that Huang also had a relationship with Kimberly Powell, Nvidia's vice president of healthcare, who reports to him. The newspaper cited five people who worked at the company.

Huang admitted in a memo to staff on Sunday that he had been unfaithful to his wife. The board launched an independent investigation into whether he was the target of a foreign intelligence effort. It also said it had confidence in Huang and his leadership team.

The Wall Street Journal reported that the board was preparing to oust Huang. Bloomberg reported that the board had been working with an outside firm to identify possible replacements. Under Nvidia's bylaws, a majority of directors can remove Huang with or without cause. Huang owns about 3.6 percent of the company, according to LSEG data, and has no majority voting control.

Analysts cited by Reuters see two likely internal candidates: Chief Financial Officer Colette Kress and engineer Ian Buck. Lian Jye Su of Omdia said that remains speculation until a final decision is made.

Three Republican House committee chairs have asked Huang to attend a closed-door briefing on November 18, and he faces a possible subpoena if he does not respond, Reuters reported. U.S. President Donald Trump said on Monday that the FBI was looking into the matter. He added that Huang told him he had "absolutely no idea" the woman was an alleged spy.