Rep. Chaka Fattah submitted his resignation following his conviction on corruption charges, but asked to stay until October when he is scheduled to be sentenced.
But House Speaker Paul D. Ryan said that the Pennsylvania Democrat should resign immediately.
Fattah, 59, was convicted Tuesday in Philadelphia after a four-week trial.
Prosecutors alleged he took bribes and stole charitable donations and campaign contributions as well as misused federal grant money under his control.
The case largely centered around a $1 million campaign loan during an unsuccessful mayoral bid in 2007.
Fattah became the first incumbent to lose his primary in April.
It's unclear whether the House would move to expel Fattah, if he doesn't leave on his own accord.
On a side note, Majority Leader Kevin McCarthy's office inadvertently issued a statement early Thursday saying the House had voted to kick Fattah out of the House. No such action took place before the chamber adjourned. His office blamed it on a software glitch.