Four days a week, Jimmy Fallon performs for a TV audience of millions of people as the host of NBC’s “The Tonight Show.” But stepping onto the stage of the Hudson Theater in front of about 1,000 theatergoers made him nervous in a whole new way.

Jimmy Fallon is going All In on Broadway. The Tonight Show Host makes his Broadway debut on Tuesday, January 28, in All In: Comedy About Love. Fallon will be in the show from Tuesday, January 28 through Sunday,

Show" host Jimmy Fallon made his Broadway debut in the all-star cast of "All In: Comedy About Love" by Simon Rich on Tuesday (January 28), calling it "exhilarating" and "exhausting."

Jimmy Fallon's Broadway debut was extra meaningful for the Tonight Show host. After taking his first bow in All In: Comedy About Love by Simon Rich on Tuesday, Jan. 28, the comedian opened up in a video shared with PEOPLE about the experience while backstage at the Hudson Theatre in New York City,