Yet another witness stated that Baldwin and Bieber were seeing a judge that day, which likely means they were processing their marriage license.
The couple became engaged earlier in the summer, but haven't talked about wedding plans publicly yet.
An insider told TMZ that Justin was super emotional and tearing up as he was overheard saying to Hailey, "I can't wait to marry you, baby".
A photo obtained by TMZ showed the singer and the model entering the city clerk's office on Thursday, where they reportedly Wednesday, according to E!
Intensifying Hurricane Florence Could Strike US Southeast
Price gouging amid natural disasters and other emergencies should be reported to state attorneys general. Roy Cooper said his state was "in the bullseye" of the storm and urged people to "get ready now".
Justin proposed to Hailey during a trip to the Bahamas last month, and later confirmed the news on Instagram in a sweet tribute post dedicated to the blonde beauty.
A source close to the couple told US Weekly Justin and Hailey "want a private wedding without media scrutiny and just want it to be with friends and family".
"Was gonna wait a while to say anything but word travels fast, listen plain and simple Hailey I am soooo in love with everything about you!"
The 24-year-old singer and the 21-year-old model were spotted arriving at a courthouse - where marriage licenses are issued on Thursday afternoon (September 13) in New York City.