The couple welcomed their first child — son Jack Blues — on Aug. 23

Justin Bieber and Hailey Bieber are already loving their time as parents, just days after bringing their newborn son home from the hospital.

A source close to Justin, 30, exclusively tells PEOPLE that both new mom Hailey, 27, and baby boy Jack Blues are “doing well” at home.

“They’re both overjoyed. The baby is such a miracle. He’s adorable and doing well,” the source says. “Hailey’s doing well, too.”

The source added that the couple had been praying for the pregnancy for a while — and the day they learned that Hailey was expecting was the “best ever.”

“The pregnancy was something that they very much wished and prayed for,” the source says. “The day they found out that Hailey was pregnant was the best ever for Justin. He was over the moon with excitement. It was a big celebration for them.”

“Justin’s already a great dad,” the source adds.

The musician confirmed he and his model wife had welcomed their son in an Instagram post on Friday, Aug. 23.

The PEOPLE Puzzler crossword is here! How quickly can you solve it? Play now!