Although Sunday Service from West was considered a surprise, the lines waiting outside New Birth began forming at least an hour before the service.
Celebrities were also in attendance, although it's not clear if they are regulars at New Birth.
Chris Tucker, an Atlanta resident, posted a photo with West on his Instagram page.
According to Team Kanye Daily, a Kanye West fan account on Twitter, and videos posted on social media, T.I., Tiny, 2 Chainz, Jermaine Dupri, Lil Yatchy and Nelly were among the other Atlanta celebrities at the service.
West has been making similar appearances on Sundays this year, including one in Dayton, Ohio, to help that community in the wake of the mass shooting. He also brought a message of faith to those attending the music festival Coachella on Easter Sunday.
In an appearance Friday on "The View," West's wife, beauty mogul Kim Kardashian West, was asked about the Sunday Service events.
"Kanye started this, I think, just to heal himself and it was a really personal thing … and it was just friends and family," Kardashian West said. “And he has had an amazing evolution of being born again and being saved by Christ.”
She added, “It is a Christian service, like a musical ministry ... they talk about Jesus and God.”
"When he goes to another church, which he has, they've shown up and done these surprise little pop-up Sunday Services in other churches," she said. "Sometimes, at the one in Calabasas, he'll have friends that are pastors that are in town get up and speak. But for the most part, it's just a musical ministry.”