"Is It a Crime" is an R&B song with Latin-tinged production that lasts for three minutes and one second long.[2][3] Lyrically, Mariah and Uchis question whether falling in love again is "a crime", wrestling with the idea of second chances in love.[2] The song’s title and subject deliberately echo Sade's 1985 ballad of the same name: Aaron Williams of Uproxx noted that the duet serves as a homage to classic R&B themes of "forbidden love", even though it does not directly sample the original.[4]
Gabriel Bras Nevares of HotNewHipHop praised the track's "sultry and ethereal" atmosphere and noted that both artists deliver "compelling performances" despite its minimalist production.[5] Nevares also stated that the song "[meets] the expected quality standard" for the R&B genre.[5] In a review for The Source, the track was praised as an "emotional banger", with a critic highlighting the song's "sweet spot between soft confession and bold proclamation" and noting the late-night appeal of its chorus.[6]