Psalm 51 is about sin as corruption, not just guilt, and for

¹[To the chief Musician, A Psalm of David, when Nathan the prophet came unto him, after he had gone in to Bathsheba.] Have mercy upon me, O God, according to thy lovingkindness: according unto the multitude of thy tender mercies blot out my transgressions. ²Wash me throughly from mine iniquity, and cleanse me from my sin. ³For I acknowledge my transgressions: and my sin ever before me. ⁴Against thee, thee only, have I sinned, and done evil in thy sight: that thou mightest be justified when thou speakest, be clear when thou judgest. ⁵Behold, I was shapen in iniquity; and in sin did my mother conceive me. ⁶Behold, thou desirest truth in the inward parts: and in the hidden thou shalt make me to know wisdom. ⁷Purge me with hyssop, and I shall be clean: wash me, and I shall be whiter than snow. ⁸Make me to hear joy and gladness; the bones thou hast broken may rejoice. ⁹Hide thy face from my sins, and blot out all mine iniquities. ¹⁰Create in me a clean heart, O God; and renew a right spirit within me. ¹¹Cast me not away from thy presence; and take not thy holy spirit from me. ¹²Restore unto me the joy of thy salvation; and uphold me free spirit. ¹³will I teach transgressors thy ways; and sinners shall be converted unto thee. ¹⁴Deliver me from bloodguiltiness, O God, thou God of my salvation: my tongue shall sing aloud of thy righteousness. ¹⁵O Lord, open thou my lips; and my mouth shall shew forth thy praise. ¹⁶For thou desirest not sacrifice; else would I give : thou delightest not in burnt offering. ¹⁷The sacrifices of God a broken spirit: a broken and a contrite heart, O God, thou wilt not despise. ¹⁸Do good in thy good pleasure unto Zion: build thou the walls of Jerusalem. ¹⁹Then shalt thou be pleased with the sacrifices of righteousness, with burnt offering and whole burnt offering: then shall they offer bullocks upon thine altar.