Phil Collins said that various drummers have inspired him but Ringo Starr was the inspiration behind this track:

When I’m playing a song I’ll often think about how another drummer might play it, and try to be that player in my performance of the song. Often I’ll think, ‘How would Keith Moon play this?’ And I’ll don my Keith Moon hat. For another song I’ll think about John Bonham, or even on occasion Stewart Copeland, but more often than any other drummer I think about Ringo. `That’s All,‘ from Genesis, is a Ringo Starr drum part.

Banks explained the making of the song in a Songfacts interview:

We were just improvising in the studio and Mike was playing a bit on guitar. With the Emulator, I was able to sample bits and pieces as we were going along. I sampled this bit of Mike’s, which didn’t sound very good, so I actually slowed it down to about half or quarter speed, and it sort of played a suggestion of the riff that became “That’s All.“ It wasn’t quite the same, but it had a suggestion of it.
I played it on the piano like that, and I thought, this is really good. Phil went at it with a sort of ‘Rocky Raccoon’ style drumming on it, which made it something it hadn’t really been at all in the first place. Then I just wanted to keep it simple, chord-wise, and let it go where it would, rather than trying to combine it with another bit, which is sometimes what we used to do. We really let the song develop in itself, and I was pleased with that. That’s a simpler Genesis song, but one that really works.