If you are the album creator, tap the avatar photo of the member at the top of the album to remove them.