A composition is the timeline you want to work with - like a sequence in Premiere. When you start, each project has probably just one composition and it feels like the project is the composition. But when your projects get more complex, you start having several compositions for different parts of your project. You can even use some compositions as layers in other compositions to structure your project.
To get started with After Effects, take a look at our free After Effects tutorial series for beginners.