What you're seeing aren't the page numbers. They are the section start page numbers, which comes from the outline (i.e., the page number of the last entry in the outline). I think a change we made in alpha.14 addressed this issue. Can you confirm which version of Asciidoctor PDF you're using?
-Dan