The previous theme I was using was causing the photo gallery to bug out at random. I thought I had fixed it this morning, but it started messing with the layout again. I found a new theme I like that should not interfere with the gallery.
The next step is to start customizing the graphics and color options. More to come there in the following days.