So I ended up doing this today because my daughter yet again moved the seat. It was as simple as I had imagined. Used my plastic interior pry tool and the panel popped right out. Simple connector to undo and put it back in....done.
2017 Cadillac ATS 3.6 awd Premium, Phantom Gray, Carbon Black package, Recaros
2017 Pacifica Limited, bright white, black/deep mocha, AST, blu-ray, 20” wheels, HK audio