Why can't I change a record's start and end time, only its duration?

You’ve most likely switched that record into duration mode by accident, which shows only the total length rather than a start and end time.

Switch it back to hours mode, and you’ll be able to edit the start and end time directly again.