I'm also confused as hell about the timing here. I wasn't expecting Kiyoshi and Rider to be arriving late night (because Kioyshi would be in bed), so I don't think it's meant to be as late for them. People just seem to be really rushing through.
It is less rushing through and more a lot of the characters do not have reasons to interact anymore at the moment. Like Forest had a shit day so she going to sleep, Amelia is making graves/memorials, Henry has to go to his clinic, Shiro is keeping watch, Jubei is cleaning up his shop, Fate is going to his company to do things probably, two different sets of smut have occurred on the first night, etc.
Most of the plots for the night have expired, there was a massive fight in which almost a city block was leveled and a lot of interactions occurred. It was what should be expected of the first night, it should be the establishing time with the least amount of interaction just because it is only night and characters are just meeting.