`CalDateTime` arithmetic operations should not silently switch date-only to date-time

[axunonb]

This behavior is used across the lib. Trying to add a time to date-only should throw.
To be fixed in a separate PR.

[axunonb]

Goes together and will be tracked with #670