All cards in Content Timeline have to be the same height, both default cards and active ones. This is why this setting is a global one.
The height of the card also controls how the content is displayed. You have to have a high enough card to be able to display your image, title, date, content, etc.
Set your card height just the way you want to and play around with the values until you get your desired result.