The actor tells PEOPLE how 'Every Brilliant Thing' pushed him far outside his comfort zone ...