Downton fight: 'We just went for it'