Patrick Wilson Drops a Serious "Well, Actually" on James