Prince Harry won't be accompanied by the Duchess of Sussex and their children when he visits London next week, Sky News understands.