This verse clarifies the condition of his giving up his body. “When he left with his body (sva-tanvā)” means according to Śrīdhara Svāmī “leaving to Vaikuṇṭha with his body.” He gave up the earth by means of his body. It does not mean “He gave the earth along with his body.” That is a wrong interpretation, because of the rule upapada-vibhakteḥ kāraka-vibhaktir balīyasī: instrumental meaning of inflection is stronger than the meaning “accompanying.”

pradarśyātapta-tapasām avitṛpta-dṛśāṁ nṛṇām ādāyāntar adhād yas tu sva-bimbaṁ loka-locanam The Lord, having shown his form, the center of attraction for all eyes, then took that form and disappeared from the men, who had not performed austerities but had attained the Lord's mercy, and were continually craving a vision of his form. SB 3.2.11

In this verse after showing his form (sva-bimbam) to the eyes of the world, he again withdrew it and disappeared. The verse does not say he gave up a body. The Kṛṣṇa-sandarbha makes this point. From that moment onwards (tadāhaḥ), Kali entered those with sleeping intelligence. Kali did not affect those who had discrimination. The thief steals wealth from a sleeping person, but is afraid to steal from someone awake.