Queensland police said the man allegedly stole the machinery before using it to break into a motorcycle shop in Ipswich.
Police footage showed the man ramming into the shop window with the tractor, attaching two motorbikes to the machinery before driving away.
Authorities followed the tractor as it drove through suburban streets and down railway lines, passing Ipswich Railway Station on the way. The suspect dropped the motorbikes during the chase.
Queensland police later arrested the man on foot after the tractor slipped down an embarkment.