The present day territory of Kavajë has been inhabited since the Late Antiquity. It is believed that the Illyrian tribe of Taulanti built their city Arnisa in the area today known as Zikxhafaj. After the eventual RomanConquest of the region, Kavajë would become a transit route for Via Egnatia. It was built by the Romans in order to link a chain of their colonies stretching from the Adriatic Sea to the Bosphorus. The famous Battle of Pharsalus between Julius Caesar and his archrival Pompey took place near Shkëmbi i Kavajës, at the time known as Petra.