This Widget will show A-to-Z listing of all the categories and its subcategories in alphabetical order. Use CSS style to decorate your page. You can adjust the width for the navigation from admin section. From admin settings you also can exclude some of the top level categories form the category listing.
Try the DemoIf you’re interested in seeing what a default installation of A to Z Category.