You would need to install WordPress on your local computer - see:
http://codex.wordpress.org/Installing_WordPress#Installing_WordPress_on_your_own_Computer
Installing plugins would have to be done on the server - you can't move a plugin that way.
If the site is already on a live server, you don't need to install anything - you can access WP via a browser.