So, recently I spun up a Wikimedia instance on EC2. More on that soon 🙂 In the meantime, just to leave a record for those also trying:
Spin up an EC2 instance and go to the console. I spun up the Amazon AMI instance (default)
Use putty to connect (Amazon directions)