My first thought is to find a place that's within walking (or biking?) distance to the office (preferably within 20mins). Compared to my current 1.5 hour commute (between Zhubei and Taipei), this will save me more than two hours a day. =D
Public transportation seems quite good around Pyrmont, with seemingly very convenient Light Rail and Monorail, ferries, buses, trains (@Central station), etc., so I should be able to tour various parts of Sydney easily. On the other hand, I could live further away and take public transport to work, but unless there's good reasons I'll stick to my plan of walking to office.
It would be nice if there's swimming pool and gym in the building so I can stay healthy and fit unless there's an aquatic/fitness centre nearby.
Thanks to a colleague that made a "My Map" of local info near the office, it seems living in Pyrmont is quite convenient with all the public transportation stops, groceries, medical center, entertainment, fish market, and more. My next steps is probably to "stroll" around Pyrmont using Google StreetView to learn more of the vicinity, find a few units that matches my criteria on real estate sites, and then physically fly to Sydney to inspect the units and experience the environment for real.