You can tell I am currently on a blitz of forgotten locations, right? Here is one from The World of Suzie Wong that I only really discovered a short while ago. Basically, the reason for these old posts is that I have been revisiting stuff with my current level of knowledge of these places and it's revealing how much I used to miss when I first started out with this blog.
Anyway, just before the couple head to the Tai Pak for their lunch, they head to Aberdeen and Lomax is seen painting/drawing. Look carefully at the following screen caps and you'll see that the actors are on the Ap Lei Chau side of the harbour.
The top picture shows the view looking to the west from Ap Lei Chau. The temple on the left is the very historical Hung Shing Temple on the Ap Lei Chau waterfront. It's thought to be the oldest temple in the area and is now a protected monument. Looking at modern pictures I would say the roof has undergone a renovation recently but it is definitely the same place despite the tidying up of the harbourfront.
The lower picture, from the same sequence, shows Holden sketching Suzie and we can see that this is also on the Ap Lei Chau side because you can just make out the old Aberdeen Police Station in the extreme top right of the picture on the other side of the harbour.